Smart factory sand table demonstration system based on visual algorithm

Abstract

The invention discloses a smart factory sand table demonstration system based on a visual algorithm, and relates to the technical field of industrial internet. The system comprises a first module, a second module, a third module, a fourth module, a fifth module, a sixth module, a seventh module, a WMS system, an MES system, an MCS system, an EAP system, an SPC system and an APS system. The first module comprises a manipulator, the WMS system sends a delivery instruction to the MES system, the MES system issues a carrying task to the MCS system, and the MCS system selects the first module to execute the carrying task according to the state of the first module; according to the invention, rapid communication and control with various hardware devices are realized through the core architecture of the Spring Boot framework and the smart factory sand table demonstration system, the automation level of a factory is remarkably improved, and meanwhile, the appearance quality of a product can be automatically detected by introducing an OpenCV visual algorithm and the smart factory sand table demonstration system, so that the product is ensured to meet the production standard, and the production efficiency is improved. And the intelligent level of the production process is further improved.

Description

Technical Field

[0001] The present invention relates to the technical field of industrial Internet, and in particular to a smart factory sandbox demonstration system based on visual algorithms. Background Art

[0002] It is a new type of infrastructure, application model and industrial ecology that deeply integrates the new generation of information and communication technology with the industrial economy. Through the comprehensive connection of people, machines, objects, systems, etc., it builds a new manufacturing and service system covering the entire industrial chain and the entire value chain, providing a way to achieve the digitalization, networking and intelligent development of industry and even industries.

[0003] The Industrial Internet is based on the network, with the platform as the hub, data as the element and security as the guarantee. It is not only the infrastructure for the digitalization, networking and intelligent transformation of the industry, but also an application model for the deep integration of the Internet, big data, artificial intelligence and the real economy. It is also a new business model and new industry that will reshape the enterprise form, supply chain and industrial chain.

[0004] At present, the industrial Internet has expanded to form six new models: platform design, intelligent manufacturing, networked collaboration, personalized customization, service extension, and digital management. The role of empowerment, intelligence, and value-added is constantly emerging, which has effectively promoted the quality improvement, efficiency increase, cost reduction, green and safe development of the real economy.

[0005] However, there are still some defects in the application of industrial Internet in factory production management:

[0006] 1. The Industrial Internet is widely used in factory production workshops to control the automated production of products. However, existing technologies cannot reduce manual intervention, which has a certain impact on the operating efficiency of the production line;

[0007] 2. On the automated production line in the workshop, the existing industrial Internet technology cannot perform high-precision identification and analysis based on the key features of the products when conducting quality inspection on the finished products produced by the factory, resulting in uncontrollable stability and reliability of product quality.

[0008] In response to the above problems, the inventor proposed a smart factory sandbox demonstration system based on visual algorithm to solve the above problems. Summary of the invention

[0009] In order to solve the above problems, the purpose of the present invention is to provide a smart factory sandbox demonstration system based on visual algorithms.

[0010] In order to solve the above technical problems, the present invention adopts the following technical solutions: a smart factory sandbox demonstration system based on visual algorithm, the smart factory sandbox demonstration system includes a first module, a second module, a third module, a fourth module, a fifth module, a sixth module, a seventh module, a WMS system, an MES system, an MCS system, an EAP system, an SPC system and an APS system;

[0011] The terminal device of the first module includes a manipulator. The WMS system sends a delivery instruction to the MES system. The MES system issues a transport task to the MCS system. The MCS system selects the first module to perform the transport task according to the status of the first module. The first module receives the delivery instruction from the MCS system, drives to the designated location where the raw materials are placed, and grabs the raw materials through the manipulator of the first module for delivery.

[0012] The terminal equipment of the second module includes a raw material storage area. The second module plans and sets the raw material storage location information through the WMS system. The raw material storage location information includes incoming storage information, outgoing storage information, raw material information, storage location information, remaining storage space and remaining loadable pressure statistics and analysis;

[0013] The terminal equipment of the third module includes an overhead crane. The third module receives and executes the instructions issued by the WMS system, receives the materials sent by the first module, and realizes air logistics delivery through the overhead crane.

[0014] The terminal device of the fourth module includes a product processing center. The fourth module simulates the manufacturing of factory products by controlling the product processing center. After the fourth module receives the raw materials and production instructions, the production content in the production instructions starts to execute the production and processing of products through the product processing center.

[0015] The terminal equipment of the fifth module includes an AOI visual inspection system. The fifth module simulates the inspection of production products on the factory site through the AOI visual inspection system. The AOI visual inspection system performs product identification and judgment based on its own visual algorithm. The EAP system collects equipment process data in real time and sends it to the SPC system. After the process is completed, the finished product is sent back to the discharge port to wait for transportation;

[0016] The terminal device of the sixth module includes a 3D digital twin display device, and the sixth module displays the sorting operation process and real-time information display through the 3D digital twin display device;

[0017] The seventh module includes a work order generation system. The MES system receives production orders and sends them to the APS system. The APS system executes the work order generation system of the seventh module to implement work order scheduling. Work orders are generated according to the set levels based on the current raw material inventory, equipment status and order status. The MES system issues information on the required raw materials for production. The first module grabs the raw materials from the second module and puts them in the designated location, waiting for the third module to transport them.

[0018] Preferably, the core architecture of the smart factory sandbox demonstration system adopts the Spring Boot framework, and the Spring Boot framework is used for process control and data management of the entire system.

[0019] Preferably, the smart factory sandbox demonstration system adopts OpenCV visual algorithm, and the OpenCV visual algorithm performs image recognition on finished products in the production process.

[0020] Preferably, RFID readers and RFID tags are deployed in the smart factory sandbox demonstration system, and the RFID readers and RFID tags track and locate the movement trajectory of hardware devices in real time.

[0021] Preferably, the OpenCV vision algorithm performs format processing on the read-in original image through the set input function, extracts feature points in the processed image through feature point detection, uses feature matching to find features in the image, analyzes matching results, and identifies the target.

[0022] Preferably, the format processing of the original image includes converting the Blob format and adjusting parameters.

[0023] Compared with the prior art, the present invention has the following beneficial effects:

[0024] 1. In the present invention, through the core architecture of the Spring Boot framework, the smart factory sandbox demonstration system realizes rapid communication and control with various hardware devices, significantly improving the automation level of the factory. At the same time, by introducing the OpenCV visual algorithm, the smart factory sandbox demonstration system can automatically detect the appearance quality of the product, ensure that the product meets the production standards, and further improve the intelligence level of the production process;

[0025] 2. In the present invention, by improving the process flow, improving equipment performance and introducing automation and intelligent technology, manual intervention is effectively reduced and the operating efficiency of the production line is improved. At the same time, through the use of RFID real-time positioning technology, the smart factory sandbox demonstration system can accurately record the movement path and timestamp of the hardware equipment, which provides strong support for the monitoring and optimization of the production process and further improves the accuracy of production;

[0026] 3. In the present invention, the key features of the product are identified and analyzed with high precision through the OpenCV visual algorithm, thereby ensuring the stability and reliability of product quality and providing strong technical support for the continuous improvement of product performance and precision;

[0027] 4. In the present invention, through 3D digital twin technology, the smart factory sandbox demonstration system can display the sorting operation process and related information in real time, making the production process more transparent. At the same time, through the RFID technology and the collaborative work between various modules, the traceability of the entire production process is achieved, which helps enterprises to quickly locate the cause when problems arise and take timely measures to improve them;

[0028] 5. In the present invention, control operations are implemented through MES system, WMS system, MCS system, EAP system, APS system and SPC system, thereby achieving efficient collaboration among various modules and systems. This collaborative working mode not only improves production efficiency, but also ensures the smooth progress of the production process. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0030] Figure 1 This is a schematic diagram of the module composition of a smart factory sandbox demonstration system based on a visual algorithm in the present invention.

[0031] Figure 2 It is a schematic diagram of the structure of the module terminal device of the present invention.

[0032] Figure 3 This is a circuit control schematic diagram of the fourth module and the fifth module of the present invention.

[0033] In the figure: 1, first module; 2, second module; 3, third module; 4, fourth module; 5, fifth module; 6, sixth module; 7, seventh module. DETAILED DESCRIPTION

[0034] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0035] Example: Figure 1-3 As shown, the present invention provides a smart factory sandbox demonstration system based on a visual algorithm, the smart factory sandbox demonstration system includes a first module 1, a second module 2, a third module 3, a fourth module 4, a fifth module 5, a sixth module 6, a seventh module 7, a WMS system, an MES system, an MCS system, an EAP system, an SPC system and an APS system;

[0036] The core architecture of the smart factory sandbox demonstration system adopts the Spring Boot framework, which is used for process control and data management of the entire system;

[0037] The smart factory sandbox demonstration system uses OpenCV visual algorithms, which perform image recognition on finished products during the production process;

[0038] The OpenCV vision algorithm processes the format of the raw image through the set input function. The format processing includes converting the Blob format and adjusting the parameters. The processed image extracts the feature points in the image through feature point detection, uses feature matching to find features in the image, analyzes the matching results, and identifies the target.

[0039] RFID readers and RFID tags are deployed in the smart factory sandbox demonstration system to track and locate the movement trajectory of hardware equipment in real time;

[0040] The terminal device of the first module 1 includes a manipulator. The WMS system sends a delivery instruction to the MES system. The MES system issues a transport task to the MCS system. The MCS system selects the first module 1 to perform the transport task according to the status of the first module 1. The first module 1 receives the delivery instruction from the MCS system, drives to the designated location where the raw materials are placed, and grabs the raw materials through the manipulator of the first module 1 for delivery.

[0041] The terminal equipment of the second module 2 includes a raw material storage area. The second module 2 plans and sets the raw material storage location information through the WMS system. The raw material storage location information includes incoming storage information, outgoing storage information, raw material information, storage location information, remaining storage space and remaining loadable pressure statistics and analysis;

[0042] The terminal equipment of the third module 3 includes an overhead crane. The third module 3 receives and executes the instructions issued by the WMS system, receives the materials sent by the first module 1, and realizes air logistics delivery through the overhead crane.

[0043] The terminal device of the fourth module 4 includes a product processing center. The fourth module 4 simulates the manufacturing of factory products by controlling the product processing center. After the fourth module 4 receives the raw materials and production instructions, the product processing center starts to produce and process the products as well as the production contents in the production instructions.

[0044] The terminal equipment of the fifth module 5 includes an AOI visual inspection system. The fifth module 5 simulates the inspection of production products on the factory site through the AOI visual inspection system. The AOI visual inspection system performs product identification and judgment based on its own visual algorithm. The EAP system collects equipment process data in real time and sends it to the SPC system. After the process is completed, the finished product is sent back to the discharge port to wait for transportation;

[0045] The terminal device of the sixth module 6 includes a 3D digital twin display device, and the sixth module 6 displays the sorting operation process and real-time information display through the 3D digital twin display device;

[0046] The seventh module 7 includes a work order generation system. The MES system receives production orders and sends them to the APS system. The APS system executes the work order generation system of the seventh module 7 to implement work order scheduling. Work orders are generated according to the set levels based on the current raw material inventory, equipment status and order status. The MES system issues information on the raw materials needed for production. The first module 1 grabs the raw materials from the second module 2 and puts them in the designated location, waiting for the third module 3 to transport them.

[0047] The MES system, WMS system, MCS system, EAP system, APS system and SPC system implement control operations and issue instructions to the first module 1, the second module 2, the third module 3, the fourth module 4, the fifth module 5, the sixth module 6 and the seventh module 7. After receiving the instructions, the first module 1, the second module 2, the third module 3, the fourth module 4, the fifth module 5, the sixth module 6 and the seventh module 7 perform corresponding actions. The first module 1, the second module 2, the third module 3, the fourth module 4, the fifth module 5, the sixth module 6 and the seventh module 7 use standard protocols to communicate.

[0048] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A smart factory sandbox demonstration system based on visual algorithm, characterized in that: The smart factory sandbox demonstration system comprises a first module (1), a second module (2), a third module (3), a fourth module (4), a fifth module (5), a sixth module (6), a seventh module (7), a WMS system, an MES system, an MCS system, an EAP system, an SPC system and an APS system; The terminal device of the first module (1) includes a robot, the WMS system sends a delivery instruction to the MES system, the MES system issues a transport task to the MCS system, the MCS system selects the first module (1) to perform the transport task according to the status of the first module (1), the first module (1) receives the delivery instruction from the MCS system, drives to a designated location where the raw materials are placed, grabs the raw materials through the robot of the first module (1) and delivers them; The terminal device of the second module (2) includes a raw material storage area. The second module (2) plans and sets the raw material storage location information through the WMS system. The raw material storage location information includes incoming storage information, outgoing storage information, raw material information, storage location information, remaining storage space and remaining load-bearing pressure statistics and analysis; The terminal device of the third module (3) includes an overhead crane. The third module (3) receives and executes instructions issued by the WMS system, receives materials sent by the first module (1), and the third module (3) realizes aerial logistics delivery through the overhead crane. The terminal device of the fourth module (4) includes a product processing center. The fourth module (4) simulates the manufacturing of factory products by controlling the product processing center. After receiving the raw materials and the production instructions, the fourth module (4) starts to produce and process the products through the product processing center as well as the production contents in the production instructions. The terminal device of the fifth module (5) includes an AOI visual inspection system. The fifth module (5) simulates the inspection of production products on the factory site through the AOI visual inspection system. The AOI visual inspection system performs product identification and judgment based on its own visual algorithm. The EAP system collects equipment process data in real time and sends it to the SPC system. After the process is completed, the finished product is sent back to the discharge port to wait for transportation; The terminal device of the sixth module (6) includes a 3D digital twin display device, and the sixth module (6) displays the sorting operation process and real-time information display through the 3D digital twin display device; The seventh module (7) includes a work order generation system. The MES system receives the production order and sends it to the APS system. The APS system executes the work order generation system of the seventh module (7) to implement work order scheduling. According to the current raw material inventory, equipment status and order status, the work order is generated according to the set level. The MES system issues information on the raw materials needed for production. The first module (1) grabs the raw materials from the second module (2) and puts them in a designated position, waiting for the third module (3) to transport them.

2. A smart factory sandbox demonstration system based on visual algorithm as claimed in claim 1, characterized in that: The core architecture of the smart factory sandbox demonstration system adopts the Spring Boot framework, which is used for process control and data management of the entire system.

3. A smart factory sandbox demonstration system based on visual algorithm as claimed in claim 1, characterized in that: The smart factory sandbox demonstration system adopts the OpenCV visual algorithm, which performs image recognition on finished products in the production process.

4. A smart factory sandbox demonstration system based on visual algorithm as claimed in claim 1, characterized in that: The smart factory sandbox demonstration system deploys RFID readers and RFID tags, which track and locate the movement trajectory of hardware devices in real time.

5. The smart factory sandbox demonstration system based on visual algorithm as claimed in claim 3, characterized in that: The OpenCV vision algorithm performs format processing on the raw image read in through the set input function, extracts feature points in the processed image through feature point detection, uses feature matching to find features in the image, analyzes the matching results, and identifies the target.

6. A smart factory sandbox demonstration system based on visual algorithm as claimed in claim 5, characterized in that: The format processing of the original image includes converting the Blob format and adjusting parameters.

Images