Efficient industrial intelligent visual quality inspection method and device combined with multi-modal network
By combining the efficient industrial intelligent vision quality inspection method of multimodal network in the industrial Internet, the problem of inefficient transmission of quality inspection images is solved, and efficient quality inspection image transmission and intelligent manufacturing support is achieved.
Patent Information
- Application Number
- CN202510102193.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-22
- Publication Date
- 2025-05-13
- Estimated Expiration
- 2045-01-22
AI Technical Summary
In the prior art, the same quality inspection images are repeatedly transmitted, resulting in low transmission efficiency and cannot effectively support the efficient quality inspection requirements in the industrial Internet.
An efficient industrial intelligent visual quality inspection method combined with multimodal network is adopted. By deploying a quality inspection image transmission network composed of a quality inspection model and programmable switch in the data center, the request and response mechanism of the interest packet format is used to avoid repeated transmission of image files.
It improves the transmission efficiency of quality inspection images, reduces the transmission overhead of image files, and supports efficient quality inspection and product life cycle management in intelligent manufacturing.
Smart Images

Figure CN119985491A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of industrial Internet, and in particular to a high-efficiency industrial intelligent visual quality inspection method and device combined with a multimodal network. Background Art
[0002] In the field of electronic circuit patch processing, solder paste detection is a key link in quality control. Its quality inspection principle is to use camera technology to output the reflected light intensity of the detected object in a quantitative grayscale value, and compare it with the grayscale value of the standard image to analyze and determine defects and classify them. With the development of artificial intelligence technology, the use of artificial intelligence technology can effectively improve the quality inspection efficiency of solder paste detection, and play an important role in product quality control, production process, operation and maintenance.
[0003] In the current AI-based quality inspection method, the quality inspection terminal captures high-definition video and images of product quality, uploads them to the inspection system deployed on the industrial cloud platform for evaluation, and issues alarms for unqualified products.
[0004] The existing technology has the following defects: multiple business links in the factory will frequently call photos that record defect information, and by obtaining this defect information, the product quality defects will be re-inspected for better iterative updates. The company's Product Lifecycle Management (PLM) system also needs to obtain this information to provide traceability capabilities for the entire product process. During the transmission process, the existing method will repeatedly transmit the same content, and the transmission efficiency is low. Summary of the invention
[0005] The purpose of the present invention is to provide an efficient industrial intelligent visual quality inspection method and device combined with a multimodal network, which solves the problem of repeated transmission of the same quality inspection image and low transmission efficiency in the prior art.
[0006] To achieve the above object, the present invention provides an efficient industrial intelligent visual quality inspection method combined with a multimodal network, the method comprising the following steps:
[0007] Step 1: Build a quality inspection image transmission network composed of programmable switches, and deploy the quality inspection model on the data center server in the quality inspection image transmission network;
[0008] Step 2: Collect solder paste spot images through a quality inspection camera, pre-process the solder paste spot images to form quality inspection images, and upload the quality inspection images to a data center;
[0009] Step 3: Obtain quality inspection images from the data center through the quality inspection model, segment each solder paste block image, evaluate the quality of solder paste printing, determine whether there are unqualified solder paste blocks in the inspected solder paste blocks, and feed back the evaluation results to the data center; if an image containing unqualified solder paste blocks is detected, the data center sends a message to the factory control center to warn of the appearance of unqualified products, and the message content is the name of the corresponding quality inspection image; the factory control center forwards the alarm information to multiple relevant departments; each relevant department sends a request to the data center to obtain the corresponding quality inspection image, and the request is sent in the format of an interest package, where the interest package contains the hash value of the name corresponding to the quality inspection image; if the images of the detected solder paste blocks are all qualified, return to step 2 to collect new solder paste spot images;
[0010] Step 4: After receiving the interest packet, the programmable switch in the quality inspection image transmission network parses the named hash value; the data center returns the corresponding image file in the form of a data packet; after receiving the data packet, the programmable switch parses the named hash value in the data packet, forwards the data packet to the interest packet port, and forwards the data packet to the storage module; after multi-hop forwarding, the data packet returns to the process department requesting the quality inspection image file;
[0011] Step 5: The process department receives the images and further analyzes and improves the process flow;
[0012] Step 6: Another relevant department sends a request to the data center to obtain the same quality inspection image file from the nearest programmable switch.
[0013] Furthermore, in the step one, the image transmission forwarding rules are implemented based on programmable switch forwarding, and multiple programmable switches are controlled by a controller. The controller deploys a network mode adapted to the quality inspection application, namely, the content identification mode, to the programmable switch; each programmable switch has a storage module to store the hash value of the quality inspection image name and the corresponding quality inspection image content.
[0014] Furthermore, in the step 2, the quality inspection camera is deployed on the intelligent manufacturing production line, connected to the programmable switch, and forwarded through multiple programmable switches, and finally forwarded to the data center server.
[0015] Furthermore, in the step 2, the quality inspection image is named as production line name-product serial number-current timestamp, and is uploaded to the data center in the form of IP for archiving and evaluation.
[0016] Furthermore, the step three is specifically as follows: obtaining a quality inspection image from the data center through a quality inspection model, determining the boundary of the solder paste block based on pixel changes, further segmenting to obtain images of each solder paste block, evaluating the quality of solder paste printing, and determining whether there are unqualified solder paste blocks among the inspected solder paste blocks. The quality inspection model feeds back the evaluation results to the data center; if an image containing unqualified solder paste blocks is detected, the data center sends a message to the factory control center to warn of the appearance of unqualified products, and the message content is the name of the corresponding quality inspection image; the factory control center forwards the alarm information to multiple relevant departments based on the production line name and product serial number; each relevant department sends a request to the data center to obtain the corresponding quality inspection image; the request is sent in the format of an interest packet, wherein the interest packet contains a hash value of the name corresponding to the image; if the images of the detected solder paste blocks are all qualified, return to step two to collect a new solder paste spot image.
[0017] Furthermore, the step 4 includes the following sub-steps:
[0018] (4.1) After receiving the interest packet, the programmable switch in the quality inspection image transmission network parses the named hash value; if the interest packet is the first request, the interest packet is forwarded to other programmable switches, which respond or eventually forward it to the data center;
[0019] (4.2) After receiving the interest packet, the data center parses the hash value of the name in the interest packet, calculates the name, and then searches for the image file to be sent according to the name; then, according to the preset segment size of the storage module, calculates the number of segments that the image file to be sent should be divided into, forms each segment of the image content to be sent and names it; uses the preset hash function to calculate the hash value of the name of each segment of the image content to be sent; determines whether the hash value of the name of each segment of the image content to be sent conflicts with the hash value of the name that has been stored, and if a hash conflict occurs, uses the candidate hash function to recalculate the hash value of the name of each segment of the image content until no conflict occurs; encapsulates the content in segments, and records the hash value of the name of each segment of the image content, the number of segments that the corresponding image file should be divided into, the current segment number, and the image content of the current segment, thereby completing the packaging of the quality inspection image data packet; sends the encapsulated data packet through the data center;
[0020] (4.3) After receiving the data packet, the programmable switch parses the named hash value in the data packet and forwards the data packet to the interest packet port, where the interest packet port is a port that has received a name identifier corresponding to the content in the data packet. At the same time, the programmable switch forwards the data packet to the storage module, which stores the named hash value, current segment number, total number of segments, and image content in the data packet. After multi-hop forwarding, the data packet returns to the process department that requested the quality inspection image file.
[0021] Furthermore, the step six is specifically as follows: another relevant department sends a request to the data center to obtain the same quality inspection image file; when the interest packet arrives at the programmable switch in the quality inspection image transmission network, the programmable switch determines that it has previously responded to the same request and directly forwards it to the storage module; when the storage module receives the interest packet, it searches for the corresponding quality inspection image content according to the hash value of the name in the interest packet, and encapsulates the quality inspection image content into a data packet, which contains the hash value of the quality inspection image name and the corresponding quality inspection image content; the storage module forwards the data packet to the interest packet port of the programmable switch, which is a port that has received a name corresponding to the content in the data packet; thereby, the other department obtains the image file from the nearest programmable switch.
[0022] To achieve the above objectives, the present invention also provides an efficient industrial intelligent visual quality inspection device combined with a multimodal network, comprising one or more processors for implementing the above efficient industrial intelligent visual quality inspection method combined with a multimodal network.
[0023] To achieve the above-mentioned purpose, the present invention also provides an electronic device, including a memory and a processor, wherein the memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement the above-mentioned efficient industrial intelligent visual quality inspection method combined with a multimodal network.
[0024] To achieve the above objectives, the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-mentioned efficient industrial intelligent visual quality inspection method combined with a multimodal network.
[0025] The beneficial effects of the present invention are: the quality inspection application combined with the multimodal network can avoid the repeated transmission of the same quality inspection image and improve the transmission efficiency of the quality inspection image. The present invention can be applied to intelligent manufacturing and can reduce the transmission overhead of image files. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.
[0027] Figure 1 A flowchart of an efficient industrial intelligent visual quality inspection method combined with a multimodal network provided by an embodiment of the present invention;
[0028] Figure 2A structural block diagram of an efficient industrial intelligent visual quality inspection method and device combined with a multimodal network provided by an embodiment of the present invention;
[0029] Figure 3 The figure is a schematic diagram of an electronic device according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION
[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0031] It should be noted that, in the absence of conflict, the features in the following embodiments and implementations may be combined with each other.
[0032] Figure 1 The following is a flow chart of an efficient industrial intelligent visual quality inspection method combined with a multimodal network provided by an embodiment of the present invention. Figure 1 As shown, the efficient industrial intelligent visual quality inspection method combined with a multimodal network in an embodiment of the present invention may include the following steps:
[0033] Step 1: Deploy the quality inspection system architecture, including building a quality inspection image transmission network composed of programmable switches, deploying quality inspection models on data center servers in the quality inspection image transmission network, and connecting quality inspection terminals.
[0034] Specifically, the quality inspection system architecture is deployed: the industrial real-time quality inspection model is deployed on the server of the smart industrial park data center. The quality inspection image transmission network is composed of programmable switches, and the image transmission forwarding rules are implemented based on the forwarding of programmable switches. Multiple programmable switches are controlled by a controller, and the controller deploys a network mode adapted to the quality inspection application, that is, the content identification mode, to the programmable switch. Each programmable switch has a storage module to store the hash value of the quality inspection image name and the corresponding quality inspection image content. The quality inspection camera is deployed on the smart manufacturing production line and connected to the programmable switch. It is forwarded through multiple programmable switches and finally forwarded to the data center server.
[0035] Step 2: Collect quality inspection images.
[0036] (2.1) Original photo shooting: Start the quality inspection camera on the production line, take photos of the printed circuit board, and collect images of solder paste spots.
[0037] (2.2) Image preprocessing: Normalize and grayscale the original photo data. Then, pass it through a filter to reduce noise and form a quality inspection image.
[0038] (2.3) The quality inspection camera generates a quality inspection image for the current product, which is named production line name-product serial number-current timestamp and uploaded to the factory data center via IP for archiving and evaluation.
[0039] Step 3: Quality assessment of solder paste blocks.
[0040] (3.1) Image positioning and segmentation: The quality inspection model obtains quality inspection images from the data center, determines the boundaries of solder paste blocks based on pixel changes, and further segments each solder paste block image to obtain key parameters such as the height, volume, area, shape and position of the printed solder paste.
[0041] (3.2) Image detection and recognition: Based on the above key parameters, the quality of solder paste printing is evaluated by comparing with the preset standard parameters to determine whether there are unqualified solder paste blocks among the inspected solder paste blocks.
[0042] (3.3) Quality inspection alarm: The quality inspection model feeds back the evaluation results to the data center. For images containing unqualified solder paste blocks, the data center sends a message to the factory control center to warn of the presence of unqualified products. The message content is the name of the corresponding quality inspection image.
[0043] (3.4) The factory control center forwards the alarm information to multiple relevant departments based on the production line name and product serial number. Each relevant department sends a request to the data center to obtain the corresponding quality inspection image. The request is sent in the format of an interest packet. The interest packet contains the hash value of the name corresponding to the image.
[0044] (3.5) If all the images of the solder paste blocks detected are qualified, return to step 2 to collect new solder paste spot images.
[0045] Step 4: Request and obtain quality inspection images.
[0046] (4.1) After receiving the interest packet, the programmable switch in the quality inspection image transmission network parses the named hash value and first checks whether the interest packet has been received before. In the first request, since the programmable switch has not received the same interest packet, it forwards the interest packet to other programmable switches, which respond to it or eventually forward it to the data center.
[0047] (4.2) The factory data center returns the corresponding image file in the form of a data packet.
[0048] Specifically, after receiving the interest packet, the data center parses the hash value of the name in the interest packet and calculates the name. The data center searches for the image file to be sent according to the name;
[0049] The data center calculates the number of segments into which the image file to be sent should be divided according to the segment size preset by the storage module;
[0050] Dividing the image file to be sent in sequence according to the number of segments to form each segment of image content to be sent;
[0051] Name each segment of the image content to be sent, using the name of the image file to be sent plus the segment number;
[0052] Use the preset hash function to calculate the named hash value of each piece of image content that needs to be sent;
[0053] Determine whether the named hash value of each segment of the image content to be sent conflicts with the named hash value that has been stored, and if a hash conflict occurs, recalculate the named hash value of each segment of the image content using a candidate hash function until no conflict occurs;
[0054] Encapsulate the content in segments, and record the hash value of each segment of the image content, the number of segments the corresponding image file should be divided into, the current segment number, and the image content of the current segment, thereby completing the packaging of the quality inspection image data package;
[0055] The data center sends the encapsulated data packet.
[0056] (4.3) After receiving the data packet, the programmable switch parses the named hash value in the data packet and forwards the data packet to the interest packet port, which is the port that has received the name identifier corresponding to the content in the data packet. At the same time, the programmable switch forwards the data packet to the storage module, which stores the named hash value, current segment number, total number of segments, and image content in the data packet. After multi-hop forwarding, the data packet returns to the process department that requested the image file.
[0057] Step 5: Improvement and control of quality process: The process department receives the images and further analyzes and improves the process flow.
[0058] Step 6: Repeated acquisition of the same quality inspection image.
[0059] Specifically, another relevant department sends a request to the data center to obtain the same quality inspection image file. When the interest packet arrives at the programmable switch in the quality inspection image transmission network, the programmable switch determines that it has previously responded to the same request, and therefore directly forwards it to the storage module. When the storage module receives the interest packet, it searches for the corresponding quality inspection image content according to the hash value of the name in the interest packet, and encapsulates the quality inspection image content into a data packet, which contains the hash value of the quality inspection image name and the corresponding quality inspection image content. The storage module forwards the data packet to the interest packet port of the programmable switch, which is a port that has received a name corresponding to the content in the data packet. Thus, the other department obtains the image file from the nearest programmable switch.
[0060] Corresponding to the aforementioned embodiment of the efficient industrial intelligent visual quality inspection method combined with a multimodal network, the present invention also provides an embodiment of a efficient industrial intelligent visual quality inspection device combined with a multimodal network.
[0061] See also Figure 2 The efficient industrial intelligent visual quality inspection device combined with a multimodal network provided in an embodiment of the present invention includes one or more processors for implementing the efficient industrial intelligent visual quality inspection method combined with a multimodal network in the above-mentioned embodiment.
[0062] The embodiments of the high-efficiency industrial intelligent visual quality inspection device combined with a multimodal network of the present invention can be applied to any device with data processing capabilities, and the device with data processing capabilities can be a device or apparatus such as a computer. The device embodiment can be implemented through software, or through hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by the processor of any device with data processing capabilities in which it is located reading the corresponding computer program instructions in the non-volatile memory into the internal memory for execution. From a hardware perspective, if Figure 2 As shown, it is a hardware structure diagram of any device with data processing capability where the efficient industrial intelligent visual quality inspection device combined with a multimodal network of the present invention is located, except Figure 2 In addition to the processor, memory, network interface, and non-volatile memory shown, any device with data processing capabilities in which the apparatus in the embodiments is located may also include other hardware, generally based on the actual functions of the device with data processing capabilities, which will not be described in detail.
[0063] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.
[0064] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of the present invention. Ordinary technicians in this field can understand and implement it without paying creative work.
[0065] Corresponding to the above-mentioned embodiment of the efficient industrial intelligent visual quality inspection method combined with a multimodal network, the embodiment of the present application also provides an electronic device, including: one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the above-mentioned efficient industrial intelligent visual quality inspection method combined with a multimodal network. Figure 3 As shown, it is a hardware structure diagram of any device with data processing capability in which the efficient industrial intelligent visual quality inspection method combined with a multimodal network provided in the embodiment of the present application is located. Figure 3 In addition to the processor, memory, DMA controller, disk, and non-volatile memory shown, any device with data processing capabilities in which the apparatus in the embodiment is located may also include other hardware, which will not be described in detail, generally based on the actual functions of the device with data processing capabilities.
[0066] Corresponding to the above-mentioned embodiment of the efficient industrial intelligent visual quality inspection method combined with a multimodal network, an embodiment of the present invention also provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the efficient industrial intelligent visual quality inspection method combined with a multimodal network in the above-mentioned embodiment is implemented.
[0067] The computer-readable storage medium may be an internal storage unit of any device with data processing capability described in any of the aforementioned embodiments, such as a hard disk or a memory. The computer-readable storage medium may also be any device with data processing capability, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash card, etc. equipped on the device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of any device with data processing capability and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by any device with data processing capability, and may also be used to temporarily store data that has been output or is to be output.
[0068] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
[0069] The above embodiments are only used to illustrate the design ideas and features of the present invention, and their purpose is to enable those skilled in the art to understand the content of the present invention and implement it accordingly. The protection scope of the present invention is not limited to the above embodiments. Therefore, any equivalent changes or modifications made based on the principles and design ideas disclosed by the present invention are within the protection scope of the present invention.
Claims
1. An efficient industrial intelligent visual quality inspection method combined with a multimodal network, characterized in that: The method comprises the following steps: Step 1: Build a quality inspection image transmission network composed of programmable switches, and deploy the quality inspection model on the data center server in the quality inspection image transmission network; Step 2: Collect solder paste spot images through a quality inspection camera, pre-process the solder paste spot images to form quality inspection images, and upload the quality inspection images to a data center; Step 3: Obtain quality inspection images from the data center through the quality inspection model, segment each solder paste block image, evaluate the quality of solder paste printing, determine whether there are unqualified solder paste blocks in the inspected solder paste blocks, and feed back the evaluation results to the data center; if an image containing unqualified solder paste blocks is detected, the data center sends a message to the factory control center to warn of the appearance of unqualified products, and the message content is the name of the corresponding quality inspection image; the factory control center forwards the alarm information to multiple relevant departments; each relevant department sends a request to the data center to obtain the corresponding quality inspection image, and the request is sent in the format of an interest package, where the interest package contains the hash value of the name corresponding to the quality inspection image; if the images of the detected solder paste blocks are all qualified, return to step 2 to collect new solder paste spot images; Step 4: After receiving the interest packet, the programmable switch in the quality inspection image transmission network parses the named hash value; the data center returns the corresponding image file in the form of a data packet; after receiving the data packet, the programmable switch parses the named hash value in the data packet, forwards the data packet to the interest packet port, and forwards the data packet to the storage module; after multi-hop forwarding, the data packet returns to the process department requesting the quality inspection image file; Step 5: The process department receives the images and further analyzes and improves the process flow; Step 6: Another relevant department sends a request to the data center to obtain the same quality inspection image file from the nearest programmable switch.
2. The efficient industrial intelligent visual quality inspection method combined with a multimodal network according to claim 1 is characterized in that: In the step one, the image transmission forwarding rule is implemented based on programmable switch forwarding. Multiple programmable switches are controlled by a controller. The controller deploys a network mode adapted to the quality inspection application, namely, the content identification mode, to the programmable switch. Each programmable switch has a storage module to store the hash value of the quality inspection image name and the corresponding quality inspection image content.
3. The efficient industrial intelligent visual quality inspection method combined with a multimodal network according to claim 1 is characterized in that: In the step 2, the quality inspection camera is deployed on the intelligent manufacturing production line, connected to the programmable switch, and forwarded through multiple programmable switches and finally forwarded to the data center server.
4. The efficient industrial intelligent visual quality inspection method combined with a multimodal network according to claim 1 is characterized in that: In step 2, the quality inspection image is named as production line name-product serial number-current timestamp, and is uploaded to the data center in the form of IP for archiving and evaluation.
5. The efficient industrial intelligent visual quality inspection method combined with a multimodal network according to claim 1 is characterized in that: The step three is specifically as follows: obtaining a quality inspection image from the data center through the quality inspection model, determining the boundary of the solder paste block based on pixel changes, further segmenting to obtain images of each solder paste block, evaluating the quality of solder paste printing, and determining whether there are unqualified solder paste blocks in the inspected solder paste blocks. The quality inspection model feeds back the evaluation results to the data center; if an image containing unqualified solder paste blocks is detected, the data center sends a message to the factory control center to warn of the appearance of unqualified products, and the message content is the name of the corresponding quality inspection image; the factory control center forwards the alarm information to multiple relevant departments based on the production line name and product serial number; each relevant department sends a request to the data center to obtain the corresponding quality inspection image; the request is sent in the format of an interest packet, wherein the interest packet contains a hash value of the name corresponding to the image; if the images of the detected solder paste blocks are all qualified, return to step two to collect a new solder paste spot image.
6. The efficient industrial intelligent visual quality inspection method combined with a multimodal network according to claim 1 is characterized in that: The step 4 includes the following sub-steps: (4.1) After receiving the interest packet, the programmable switch in the quality inspection image transmission network parses the named hash value; if the interest packet is the first request, the interest packet is forwarded to other programmable switches, which respond or eventually forward it to the data center; (4.2) After receiving the interest packet, the data center parses the hash value of the name in the interest packet, calculates the name, and then searches for the image file to be sent according to the name; then, according to the preset segment size of the storage module, calculates the number of segments that the image file to be sent should be divided into, forms each segment of the image content to be sent and names it; uses the preset hash function to calculate the hash value of the name of each segment of the image content to be sent; determines whether the hash value of the name of each segment of the image content to be sent conflicts with the hash value of the name that has been stored, and if a hash conflict occurs, uses the candidate hash function to recalculate the hash value of the name of each segment of the image content until no conflict occurs; encapsulates the content in segments, and records the hash value of the name of each segment of the image content, the number of segments that the corresponding image file should be divided into, the current segment number, and the image content of the current segment, thereby completing the packaging of the quality inspection image data packet; sends the encapsulated data packet through the data center; (4.3) After receiving the data packet, the programmable switch parses the named hash value in the data packet and forwards the data packet to the interest packet port, where the interest packet port is a port that has received a name identifier corresponding to the content in the data packet. At the same time, the programmable switch forwards the data packet to the storage module, which stores the named hash value, current segment number, total number of segments, and image content in the data packet. After multi-hop forwarding, the data packet returns to the process department that requested the quality inspection image file.
7. The efficient industrial intelligent visual quality inspection method combined with a multimodal network according to claim 1 is characterized in that: The specific steps of step six are as follows: another relevant department sends a request to the data center to obtain the same quality inspection image file; when the interest packet arrives at the programmable switch in the quality inspection image transmission network, the programmable switch determines that it has previously responded to the same request and directly forwards it to the storage module; when the storage module receives the interest packet, it searches for the corresponding quality inspection image content according to the hash value of the name in the interest packet, and encapsulates the quality inspection image content into a data packet, which contains the hash value of the quality inspection image name and the corresponding quality inspection image content; the storage module forwards the data packet to the interest packet port of the programmable switch, which is a port that has received a name corresponding to the content in the data packet; thereby, the other department obtains the image file from the nearest programmable switch.
8. An efficient industrial intelligent visual quality inspection device combined with a multimodal network, characterized in that: It includes one or more processors for implementing the efficient industrial intelligent visual quality inspection method combined with a multimodal network as described in any one of claims 1 to 7.
9. An electronic device, comprising a memory and a processor, characterized in that: The memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement the efficient industrial intelligent visual quality inspection method combined with a multimodal network as described in any one of claims 1-7 above.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the efficient industrial intelligent visual quality inspection method combined with a multimodal network as described in any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Scheduling method and system supporting multi-modal processing logic
CN117240795A
Visual inspection system for packaging auxiliary material of module memory bank
CN117250199A
Named data network transmission performance analysis method, device and system
CN118337638A
Method and device for identification management and optimized forwarding in large-scale polymorphic network
US20240171509A1
Virtual and real combined dynamic traffic scheduling method and apparatus based on SDN and ndn
WO2024108493A1