Automatic commissioning system and portable handheld device

Abstract

This application provides an automatic debugging system and a portable handheld device. The system includes: a scanning unit that scans at least two devices in a system under test and acquires device information for the at least two devices; an identification unit that determines the product models of the at least two devices in the system under test and the connection method between the at least two devices based on the device information; a modeling unit that models the system under test based on the product models and connection method to obtain an engineering architecture diagram of the system under test; and a programming unit that generates a test program for testing the system under test based on the engineering architecture diagram. This reduces the technical requirements for operators, shortens testing time, and improves the programming efficiency of the testing system.

Description

Technical Field

[0001] This application relates to the field of integrated device testing technology, and in particular to an automatic debugging system and a portable handheld device. Background Technology

[0002] In the field of industrial automation control, various industrial control products (such as PLCs (Programmable Logic Controllers), frequency converters, servo drives, industrial robots, etc.) are usually equipped with detailed technical manuals, covering product performance specifications, electrical wiring diagrams, parameter configuration tables, program routines, and fault code tables. Technicians frequently need to consult these scattered documents to sift through the required technical information during equipment installation, system debugging, parameter setting, and routine maintenance. However, with the increasing complexity and serialization of industrial product functions, the quantity and content of technical documents have also increased dramatically. The ability to quickly and accurately locate the required information from a vast amount of manuals, and to generate test programs and execute system debugging based on that information, has become a key factor affecting on-site work efficiency.

[0003] Currently, there are two main practices for on-site debugging of industrial control systems: one is to obtain fixed product information links or electronic documents by scanning the QR code or barcode on the product; the other is to rely entirely on manually flipping through paper or PDF (Portable Document Format) manuals to find the required content one by one.

[0004] It should be noted that the above introduction to the technical background is only for the purpose of providing a clear and complete explanation of the technical solutions of this application and facilitating understanding by those skilled in the art. It should not be assumed that these technical solutions are known to those skilled in the art simply because they have been described in the background section of this application. Summary of the Invention

[0005] The inventors discovered that existing on-site debugging methods for industrial control systems have the following shortcomings in practical applications: First, QR code or barcode labels are exposed to harsh industrial environments for extended periods, making them highly susceptible to wear, contamination, or damage, rendering them unreadable. Furthermore, they have limited information storage capacity, typically only redirecting users to a general download page and failing to provide differentiated guidance based on specific user scenarios (such as wiring, programming, or troubleshooting).

[0006] Secondly, the on-site installation and commissioning information is scattered across multiple manuals, requiring technicians to cross-reference and consult different manuals, making information integration difficult and resulting in low search efficiency.

[0007] Furthermore, when equipment malfunctions, the traditional approach is to observe the indicator light status and then refer to the fault code table in the manual for judgment. This process is not only time-consuming but also highly dependent on the experience of personnel, and is prone to prolonging downtime due to misjudgment.

[0008] In addition, after the system is built, functional verification is required. Different systems have different control programs, and programming and testing require high professional skills from operators, which increases labor and time costs.

[0009] To address at least one of the aforementioned problems or other similar issues, embodiments of this application provide an automated debugging system capable of automatically generating test programs and a portable handheld device.

[0010] According to a first aspect of the embodiments of this application, an automatic debugging system is provided, the automatic debugging system comprising: A scanning unit that scans at least two devices in the system under test and acquires device information of the at least two devices; An identification unit, which determines the product models of at least two devices in the system under test and the connection method between the at least two devices based on the device information; The modeling unit models the system under test based on the product model and the connection method to obtain the engineering architecture diagram of the system under test. The programming unit generates test programs for testing the system under test based on the engineering architecture diagram.

[0011] According to a second aspect of the embodiments of this application, the system to be tested includes: at least one master station device, at least one slave station device, and a plurality of connection lines connecting the devices.

[0012] According to a third aspect of the embodiments of this application, the scanning unit includes: a camera device and / or a wireless connection device; the device information acquired by the scanning unit includes at least one of the following: an image of the device's appearance, model identification text, port type and quantity, and the type and quantity of the connection cable.

[0013] According to a fourth aspect of the embodiments of this application, the automatic debugging system further includes: A storage unit stores a database, which includes product model information, port type information, and port configuration information, wherein the product model information, the port type information, and the port configuration information are mutually associated. The identification unit identifies the product model and / or connection method of each device in the system under test by querying the database.

[0014] According to a fifth aspect of the embodiments of this application, the identification unit is further configured to: Based on the appearance image in the device information, the communication protocol type or configuration parameters of the port type corresponding to the device are analyzed by an image recognition model, and / or, the master station device and slave station device in the system under test are distinguished and identified according to the device information.

[0015] According to a sixth aspect of the embodiments of this application, the modeling unit uses a pre-trained AI model to model the system to be tested based on the product model and the connection method, and generates the engineering architecture diagram.

[0016] According to a seventh aspect of the embodiments of this application, the automatic debugging system further includes: A communication unit that transmits the generated test program to the master station device and / or slave station device in the system under test.

[0017] According to an eighth aspect of the embodiments of this application, the master station device is a programmable logic controller (PLC); and / or, the slave station device is a programmable logic controller (PLC).

[0018] According to a ninth aspect of the embodiments of this application, the automatic debugging system further includes: The fault diagnosis unit determines the equipment fault based on the equipment information obtained by the identification unit. The device information includes: indicator light color and flashing frequency.

[0019] According to a tenth aspect of the embodiments of this application, a portable handheld device is provided, which has an automatic debugging system as described in any one of the first to ninth aspects.

[0020] One of the beneficial effects of the embodiments of this application is that the automatic debugging system provided by the embodiments of this application identifies the model of each device in the industrial control system to be tested and the port connection method between the master and slave devices by using image recognition technology. Then, based on the device model and the port connection method, artificial intelligence is used to automatically generate test programs. As a result, the technical requirements for operators can be greatly reduced, the test time can be reduced, and the programming efficiency of the test system can be improved.

[0021] Specific embodiments of this application are disclosed in detail with reference to the following description and accompanying drawings, indicating how the principles of this application can be adopted. It should be understood that the embodiments of this application are not limited in scope. Within the spirit and scope of the appended claims, embodiments of this application include many changes, modifications, and equivalents.

[0022] Features described and / or illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, combined with features in other embodiments, or substituted for features in other embodiments.

[0023] It should be emphasized that the term "including / comprises" as used herein refers to the presence of a feature, whole, step, or component, but does not exclude the presence or addition of one or more other features, wholes, steps, or components. Attached Figure Description

[0024] The accompanying drawings, which form part of the specification, are used to provide a further understanding of the embodiments of this application and illustrate the implementation methods of this application, together with the textual description, to explain the principles of this application. Obviously, the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any creative effort. In the drawings: Figure 1 This is a schematic diagram of an automatic debugging system according to an embodiment of this application; Figure 2 This is a schematic diagram of the engineering architecture generated by the automatic debugging system according to an embodiment of this application; Figure 3 This is a flowchart of the automatic debugging system according to an embodiment of this application. Detailed Implementation

[0025] Referring to the accompanying drawings, the foregoing and other features of this application will become apparent from the following description. Specific embodiments of this application are specifically disclosed in the description and drawings, illustrating partial implementations in which the principles of this application may be employed. It should be understood that this application is not limited to the described embodiments; rather, it includes all modifications, variations, and equivalents falling within the scope of the appended claims.

[0026] In embodiments of this application, the term "and / or" includes any one and all combinations of one or more of the terms listed in association. The terms "comprising," "including," "having," etc., refer to the presence of the stated features, elements, components, or assemblies, but do not exclude the presence or addition of one or more other features, elements, components, or assemblies.

[0027] In the embodiments of this application, the singular forms "a," "the," etc., may include the plural forms and should be broadly interpreted as "a kind" or "a class" rather than limited to the meaning of "an." Furthermore, the term "the" should be understood to include both the singular and plural forms unless the context explicitly indicates otherwise. Additionally, the term "according to" should be understood as "at least partially based on…," and the term "based on" should be understood as "at least partially based on…," unless the context explicitly indicates otherwise.

[0028] The embodiments of this application will now be described with reference to the accompanying drawings.

[0029] First aspect of the embodiments

[0030] This application provides an automatic debugging system. Figure 1 This is a schematic diagram of an automatic debugging system 100 according to an embodiment of this application, as shown below. Figure 1 As shown, the automatic debugging system 100 includes: a scanning unit 110, an identification unit 120, a modeling unit 130, and a programming unit 140.

[0031] Scanning unit 110 scans at least two devices in the system under test and obtains device information of the at least two devices; identification unit 120 determines the product models of the at least two devices in the system under test and the connection method between the at least two devices based on the obtained device information; modeling unit 130 models the system under test based on the product models and connection methods to obtain the engineering architecture diagram of the system under test; programming unit 140 generates a test program for testing the system under test based on the engineering architecture diagram.

[0032] The automatic debugging system 100 provided in the embodiments of this application identifies the model of each device in the industrial control system to be tested and the port connection method between the master and slave devices by using image recognition technology. Then, it automatically generates test programs using artificial intelligence based on the device model and port connection method. This can greatly reduce the technical requirements of operators, reduce test time, and improve the programming efficiency of the test system.

[0033] In the above embodiments, the system to be tested is, for example, an engineering control system that includes multiple devices.

[0034] In some embodiments, the system under test includes: at least one master station device, at least one slave station device, and multiple connection cables connecting the devices.

[0035] In the above embodiments, the master device is a programmable logic controller (PLC), and / or the slave device is a programmable logic controller (PLC). For example, the master device and the slave device can be a PLC 301, or the slave device can be an IO (Input / Output) module, a frequency converter, a servo drive, etc., and the multiple connecting lines between the master device and the slave device can be IO cables, communication cables, etc.

[0036] The master station equipment, slave station equipment, and connecting lines can also be other types or models of equipment and cables. For details, please refer to the relevant technologies in this field. This application does not limit them.

[0037] In some embodiments, the scanning unit 110 includes a camera device and / or a wireless connection device, and the device information acquired by the scanning unit 110 includes at least one of the following: an image of the device's appearance, model identification text, port type and number, and connection cable type and number.

[0038] In some possible implementations, when the scanning unit is a camera device equipped with a high-resolution camera, the scanning unit 110 can be used to capture images of the device's appearance, including the overall shape of the device, the model identification text on the nameplate, the port layout, the status of indicator lights, the color of the connecting cables, and the shape of the interfaces. For example, by taking pictures of each device in the industrial control system one by one, information such as the model identification, port type (e.g., RJ45 interface, DB9 interface, terminal block, etc.), and the color of the connecting cables (e.g., yellow wire, blue wire, black wire, etc.) can be obtained.

[0039] In other possible implementations, the scanning unit 110 can also acquire device information via wireless communication. For example, when the scanning unit 110 is a wirelessly connected device equipped with a wireless communication module (such as Wi-Fi, Bluetooth, etc.), the scanning unit 110 establishes a connection with the device that has wireless communication capabilities and directly obtains internal information such as the device's model and firmware version through a wireless query mechanism. For example, a frequency converter that supports Bluetooth can respond to a query command from a handheld device and return its model data. Specific query and response processes can be found in relevant technologies in the art and will not be elaborated here.

[0040] In the above embodiments, the device information acquired by the scanning unit 110 may include: the device's appearance image, model identification text, port type and quantity, connection cable type and quantity (such as cable color and interface shape), indicator light color and flashing frequency, etc.

[0041] By using image recognition and / or wireless communication through the scanning unit 110 to acquire device information, technicians can obtain accurate device model, connection cable type and other necessary device information during the system testing phase without relying on experience or manuals. This greatly reduces the technical difficulty of device identification and improves work efficiency.

[0042] In some embodiments, such as Figure 1 As shown, the automatic debugging system 100 of this application embodiment also includes a storage unit 150, which stores a database containing: product model information, port type information and port configuration information, and the product model information, port type information and port configuration information are related to each other.

[0043] In the above embodiments, the identification unit 120 can also identify the product model and / or connection method of each device in the system under test by querying a database. Specifically, the database can be pre-built and can contain extensive product model information, port type information, and port configuration information. This information can be interconnected through product identification and other information. Thus, the identification unit 120 can identify the device model and its corresponding port type by querying the above information in the database, and thereby determine the connection method between devices. For example, for a specific PLC model, the database records its appearance feature template, port type (e.g., Ethernet port, serial port, number of digital input / output channels, etc.), supported bus protocols (e.g., Profinet, EtherCAT, etc.), and typical wiring methods, etc. This application does not limit the specific association method of the above information. For example, the association can be established by a table, or by a folder, etc.

[0044] After the scanning unit 110 acquires the device information, the identification unit 120 queries the database to compare and match the device information obtained by the scanning unit 110 with the data stored in the database, thereby identifying the specific product model. For example, for model identification text, Optical Character Recognition (OCR) technology can be used for recognition; for appearance images, features can be extracted using deep learning-based image recognition models (e.g., convolutional neural networks) and compared with the database; for devices with wireless capabilities, the identification unit 120 fuses and verifies the appearance recognition results with the response information obtained from wireless interrogation, thereby confirming the product model. This makes the identification results more accurate.

[0045] In some embodiments, the identification unit 120 is further configured to: based on the appearance image in the device information, parse the communication protocol type or configuration parameters of the port type corresponding to the device through an image recognition model, and / or, distinguish and identify the master station device and slave station device in the system under test according to the device information.

[0046] The identification unit 120 is also configured to parse the communication protocol type or configuration parameters of the device port type using an image recognition model based on the appearance image in the device information. For example, when the identification unit 120 identifies that the device has an RJ45 interface, it can determine that the device uses Ethernet communication, and further infer the specific communication protocol (e.g., Profinet or EtherCAT) by combining the device's product model. Simultaneously, the identification unit 120 can distinguish between master and slave devices based on device information (such as device size, number of ports, tag characteristics, etc.). For example, it can distinguish between master and slave devices based on information such as the device's product model, port layout, and number of ports.

[0047] In the above embodiments, after the identification unit 120 determines the master and slave station equipment information, the information can also be provided to technicians for manual verification to further verify the identification results.

[0048] In the above embodiments, for identifying the connection method, the identification unit 120 can determine the wiring status of each port by analyzing the color, interface shape, and connection relationship of the connecting cable. For example, when the identification unit 120 identifies that a blue cable is connected to a device port, it can determine that the blue cable is an I / O connection by querying database information. The specific connecting cable type can be pre-stored in the database according to industry standards.

[0049] In some embodiments, the modeling unit 130 uses a pre-trained AI model to model the system under test based on the product model and connection method, and generates an engineering architecture diagram. Figure 2 This is a schematic diagram of the engineering architecture of an embodiment of this application, as shown below. Figure 2 As shown, this engineering architecture diagram can graphically display all devices in the system, the connections between devices (including bus connections and I / O wiring), the port allocation for each device, and the parameter specifications of each interface. For example, after the modeling unit 130 obtains the device information and connection methods identified by the identification unit 120, it can generate information such as... Figure 2 The engineering architecture diagram shown includes a PLC controller 201, a PC controller 202, communicators 203 and 204, an input unit 205, and an output unit 206. The PLC controller 201 and the communicator 203 support the EtherCAT bus protocol and the EtherNet / IP bus protocol, and the PC controller 202 and the communicator 204 support the EtherCAT bus protocol.

[0050] In the above embodiments, the modeling unit 130 can use a pre-trained AI model for automatic modeling. For example, the AI ​​model can automatically generate an architecture diagram of an industrial control system based on the input device list and connection relationships. This architecture diagram can be displayed on the user interface for technicians to verify and serve as the basis for programming subsequent test programs.

[0051] Based on the aforementioned engineering architecture diagram, programming unit 140 can automatically generate test programs for testing the system under test. For example, programming unit 140 has built-in instruction libraries and program templates for different PLC models. After obtaining the engineering architecture diagram, it can call the corresponding program template and fill in the specific specification parameters according to the device model, IO mapping relationship, bus configuration, and other information in the engineering architecture diagram to generate a test program for that engineering architecture diagram.

[0052] In some embodiments, such as Figure 1 As shown, the automatic debugging system 100 of this application embodiment also includes a communication unit 160. The communication unit 160 can transmit the generated test program to the master station device and / or slave station device in the system under test. For example, the communication unit 160 can support wired (such as Ethernet) and wireless (such as Wi-Fi, Bluetooth) transmission methods. When the master station device is equipped with a wireless module (such as a Wi-Fi or Bluetooth module), the communication unit 160 can directly transmit the test program to the master station device wirelessly, thereby enabling faster and more convenient system testing.

[0053] In some embodiments, such as Figure 1 As shown, the automatic debugging system 100 of this application embodiment further includes a fault diagnosis unit 170, which determines a device fault based on the device information obtained by the identification unit 120. As mentioned above, the device information may also include the indicator light color and flashing frequency of the device. The fault diagnosis unit 170 can determine whether the device has malfunctioned and determine the fault type based on the indicator light color and flashing frequency, combined with the fault codes in the database.

[0054] In the above embodiments, the fault diagnosis unit 170 can display the determined fault type in an explicit manner, which makes it easier for staff to confirm the fault type. This application does not limit the specific display method.

[0055] Figure 3 This is a flowchart illustrating the operation of the automatic debugging system 100 according to an embodiment of this application. Figure 3 As shown, the automatic debugging system 100 can perform the following steps during operation: S301: The scanning unit scans at least two devices in the system under test and obtains the device information of each device in the system under test; S302: The identification unit queries the database in the storage unit based on the device information to determine the product model and connection method of each device; S303: The modeling unit automatically generates the system's engineering architecture diagram based on the recognition results; S304: The programming unit automatically generates system test programs based on the engineering architecture diagram; S305: The communication unit transmits the test program to each device; S306: Each device runs a test procedure. Technicians verify the correctness of the system based on the device's actions. When a fault occurs, the fault diagnosis unit investigates the fault.

[0056] It is worth noting that the above appendix Figure 3 The embodiments described herein are merely illustrative and are not limited thereto. For example, the execution order of various operations can be appropriately adjusted, and additional operations can be added or some operations can be removed. Those skilled in the art can make appropriate modifications based on the above description, and are not limited to the above-described embodiments. Figure 3 The records.

[0057] The automatic debugging system 100 provided in this application identifies the model of each device in the industrial control system to be tested and the port connection method between the master and slave devices by using image recognition technology. Then, it automatically generates test programs using artificial intelligence based on the device model and port connection method. In the debugging process of complex engineering control systems containing multiple brands and models of devices, it can significantly reduce the technical experience requirements of operators, improve the efficiency of system construction and troubleshooting, reduce test time, and improve the programming efficiency of the test system.

[0058] Second aspect of the embodiments

[0059] This application provides a portable handheld device having the automatic debugging system 100 described in the first aspect embodiment.

[0060] For example, the automatic debugging system 100 can be configured in the portable handheld device in the form of software and / or firmware. This application does not limit the specific configuration method.

[0061] The portable handheld device provided in this application also has the conventional components and functions of a portable handheld device, which can be specifically referred to in related technologies. In the embodiments of the first aspect, the process of generating the test program using the automatic debugging system has been described in detail, and its content is incorporated herein by reference, so the description is omitted here.

[0062] In this application embodiment, the type of portable handheld device is not limited. For example, it may be a portable tablet computer, a smartphone, etc. For the specific composition and function of the portable handheld device, please refer to the relevant technology, which is omitted here.

[0063] The embodiments of this application have been described above with reference to specific implementation methods. However, those skilled in the art should understand that these descriptions are exemplary and not intended to limit the scope of protection of the embodiments of this application. Those skilled in the art can make various modifications and variations to the embodiments of this application based on the spirit and principles of the embodiments, and these modifications and variations are also within the scope of the embodiments of this application.

[0064] The methods / apparatus described in conjunction with the embodiments of this application can be directly embodied in hardware, software modules executed by a processor, or a combination of both. For example, one or more and / or combinations of one or more functional block diagrams shown in the figures can correspond to various software modules in a computer program flow, or to various hardware modules. These software modules can correspond to the various steps shown in the figures, respectively. These hardware modules can be implemented, for example, using a field-programmable gate array (FPGA) to embed these software modules.

[0065] The software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art. A storage medium can be coupled to the processor, enabling the processor to read information from and write information to the storage medium; or the storage medium can be an integral part of the processor. The processor and storage medium can reside in an ASIC. The software module can be stored in the memory of a mobile terminal or in a memory card that can be inserted into the mobile terminal. For example, if the device (such as a mobile terminal) uses a high-capacity MEGA-SIM card or a high-capacity flash memory device, the software module can be stored in the MEGA-SIM card or the high-capacity flash memory device.

[0066] One or more and / or one or more combinations of functional blocks described in the accompanying drawings can be implemented as a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or any suitable combination thereof for performing the functions described herein. One or more and / or one or more combinations of functional blocks described in the accompanying drawings can also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in communication with a DSP, or any other such configuration.

[0067] Preferred embodiments of the present application have been described above with reference to the accompanying drawings. Many features and advantages of these embodiments are apparent from this detailed description, and therefore the appended claims are intended to cover all such features and advantages falling within the true spirit and scope of these embodiments. Furthermore, since many modifications and alterations will readily occur to those skilled in the art, the embodiments of the present application are not intended to be limited to the precise structures and operations illustrated and described, but rather to encompass all suitable modifications and equivalents falling within their scope.

Claims

1. An automatic debugging system, characterized in that, The automatic debugging system includes: A scanning unit that scans at least two devices in the system under test and acquires device information of the at least two devices; An identification unit, which determines the product models of at least two devices in the system under test and the connection method between the at least two devices based on the device information; The modeling unit models the system under test based on the product model and the connection method to obtain the engineering architecture diagram of the system under test. The programming unit generates test programs for testing the system under test based on the engineering architecture diagram.

2. The system according to claim 1, characterized in that, The system to be tested includes: at least one master station device, at least one slave station device, and multiple connection lines connecting the devices.

3. The system according to claim 1, characterized in that, The scanning unit includes: a camera device and / or a wireless connection device; The device information acquired by the scanning unit includes at least one of the following: The device's appearance image, model identification text, port type and quantity, and connection cable type and quantity.

4. The system according to claim 3, characterized in that, The automatic debugging system also includes: A storage unit stores a database, which includes product model information, port type information, and port configuration information, wherein the product model information, the port type information, and the port configuration information are mutually associated. The identification unit identifies the product model and / or connection method of each device in the system under test by querying the database.

5. The system according to claim 3, characterized in that, The identification unit is further configured to: Based on the appearance image in the device information, the communication protocol type or configuration parameters of the port type corresponding to the device are analyzed by an image recognition model, and / or, the master station device and slave station device in the system under test are distinguished and identified according to the device information.

6. The system according to claim 2, characterized in that, The modeling unit uses a pre-trained AI model to model the system under test based on the product model and the connection method, and generates the engineering architecture diagram.

7. The system according to claim 2, characterized in that, The automatic debugging system also includes: A communication unit that transmits the generated test program to the master station device and / or the slave station device in the system under test.

8. The system according to claim 7, characterized in that, The master station device is a programmable logic controller (PLC); and / or, the slave station device is a programmable logic controller (PLC).

9. The system according to claim 1, characterized in that, The automatic debugging system also includes: The fault diagnosis unit determines the equipment fault based on the equipment information obtained by the identification unit. The device information includes: indicator light color and flashing frequency.

10. A portable handheld device, characterized in that, The portable handheld device has an automatic debugging system as described in any one of claims 1 to 9.

Images