Printing equipment signal card remote debugging method, device, equipment and medium

Abstract

The present application relates to a remote debugging method, device, equipment and medium for a printing equipment signal card, the method comprising: an FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold value, and when it exceeds, triggers an interrupt signal and sends it to an industrial computer to determine the interrupt source; the host computer in the industrial computer obtains the encoder data, status register data and time series data corresponding to the output control quantity data in the FIFO data according to the interrupt source, and uploads it to a cloud server; detects whether the time series data conforms to the preset process template data in the cloud server, and triggers a fault warning if the time series data does not conform to the preset process template data; determines the functional defect corresponding to the printing equipment signal card according to the fault warning, and remotely debugs the printing equipment signal card according to the functional defect. The present application does not require R&D personnel to conduct on-site error troubleshooting of the printing equipment signal card, which greatly saves manpower and material resources.

Description

Technical Field

[0001] The present application relates to the field of printing equipment, and in particular to a remote debugging method for a signal card of a printing equipment, a corresponding device, an electronic device and a computer-readable storage medium. Background Art

[0002] At present, printing equipment is no longer limited to the printing of book packaging. Printing technology has been widely used in more and more industries such as wood texture printing, floor tile pattern printing, and even electronic circuit printing.

[0003] The signal card of printing equipment is a key component of printing equipment automation. During the use of printing equipment, if the signal card of printing equipment is abnormal, after-sales personnel are generally required to arrive at the site to debug the signal card of printing equipment. This not only makes it difficult to quickly locate and solve the problem, but also easily leads to user complaints. The debugging process of the signal card of printing equipment is time-consuming and labor-intensive, resulting in a longer debugging cycle and low efficiency. In addition, it will inevitably incur travel expenses, resulting in increased after-sales costs.

[0004] In order to adapt to the abnormality of the printing equipment signal card in the prior art, after-sales personnel need to arrive at the site to debug the printing equipment signal card. This not only makes it impossible to quickly locate and solve the problem but also easily leads to user complaints. In addition, the debugging process of the printing equipment signal card is time-consuming and labor-intensive, resulting in a longer debugging cycle and low efficiency. The applicant has made corresponding explorations in order to solve this problem. Summary of the invention

[0005] The purpose of the present application is to solve the above-mentioned problem and to provide a printing equipment signal card remote debugging method, corresponding device, electronic equipment and computer-readable storage medium.

[0006] In order to meet the various objectives of this application, this application adopts the following technical solutions:

[0007] A printing equipment signal card remote debugging method proposed to meet one of the purposes of this application includes the following steps:

[0008] In response to a remote debugging instruction of a printing device signal card, the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold value. When the threshold value is exceeded, an interrupt signal is triggered and sent to the industrial computer to determine the interrupt source. The FIFO data includes one or more of the encoder data, status register data, and output control quantity data at each trigger input point in the printing device signal card;

[0009] The host computer in the industrial computer obtains the encoder data, status register data and time series data corresponding to the output control quantity data in the FIFO data according to the interrupt source, and uploads it to the cloud server;

[0010] Detecting whether the time series data conforms to the process template data preset in the cloud server, and triggering a fault warning if the time series data does not conform to the preset process template data;

[0011] The functional defect corresponding to the printing device signal card is determined according to the fault warning, and the printing device signal card is remotely debugged according to the functional defect.

[0012] Optionally, before the step of responding to the remote debugging instruction of the printing device signal card and the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds a preset threshold, the following steps are included:

[0013] The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card;

[0014] The FPGA chip stores the encoder data, status register data and output control quantity data at each trigger input point in the printing device signal card in chronological order according to the encoder input signal, light trigger signal and ordinary digital input signal.

[0015] Optionally, in response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds a preset threshold, the following steps are included:

[0016] The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card;

[0017] The encoder input signal, the optical trigger signal and the common digital input signal in the printing device signal card are delayed and filtered to avoid false triggering.

[0018] Optionally, in response to the remote debugging instruction of the printing device signal card, the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold, and when it exceeds, triggers an interrupt signal and sends it to the PCIE interface bridge chip in the industrial computer, including the following steps:

[0019] The FPGA chip triggers an interrupt signal and transmits it to the PCI E interface bridge chip in the industrial computer;

[0020] The FPGA chip triggers the host computer in the industrial computer to execute a user callback function based on the driver program. The host computer reads the status register in the FPGA chip to determine the interrupt source to obtain the time series data corresponding to the encoder data, status register data and output control quantity data in the FIFO data in the FPGA chip.

[0021] Optionally, in response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds a preset threshold, the following steps are included:

[0022] The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card;

[0023] The rising edge or falling edge of the optical trigger signal or the common digital input signal is captured, and the encoder data at each trigger point of the printing device signal card is latched for position comparison.

[0024] Optionally, the step of determining a functional defect corresponding to the printing device signal card according to the fault warning, and performing remote debugging of the printing device signal card according to the functional defect comprises the following steps:

[0025] Responding to the debugging instruction of the signal card of the printing device, obtaining the image data of the printed product in the printing device;

[0026] Identifying a printed product defect corresponding to the printed product image data based on a preset printed product defect recognition model;

[0027] Writing the encoder data at the rejection point corresponding to the defect category of the printed product into the FPGA chip in chronological order;

[0028] The functional defect corresponding to the signal card of the printing device is determined according to the printed product defect and the encoder data at the rejection point corresponding to the printed product defect, and the remote debugging of the signal card of the printing device is performed according to the functional defect.

[0029] Optionally, the step of identifying the printed product defects corresponding to the printed product image data based on a preset printed product defect recognition model comprises the following steps:

[0030] Extracting image feature information of each of the printed product image data based on a convolutional neural network in a preset printed product defect recognition model;

[0031] Fully connecting the image feature information based on the classifier in the preset printed product defect recognition model to obtain the classification probabilities corresponding to the mapping thereof to the preset multiple printed product defects;

[0032] The printed product defect with the largest classification probability is determined as the printed product defect corresponding to the printed product image data.

[0033] A printing equipment signal card remote debugging device provided for another purpose of the present application includes:

[0034] A FIFO data detection module is configured to respond to a remote debugging instruction of a printing device signal card, and the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold value. When the threshold value is exceeded, an interrupt signal is triggered and sent to the industrial computer to determine the interrupt source. The FIFO data includes one or more of the encoder data, status register data, and output control quantity data at each trigger input point in the printing device signal card;

[0035] A FIFO data uploading module is configured as a host computer in the industrial computer to obtain the encoder data, status register data and time series data corresponding to the output control quantity data in the FIFO data according to the interrupt source, and upload it to the cloud server;

[0036] A time series data detection module, configured to detect whether the time series data conforms to the process template data preset in the cloud server, and trigger a fault warning if the time series data does not conform to the preset process template data;

[0037] The device signal card debugging module is configured to determine the functional defect corresponding to the printing device signal card according to the fault warning, and to perform remote debugging of the printing device signal card according to the functional defect.

[0038] An electronic device provided to meet another purpose of the present application includes a central processing unit and a memory, wherein the central processing unit is used to call and run a computer program stored in the memory to execute the steps of the remote debugging method of the printing device signal card described in the present application.

[0039] A computer-readable storage medium is provided to meet another purpose of the present application, which stores a computer program implemented according to the printing device signal card remote debugging method in the form of computer-readable instructions. When the computer program is called and executed by a computer, the steps included in the corresponding method are executed.

[0040] Compared with the prior art, the present application aims at the problem that the printing equipment signal card in the prior art has an abnormality, and after-sales personnel need to arrive at the site to debug the printing equipment signal card, which not only makes it impossible to quickly locate and solve the problem, but also easily causes user complaints, and the debugging process of the printing equipment signal card is time-consuming and labor-intensive, resulting in a longer debugging cycle and low efficiency. The present application includes but is not limited to the following beneficial effects:

[0041] First, the printing equipment signal card remote debugging method of the present application can effectively solve the problem that the printing equipment signal card needs to be debugged on-site. R&D personnel or debugging personnel do not need to go to the equipment testing site in person to troubleshoot errors, which greatly saves manpower and material resources and greatly facilitates the R&D and debugging work of the printing equipment signal card.

[0042] Secondly, the remote debugging method of the printing device signal card of the present application does not require R&D personnel or debugging personnel to arrive at the site. The FIFO data such as encoder data, status register data, output control quantity data, etc. of the printing device signal card can be obtained through the cloud server, which can quickly locate the defect problem of the printing signal card, greatly improving the debugging efficiency of the printing signal card. R&D personnel or debugging personnel do not need to arrive at the site, which greatly saves after-sales costs;

[0043] Furthermore, the present application identifies the printed product defects corresponding to the printed product based on the printed product defect recognition model, and transmits the printed product defects corresponding to the printed product and its corresponding encoder data, status register data, output control quantity data and other FIFO data to the cloud server, so that R&D personnel or debugging personnel can quickly locate the defect problem of the printing signal card according to the printed product defects and its corresponding encoder data, status register data, output control quantity data and other FIFO data to debug the printing signal card, which greatly improves the debugging efficiency of the printing signal card. R&D personnel or debugging personnel do not need to arrive at the site, which greatly saves after-sales costs and significantly improves user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0045] Figure 1 The hardware block diagram used by the signal card of the printing device of this application;

[0046] Figure 2 This is a physical schematic diagram of a signal card of a printing device in an embodiment of the present application;

[0047] Figure 3 This is a schematic diagram of the actual measurement of the signal card of the printing device in the embodiment of the present application;

[0048] Figure 4 This is a flow chart of a remote debugging method for a printing device signal card in an embodiment of the present application;

[0049] Figure 5 This is a schematic diagram of the process of reading time series data in an embodiment of the present application;

[0050] Figure 6A schematic diagram of the cloud architecture of the remote debugging method of the printing device signal card in the embodiment of the present application;

[0051] Figure 7 A schematic diagram of a process for obtaining an encoder input signal, an optical trigger signal, and a common digital input signal in a signal card of a printing device in an embodiment of the present application;

[0052] Figure 8 A schematic diagram of a process for remote debugging of a signal card of a printing device according to a functional defect in an embodiment of the present application;

[0053] Fig. 9 A schematic diagram of a process of identifying printed product defects corresponding to printed product image data based on a preset printed product defect recognition model in an embodiment of the present application;

[0054] Fig.10 This is a principle block diagram of a remote debugging device for a signal card of a printing device in an embodiment of the present application;

[0055] Fig.11 It is a schematic diagram of the structure of the computer device in the embodiment of the present application. DETAILED DESCRIPTION

[0056] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be interpreted as limiting the present application.

[0057] It will be understood by those skilled in the art that, unless expressly stated, the singular forms "one", "said", and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate element. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.

[0058] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those generally understood by those skilled in the art to which this application belongs. It should also be understood that terms such as those defined in general dictionaries should be understood to have meanings consistent with those in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless specifically defined as here.

[0059] It will be understood by those skilled in the art that the "client", "terminal" and "terminal device" used herein include both devices with wireless signal receivers, which are devices with only wireless signal receivers without transmission capabilities, and devices with receiving and transmitting hardware, which are devices with receiving and transmitting hardware capable of two-way communication on a two-way communication link. Such devices may include: cellular or other communication devices such as personal computers, tablet computers, which have single-line displays or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service, personal communication system), which can combine voice, data processing, fax and / or data communication capabilities; PDA (Personal Digital Assistant, personal digital assistant), which may include a radio frequency receiver, pager, Internet / intranet access, web browser, notepad, calendar and / or GPS (Global Positioning System, global positioning system) receiver; conventional laptop and / or palmtop computers or other devices, which have and / or include a conventional laptop and / or palmtop computer or other device with and / or including a radio frequency receiver. The "client", "terminal" and "terminal device" used herein may be portable, transportable, installed in a vehicle (air, sea and / or land), or suitable for and / or configured to run locally, and / or in a distributed form, at any other location on the earth and / or in space. The "client", "terminal" and "terminal device" used herein may also be a communication terminal, an Internet terminal, a music / video playing terminal, for example, a PDA, a MID (Mobile Internet Device) and / or a mobile phone with a music / video playing function, or a smart TV, a set-top box and other devices.

[0060] The hardware referred to by the names such as "server", "client", and "service node" in this application is essentially an electronic device with the equivalent capabilities of a personal computer. It is a hardware device with the necessary components revealed by the von Neumann principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device. The computer program is stored in its memory, and the central processing unit calls the program stored in the external memory into the internal memory for execution, executes the instructions in the program, and interacts with the input and output devices to complete specific functions.

[0061] It should be pointed out that the concept of "server" referred to in this application can also be extended to the case of server clusters. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided. In physical space, these servers can be independent of each other but can be called through interfaces, or integrated into a physical computer or a set of computer clusters. Those skilled in the art should understand this flexibility, and should not use it to restrict the implementation of the network deployment method of this application.

[0062] Unless expressly specified, one or more technical features of the present application can be deployed on a server for implementation and accessed by a client through a remote call to obtain an online service interface provided by the server, or can be directly deployed and run on a client for access.

[0063] The neural network models referenced or may be referenced in this application, unless expressly specified, can be deployed on a remote server and remotely called on the client, or can be deployed and directly called on a client with sufficient device capabilities. In some embodiments, when it runs on the client, its corresponding intelligence can be obtained through transfer learning to reduce the requirements for the client's hardware operating resources and avoid excessive occupation of the client's hardware operating resources.

[0064] Unless explicitly specified, the various data involved in this application can be stored remotely on a server or on a local terminal device, as long as it is suitable for being called by the technical solution of this application.

[0065] Those skilled in the art should be aware that, although the various methods of the present application are described based on the same concept and thus present commonality to each other, unless otherwise specified, these methods can be independently executed. Similarly, for each embodiment disclosed in the present application, they are all proposed based on the same inventive concept, therefore, concepts with the same expression, and concepts that are appropriately changed for convenience despite different expressions, should be understood as equivalent.

[0066] Unless the mutually exclusive relationship between the embodiments to be disclosed in this application is explicitly stated, the relevant technical features involved in each embodiment can be cross-combined to flexibly construct a new embodiment, as long as such combination does not deviate from the creative spirit of this application and can meet the needs of the prior art or solve certain deficiencies in the prior art. Those skilled in the art should be aware of this flexibility.

[0067] See also Figure 1 , Figure 2 as well as Figure 3 The printing equipment signal card in the printing equipment is generally inserted into the PCIE slot of the industrial computer, and exchanges data with the host computer in the industrial computer through the PCIE interface. The printing equipment signal card can use large-scale programmable logic devices (Fielded Programmable Gate Arrays, FPGA) to store the control data transmitted by the industrial computer and generate various control signals required by the printing equipment. The control signal includes one or more control signals such as light triggering and rejection.

[0068] Based on the above exemplary scenarios, please refer to Figure 4 In one embodiment, the printing device signal card remote debugging method of the present application includes the following steps:

[0069] Step S10, in response to the remote debugging instruction of the printing device signal card, the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold value, and when it exceeds, triggers an interrupt signal and sends it to the industrial computer to determine the interrupt source, wherein the FIFO data includes one or more of the encoder data, status register data, and output control quantity data at each trigger input point in the printing device signal card;

[0070] The terminal device of the printing equipment signal card debugging personnel can respond to the remote debugging instructions of the printing equipment signal card. The FPGA chip in the printing equipment signal card stores FIFO data such as encoder data, status register data, output control quantity data, etc. at each trigger input point of the printing equipment signal card in chronological order. Before the FIFO data such as encoder data, status register data, output control quantity data, etc. are about to be full, an interrupt signal is generated, and the PCIE interface bridge chip in the industrial computer is used to notify the host computer in the industrial computer to take away the FIFO data such as encoder data, status register data, output control quantity data, etc.

[0071] Specifically, the terminal device can respond to the remote debugging instruction of the printing device signal card, and the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold. When it exceeds, an interrupt signal is triggered and sent to the PCIE interface bridge chip in the industrial computer to determine the interrupt source. The FIFO data includes one or any multiple of the encoder data, status register data and output control quantity data at each trigger input point in the printing device signal card;

[0072] Step S20, the host computer in the industrial computer obtains the encoder data, status register data and time series data corresponding to the output control amount data in the FIFO data according to the interrupt source, and uploads it to the cloud server;

[0073] After the PCIE interface bridge chip in the industrial computer obtains the interrupt signal triggered by the FPGA chip, the host computer in the industrial computer is triggered to execute the user callback function based on the interrupt signal through the driver, and the status register in the FPGA chip is read to determine the interrupt source. The host computer in the industrial computer obtains the encoder data, status register data and output control quantity data in the FIFO data according to the interrupt source, and uploads it to the cloud server.

[0074] In some embodiments, see Figure 5 In the industrial computer, in order to meet the requirement of real-time reading of the recorded data inside the FPGA chip, the host computer in the industrial computer adopts multi-threading technology and specially opens up a thread to handle the interrupt response and real-time data reading of the printing device signal card. The FPGA chip on the printing device signal card records the real-time data sequence in chronological order, that is, the encoder count value, status register data, output control quantity and other FIFO data at each trigger input point in the printing device signal card. When the FIFO data is about to be full, the host computer in the industrial computer is notified to read through an interrupt. The host computer transmits the read real-time data sequence to the cloud through the Internet and saves it in the MySQL database.

[0075] In some embodiments, the host computer of the industrial computer can also upload other auxiliary data, such as the number of scrap values ​​that have occurred, etc. This will make it easier to perform data analysis in the cloud, further enrich and improve the cloud remote debugging function of the signal card, and help discover deeper signal card function defects.

[0076] In some embodiments, see Figure 6The cloud server can be developed based on the Springboot architecture and written in Java. It uses Redis to cache the real-time data sent by the industrial computer host computer through Socket communication to meet the real-time requirements. The real-time data is finally written to the MySQL database. A data analysis class is designed in the cloud. On the one hand, Java language programming can be used to implement simple data processing and analysis and comparison. On the other hand, an interface is provided to transmit the data of the MySQL database to the Python algorithm through the Local Socket communication inside the cloud server, which is convenient for expanding and implementing complex big data analysis algorithms.

[0077] Step S30, detecting whether the time series data conforms to the process template data preset in the cloud server, and triggering a fault warning if the time series data does not conform to the preset process template data;

[0078] After the host computer in the industrial computer uploads the time series data corresponding to the encoder data, status register data and output control quantity data in the FIFO data to the cloud server, it detects whether the time series data conforms to the process template data preset in the cloud server. If the time series data does not conform to the preset process template data, a fault warning is triggered.

[0079] In some embodiments, the process template data is defined according to different measured application scenarios. Technical personnel in this field can determine the process template data as needed based on actual conditions. During the development and debugging process, the process template data for the normal operation of the printing equipment is defined according to the specific measured application scenarios.

[0080] An example of one application scenario is given below, which does not constitute a limitation on the present application: (1) The first light trigger input signal TrigIN1 in the printing device prompts that the printed product has arrived at the first station; (2) After 10,000 encoder pulses, the printed product will arrive at the second station. At this time, a trigger signal TrigOUT1 is given to trigger the camera flash to take a picture. The flash is on for 500 encoder pulses; (3) When a printed product defect is identified based on the printed product defect recognition model, the encoder value at the rejection point is written into the FIFO data inside the FPGA chip; (4) When the second light trigger signal TrigIN2 is input, the printed product arrives at the rejection point, and the real-time encoder value is compared with the rejection FIFO data value. When the real-time encoder value is larger, the rejection trigger signal TrigOUT2 is output immediately.

[0081] In the above application scenario, the process template data is: encoder value EncVal1 at TrigIN1, encoder value EncVal1+10000 at TrigOUT1, trigger output signal width value is 500, encoder value EncVal2 at TrigIN2, and reject FIFO encoder value EncFIFOVal2.

[0082] It is detected whether the time series data conforms to the process template data preset in the cloud server, and if the time series data does not conform to the preset process template data, a fault warning is triggered.

[0083] Step S40: determining the functional defect corresponding to the printing device signal card according to the fault warning, and performing remote debugging of the printing device signal card according to the functional defect.

[0084] The terminal device of the debugging personnel of the printing equipment signal card determines the corresponding functional defects of the printing equipment signal card according to the fault warning, and performs remote debugging of the printing equipment signal card according to the functional defects. The terminal device of the debugging personnel of the printing equipment signal card only needs to receive the data uploaded by the printing equipment signal card in real time, and then analyze the encoder count value, status register data, output control quantity data and other time series data at each trigger input point in the printing equipment signal card according to the data characteristics of the process template, so as to determine whether the printing equipment signal card is working normally and realize remote debugging.

[0085] On the basis of any embodiment of the present application, in response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds the preset threshold, the following steps are included:

[0086] The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card;

[0087] The FPGA chip stores the encoder data, status register data and output control quantity data at each trigger input point in the printing device signal card in chronological order according to the encoder input signal, light trigger signal and ordinary digital input signal.

[0088] It can be seen from the above embodiments that, compared with the prior art, the present application aims at the problem that the printing device signal card in the prior art is abnormal, and after-sales personnel need to arrive at the site to debug the printing device signal card, which not only makes it impossible to quickly locate and solve the problem, but also easily leads to user complaints, and the debugging process of the printing device signal card is time-consuming and labor-intensive, resulting in a longer debugging cycle and low efficiency. The present application includes but is not limited to the following beneficial effects:

[0089] First, the printing equipment signal card remote debugging method of the present application can effectively solve the problem that the printing equipment signal card needs to be debugged on-site. R&D personnel or debugging personnel do not need to go to the equipment testing site in person to troubleshoot errors, which greatly saves manpower and material resources and greatly facilitates the R&D and debugging work of the printing equipment signal card.

[0090] Secondly, the remote debugging method of the printing device signal card of the present application does not require R&D personnel or debugging personnel to arrive at the site. The FIFO data such as encoder data, status register data, output control quantity data, etc. of the printing device signal card can be obtained through the cloud server, which can quickly locate the defect problem of the printing signal card, greatly improving the debugging efficiency of the printing signal card. R&D personnel or debugging personnel do not need to arrive at the site, which greatly saves after-sales costs;

[0091] Furthermore, the present application identifies the printed product defects corresponding to the printed product based on the printed product defect recognition model, and transmits the printed product defects corresponding to the printed product and its corresponding encoder data, status register data, output control quantity data and other FIFO data to the cloud server, so that R&D personnel or debugging personnel can quickly locate the defect problem of the printing signal card according to the printed product defects and its corresponding encoder data, status register data, output control quantity data and other FIFO data to debug the printing signal card, which greatly improves the debugging efficiency of the printing signal card. R&D personnel or debugging personnel do not need to arrive at the site, which greatly saves after-sales costs and significantly improves user experience.

[0092] Specifically, see Figure 7 The FPGA chip can obtain the encoder input signal, light trigger signal and ordinary digital input signal in the printing equipment signal card. All input signals will eventually be sent to the FPGA chip for processing. The FPGA chip stores the encoder data, status register data and output control quantity data at each trigger input point in the printing equipment signal card in chronological order according to the encoder input signal, light trigger signal and ordinary digital input signal.

[0093] On the basis of any embodiment of the present application, in response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds the preset threshold, the following steps are included:

[0094] The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card;

[0095] The encoder input signal, the optical trigger signal and the common digital input signal in the printing device signal card are delayed and filtered to avoid false triggering.

[0096] Specifically, the FPGA chip can obtain the encoder input signal, light trigger signal and ordinary digital input signal in the printing device signal card. The encoder input signal, light trigger signal and ordinary digital input signal in the printing device signal card will first be delayed and filtered to avoid false triggering, which is particularly important for industrial applications. This delay value can be set to a timer count value or an encoder count value.

[0097] On the basis of any embodiment of the present application, in response to a remote debugging instruction of a printing device signal card, the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold, and when it exceeds, triggers an interrupt signal and sends it to a PCIE interface bridge chip in an industrial computer, comprising the following steps:

[0098] The FPGA chip triggers an interrupt signal and transmits it to the PCI E interface bridge chip in the industrial computer;

[0099] The FPGA chip triggers the host computer in the industrial computer to execute a user callback function based on the driver program. The host computer reads the status register in the FPGA chip to determine the interrupt source to obtain the time series data corresponding to the encoder data, status register data and output control quantity data in the FIFO data in the FPGA chip.

[0100] Specifically, the FPGA chip in the printing device signal card stores the FIFO data such as encoder data, status register data, output control quantity data, etc. at each trigger input point of the printing device signal card in chronological order. The FPGA chip generates an interrupt signal before the FIFO data such as encoder data, status register data, output control quantity data, etc. are about to be fully stored, and sends the interrupt signal to the PCIE interface bridge chip in the industrial computer to notify the host computer in the industrial computer to take away the FIFO data such as encoder data, status register data, output control quantity data, etc. The FPGA chip triggers the host computer in the industrial computer to execute the user callback function based on the driver program, and the host computer in the industrial computer reads the status register in the FPGA chip to determine the interrupt source, so as to obtain the time series data corresponding to the encoder data, status register data and output control quantity data in the FIFO data in the FPGA chip.

[0101] On the basis of any embodiment of the present application, in response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds the preset threshold, the following steps are included:

[0102] The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card;

[0103] The rising edge or falling edge of the optical trigger signal or the common digital input signal is captured, and the encoder data at each trigger point of the printing device signal card is latched for position comparison.

[0104] Specifically, the FPGA chip can capture the rising edge or falling edge of the optical trigger signal or the ordinary digital input signal, and latch the encoder count value at the trigger point for position comparison. At the same time, the host computer interrupt callback function can also be set for the host computer to read the encoder count value latched at the trigger point, which is convenient for more complex operations.

[0105] Based on any embodiment of this application, please refer to Figure 8 The steps of determining the functional defect corresponding to the printing device signal card according to the fault warning and remotely debugging the printing device signal card according to the functional defect include the following steps:

[0106] Step 401, responding to the debugging instruction of the printing device signal card, obtaining the printed product image data in the printing device;

[0107] Specifically, the image data that needs to be used for printed product defect recognition through the technical solution of this application can be regarded as the printed product image data of this application. The types and sources of the printed product image data described in this application are wide-ranging and can be determined according to the actual application scenario, which is not limited here. The printed product image data can be obtained based on the industrial camera of the printing equipment or other camera equipment, which is not limited here.

[0108] Step 403: identifying printed product defects corresponding to the printed product image data based on a preset printed product defect recognition model;

[0109] Step 405, writing the encoder data at the rejection point corresponding to the defect category of the printed product into the FPGA chip in chronological order;

[0110] Step 407: Determine the functional defect corresponding to the printing device signal card according to the printed product defect and the encoder data at the rejection point corresponding to the printed product defect, and perform remote debugging of the printing device signal card according to the functional defect.

[0111] The first light trigger input signal TrigIN1 in the printing device prompts that the printed product has arrived at the first station; after 10,000 encoder pulses, the printed product will arrive at the second station, at which time a trigger signal TrigOUT1 is given to trigger the camera flash to take a picture, and the flash is on for 500 encoder pulses; based on the printed product defect recognition model, when the printed product defect is identified, the encoder value at the rejection point is written into the FIFO data inside the FPGA chip; when the second light trigger signal TrigIN2 is input, at this time, the printed product arrives at the rejection point, the real-time encoder value is compared with the rejection FIFO data value, and when the real-time encoder value is larger, the rejection trigger signal TrigOUT2 is output immediately.

[0112] Specifically, the printed product defects corresponding to the printed product image data are identified based on a preset printed product defect recognition model; the encoder data at the rejection point corresponding to the printed product defect category is written into the FPGA chip in chronological order; the functional defects corresponding to the printing device signal card are determined based on the printed product defects and the encoder data at the rejection point corresponding to the printed product defects, and the printing device signal card is remotely debugged based on the functional defects.

[0113] In some embodiments, the printed product defect recognition model can be implemented based on an image feature extractor followed by a classifier. When the printed product defect recognition model is trained, printed product image data in a defective state can be collected in advance as sample images, and sample labels are labeled for each training sample. The defects corresponding to the printed product image data of the training sample and the defect types corresponding to the defects are labeled. After the labeling of each training sample is completed, each training sample and its supervisory label can be mapped to construct a training set, and the sample images and sample labels in the sample data set are input. The sample labels represent the defects corresponding to the printed product image data. and the defect type corresponding to the defect, the image feature extractor extracts the deep semantic information of the sample image, and classifies and maps the corresponding classification result according to the deep semantic information to determine whether it represents the defect corresponding to the printed product image data and the defect type corresponding to the defect, calculates the classification loss value of the classification result according to the sample label, and implements gradient update on the printed product defect recognition model when the classification loss value represents non-convergence, and continues to call the next sample image and its sample label from the sample data set to implement iterative training until the model converges. After the iterative training reaches convergence, it can be used to predict the printed product defect corresponding to the printed product image data.

[0114] It is not difficult to understand that to perform print defect recognition on print image data in a printing device, the print image data is first acquired, and the print image data is input into the trained print defect recognition model to obtain the print defect corresponding to the print image data.

[0115] Based on any embodiment of this application, please refer to Fig. 9 The step of identifying the printed product defects corresponding to the printed product image data based on a preset printed product defect recognition model comprises the following steps:

[0116] Step 100: extracting image feature information of each printed product image data based on a convolutional neural network in a preset printed product defect recognition model;

[0117] A preset printed product defect recognition model is used to perform printed product defect recognition on each of the printed product image data. The convolution network in the model generally includes multiple convolution layers, each of which includes multiple convolution kernels (also called filters). Each convolution kernel has a different weight corresponding to it, which is used to extract different image features. These convolution kernels scan the entire image frame from left to right and from top to bottom in sequence to extract the corresponding image feature information. In this process, the shallow layer, i.e., the front convolution layer in the convolution network extracts the shallow image features corresponding to the image frame, including local and detail information, such as: the color, texture, edge, contour and other information of the image frame, which has a small receptive field layer by layer, i.e., each pixel of the output feature map only uses a very small range of the input image frame. After that, the receptive field of the subsequent convolution layer is enlarged layer by layer as a deep layer, and the deep image features corresponding to the image frame are extracted, including more complex and abstract information. Accordingly, after the operation of all convolution layers and the fusion of the shallow image features and the deep image features, the abstract representation of the image frame at different scales, i.e., the image feature information, is obtained.

[0118] Step 200: Fully connect the image feature information based on the classifier in the preset printed product defect recognition model to obtain the classification probabilities corresponding to the mapping to the preset multiple printed product defects;

[0119] The classifier may be an MLP (multi-layer perceptron), which includes an input layer, a hidden layer, and an output layer. The specific number of hidden layers can be flexibly set by a person skilled in the art. The layers in a multi-layer perceptron are fully connected. The input layer receives the image feature information and inputs it into the hidden layer. Through the activation function corresponding to the hidden layer, the image feature information is classified and mapped to a preset binary classification space. The output of the last hidden layer is normalized through the activation function of the output layer, and the classification probabilities corresponding to the first and second space mapped to the binary classification space are calculated. The first space represents a binary value "1", and the second space represents a binary value "0". The activation function may be flexibly set by a person skilled in the art. The activation function corresponding to the hidden layer may be a ReLU (Rectified Linear Unit) function, etc., and the activation function of the output layer may be a Softmax function or a Sigmord function, etc.

[0120] Step 300: Determine the printed product defect with the largest classification probability as the printed product defect corresponding to the printed product image data.

[0121] Determine whether the maximum classification probability exceeds a preset threshold. When it exceeds the preset threshold, determine the printed product defect with the maximum classification probability as the defect recognition result of the current printed product image data, and determine the printed product defect with the maximum classification probability as the printed product defect corresponding to the printed product image data.

[0122] It can be seen from the above embodiments that the present application identifies the printed product defects corresponding to the printed product based on the printed product defect recognition model, and transmits the printed product defects corresponding to the printed product and its corresponding encoder data, status register data, output control quantity data and other FIFO data to the cloud server, so that R&D personnel or debugging personnel can quickly locate the defect problem of the printing signal card according to the printed product defects and its corresponding encoder data, status register data, output control quantity data and other FIFO data to debug the printing signal card, which greatly improves the debugging efficiency of the printing signal card. R&D personnel or debugging personnel do not need to arrive at the site, which greatly saves after-sales costs and significantly improves user experience.

[0123] See also Fig.10A printing device signal card remote debugging device provided to meet one of the purposes of the present application includes a FIFO data detection module 1100, a FIFO data upload module 1200, a time series data detection module 1300 and a device signal card debugging module 1400. Among them, the FIFO data detection module 1100 is configured to respond to the remote debugging instruction of the printing device signal card, and the FPGA chip detects whether the FIFO data in the FPGA chip exceeds the preset threshold value. When it exceeds, an interrupt signal is triggered and sent to the industrial computer to determine the interrupt source. The FIFO data includes one or any multiple of the encoder data, status register data and output control quantity data at each trigger input point in the printing device signal card; the FIFO data upload module 1200 is configured to enable the host computer in the industrial computer to obtain the encoder data, status register data and output control quantity data in the FIFO data according to the interrupt source. The corresponding time series data, and upload it to the cloud server; the time series data detection module 1300 is configured to detect whether the time series data conforms to the preset process template data in the cloud server. If the time series data does not conform to the preset process template data, a fault warning is triggered; the device signal card debugging module 1400 is configured to determine the corresponding functional defects of the printing device signal card according to the fault warning, and perform remote debugging of the printing device signal card according to the functional defects.

[0124] Based on any embodiment of this application, please refer to Fig.11 Another embodiment of the present application further provides an electronic device, which can be implemented by a computer device, such as Fig.11 As shown, a schematic diagram of the internal structure of a computer device. The computer device includes a processor, a computer-readable storage medium, a memory, and a network interface connected via a system bus. Among them, the computer-readable storage medium of the computer device stores an operating system, a database, and computer-readable instructions. The database may store a control information sequence. When the computer-readable instructions are executed by the processor, the processor can implement a printing device signal card remote debugging method. The processor of the computer device is used to provide computing and control capabilities to support the operation of the entire computer device. The memory of the computer device may store computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor can execute the printing device signal card remote debugging method of the present application. The network interface of the computer device is used to connect and communicate with a terminal. Those skilled in the art can understand that Fig.11 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0125] In this embodiment, the processor is used to execute Fig.10 The memory stores the program code and various data required to execute the above modules or submodules. The network interface is used to transmit data between user terminals or servers. The memory in this embodiment stores the program code and data required to execute all modules / submodules in the printing device signal card remote debugging device of this application, and the server can call the program code and data of the server to execute the functions of all submodules.

[0126] The present application also provides a storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the remote debugging method of the printing device signal card described in any embodiment of the present application.

[0127] The present application also provides a computer program product, including a computer program / instruction, which, when executed by one or more processors, implements the steps of the remote debugging method for a printing device signal card described in any embodiment of the present application.

[0128] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments of the present application can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the aforementioned storage medium can be a computer-readable storage medium such as a disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0129] The above description is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

[0130] To summarize, the present application identifies the printed product defects corresponding to the printed product based on the printed product defect recognition model, and transmits the printed product defects corresponding to the printed product and its corresponding encoder data, status register data, output control quantity data and other FIFO data to the cloud server, so that R&D personnel or debugging personnel can quickly locate the defect problem of the printing signal card according to the printed product defects and its corresponding encoder data, status register data, output control quantity data and other FIFO data to debug the printing signal card, which greatly improves the debugging efficiency of the printing signal card. R&D personnel or debugging personnel do not need to arrive at the site, which greatly saves after-sales costs and significantly improves user experience.

Claims

1. A remote debugging method for a printing device signal card, characterized in that: The steps include: In response to a remote debugging instruction of a printing device signal card, the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold value. When the threshold value is exceeded, an interrupt signal is triggered and sent to the industrial computer to determine the interrupt source. The FIFO data includes one or more of the encoder data, status register data, and output control quantity data at each trigger input point in the printing device signal card; The host computer in the industrial computer obtains the encoder data, status register data and time series data corresponding to the output control quantity data in the FIFO data according to the interrupt source, and uploads it to the cloud server; Detecting whether the time series data conforms to the process template data preset in the cloud server, and triggering a fault warning if the time series data does not conform to the preset process template data; Determining the functional defect corresponding to the printing device signal card according to the fault warning, and performing remote debugging of the printing device signal card according to the functional defect, which includes: Responding to the debugging instruction of the signal card of the printing device, obtaining the image data of the printed product in the printing device; Identifying a printed product defect corresponding to the printed product image data based on a preset printed product defect recognition model; Writing the encoder data at the rejection point corresponding to the defect category of the printed product into the FPGA chip in chronological order; Determine the functional defect corresponding to the signal card of the printing device according to the printed product defect and the encoder data at the rejection point corresponding to the printed product defect, and perform remote debugging of the signal card of the printing device according to the functional defect, which includes: (1) The first light trigger input signal TrigIN1 in the printing device indicates that the printed product has arrived at the first station; (2) After 10,000 encoder pulses, the printed product reaches the second workstation. At this time, a trigger signal TrigOUT1 is given to trigger the camera flash to take a picture. The flash is on for 500 encoder pulses. (3) When a printed product defect is identified based on the printed product defect recognition model, the encoder value at the rejection point is written into the FIFO data inside the FPGA chip. (4) When the second light trigger signal TrigIN2 is input, the printed product reaches the rejection point. The real-time encoder value is compared with the rejection FIFO data value. When the real-time encoder value is larger, the rejection trigger signal TrigOUT is output immediately.

2. The remote debugging method of the printing equipment signal card according to claim 1, characterized in that: In response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds a preset threshold, the method includes the following steps: The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card; The FPGA chip stores the encoder data, status register data and output control quantity data at each trigger input point in the printing device signal card in chronological order according to the encoder input signal, light trigger signal and ordinary digital input signal.

3. The remote debugging method of the printing equipment signal card according to claim 2, characterized in that: In response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds a preset threshold, the method includes the following steps: The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card; The encoder input signal, the optical trigger signal and the common digital input signal in the printing device signal card are delayed and filtered to avoid false triggering.

4. The remote debugging method of the printing equipment signal card according to claim 1, characterized in that: In response to the remote debugging instruction of the printing device signal card, the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold, and when it exceeds, triggers an interrupt signal and sends it to the PCIE interface bridge chip in the industrial computer, including the following steps: The FPGA chip triggers an interrupt signal and transmits it to the PCIE interface bridge chip in the industrial computer; The FPGA chip triggers the host computer in the industrial computer to execute a user callback function based on the driver program. The host computer reads the status register in the FPGA chip to determine the interrupt source to obtain the time series data corresponding to the encoder data, status register data and output control quantity data in the FIFO data in the FPGA chip.

5. The remote debugging method of the printing equipment signal card according to claim 1, characterized in that: In response to the remote debugging instruction of the printing device signal card, before the step of the FPGA chip detecting whether the FIFO data in the FPGA chip exceeds a preset threshold, the method includes the following steps: The FPGA chip obtains the encoder input signal, the light trigger signal and the common digital input signal in the printing device signal card; The rising edge or falling edge of the optical trigger signal or the common digital input signal is captured, and the encoder data at each trigger point of the printing device signal card is latched for position comparison.

6. The remote debugging method of the printing equipment signal card according to claim 1, characterized in that: The step of identifying the printed product defects corresponding to the printed product image data based on a preset printed product defect recognition model comprises the following steps: Extracting image feature information of each of the printed product image data based on a convolutional neural network in a preset printed product defect recognition model; Fully connecting the image feature information based on the classifier in the preset printed product defect recognition model to obtain the classification probabilities corresponding to the mapping thereof to the preset multiple printed product defects; The printed product defect with the largest classification probability is determined as the printed product defect corresponding to the printed product image data.

7. A remote debugging device for a printing equipment signal card, characterized in that: include: A FIFO data detection module is configured to respond to a remote debugging instruction of a printing device signal card, and the FPGA chip detects whether the FIFO data in the FPGA chip exceeds a preset threshold value. When the threshold value is exceeded, an interrupt signal is triggered and sent to the industrial computer to determine the interrupt source. The FIFO data includes one or more of the encoder data, status register data, and output control quantity data at each trigger input point in the printing device signal card; A FIFO data uploading module is configured as a host computer in the industrial computer to obtain the encoder data, status register data and time series data corresponding to the output control quantity data in the FIFO data according to the interrupt source, and upload it to the cloud server; A time series data detection module, configured to detect whether the time series data conforms to the process template data preset in the cloud server, and trigger a fault warning if the time series data does not conform to the preset process template data; The device signal card debugging module is configured to determine the functional defect corresponding to the printing device signal card according to the fault warning, and to perform remote debugging of the printing device signal card according to the functional defect, and includes: Responding to the debugging instruction of the signal card of the printing device, obtaining the image data of the printed product in the printing device; Identifying a printed product defect corresponding to the printed product image data based on a preset printed product defect recognition model; Writing the encoder data at the rejection point corresponding to the defect category of the printed product into the FPGA chip in chronological order; Determine the functional defect corresponding to the signal card of the printing device according to the printed product defect and the encoder data at the rejection point corresponding to the printed product defect, and perform remote debugging of the signal card of the printing device according to the functional defect, which includes: (1) The first light trigger input signal TrigIN1 in the printing device indicates that the printed product has arrived at the first station; (2) After 10,000 encoder pulses, the printed product reaches the second workstation. At this time, a trigger signal TrigOUT1 is given to trigger the camera flash to take a picture. The flash is on for 500 encoder pulses. (3) When a printed product defect is identified based on the printed product defect recognition model, the encoder value at the rejection point is written into the FIFO data inside the FPGA chip. (4) When the second optical trigger signal TrigIN2 is input, the printed product reaches the rejection point. The real-time encoder value is compared with the rejection FIFO data value. When the real-time encoder value is larger, a rejection trigger signal TrigOUT is output immediately.

8. An electronic device, comprising a central processing unit and a memory, characterized in that: The central processing unit is used to call and run the computer program stored in the memory to execute the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: It stores a computer program implemented according to the method described in any one of claims 1 to 6 in the form of computer-readable instructions, and when the computer program is called and executed by a computer, the steps included in the corresponding method are executed.

Images