A replay system for visual inspection process

Abstract

The invention discloses a replay system for a visual detection process, comprising a detection system and a replay system; the detection system comprises a signal docking module, a detection logic module and a replay function module; the replay system comprises a replay interaction module, a replay logic module, a log parsing module and a replay information notification module; the replay interaction module is used to set replay parameters and display replay progress; the replay logic module transmits the replay interval to the log parsing module; the log parsing module transmits the signal in the replay interval to the replay logic module; the replay logic module transmits the signal to different replay information notification modules based on the sequence of signal occurrence; the replay information notification module is respectively connected to the signal docking module and the replay function module in the detection system to reproduce the sequence of signal occurrence; the system utilizes the signal interaction between the detection system and the replay system to more realistically restore the automated signal data flow; the signal receiving process is replayed to facilitate finding program operation loopholes.

Description

Technical Field

[0001] The invention relates to the field of log replay, and in particular to a replay system for a visual inspection process. Background Art

[0002] In the visual inspection scenario, the object to be tested is usually moved to the inspection area by a roller bed / conveyor line. The visual sensor is fixed on the end of the robot and is driven by the robot to a suitable position to collect images of the object to be tested. During this process, the inspection software running in the industrial computer needs to communicate with multiple devices and process the collected images in real time.

[0003] In order to test the cause of the fault, you need to reproduce the detection process. There are two existing reproduction methods:

[0004] Method 1: directly build the environment of the testing site to simulate the actual operation process of the software. Since the visual inspection process involves a large number of automated equipment and signals, and also involves the inspection of multiple types of objects to be tested, it is often difficult to effectively restore the inspection scene in the laboratory environment.

[0005] Method 2: Use program logs to restore the software running process. The program log records the program running process. For this reason, program logs are often used to track the execution of the program to help developers locate problems and debug codes. For various signals in the visual inspection process, especially image acquisition and playback signals, there is a lack of effective connection with the log, resulting in a mismatch between the image playback process and the actual inspection process, affecting the reproduction effect. Summary of the invention

[0006] In order to solve the above technical problems, the present invention provides a replay system for the visual detection process, which utilizes the signal interaction between the detection system and the replay system to more realistically restore the automated signal data flow; and replays the signal receiving process to facilitate finding program operation loopholes.

[0007] To this end, the technical solution of the present invention is as follows:

[0008] A replay system for a visual inspection process, the visual inspection process being recorded in a program log; comprising an inspection system and a replay system;

[0009] The detection system includes a signal docking module, a detection logic module and a replay function module; the signal docking module is used to realize the signal transmission between the external device signal and the detection logic module during the visual detection process; the detection logic module is used to realize the process control, recording and image processing of the detection process; the replay function module is used to realize the reproduction of the detection process in combination with the replay system;

[0010] The replay system includes: a replay interaction module, a replay logic module, a log parsing module and two or more replay information notification modules;

[0011] The playback interaction module is used to set playback parameters and display playback progress. It transmits the set playback parameters to the playback logic module and can display the playback progress transmitted by the playback logic module.

[0012] The replay logic module sets the replay interval based on the received replay parameters and transmits it to the log parsing module;

[0013] The log parsing module is used to parse the signals contained in the program log within the replay interval and transmit them to the replay logic module; the replay logic module transmits the received parsed signals to different replay information notification modules based on the order in which they occur, and at the same time, transmits them to the replay interaction module for display;

[0014] The two or more playback information notification modules are respectively connected to the signal docking module and the playback function module in the detection system to reproduce the signal generation order in the playback interval and transmit it to the detection logic module to reproduce the working process in the playback interval.

[0015] Further, the replay function module includes a replay docking module, an image loading module and an image replay module; the corresponding replay information notification module includes a replay switch notification module, a picture loading notification module, a picture replay notification module and a signal replay notification module;

[0016] Therefore, the signal replay notification module is connected to the signal docking module to reproduce the working process through the detection logic module according to the occurrence order of the internal and external device signals in the replay interval;

[0017] The playback switch notification module is connected to the playback docking module, and is used to obtain the playback function on / off information from the playback logic module, and transmit it to the detection logic module through the playback docking module;

[0018] The image loading notification module is connected to the image loading module to send the corresponding vehicle passing record and the detected position of the image to be loaded in the playback interval to the image loading module, and then the image loading module loads the image from the corresponding image storage path;

[0019] The image acquisition and replay notification module is connected to the image replay module, and the image replay module is connected to the image loading module, and is used to obtain the image collected within the replay interval and transmit it to the detection logic module for processing.

[0020] Furthermore, the replay parameters are: replay mode on / off, replay period, program log storage path and image storage path.

[0021] Furthermore, the external device signal includes: a signal indicating that the object to be tested has arrived, a signal indicating that the robot has arrived, a signal indicating that the image acquisition has been completed, and a signal indicating that the object to be tested has left; the program log includes the above external device signals and timestamps accordingly.

[0022] Furthermore, the replay logic module is also provided with: a replay clock module, which is used to calculate the time interval between the timestamp recorded in the program log and the playback time, and use the time interval to set the replay time for each signal in turn. When the signal is replayed, when the signal reaches the replay time, it is sent out and displayed in the replay interaction module.

[0023] Preferably, the external device signal includes a signal that the object to be tested has arrived and a signal that image acquisition is completed;

[0024] The object-to-be-tested arrival signal includes the object-to-be-tested encoding information, which can index the object to be tested;

[0025] The image acquisition completion signal includes the visual sensor coding information and the detection posture number information, which can index the detection posture of the visual sensor;

[0026] The detection logic module matches the image with the coding information of the object to be detected, the coding information of the visual sensor and the detection posture number information, and stores them in the specified image storage path.

[0027] Preferably, the replay logic module is provided with: an object to be tested detection module, which is used to batch extract all signals from the arrival signal to the departure signal of a single object to be tested from the signal sent from the log analysis module, taking the object to be tested as a unit, uniformly identify these signals and set the replay time of the signals in turn; when the signal reaches the replay time, it is sent out and displayed on the replay interaction module.

[0028] Preferably, the playback interaction module includes a configuration area and a status area, wherein the configuration area is used to set and display playback parameters; and the status area is used to display a playback signal-time list.

[0029] In order to speed up the playback speed, preferably, the configuration area is also used to display and set: the playback speed is n;

[0030] The playback logic module is provided with a speed control module, which compresses the playback time interval between different signals into 1 / n times according to the playback speed n set in the configuration area when the signal is played back;

[0031] Preferably, the configuration area is also used to display and set: the interval time S;

[0032] The replay logic module is also provided with an interval control module, which limits the maximum time interval between the replay time of the last object to be tested leaving signal and the next object to be tested arriving signal according to the interval time S set in the configuration area during signal replay;

[0033] More preferably, the configuration area is further used to display and set: image playback advance time t;

[0034] The replay logic module is also provided with: an image advance control module. When the signal is replayed, it advances the replay time of the image acquisition completion signal at the kth detection posture by k×t seconds according to the image replay advance time t set in the configuration area, where k=1, 2...M, and M represents the number of detection postures.

[0035] Preferably, the configuration area is also used to display and select: a list of test object selections and a start / stop button for the playback process; the list of test object selections is used for the user to select the test object to be played back; the start / stop button for the playback process is used to start or pause the playback system, and correspondingly to make the detection logic module load or stop loading images from the stored images;

[0036] The status area is also used to display the model of the object to be tested that is currently being played back;

[0037] The replay logic module selects the signal corresponding to the object to be tested selected in the object to be tested selection list from the signal sent by the log analysis module, replays the signal and displays it in the status area.

[0038] This playback system does not require the construction of a complex on-site workstation environment and has the following features:

[0039] Not dependent on the workstation environment;

[0040] No reliance on automated communication equipment;

[0041] No reliance on sensor devices;

[0042] Not dependent on network equipment such as cables / switches.

[0043] This system can effectively reproduce various signals in the visual inspection process, replay the image acquisition and image processing process, and is fast and easy to implement.

[0044] When the system replays the signal, it achieves:

[0045] The order in which the objects to be tested are placed is consistent with the program log;

[0046] The timing of the robot arriving at the location (robot position and posture) is consistent with the program log;

[0047] The timing of sensor image acquisition and image calculation is consistent with the on-site situation.

[0048] In addition, the introduction of repeated speed control, advance image acquisition control, and interval control in the replay logic module can further shorten the event replay time and speed up the replay process.

[0049] The visual inspection process focuses more on the image acquisition and processing process, which is also the focus of the replay process. This system pre-loads the image through the image loading module. When the image acquisition is completed and the signal is replayed, the image is immediately passed to the detection logic module for processing, thus achieving short replay time and high efficiency while ensuring the accuracy of the image acquisition and processing replay timing.

[0050] Furthermore, the system also shortens the time consumption of other automated processes as much as possible. For example, in the process of visual inspection of automobiles, the inspection interval between two adjacent vehicles is not fixed. When the production line is stopped, the interval between the arrival time of two adjacent vehicles may be as long as several hours. The system can strictly limit the arrival time of two vehicles to be tested through interval control, ensuring the efficient progress of the signal replay process.

[0051] For example, during visual inspection, the robot's moving trajectory and posture correction all take time. This system advances the image replay time by t, reduces the waiting time for posture de-jittering after the robot is in place, and reduces the time consumption of the camera image acquisition process, thereby speeding up the replay of the image processing process. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 It is a schematic diagram of the detection system and the playback system structure;

[0053] Figure 2 It is a structural block diagram of the detection system and the playback system in a specific implementation mode;

[0054] Figure 3 This is a schematic diagram of a playback interface in a specific implementation mode;

[0055] Figure 4 This is a schematic diagram of the playback time consumption at 1x speed in Example 1;

[0056] Figure 5 This is a schematic diagram of the playback time consumption at 2x speed in Example 2;

[0057] Figure 6 This is a schematic diagram of playback time consumption in Example 3 at 2x speed, interval time S=5s, and advance time t=2.5s. DETAILED DESCRIPTION

[0058] The technical solution of the present invention is described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0059] A replay system for a visual inspection process that is recorded in a program log; Figure 1 As shown, it includes a detection system and a playback system;

[0060] Among them, the detection system includes a signal docking module, a detection logic module and a replay function module; the signal docking module is used to realize the signal transmission between the external device signal and the detection logic module during the visual detection process; the detection logic module is used to realize the process control, recording and image processing of the detection process; the replay function module is used to realize the reproduction of the detection process in combination with the replay system;

[0061] The replay system includes: a replay interaction module, a replay logic module, a log parsing module and two or more replay information notification modules;

[0062] The playback interaction module is used to set playback parameters and display playback progress. It transmits the set playback parameters to the playback logic module and can display the playback progress transmitted by the playback logic module.

[0063] The replay logic module sets the replay interval based on the received replay parameters and transmits it to the log parsing module;

[0064] The log parsing module is used to parse the signals contained in the program log within the replay interval and transmit them to the replay logic module; the replay logic module transmits the received parsed signals to different replay information notification modules based on the order in which they occur, and at the same time, transmits them to the replay interaction module for display;

[0065] Two or more playback information notification modules are connected to the signal docking module and playback function module in the detection system respectively, and are used to reproduce the signal occurrence order in the playback interval and transmit it to the detection logic module to reproduce the working process in the playback interval.

[0066] Specifically, the replay function module includes a replay docking module, an image loading module and an image replay module; the corresponding replay information notification module includes a replay switch notification module, a picture loading notification module, a picture replay notification module and a signal replay notification module;

[0067] The signal replay notification module is connected to the signal docking module and is used to reproduce the working process through the detection logic module according to the occurrence order of the internal and external device signals in the replay interval;

[0068] The replay switch notification module is connected to the replay docking module and is used to obtain the information of replay function on / off from the replay logic module and transmit it to the detection logic module through the replay docking module;

[0069] The image loading notification module is connected to the image loading module to send the corresponding vehicle passing record and the detected posture of the image to be loaded in the playback interval to it, and then the image loading module loads the image from the corresponding image storage path;

[0070] The image acquisition and replay notification module is connected to the image replay module, and the image replay module is connected to the image loading module, and is used to obtain the images collected within the replay interval and transmit them to the detection logic module for processing.

[0071] In specific implementation, the replay parameters are: replay mode on / off, replay period, program log storage path and image storage path.

[0072] The external device signals include: the arrival signal of the object to be tested, the arrival signal of the robot, the image acquisition completion signal, and the departure signal of the object to be tested; the program log includes the above external device signals and timestamps.

[0073] More specifically, the external device refers to the device used to monitor the arrival / departure of the object to be tested (such as a roller bed), the device that can feedback the robot's position information (such as a robot controller), and the device that can feedback the image acquisition status of the visual inspection equipment (such as a visual sensor).

[0074] In specific implementation, the replay logic module is also provided with: a replay clock module, which is used to calculate the time interval between the timestamp recorded in the program log and the playback time, and use the time interval to set the replay time for each signal in turn. When the signal is replayed, when the signal reaches the replay time, it is sent out and displayed in the replay interaction module.

[0075] The arrival signal of the object under test includes coding information of the object under test, which can index the object under test;

[0076] The image acquisition completion signal contains the visual sensor coding information and the detection posture number information, which can index the detection posture of the visual sensor;

[0077] The detection logic module matches the image with the coding information of the object to be detected, the coding information of the visual sensor and the detection posture number information, and stores them in the specified image storage path.

[0078] In specific implementation, the replay logic module is provided with: an object under test detection module, which is used to batch extract all signals from the arrival signal to the departure signal of a single object under test from the signal sent from the log analysis module, taking the object under test as the unit, uniformly identify these signals and set the replay time of the signals in turn. When the signal reaches the replay time, it is sent out and displayed in the replay interaction module.

[0079] Specifically, Figure 3As shown, the playback interaction module (playback interface) includes a configuration area and a status area. The configuration area is used to set and display playback parameters; the status area is used to display the playback signal-time list (the playback signal and its corresponding time).

[0080] In order to speed up the playback process and shorten the playback time, the configuration area is also used to display and set: playback speed is n;

[0081] The playback logic module is provided with a speed control module. When the signal is played back, it compresses the playback time interval between different signals to 1 / n times according to the playback speed n set in the configuration area;

[0082] In order to further shorten the playback time, the configuration area is also used to display and set: interval time S;

[0083] The replay logic module is also provided with an interval control module, which limits the maximum time interval between the replay time of the last DUT's DUT departure signal and the next DUT's DUT arrival signal according to the interval time S set in the configuration area during signal replay;

[0084] More preferably, the configuration area is further used to display and set: image playback advance time t;

[0085] The replay logic module is also provided with: an image advance control module. When the signal is replayed, it advances the replay time of the acquisition completion signal at the kth detection posture by k×t seconds according to the image replay advance time t set in the configuration area, where k=1, 2...M, and M represents the number of detection postures.

[0086] In order to make the operation more convenient, the configuration area is also used to display and select: the object selection list and the start / stop button of the playback process; the object selection list is used for the user to select the object to be played back; the start / stop button of the playback process is used to start or pause the playback system, and correspondingly make the detection logic module load or stop loading images from the stored images;

[0087] The status area is also used to display the model of the DUT currently being replayed;

[0088] The replay logic module selects the signal corresponding to the object under test selected in the object under test selection list from the signal sent by the log analysis module, replays it and displays it in the status area.

[0089] In order to facilitate the explanation of the specific implementation process of this solution, the following exemplary description is given:

[0090] A replay system for the visual inspection process. During the visual inspection process, batches of objects to be tested are moved to the inspection area in sequence by a mobile device and remain stationary. The robot drives the visual sensor to the specified inspection position according to the set trajectory to collect images of the objects to be tested in the inspection area. The image data is processed by the inspection system to realize the inspection of the objects to be tested.

[0091] The detection system includes: a detection logic module and a signal docking module that communicate with each other; wherein the signal docking module is used to receive the arrival signal of the object to be detected and the arrival signal of the robot, and then send each signal to the detection logic module; the detection logic module configures the detection parameters (such as the image acquisition parameters of the visual sensor, the robot de-jitter delay, etc.) according to the received arrival signal of the object to be detected; according to the detection parameters and the arrival signal of the robot, a start image acquisition signal is sent to the visual sensor; after the image acquisition, the visual sensor sends the image and the image acquisition completion signal to the detection logic module; the detection logic module calculates the image and stores it in the specified image storage path; and sends a continue moving signal to the robot through the signal docking module; when all images are acquired, a departure signal of the object to be detected is sent to the mobile device, and the object to be detected leaves;

[0092] During this period, the external device signals (the arrival signal of the object to be tested, the arrival signal of the robot, the completion signal of image acquisition, and the departure signal of the object to be tested) and their corresponding timestamps are recorded in the program log;

[0093] For signal replay, Figure 2 As shown, the detection system (a system used in actual detection or a system that restores the actual system in one-to-one ratio) also includes: an image loading module, a replay docking module and an image replay module for docking with the replay system; wherein the image replay module is connected to the image loading module and the detection logic module respectively, and the replay docking module is connected to the detection logic module;

[0094] The replay system includes a replay logic module and a replay interaction module (replay interface), a replay switch notification module, a log parsing module, a signal replay notification module, a picture acquisition loading notification module and a picture acquisition replay notification module, which are respectively connected to the replay logic module; wherein the signal replay notification module communicates with the signal docking module, the picture acquisition loading notification module communicates with the image loading module, the picture acquisition replay notification module communicates with the image replay module, and the replay switch notification module communicates with the replay docking module;

[0095] The playback interaction module (playback interface) includes a configuration area and a status area. The configuration area is used to display and set the playback mode switch, playback period, program log storage path and image storage path; the status area is used to display the signal list for playback (signal and corresponding playback time);

[0096] The playback mode switch is used to turn the playback system on / off;

[0097] When signal replay is required, the replay mode switch is set to on, and the replay logic module sends the replay period and program log storage path set in the configuration area to the log parsing module; the log parsing module extracts the signal within the replay period from the program log of the corresponding path and sends it to the replay logic module;

[0098] At the same time, the replay logic module sends a replay start notification to the replay docking module through the replay switch notification module, and the replay docking module then forwards the replay start notification to the detection logic module to notify the detection logic module that the replay process has been turned on. The subsequent received signal is a replay signal, and there is no need to send a signal to the visual sensor, robot, and mobile device;

[0099] The playback logic module identifies each signal to be played back in turn and displays the signal in the status area;

[0100] When the replay logic module identifies the arrival signal of the object to be tested, the arrival signal of the robot, and the departure signal of the object to be tested, it sends the signal to the signal docking module through the signal replay notification module, and the signal docking module then sends the signal to the detection logic module to realize the replay of the signal receiving process of the detection system;

[0101] When the replay logic module recognizes the robot in place signal, it sends a loading signal and an image storage path to the image loading module through the image loading notification module. After receiving the loading signal, the image loading module loads the image from the corresponding image storage path;

[0102] When the replay logic module recognizes the image acquisition completion signal, it sends a replay signal to the image replay module through the image acquisition replay notification module, notifying the image replay module to send the loaded image to the detection logic module for calculation, thereby realizing the replay of the detection system image calculation process;

[0103] When the playback logic module has identified all signals within the playback period, the display signal in the status area is no longer updated;

[0104] The replay mode switch is set to off, and the replay logic module sends a replay shutdown notification to the replay docking module through the replay switch notification module. The replay docking module then forwards the replay shutdown notification to the detection logic module to notify the detection logic module that the replay process is closed.

[0105] Accordingly, in this embodiment, a replay method for a visual inspection process is provided, comprising the following steps:

[0106] 1) Configure the replay parameters on the replay interface. When signal replay is required, set the replay mode switch to on and start the replay system. The replay parameters include the replay period, program log storage path, and image storage path.

[0107] 2) The replay system extracts the signal within the replay period from the program log of the corresponding path, and sends a replay start notification to the detection system, notifying the detection system that the replay process has been started. The subsequent received signal is the replay signal, and there is no need to send a signal to the visual sensor, robot, and mobile device;

[0108] At the same time, the playback system identifies each signal to be played back in turn and displays the signal on the playback interface;

[0109] When the replay system recognizes the arrival signal of the object to be tested, the arrival signal of the robot, and the departure signal of the object to be tested, the signal is sent to the detection system to realize the replay of the signal receiving process of the detection system;

[0110] At the same time, when the replay system recognizes the robot's arrival signal, it sends a loading signal and an image storage path to the detection system. After receiving the loading signal, the detection system loads the image from the corresponding image storage path.

[0111] When the replay system recognizes the image acquisition completion signal, it sends a replay signal to the detection system, notifying the detection system to calculate the loaded image, thereby realizing the replay of the image calculation process of the detection system;

[0112] When the playback system has identified all signals within the playback period, the display signal in the status area will no longer be updated;

[0113] The replay mode switch is set to off, and the replay system sends a replay shutdown notification to the detection system, notifying the detection system that the replay process is closed.

[0114] In order to show the improvement of playback efficiency by playback speed, interval time S, and image playback advance time t, the following example is used to explain in detail:

[0115] Example 1:

[0116] like Figure 4 As shown, taking two vehicles to be tested (vehicle 1 and vehicle 2) being positioned in the detection area in sequence by mobile equipment as an example, robot 1 drives acquisition device 1 (visual sensor 1) to arrive at detection positions P1 and P2 in sequence according to the set trajectory to collect images of the objects to be tested in the detection area, and robot 2 drives acquisition device 2 (visual sensor 2) to arrive at detection positions P1 and P2 in sequence according to the set trajectory to collect images of the objects to be tested in the detection area. Figure 4 The detection process in the figure shows the arrival time of robots 1 and 2 at the detection positions P1 and P2, respectively, and the completion time of image acquisition. Specifically, taking vehicle 1 as an example, the signals (events) and timestamps recorded in the program log are as follows:

[0117] a) 09-30 09:00:00.0 Vehicle 1 arrives (the object to be tested arrives), 09-30 09:00:45.0 Vehicle 1 leaves (the object to be tested leaves);

[0118] b) 09-30 09:00:05.0 Equipment 1 posture P1 is in place (robot is in place), 09-30 09:00:10.0 Equipment 1 posture P1 image acquisition is completed, 09-30 09:00:25.0 Equipment 1 posture P2 is in place, 09-30 09:00:30.0 Equipment 1 posture P2 image acquisition is completed;

[0119] c) 09-30 09:00:07.5 Equipment 2 posture P1 is in place, 09-30 09:00:12.5 Equipment 2 posture P1 image acquisition is completed, 09-30 09:00:27.5 Equipment 1 posture P2 is in place, 09-30 09:00:32.5 Equipment 1 posture P2 image acquisition is completed;

[0120] Figure 4 The replay process in the figure shows the arrival time of robots 1 and 2 at the detection positions P1 and P2 respectively, and the completion time of image acquisition when the signal is replayed;

[0121] During replay, the UUT detection module extracts all signals from the arrival signal to the departure signal of a single UUT in batches from the signals sent by the log parsing module, taking the UUT as the unit, identifies these signals uniformly and sets the replay time of the signals in sequence. When the signal reaches the replay time, it is sent out and displayed on the replay interface;

[0122] Among them, the playback clock module calculates the time interval between the timestamp (such as) recorded in the program log and the playback time (the time interval between 09-30 18:00:00 and 09-30 09:00:00.0 is 00-0009:00:00), and uses the time interval to set the playback time for each signal in turn. When the signal is played back, when the signal reaches the playback time, it is sent out and displayed on the playback interface, such as Figure 4 In the playback process, taking vehicle 1 as an example, the playback time of each signal is as follows:

[0123] a) 09-30 18:00:00.0 Vehicle 1 arrived, 09-30 18:00:45.0 Vehicle 1 left

[0124] b) 09-30 18:00:05.0 Device 1 Pose P1 is in place, 09-30 18:00:10.0 Device 1 Pose P1 is collected, 09-30 18:00:25.0 Device 1 Pose P2 is in place, 09-30 18:00:30.0 Device 1 Pose P2 is collected

[0125] c) 09-30 18:00:07.5 Equipment 2 posture P1 is in place, 09-30 18:00:12.5 Equipment 2 posture P1 image acquisition is completed, 09-30 18:00:27.5 Equipment 1 posture P2 is in place, 09-30 18:00:32.5 Equipment 1 posture P2 image acquisition is completed;

[0126] In this example 1, the signal recording timing of the detection process is restored one-to-one.

[0127] Example 2:

[0128] Compared with Example 1, in Example 2, the playback speed is 2 times. During the playback process, the playback time interval between the signal of the object to be tested in place and the signal of the robot in place, the playback time interval between the signals of the same robot in place, and the playback time interval between the signal of the robot in place and the signal of image acquisition completion are all compressed to 1 / 2.

[0129] Specifically, Figure 5 As shown, the playback time of each signal is as follows:

[0130] a) 09-30 18:00:00.0 Vehicle 1 arrived, 09-30 18:00:22.5 Vehicle 1 left;

[0131] b) 09-30 18:00:02.5 Equipment 1 posture P1 is in place, 09-30 18:00:05.0 Equipment 1 posture P1 image acquisition is completed, 09-30 18:00:12.5 Equipment 1 posture P2 is in place, 09-30 18:00:15.0 Equipment 1 posture P2 image acquisition is completed;

[0132] c) 09-30 18:00:03.8 Equipment 2 posture P1 is in place, 09-30 18:00:06.8 Equipment 2 posture P1 image acquisition is completed, 09-30 18:00:13.8 Equipment 1 posture P2 is in place, 09-30 18:00:16.3 Equipment 1 posture P2 image acquisition is completed;

[0133] In this example 2, the playback is performed at 2 times the speed, which reduces the playback time by half and speeds up the playback process.

[0134] Example 3:

[0135] Based on Example 2, this example further sets the interval time S=5s, and the interval control module limits the maximum time interval between the departure signal of the last object to be tested and the playback time of the arrival signal of the next object to be tested to 5s; because the speed is doubled, the interval between the arrival time of vehicle 2 and the departure time of vehicle 1 is finally 2.5s;

[0136] In addition, this example also sets the image replay advance time t=2.5s in the configuration area; the image advance control module in the replay logic module advances the replay time of the image acquisition completion signal at the kth detection posture by k×t seconds according to the image replay advance time t=2.5s, where k=1,2...M, and M represents the number of detection postures.

[0137] Specifically, with Figure 4 In comparison, if only the image playback advance time t = 2.5s is set, the playback time of each signal is as follows:

[0138] a) 09-30 18:00:00.0 Vehicle arrived, 09-30 18:00:40.0 Vehicle left

[0139] b) 09-30 18:00:05.0 Equipment 1 posture P1 is in place, 09-30 18:00:07.5 Equipment 1 posture P1 image acquisition is completed, 09-30 18:00:22.5 Equipment 1 posture P2 is in place, 09-30 18:00:25.0 Equipment 1 posture P2 image acquisition is completed;

[0140] c) 09-30 18:00:07.5 Equipment 2 posture P1 is in place, 09-30 18:00:10.0 Equipment 2 posture P1 image acquisition is completed, 09-30 18:00:25.0 Equipment 1 posture P2 is in place, 09-30 18:00:27.5 Equipment 1 posture P2 image acquisition is completed;

[0141] On this basis, after 2 times the speed, Figure 6 As shown, the playback time of each signal is as follows:

[0142] a) 09-30 18:00:00.0 Vehicle 1 arrived, 09-30 18:00:20.0 Vehicle 1 left;

[0143] 09-30 18:00:22.5 Vehicle 2 is in place (S=5s is compressed to 1 / 2);

[0144] b) 09-30 18:00:02.5 Equipment 1 posture P1 is in place, 09-30 18:00:03.8 Equipment 1 posture P1 image acquisition is completed, 09-30 18:00:11.3 Equipment 1 posture P2 is in place, 09-30 18:00:12.5 Equipment 1 posture P2 image acquisition is completed;

[0145] c) 09-30 18:00:03.8 Equipment 2 posture P1 is in place, 09-30 18:00:05.0 Equipment 2 posture P1 image acquisition is completed, 09-30 18:00:12.5 Equipment 1 posture P2 is in place, 09-30 18:00:13.8 Equipment 1 posture P2 image acquisition is completed;

[0146] This example further shortens the signal replay time and improves the replay efficiency by setting the interval time S=5s and the image replay advance time t=2.5s.

[0147] In specific implementation, it is not limited to the above three examples, and the execution speed of the replay process can be selected in combination with actual conditions.

[0148] The foregoing description of the specific exemplary embodiments of the present invention is presented for the purpose of illustration and description. The foregoing description is not intended to be exhaustive, nor is it intended to limit the present invention to the precise form disclosed, and it is apparent that many changes and variations are possible in light of the above teachings. The exemplary embodiments are selected and described to explain the specific principles of the present invention and its practical application, so that other technicians in the field can realize and utilize the various exemplary embodiments of the present invention and its different selected forms and modified forms. The scope of the present invention is intended to be limited by the appended claims and their equivalents.

Claims

1. A replay system for a visual inspection process, the visual inspection process being recorded in a program log; characterized in that: Including detection system and playback system; The detection system includes a signal docking module, a detection logic module and a replay function module; the signal docking module is used to realize the signal transmission between the external device signal and the detection logic module during the visual detection process; the detection logic module is used to realize the process control, recording and image processing of the detection process; The replay function module is used to realize the reproduction of the detection process in combination with the replay system; The replay system includes: a replay interaction module, a replay logic module, a log parsing module and two or more replay information notification modules; The playback interaction module is used to set playback parameters and display playback progress. It transmits the set playback parameters to the playback logic module and can display the playback progress transmitted by the playback logic module. The replay logic module sets the replay interval based on the received replay parameters and transmits it to the log parsing module; The log parsing module is used to parse the signals contained in the program log within the replay interval and transmit them to the replay logic module; the replay logic module transmits the received parsed signals to different replay information notification modules based on the order in which they occur, and at the same time, transmits them to the replay interaction module for display; The two or more playback information notification modules are respectively connected to the signal docking module and the playback function module in the detection system to reproduce the signal generation order in the playback interval and transmit it to the detection logic module to reproduce the working process in the playback interval.

2. The replay system for visual inspection process as claimed in claim 1, characterized in that: The replay function module includes a replay docking module, an image loading module and an image replay module; the corresponding replay information notification module includes a replay switch notification module, a picture loading notification module, a picture replay notification module and a signal replay notification module; Therefore, the signal replay notification module is connected to the signal docking module to reproduce the working process through the detection logic module according to the occurrence order of the internal and external device signals in the replay interval; The playback switch notification module is connected to the playback docking module, and is used to obtain the playback function on / off information from the playback logic module, and transmit it to the detection logic module through the playback docking module; The image loading notification module is connected to the image loading module to send the corresponding vehicle passing record and the detected position of the image to be loaded in the playback interval to the image loading module, and then the image loading module loads the image from the corresponding image storage path; The image acquisition and replay notification module is connected to the image replay module, and the image replay module is connected to the image loading module, and is used to obtain the image collected within the replay interval and transmit it to the detection logic module for processing.

3. The replay system for visual inspection process as claimed in claim 1, characterized in that: The playback parameters are: playback mode on / off, playback period, program log storage path and image storage path.

4. The replay system for visual inspection process as claimed in claim 1, characterized in that: The external device signals include: a signal that the object to be tested has arrived, a signal that the robot has arrived, a signal that the image acquisition is completed, and a signal that the object to be tested has left; the program log includes the above external device signals and timestamps accordingly.

5. The replay system for visual inspection process as claimed in claim 1, characterized in that: The replay logic module is also provided with: a replay clock module, which is used to calculate the time interval between the timestamp recorded in the program log and the playback time, and use the time interval to set the replay time for each signal in turn. When the signal is replayed, when the signal reaches the replay time, it is sent out and displayed in the replay interaction module.

6. The replay system for visual inspection process as claimed in claim 1, characterized in that: The external device signal includes a signal that the object to be tested has arrived and a signal that the image acquisition is completed; The object-to-be-tested arrival signal includes the object-to-be-tested encoding information, which can index the object to be tested; The image acquisition completion signal includes the visual sensor coding information and the detection posture number information, which can index the detection posture of the visual sensor; The detection logic module matches the image with the coding information of the object to be detected, the coding information of the visual sensor and the detection posture number information, and stores them in the specified image storage path.

7. The replay system for visual inspection process as claimed in claim 1, characterized in that: The replay logic module is provided with: an object under test detection module, which is used to batch extract all signals of a single object under test from the arrival signal to the departure signal from the signal sent by the log analysis module, taking the object under test as the unit, uniformly identify these signals and set the replay time of the signal in turn. When the signal reaches the replay time, it is sent out and displayed in the replay interaction module.

8. The replay system for visual inspection process as claimed in claim 1, characterized in that: The playback interaction module includes a configuration area and a status area. The configuration area is used to set and display playback parameters; the status area is used to display the playback signal-time list.

9. The replay system for visual inspection process as claimed in claim 8, characterized in that: The configuration area is also used to display and set: playback speed is n; The playback logic module is provided with a speed control module, which compresses the playback time interval between different signals into 1 / n times according to the playback speed n set in the configuration area when the signal is played back; Preferably, the configuration area is also used to display and set: the interval time S; The replay logic module is also provided with an interval control module, which limits the maximum time interval between the replay time of the last object to be tested leaving signal and the next object to be tested arriving signal according to the interval time S set in the configuration area during signal replay; More preferably, the configuration area is further used to display and set: image playback advance time t; The replay logic module is also provided with: an image advance control module. When the signal is replayed, it advances the replay time of the image acquisition completion signal at the kth detection posture by k×t seconds according to the image replay advance time t set in the configuration area, where k=1, 2...M, and M represents the number of detection postures.

10. The replay system for visual inspection process according to claim 8, characterized in that: The configuration area is also used to display and select: a list of test objects to be tested, and a start / stop button for the playback process; the list of test objects to be tested is used for the user to select the test objects to be played back; the start / stop button for the playback process is used to start or pause the playback system, and correspondingly to make the detection logic module load or stop loading images from the stored images; The status area is also used to display the model of the object to be tested that is currently being played back; The replay logic module selects the signal corresponding to the object to be tested selected in the object to be tested selection list from the signal sent by the log analysis module, replays the signal and displays it in the status area.

Images