Dynamic safety control system and method combining vision and electronic cam
By combining visual and electronic cam dynamic safety control systems to monitor and control the abnormal state of the press in real time, the problem of insufficient combination of visual data and cam data in the prior art is solved, and the safety and efficiency of the production process are improved.
Patent Information
- Application Number
- CN202411406769.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-10
- Publication Date
- 2024-11-19
AI Technical Summary
The existing press control system fails to effectively combine visual data and cam data to judge the abnormal state of the equipment and the safety relationship between the moving target and the visual signal, resulting in an increase in the possibility of safety accidents.
A dynamic safety control system combining visual and electronic cams is designed, including data acquisition module, visual processing module, abnormality judgment module, security judgment module and abnormality control module. By obtaining visual data and cam data in the working area of the equipment in real time, it can identify the visual data and cam data in the working area of the equipment. An abnormal state and a control signal is generated to execute an abnormal control policy to ensure the safety of device operation.
Real-time monitoring and control of the operating status of the equipment is realized, abnormal situations are discovered in a timely manner, the possibility of accidents is reduced, the safety and stability of the production process are improved, the safety of operators are ensured, and the production efficiency and equipment utilization are improved.
Smart Images

Figure CN118977459A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of presses, and in particular to a dynamic safety control system and method combining vision and electronic cams. Background Art
[0002] As a metal forming equipment, the press has the characteristics of wide application and high production efficiency. The press can be widely used in cutting, punching, blanking, bending, riveting and forming processes. It applies strong pressure to the metal blank to make the metal plastically deform and break to process it into parts. In the process of using the press for cutting, punching, blanking, bending, riveting and other processes, if the operator does not operate properly, safety accidents are likely to occur during the operation. At present, there is no combination of visual data and cam data in the working area of the press to judge the abnormal state of the press and the safety relationship between the moving target and the visual signal, and to comprehensively judge and issue corresponding signals and corresponding operations.
[0003] For example, a Chinese patent with authorization announcement number CN105700453B discloses a control system for an intelligent servo press, including a servo drive unit, a PLC control unit and a control power supply unit; the servo drive unit includes a main drive servo controller, a mold adjustment servo controller, an electric pump motor and a multi-function power meter connected to a three-phase power supply; the PLC control unit includes a PLC, and the drive power supply end of the PLC is connected to an AC 220V power supply; the control power supply end of the PLC is connected to a DC 24V power supply, and the PLC collects action signals of each corresponding device and sends control signals to control the corresponding device; the control power supply unit includes a control transformer, the front end of the control transformer is connected to an AC 380V power supply, and the rear end of the control transformer outputs an AC 220V voltage, which, as an AC 220V power supply, ensures the stamping accuracy of the press and the quality of the stamped parts, improves the stamping processing efficiency, and can be used in press control.
[0004] For example, a Chinese patent with authorization announcement number CN106863893B discloses a control system for a hot forging press, including a motor control unit, a PLC control unit and a power control unit; the motor control unit includes a main motor, a mold adjustment motor, a conveyor belt motor, a lubricating oil motor and a multi-function power meter connected to a three-phase power supply, the main motor is connected to the three-phase power supply via a frequency converter, a reactor and a circuit breaker QF2, the PLC control unit includes a PLC local unit, a pressure analog module, a tonnage analog module, a temperature analog module, a Mod-bus module and a switch detection module; the power control unit includes a transformer, the front end of the transformer is connected to an AC 380V power supply, and the rear end of the transformer outputs an AC 220V voltage as an AC 220V power supply. The rear end of the transformer is connected to an AC 220V socket, a photoelectric protection device, a height lamp and a DC 24V power conversion circuit, which solves the problem that the frequency converter is easily interfered during on-site communication, improves the production efficiency of the press, and can be used in hot forging production.
[0005] The above patents have the problems raised by this background technology: the control system of the above intelligent servo press drives the servo controller through the servo drive unit, and controls the corresponding devices through the PLC control unit, and the control power unit controls the transformer. The three units jointly ensure the stamping accuracy of the press and the quality of the stamped parts; the control system of the above hot forging press controls the motor and the power meter through the motor control unit, the PLC control unit simulates the pressure, tonnage and temperature, and the power control unit controls the transformer. The synergy of the three units solves the problem that the frequency converter is easily interfered during on-site communication. The above two patents do not solve the problem of combining the visual data and cam data of the working area of the press to judge the abnormal state of the press and the safety relationship between the moving target and the visual signal, and comprehensively judge and send corresponding signals and corresponding operations. To solve this problem, the present invention proposes a dynamic safety control system and method combining vision and electronic cam. Summary of the invention
[0006] The purpose of this section is to summarize some aspects of the embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the specification abstract and the invention title of this application to avoid blurring the purpose of this section, the specification abstract and the invention title, and such simplifications or omissions cannot be used to limit the scope of the present invention.
[0007] In view of the problems existing in the above-mentioned existing dynamic safety control system and method combining vision and electronic cam, the present invention is proposed.
[0008] Therefore, an object of the present invention is to provide a dynamic safety control system and method combining vision and electronic cam.
[0009] To solve the above technical problems, the present invention provides a dynamic safety control system combining vision and electronic cam, comprising: a data acquisition module, a vision processing module, an abnormality judgment module, a safety judgment module and an abnormality control module;
[0010] The data acquisition module is configured with a traceability management strategy to obtain visual data and cam data of the equipment working area in real time;
[0011] The visual processing module is equipped with a signal recognition strategy, a grid construction strategy and a target judgment strategy, which are used to process visual data, recognize and extract visual signals, and judge the existence of moving targets based on visual signals;
[0012] The abnormal judgment module is configured with an abnormal identification strategy, which is used to calculate the changes in the running verification area at different times based on the cam data, and compare and verify with the actual results of the running verification area in the visual signal to identify the abnormal state of the equipment;
[0013] The safety judgment module is configured with a relationship judgment strategy, which is used to judge the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area according to the visual signal and the cam data, and calculate the speed and movement direction of the moving target;
[0014] The abnormal control module configures an abnormal control strategy to generate a control signal and execute the abnormal control strategy when an abnormal state of a device occurs or a mobile target is not in a safe state.
[0015] As a preferred solution of the dynamic safety control system combining vision and electronic cam described in the present invention, wherein: the vision processing module is configured with a signal recognition strategy, a grid construction strategy and a target judgment strategy, the signal recognition strategy is used to recognize the visual signal and configure the signal threshold, and the visual signal is compared with the signal threshold to determine the functional area where the device is located, the grid construction strategy is used to construct a virtual grid for the working area of the device according to the workflow, and the target judgment strategy is used to recognize the existence of a moving target in the virtual grid, and judge the existence of a security risk in the functional area corresponding to the virtual grid where the moving target is located;
[0016] Signal identification strategies include:
[0017] Regularly capture the visual data of the equipment working area, pre-process the visual data, and generate visual signals with virtual grids for each frame of visual data. The functional areas pointed to by the visual signals include the operation verification area, the safety area, the secondary safety area and the brake protection area. Configure the signal threshold, which includes the verification signal, the safety signal and the secondary safety signal. If the visual signal is less than or equal to the verification signal, the visual signal is in the operation verification area.
[0018] If the visual signal is greater than the verification signal and less than or equal to the safety signal, the visual signal is in the safety zone;
[0019] If the visual signal is greater than the safety signal and less than or equal to the secondary safety signal, the visual signal is in the secondary safety zone;
[0020] If the visual signal is greater than the secondary safety signal, the visual signal is in the brake protection area.
[0021] As a preferred solution of the dynamic safety control system combining vision and electronic cam described in the present invention, the grid construction strategy includes:
[0022] The size and resolution of the virtual grid are determined according to the size of the equipment's working area. The equipment's working area is divided into corresponding grid units according to the equipment's workflow. The functional area represented by each grid unit is determined, including the operation verification area, safety area, secondary safety area, and brake protection area. A color is assigned to each grid unit. Based on the size and resolution of the virtual grid and the color assignment of the grid unit, the virtual grid is synthesized with each frame of visual data to generate a corresponding visual signal.
[0023] As a preferred solution of the dynamic safety control system combining vision and electronic cam described in the present invention, the target judgment strategy includes:
[0024] Determine the motion feature according to the visual signal and configure the motion threshold. If the motion feature is less than or equal to the motion threshold, it means that there is no moving target in the visual signal.
[0025] If the motion feature is greater than the motion threshold, it means that there is a moving target in the visual signal. The grid unit where the moving target is located is determined and recorded as the target area. The authenticity of the target area is determined and the grid unit position of the moving target in consecutive frames is identified. If the grid unit position of the moving target in consecutive frames is the same, it means that the target area is false.
[0026] If the grid cell positions of the moving target in consecutive frames are different, the target region is true.
[0027] As a preferred solution of the dynamic safety control system combining vision and electronic cam described in the present invention, the abnormality judgment module is configured with an abnormality recognition strategy, which is used to judge the change of the operation verification area according to the position deviation of the slider movement and the distance of the grid unit of the operation verification area in the visual signal along the stroke direction, and judge the authenticity of the abnormal state. The abnormality recognition strategy includes:
[0028] The changes in the operation verification area at different times are compared and verified with the actual results of the operation verification area in the visual signal. The changes in the operation verification area at different times include the position deviation of the slider movement in the operation verification area. The position deviation of the slider movement in the operation verification area at different times is calculated according to the cam data. The position deviation formula of the slider movement in the operation verification area is as follows:
[0029] s = v (t1 - t0);
[0030] Where s represents the position deviation of the slider in the operation verification area, v represents the speed of the slider, t1 represents the time of leaving the operation verification area, and t0 represents the time of entering the operation verification area;
[0031] Set the movement direction of the equipment to the stroke direction, and compare and verify the position deviation of the slider movement with the distance of the grid unit in the operation verification area in the visual signal along the stroke direction. If the position deviation of the slider movement is equal to the distance of the grid unit in the operation verification area in the visual signal along the stroke direction, it means that there is no change in the operation verification area at different times and the equipment is in no abnormal state;
[0032] If the position deviation of the slider movement is not equal to the distance of the grid unit in the operation verification area in the visual signal along the stroke direction, it means that the operation verification area has changed at different times and the equipment is in an abnormal state. The authenticity of the abnormal state is determined based on the visual signal;
[0033] The distance of the grid unit in the running verification area in the visual signal along the stroke direction and the distance of the grid unit in the safety area along the stroke direction are combined into the safety grid distance. At the same time, the position deviation of the slider from entering the running verification area to leaving the safety area is calculated and recorded as the safety deviation. If the distance of the virtual grid in the visual signal along the stroke direction remains unchanged and the safety deviation is less than or equal to the safety grid distance, the abnormal state is false;
[0034] If the distance of the virtual grid in the visual signal along the stroke direction remains unchanged and the safety deviation is greater than the safety grid distance, the abnormal state is true and an abnormal signal is generated.
[0035] As a preferred solution of the dynamic safety control system combining vision and electronic cam described in the present invention, the safety judgment module is configured with a relationship judgment strategy, which is used to judge the safety state of the moving target based on the comparison between the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the braking protection area pointed to by the visual signal and the safety distance threshold, and the relationship judgment strategy includes:
[0036] The position of the moving target is obtained in real time through visual signals and cam data, and the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the brake protection area pointed to by the visual signal is calculated at each moment. According to the preset safety distance threshold, the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area is judged. If the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the brake protection area pointed to by the visual signal is greater than or equal to the safety distance threshold, then the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area is satisfied, indicating that the moving target is in a safe state;
[0037] If the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the braking protection area pointed to in the visual signal is less than the safety distance threshold, the safety relationship between the moving target and the operation verification area, the secondary safety area and the braking protection area is not satisfied, indicating that the moving target is not in a safe state.
[0038] As a preferred solution of the dynamic safety control system combining vision and electronic cam described in the present invention, the abnormal control strategy includes:
[0039] If the equipment is in an abnormal state, the authenticity of the abnormal state is determined based on the visual signal. If the abnormal state is true, the control signal is an abnormal signal and parking protection is executed;
[0040] If the moving target is not in a safe state, the position of the grid unit where the moving target is located is determined. If the moving target is in a secondary safe area, the control signal is a prompt signal to remind the operator to pay attention to safety;
[0041] If the moving target is in the brake protection area, the control signal is a protection signal and the equipment is stopped urgently.
[0042] As a preferred solution of the dynamic safety control system combining vision and electronic cam described in the present invention, wherein: the cam data includes the position of the slider at different times;
[0043] Obtain visual data and cam data of the equipment working area in real time, and manage the visual data and cam data traceability. The traceability management strategy includes:
[0044] Distinguish visual data from cam data, and generate visual identifiers for visual data. The visual identifiers include visual moment, motion features, and visual devices. Here, visual moment refers to the time when each frame of visual data occurs, motion features refer to the motion state of an object in each frame of visual data, and visual devices refer to visual devices used to obtain visual data.
[0045] Generate a cam identifier for the cam data, the cam identifier includes a cam moment, a slider position and a cam device, wherein the cam moment refers to the moment corresponding to obtaining the cam data, the slider position refers to the position of the slider at different moments, and the cam device refers to the cam device used to obtain the cam data;
[0046] The visual moment of the visual data and the cam moment of the cam data are associated and corresponded, and the visual data, visual identifier, cam data and cam identifier are stored in a database to ensure the integrity and traceability of the visual data and cam data, and facilitate subsequent query and processing analysis.
[0047] The dynamic safety control method combining vision and electronic cam includes: S1, obtaining visual data and cam data of the working area of the equipment in real time;
[0048] S2, processing the visual data, identifying and extracting the visual signal, and judging the existence of the moving target based on the visual signal;
[0049] S3. Calculate the changes of the running verification area at different times according to the cam data, and compare and verify with the actual results of the running verification area in the visual signal to identify the abnormal state of the equipment;
[0050] S4, judging the safety relationship between the moving target and the operation verification area, the secondary safety area and the braking protection area according to the visual signal and the cam data, and calculating the speed and movement direction of the moving target;
[0051] S5. When an abnormal state occurs in a device or a mobile target is not in a safe state, a control signal is generated and an abnormal control strategy is executed.
[0052] Beneficial effects of the present invention: The present invention acquires visual data and cam data of the equipment working area in real time through the data acquisition module, traces the acquired data, and realizes real-time monitoring and control of the equipment operation status; the visual processing module processes the visual data, identifies and extracts the visual signal, and judges the existence of the moving target according to the visual signal, and effectively monitors the moving target in the equipment working area; the abnormal judgment module calculates the changes of the operation verification area at different times according to the cam data, and compares and verifies with the actual results of the operation verification area in the visual signal, identifies the abnormal state of the equipment, and promptly discovers the abnormal operation of the equipment, reducing the possibility of accidents; the safety judgment module judges the safety between the moving target and the operation verification area, the secondary safety area and the brake protection area according to the visual signal and the cam data The abnormal control module generates a control signal when the equipment is in an abnormal state or the moving target is not in a safe state, and executes the abnormal control strategy to achieve timely intervention and control of the equipment operation status, prevent accidents, and ensure the safety of the production environment. Compared with the existing equipment using grating stamping safety protection scheme, the interaction of the above modules can combine the electronic cam and vision configured in the equipment itself to form a safety protection system with self-feedback, realize comprehensive monitoring and safety assessment of the equipment operation status, improve the safety and stability of the production process, reduce the risk of accidents, ensure the safety of operators, and at the same time improve production efficiency and equipment utilization, with higher reliability and lower cost, and have broad social and economic benefits. BRIEF DESCRIPTION OF THE DRAWINGS
[0053] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them:
[0054] Figure 1 This is a system structure diagram of a dynamic safety control system combining vision and electronic cam according to the present invention;
[0055] Figure 2 It is a signal recognition strategy flow chart of the dynamic safety control system combining vision and electronic cam of the present invention;
[0056] Figure 3 This is a flow chart of the abnormality identification strategy of the dynamic safety control system combining vision and electronic cam of the present invention;
[0057] Figure 4 The figure is a flow chart of the dynamic safety control method combining vision and electronic cam of the present invention. DETAILED DESCRIPTION
[0058] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the accompanying drawings.
[0059] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention can also be implemented in other ways different from those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
[0060] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.
[0061] Example 1
[0062] In this embodiment, a system structure diagram of a dynamic safety control system combining vision and electronic cam is provided, such as Figure 1 As shown, the dynamic safety control system combining vision and electronic cam includes a data acquisition module, a vision processing module, an abnormality judgment module, a safety judgment module and an abnormality control module.
[0063] In this embodiment, the device is a press.
[0064] The data acquisition module is used to obtain the visual data and cam data of the press working area in real time.
[0065] The cam data includes the position of the slider at different times.
[0066] Acquire the visual data and cam data of the press working area in real time, and manage the visual data and cam data traceability. The traceability management strategy includes:
[0067] Distinguish visual data from CAM data, generate a visual identifier for the visual data, the visual identifier includes visual moment, motion feature and visual device, the visual moment here refers to the time when each frame of visual data occurs, the motion feature refers to the motion state of the object in each frame of visual data, and the visual device refers to the visual device used to obtain visual data.
[0068] A cam identifier is generated for the cam data. The cam identifier includes a cam moment, a slider position and a cam device. The cam moment here refers to the moment corresponding to obtaining the cam data, the slider position refers to the position of the slider at different moments, and the cam device refers to the cam device used to obtain the cam data.
[0069] The visual moment of the visual data and the cam moment of the cam data are associated and corresponded, and the visual data, visual identifier, cam data and cam identifier are stored in a database to ensure the integrity and traceability of the visual data and cam data, and facilitate subsequent query and processing analysis.
[0070] The visual processing module is configured with a signal recognition strategy, a grid construction strategy, and a target judgment strategy. The signal recognition strategy is used to recognize visual signals and configure signal thresholds, and compare the visual signals with the signal thresholds to determine the functional area where the press is located. The grid construction strategy is used to build a virtual grid for the press working area according to the workflow. The target judgment strategy is used to recognize the existence of moving targets in the virtual grid and determine the existence of safety risks in the functional area corresponding to the virtual grid where the moving target is located. It is used to process visual data, recognize and extract visual signals, and determine the existence of moving targets based on visual signals.
[0071] The functional areas pointed to by the visual signals include the operation verification area, the safety area, the secondary safety area and the brake protection area.
[0072] Signal recognition strategies such as Figure 2 As shown, specifically including:
[0073] The visual data of the working area of the press is captured regularly. The quality of the visual data is ensured through preset lighting conditions and camera configurations. The visual data is preprocessed, including removing image noise and enhancing image contrast. Each frame of visual data is converted into a visual signal with virtual grids of different colors. The functional areas pointed to by the visual signal include the operation verification area, the safety area, the secondary safety area and the brake protection area. The signal threshold is configured. The signal threshold includes the verification signal, the safety signal and the secondary safety signal. If the visual signal is less than or equal to the verification signal, the visual signal is in the operation verification area.
[0074] If the visual signal is greater than the verification signal and less than or equal to the safety signal, the visual signal is in the safety zone;
[0075] If the visual signal is greater than the safety signal and less than or equal to the secondary safety signal, the visual signal is in the secondary safety zone;
[0076] If the visual signal is greater than the secondary safety signal, the visual signal is in the brake protection area.
[0077] The secondary safety zone refers to the area between the safety zone and the brake protection zone. When the operator reaches the secondary safety zone, he needs to be reminded to pay attention to safety.
[0078] Raster construction strategies include:
[0079] The size and resolution of the virtual grid are determined according to the size of the working area of the press. This needs to be adjusted according to the actual working area of the press to ensure that the virtual grid can accurately represent different functional areas. The working area of the press is divided into corresponding grid units according to the workflow of the press. The functional area represented by each grid unit is determined, including the operation verification area, the safety area, the secondary safety area and the brake protection area. A color is assigned to each grid unit. The operation verification area is a blue virtual grid, the safety area is a green virtual grid, the secondary safety area is a yellow virtual grid, and the brake protection area is a red virtual grid. According to the size and resolution of the virtual grid and the color assignment of the grid unit, the virtual grid is synthesized with the visual data of each frame to generate a corresponding visual signal, such as drawing a rectangle of the corresponding color at the position of each grid unit. The constructed virtual grid is preliminarily tested in the actual environment to ensure that the division and marking of each functional area are accurate. The actual environment may change, such as light changes. If an abnormality is found through the abnormality judgment module, the visual signal needs to be corrected, including dynamically adjusting the boundary and position of the virtual grid.
[0080] Target determination strategies include:
[0081] Determine the motion feature according to the visual signal and configure the motion threshold. If the motion feature is less than or equal to the motion threshold, it means that there is no moving target in the visual signal.
[0082] If the motion feature is greater than the motion threshold, it means that there is a moving target in the visual signal. The grid unit where the moving target is located is determined and recorded as the target area. The authenticity of the target area is determined and the grid unit position of the moving target in consecutive frames is identified. If the grid unit position of the moving target in consecutive frames is the same, it means that the target area is false.
[0083] If the grid unit position of the moving target in consecutive frames is different, it means that the target area is true, and the abnormal judgment module needs to be executed first to judge the abnormal state of the press and effectively monitor the moving target in the working area of the press.
[0084] The abnormality judgment module is used to calculate the changes in the running verification area at different times based on the cam data, and compare and verify it with the actual results of the running verification area in the visual signal to identify the abnormal state of the press.
[0085] Configure an abnormality recognition strategy to determine the change of the running verification area according to the position deviation of the slider movement and the distance of the grid unit of the running verification area in the visual signal along the stroke direction, and determine the authenticity of the abnormal state. The abnormality recognition strategy is as follows Figure 3 As shown, specifically including:
[0086] The changes in the operation verification area at different times are compared and verified with the actual results of the operation verification area in the visual signal. The changes in the operation verification area at different times include the position deviation of the slider movement in the operation verification area. The position deviation of the slider movement in the operation verification area at different times is calculated according to the cam data. The position deviation formula of the slider movement in the operation verification area is as follows:
[0087] s = v (t1 - t0);
[0088] Where s represents the position deviation of the slider in the operation verification area, v represents the speed of the slider, t1 represents the time of leaving the operation verification area, and t0 represents the time of entering the operation verification area.
[0089] Set the movement direction of the press machine to the stroke direction, compare and verify the position deviation of the slider movement with the distance of the grid unit in the operation verification area in the visual signal along the stroke direction. If the position deviation of the slider movement is equal to the distance of the grid unit in the operation verification area in the visual signal along the stroke direction, it means that there is no change in the operation verification area at different times and the press machine is in no abnormal state.
[0090] If the position deviation of the slider movement is not equal to the distance of the grid unit in the operation verification area in the visual signal along the stroke direction, it means that the operation verification area has changed at different times and the press is in an abnormal state. The authenticity of the abnormal state is judged based on the visual signal.
[0091] The distance of the grid unit in the running verification area in the visual signal along the stroke direction and the distance of the grid unit in the safety area along the stroke direction are combined into the safety grid distance. At the same time, the position deviation of the slider from entering the running verification area to leaving the safety area is calculated and recorded as the safety deviation. If the distance of the virtual grid in the visual signal along the stroke direction remains unchanged and the safety deviation is less than or equal to the safety grid distance, the abnormal state is false;
[0092] If the distance of the virtual grid in the visual signal along the stroke direction remains unchanged and the safety deviation is greater than the safety grid distance, the abnormal state is true, an abnormal signal is generated, the abnormal control module and the safety judgment module are executed, the corresponding operations are performed and the safety relationship of the moving target is judged, the abnormal operation of the press is discovered in time, and the possibility of accidents is reduced.
[0093] The safety judgment module is used to judge the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area according to the visual signal and the cam data, and calculate the speed and movement direction of the moving target.
[0094] The safety judgment module is configured with a relationship judgment strategy, which is used to judge the safety status of the moving target based on the comparison between the distance between the moving target and the boundaries of the grid cells corresponding to the operation verification area, the secondary safety area and the braking protection area pointed to by the visual signal and the safety distance threshold. The relationship judgment strategy includes:
[0095] The position of the moving target is obtained in real time through visual signals and cam data, and the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the brake protection area pointed to by the visual signal is calculated at each moment. According to the preset safety distance threshold, the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area is judged. If the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the brake protection area pointed to by the visual signal is greater than or equal to the safety distance threshold, then the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area is satisfied, indicating that the moving target is in a safe state;
[0096] If the distance between the mobile target and the boundary of the grid unit corresponding to the operation verification area, secondary safety area and braking protection area pointed to in the visual signal is less than the safety distance threshold, the safety relationship between the mobile target and the operation verification area, secondary safety area and braking protection area is not satisfied, indicating that the mobile target is not in a safe state, and the abnormal control module is executed to send a corresponding signal and perform a corresponding operation.
[0097] The formula for the distance between the moving target and the boundaries of the grid cells corresponding to the running verification area, the secondary safety area, and the braking protection area in the visual signal is as follows:
[0098]
[0099] Where d represents the distance between the moving target and the boundaries of the grid cells corresponding to the running verification area, the secondary safety area, and the braking protection area in the visual signal, abs(·) represents absolute value processing, (x, y) represents the position coordinates of the moving target at time t, (x1, y1) and (x2, y2) represent the position coordinates of the two endpoints of the grid cell, respectively, and sqrt(·) represents square root processing.
[0100] At the same time, the speed and direction of movement of the moving target are calculated according to the position of the moving target at different times. The speed formula of the moving target is as follows:
[0101]
[0102] In the formula, v m represents the speed of the moving target at different times, (x',y') represents the position coordinates of the moving target at time t2, and (x,y) represents the position coordinates of the moving target at time t.
[0103] The formula for the moving direction of a moving target is as follows:
[0104] dm=arctan((x′-x) / (y′-y));
[0105] Where dm represents the moving direction of the moving target, and arctan(·) represents the inverse tangent function.
[0106] The programmable electronic cam of the press is used to output the position and speed of the slider, which is used to calculate the changes in the running verification area in the visual signal and perform verification at the next moment. Safety verification is only necessary when the slider is moving downward, that is, when the electronic cam marquee is between 0 and 180 degrees. When the electronic cam marquee is between 0 and 180 degrees, it means that the press is performing a stamping action, that is, the press needs to perform safety verification during the stamping process. No safety verification is required if the press is in the process of lifting the arm.
[0107] The abnormal control module is used to generate a control signal and execute an abnormal control strategy when the press is in an abnormal state or the moving target is not in a safe state.
[0108] Abnormal control strategies include:
[0109] If the press machine is in an abnormal state, the authenticity of the abnormal state is determined based on the visual signal. If the abnormal state is true, the control signal is an abnormal signal and parking protection is executed;
[0110] If the moving target is not in a safe state, the position of the grid unit where the moving target is located is determined. If the moving target is in a secondary safe area, the control signal is a prompt signal to remind the operator to pay attention to safety;
[0111] If the moving target is in the brake protection area, the control signal is a protection signal and the press is stopped urgently.
[0112] Realize timely intervention and control of the press operation status to prevent accidents and ensure the safety of the production environment.
[0113] Example 2
[0114] In this embodiment, a method flow chart of a dynamic safety control method combining vision and electronic cam is provided, such as Figure 4 As shown, the dynamic safety control method combining vision and electronic cam includes:
[0115] S1. Obtain visual data and cam data of the press working area in real time.
[0116] S2. Process the visual data, identify and extract the visual signal, and determine the existence of the moving target based on the visual signal.
[0117] S3. According to the cam data, the changes in the running verification area at different times are calculated, and compared with the actual results of the running verification area in the visual signal to identify the abnormal state of the press.
[0118] S4. Determine the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area based on the visual signal and the cam data, and calculate the speed and movement direction of the moving target.
[0119] S5, generating a control signal when the press is in an abnormal state or the moving target is not in a safe state, and executing an abnormal control strategy;
[0120] For the specific contents of the dynamic safety control method combining vision and electronic cam, please refer to the dynamic safety control system combining vision and electronic cam, which will not be repeated here.
[0121] Example 3
[0122] In this embodiment, a computer device is provided, including a memory and a processor, the memory is used to store instructions, and the processor is used to execute the instructions, so that the computer device executes the steps of implementing the above-mentioned dynamic safety control method combining vision and electronic cam.
[0123] Example 4
[0124] In this embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed, the steps of the dynamic safety control method combining vision and electronic cam are implemented.
[0125] The computer-readable storage medium includes: a U disk, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk, and other media for storing program codes.
[0126] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should be included in the scope of the claims of the present invention.
Claims
1. Dynamic safety control system combining vision and electronic cam, characterized by: include: Data acquisition module, visual processing module, abnormality judgment module, safety judgment module and abnormality control module; The data acquisition module is configured with a traceability management strategy to obtain visual data and cam data of the equipment working area in real time; The visual processing module is equipped with a signal recognition strategy, a grid construction strategy and a target judgment strategy, which are used to process visual data, recognize and extract visual signals, and judge the existence of moving targets based on visual signals; The abnormal judgment module is configured with an abnormal identification strategy, which is used to calculate the changes in the running verification area at different times based on the cam data, and compare and verify with the actual results of the running verification area in the visual signal to identify the abnormal state of the equipment; The safety judgment module is configured with a relationship judgment strategy, which is used to judge the safety relationship between the moving target and the operation verification area, the secondary safety area and the braking protection area according to the visual signal and the cam data, and calculate the speed and movement direction of the moving target; The abnormal control module configures an abnormal control strategy to generate a control signal and execute the abnormal control strategy when an abnormal state of a device occurs or a mobile target is not in a safe state.
2. The dynamic safety control system combining vision and electronic cam as claimed in claim 1, characterized in that: The visual processing module is configured with a signal recognition strategy, a grid construction strategy and a target judgment strategy. The signal recognition strategy is used to recognize visual signals and configure signal thresholds, and compare the visual signals with the signal thresholds to determine the functional area where the device is located. The grid construction strategy is used to construct a virtual grid for the device working area according to the workflow. The target judgment strategy is used to recognize the existence of a moving target in the virtual grid and determine the existence of security risks in the functional area corresponding to the virtual grid where the moving target is located. Signal identification strategies include: Regularly capture the visual data of the equipment working area, pre-process the visual data, and generate visual signals with virtual grids for each frame of visual data. The functional areas pointed to by the visual signals include the operation verification area, the safety area, the secondary safety area and the brake protection area. Configure the signal threshold, which includes the verification signal, the safety signal and the secondary safety signal. If the visual signal is less than or equal to the verification signal, the visual signal is in the operation verification area. If the visual signal is greater than the verification signal and less than or equal to the safety signal, the visual signal is in the safety zone; If the visual signal is greater than the safety signal and less than or equal to the secondary safety signal, the visual signal is in the secondary safety zone; If the visual signal is greater than the secondary safety signal, the visual signal is in the brake protection area.
3. The dynamic safety control system combining vision and electronic cam as claimed in claim 2, characterized in that: Raster construction strategies include: The size and resolution of the virtual grid are determined according to the size of the equipment's working area. The equipment's working area is divided into corresponding grid units according to the equipment's workflow. The functional area represented by each grid unit is determined, including the operation verification area, safety area, secondary safety area, and brake protection area. A color is assigned to each grid unit. Based on the size and resolution of the virtual grid and the color assignment of the grid unit, the virtual grid is synthesized with each frame of visual data to generate a corresponding visual signal.
4. The dynamic safety control system combining vision and electronic cam as claimed in claim 3, characterized in that: Target determination strategies include: Determine the motion feature according to the visual signal and configure the motion threshold. If the motion feature is less than or equal to the motion threshold, it means that there is no moving target in the visual signal. If the motion feature is greater than the motion threshold, it means that there is a moving target in the visual signal. The grid unit where the moving target is located is determined and recorded as the target area. The authenticity of the target area is determined and the grid unit position of the moving target in consecutive frames is identified. If the grid unit position of the moving target in consecutive frames is the same, it means that the target area is false. If the grid cell positions of the moving target in consecutive frames are different, the target region is true.
5. The dynamic safety control system combining vision and electronic cam as claimed in claim 4, characterized in that: The abnormality judgment module is configured with an abnormality recognition strategy, which is used to judge the change of the running verification area according to the position deviation of the slider movement and the distance of the grid unit of the running verification area in the visual signal along the stroke direction, and to judge the authenticity of the abnormal state. The abnormality recognition strategy includes: The changes in the operation verification area at different times are compared and verified with the actual results of the operation verification area in the visual signal. The changes in the operation verification area at different times include the position deviation of the slider movement in the operation verification area. The position deviation of the slider movement in the operation verification area at different times is calculated according to the cam data. The position deviation formula of the slider movement in the operation verification area is as follows: s = v (t1 - t0); Where s represents the position deviation of the slider in the operation verification area, v represents the speed of the slider, t1 represents the time of leaving the operation verification area, and t0 represents the time of entering the operation verification area; Set the movement direction of the equipment to the stroke direction, and compare and verify the position deviation of the slider movement with the distance of the grid unit in the operation verification area in the visual signal along the stroke direction. If the position deviation of the slider movement is equal to the distance of the grid unit in the operation verification area in the visual signal along the stroke direction, it means that there is no change in the operation verification area at different times and the equipment is in no abnormal state; If the position deviation of the slider movement is not equal to the distance of the grid unit in the operation verification area in the visual signal along the stroke direction, it means that the operation verification area has changed at different times and the equipment is in an abnormal state. The authenticity of the abnormal state is determined based on the visual signal; The distance of the grid unit in the running verification area in the visual signal along the stroke direction and the distance of the grid unit in the safety area along the stroke direction are combined into the safety grid distance. At the same time, the position deviation of the slider from entering the running verification area to leaving the safety area is calculated and recorded as the safety deviation. If the distance of the virtual grid in the visual signal along the stroke direction remains unchanged and the safety deviation is less than or equal to the safety grid distance, the abnormal state is false; If the distance of the virtual grid in the visual signal along the stroke direction remains unchanged and the safety deviation is greater than the safety grid distance, the abnormal state is true and an abnormal signal is generated.
6. The dynamic safety control system combining vision and electronic cam as claimed in claim 5, characterized in that: The safety judgment module is configured with a relationship judgment strategy, which is used to judge the safety status of the moving target based on the comparison between the distance between the moving target and the boundaries of the grid cells corresponding to the operation verification area, the secondary safety area and the braking protection area pointed to by the visual signal and the safety distance threshold. The relationship judgment strategy includes: The position of the moving target is obtained in real time through visual signals and cam data, and the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the brake protection area pointed to by the visual signal is calculated at each moment. According to the preset safety distance threshold, the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area is judged. If the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the brake protection area pointed to by the visual signal is greater than or equal to the safety distance threshold, then the safety relationship between the moving target and the operation verification area, the secondary safety area and the brake protection area is satisfied, indicating that the moving target is in a safe state; If the distance between the moving target and the boundary of the grid unit corresponding to the operation verification area, the secondary safety area and the braking protection area pointed to in the visual signal is less than the safety distance threshold, the safety relationship between the moving target and the operation verification area, the secondary safety area and the braking protection area is not satisfied, indicating that the moving target is not in a safe state.
7. The dynamic safety control system combining vision and electronic cam as claimed in claim 6, characterized in that: Abnormal control strategies include: If the equipment is in an abnormal state, the authenticity of the abnormal state is determined based on the visual signal. If the abnormal state is true, the control signal is an abnormal signal and parking protection is executed; If the moving target is not in a safe state, the position of the grid unit where the moving target is located is determined. If the moving target is in a secondary safe area, the control signal is a prompt signal to remind the operator to pay attention to safety; If the moving target is in the brake protection area, the control signal is a protection signal and the equipment is stopped urgently.
8. The dynamic safety control system combining vision and electronic cam as claimed in claim 7, characterized in that: The cam data includes the position of the slider at different times; Obtain visual data and cam data of the equipment working area in real time, and manage the visual data and cam data traceability. The traceability management strategy includes: Distinguish visual data from cam data, generate visual identifiers for visual data, the visual identifiers include visual moment, motion features and visual devices, the visual moment refers to the time when each frame of visual data occurs, the motion features refer to the motion state of the object in each frame of visual data, and the visual device refers to the visual device used to obtain visual data; Generate a cam identifier for the cam data, the cam identifier includes a cam moment, a slider position and a cam device, wherein the cam moment refers to the moment corresponding to obtaining the cam data, the slider position refers to the position of the slider at different moments, and the cam device refers to the cam device used to obtain the cam data; The visual moment of the visual data and the cam moment of the cam data are associated and corresponded, and the visual data, visual identifier, cam data and cam identifier are stored in a database to ensure the integrity and traceability of the visual data and cam data, and facilitate subsequent query and processing analysis.
9. A dynamic safety control method combining vision and electronic cam, implemented based on a dynamic safety control system combining vision and electronic cam according to any one of claims 1 to 8, characterized in that: include: S1, real-time acquisition of visual data and cam data of the equipment working area; S2, processing the visual data, identifying and extracting the visual signal, and judging the existence of the moving target based on the visual signal; S3. Calculate the changes of the running verification area at different times according to the cam data, and compare and verify with the actual results of the running verification area in the visual signal to identify the abnormal state of the equipment; S4, judging the safety relationship between the moving target and the operation verification area, the secondary safety area and the braking protection area according to the visual signal and the cam data, and calculating the speed and movement direction of the moving target; S5. When an abnormal state occurs in a device or a mobile target is not in a safe state, a control signal is generated and an abnormal control strategy is executed.
Citation Information
Patent Citations
A control system and control method for an intelligent servo press
CN105700453B
A control system for a hot forging press
CN106863893B
Cited By
Electronic cam auxiliary braking system and method
CN120573076A
Electronic cam-assisted brake system and method
CN120573076B
