Photographing device of punching machine safety auxiliary system
By setting up cameras to cross-shot images on both sides of the punching machine work area, and training AI models to identify hand features, the problem that AI models in the prior art are difficult to effectively identify hand, improving the recognition efficiency and accuracy of the punching machine safety assistance system.
Patent Information
- Application Number
- CN202311311890.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-11
- Publication Date
- 2025-04-11
AI Technical Summary
When training AI models to identify hand images, existing punch press safety assistance systems are difficult to effectively and correctly identify hand features, resulting in the failure of the safety device and unable to effectively protect operators.
The first and second cameras are arranged on both sides of the working area of the punch, and the images are taken from the two sides, covering the most hand features, and training the AI model to identify the hands and punches.
Through cross-shooting images, the AI model can more efficiently and correctly identify hand features, improving the recognition efficiency and accuracy of the safety assistance system, ensuring the safety of the operator.
Smart Images
Figure CN119815167A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a device for a punching machine, and in particular to a photographing device for a safety auxiliary system of a punching machine. Background Art
[0002] The existing punching machine is provided with a punch driven to punch downward above the working platform of the machine base. The punch drives the upper die to press downward, so that the workpiece placed on the working platform can be deformed by the upper die in the working area between the working platform and the punch, so that the workpiece is processed into a finished product.
[0003] In order to prevent the punch from injuring the human body when it descends, especially to prevent the operator's hands from being injured when they frequently reach into the working area, the punch machine is provided with a safety device that requires both hands to press buttons at the same time in front of the machine. The punch can only descend when both hands press the two buttons of the safety device at the same time, thus preventing the user's hands from being crushed by the punch when they stay in the working area.
[0004] However, some punch press operators, in order to speed up the insertion of workpieces, or employers, in order to increase the efficiency of punch press operations, will disable the safety device by turning it off, or by pressing down one of the buttons with a heavy object. Therefore, some manufacturers use machine learning to train AI models to recognize hand images, hoping to prevent the punch from descending and injuring the operator's hand when the operator's hand is in the work area through photography. At this time, what kind of image is used to train the AI model to recognize human hands, and how to enable the AI model to efficiently and correctly recognize the hand in the image is a major issue. Summary of the invention
[0005] In view of this, the present invention sets a first camera and a second camera on opposite sides of the working area of the punch press, so as to capture images of the working area from opposite sides of the working area, so that the cross-shot images can cover the most human hand features that can be recognized by the AI model, and are used to train the AI model of the punch press safety assistance system, or for the AI model to recognize the hands and the punch of the punch press in the image.
[0006] In order to achieve the above-mentioned purpose, the present invention provides a photographic device of a punch press safety auxiliary system, which is a first camera and a second camera set on a punch press; the punch press has a machine base, and a working platform and a punch are spaced apart on the machine base along a Z-axis direction; a working area is defined in the space between the working platform and the punch.
[0007] The first camera has a first lens, and the second camera has a second lens; the first camera and the second camera are arranged on two sides of opposite directions outside the working area, and the first lens and the second lens are facing each other; the field of view of the images taken by the first camera and the second camera at least covers the working area, and the images taken by the first camera and the second camera are transmitted to a punching machine safety assistance system for identifying human hands.
[0008] The effect of the present invention is that, due to the asymmetry of human hands, when two cameras are used to capture the hands of a punch press operator extending into the work area, the images cross-shot from opposite directions can cover the most human hand features that can be recognized by the AI model. Therefore, the AI model can be trained to recognize hands with images having more hand features, or the trained AI model can be provided to recognize the hands that appear in the images. Since the hands that appear in the images captured by the first camera and the second camera have more hand features, when only part of the hand appears in the field of view of the image, the AI model can recognize the hand through the images on opposite sides, which can improve the efficiency and accuracy of the AI model in recognizing images. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] Figure 1 It is a front view of a preferred embodiment of the present invention.
[0010] Figure 2 It is a right side view of the above preferred embodiment of the present invention.
[0011] Figure 3 for Figure 1 Schematic diagram of the offset angle between the first camera and the second camera.
[0012] Figure 4 It is a block diagram of the above preferred embodiment of the present invention.
[0013] Figure 5 It is a right side plan view showing the hand reaching into the work area within the field of view.
[0014] Description of Reference Numerals
[0015] [The present invention]
[0016] 100: Photographic device for punch press safety assistance system
[0017] 10: Punch Press
[0018] 12: Base
[0019] 14: Work Platform
[0020] 141: Working surface
[0021] 16: Punch
[0022] 161: Bottom edge
[0023] 18: Drive system
[0024] 19: Electrical box
[0025] 20: First Camera
[0026] 22: First Shot
[0027] 30: Second Camera
[0028] 32: Second Shot
[0029] 40: Punch safety auxiliary system
[0030] 42: Control host
[0031] A: Workspace
[0032] F: Field of view
[0033] H: Hand
[0034] S: Bracket
[0035] HL: Feed direction
[0036] L1: First optical axis
[0037] L2: Second optical axis
[0038] L3: Optical axis connection
[0039] Z: AI Model
[0040] θ1: First deviation angle
[0041] θ2: Second deviation angle DETAILED DESCRIPTION
[0042] In order to more clearly illustrate the present invention, preferred embodiments are given and described in detail with reference to the accompanying drawings. Figures 1 to 5 As shown, a photographic device 100 of a punch press safety assistance system of a preferred embodiment of the present invention is provided with a first camera 20 and a second camera 30 on a punch press 10, and the first camera 20 and the second camera 30 are respectively connected to a control host 42 of a punch press safety assistance system 40 by signals.
[0043] Please see Figure 1 , Figure 2 and Figure 5As shown, the punch press 10 is a machine tool having an X-axis, a Y-axis and a Z-axis, and a three-dimensional coordinate system is constructed with the X-axis, the Y-axis and the Z-axis. The punch press 10 has a machine base 12, and a working platform 14 and a punch 16 are arranged at intervals along the direction of the Z-axis on the machine base 12. The working platform 14 is fixed to the machine base 12 and has a working surface 141; the punch 16 is combined with the machine base 12 in a manner that it can slide relative to the machine base 12 along the Z-axis, and the punch 16 has a bottom edge 161 facing the working surface 141. The punch press 10 in this preferred embodiment is a hydraulic punch press, and in other embodiments, the punch press 10 can also be a mechanical punch press.
[0044] The punch press 10 is provided with a driving system 18 in the top of the machine base 12. The driving system 18 is a hydraulic driving system and is connected to the punch 16 to drive the punch 16 to move forward and backward along the Z axis toward the working platform 14. An electrical box 19 is provided in the machine base 12. The electrical box 19 is electrically connected to the driving system 18 to supply the power required for the operation of the driving system 18. The space between the working surface 141 of the working platform 14 and the bottom edge 161 of the punch 16 is defined as a working area A. The working area A is the area through which the punch 16 will pass when it is driven by the driving system 18 and descends along the Z axis toward the working platform 14. The working area A is also the space into which the hand H of the human body will extend when the operator of the punch press 10 places the workpiece to be punched by the punch press 10 on the working surface 141 of the working platform 14. During the descent of the punch 16, it is necessary to warn the human hand H not to enter the working area A to avoid danger.
[0045] Please see Figures 1 to 5 As shown, the first camera 20 has a first lens 22, and the first lens 22 has a first optical axis L1. The second camera 30 has a second lens 32, and the second lens 32 has a second optical axis L2. The first camera 20 and the second camera 30 are respectively arranged on the base 12 of the punching machine 10 by a bracket S magnetically attracted to the base 12; or in other preferred embodiments, a bracket supported on the ground can also be used to support the first camera 20 and the second camera 30 on the ground respectively. With the support of the above brackets, the first camera 20 and the second camera 30 are arranged on two sides of opposite directions outside the working area A. In this preferred embodiment, the first camera 20 and the second camera 30 are arranged outside the working area A and on opposite sides of the working area A along the X-axis direction.
[0046] The first lens 22 of the first camera 20 and the second lens 32 of the second camera 30 face each other: that is, the first camera 20 and the second camera 30 face the direction of the working area A respectively. The field of view F of the image taken by the first camera 20 in the direction of the working area A at least covers the working area A, and the field of view F of the image taken by the second camera 30 in the direction of the working area A at least covers the working area A, so that no matter whether the image is taken by the first camera 20 or the second camera 30, the image field F includes the image of the working area A.
[0047] Through the above configuration, an object entering the field of view F of the image captured by the first camera 20, that is, an object entering the field of view F of the image captured by the second camera 30, will have an image captured from one of the two opposite sides of the working area A along the X-axis and an image captured from the other side. The direction in which the hand H of the operator of the punch press 10 extends into the working area A along the Y-axis is defined as a feed direction HL; when the hand H of the operator of the punch press 10 extends into the working area A along the feed direction HL, the first camera 20 and the second camera 30 can capture an image of the left side of the hand H and an image of the right side of the hand H, respectively. In this way, the appearance features of the hand H are covered most by the left and right crossed images.
[0048] Please see Figures 2 to 5 As shown, the line where the first optical axis L1 of the first camera 20 and the second optical axis L2 of the second camera 30 overlap is defined as an optical axis line L3, and the optical axis line L3 passes through the working area A. Since the first camera 20 and the second camera 30 shoot images from opposite sides of the working area A along the X-axis, and the field of view F of the image needs to at least cover the working area A; therefore, limiting the angles at which the first optical axis L1 of the first camera 20 and the second optical axis L2 of the second camera 30 are offset from the optical axis line L3 can prevent the first camera 20 from shooting an image with the entire working area A in the field of view F, while the second camera 30 only shows part of the working area A, and vice versa.
[0049] Therefore, there is a first offset angle θ1 between the first optical axis L1 and the optical axis line L3, and the angle of the first offset angle θ1 is less than or equal to 15 degrees; there is a second offset angle θ2 between the second optical axis L2 and the optical axis line L3, and the angle of the second offset angle θ2 is less than or equal to 15 degrees. In this preferred embodiment, the angle of the first offset angle is 0 degrees; the angle of the second offset angle is 0 degrees; the optical axis line L3 is set to be parallel to the X axis, and the optical axis line L3 passes through the middle of the working area A.
[0050] The images captured by the first camera 20 and the second camera 30 are transmitted to the control host 42 of the punch press safety assistance system 40 in a wired manner; in other preferred embodiments, the images captured by the first camera 20 and the second camera 30 can also be transmitted to the control host 42 of the punch press safety assistance system 40 in a wireless manner; the control host 42 is electrically connected to the electrical box 19 of the punch press 10, so that the electrical box 19 is powered off under the control of the control host 42.
[0051] The control host 42 of the punch press safety auxiliary system 40 uses the images taken by the first camera 20 and the second camera 30 from opposite directions to train an AI model Z for identifying the human hand H and the punch 16 of the punch press 10. When the AI model Z is trained, please refer to Figure 1 , Figure 2 and Figure 5 As shown, the control host 42 of the punch press safety auxiliary system 40 can identify the hand H and the punch 16 from the images captured by the first camera 20 and the second camera 30 .
[0052] Since the images taken crosswise from opposite directions of the working area A by the first camera 20 and the second camera 30 can cover the most hand features of the human body H that can be recognized by the AI model Z, therefore, when the hand H of the operator of the photographic device 100 of the punch press safety assistance system enters the field of view F of the image taken by the first camera 20 and the second camera 30 along the feed direction HL, as long as the hand H enters the field of view F of the captured image along 15% of the length of the feed direction HL, the features of the hand H displayed in the image are sufficient to provide the AI model Z loaded in the control host 42 with recognition of the hand H in the captured image. In this way, the efficiency and accuracy of the AI model Z in recognizing the hand H in the images taken by the first camera 20 and the second camera 30 can be improved.
[0053] When the punch press safety auxiliary system 40 is in operation, the AI model Z stored in the control host 42 identifies the human hand H and the punch 16 of the punch press 10 from the images captured by the first camera 20 and the second camera 30. In the process of the punch 16 of the punch press 10 moving toward the working area A, the AI model Z stored in the control host 42 determines whether the hand H identified in the image is located in the working area A. If so, the control host 42 controls the electrical box 19 of the punch press 10 to cut off the power, stop the operation of the punch press 10, and protect the safety of the operator of the punch press 10; if not, the AI model Z continues to identify the hand H and the punch 16 appearing in the captured images received by the first camera 20 and the second camera 30, and thereby monitors whether the human hand H moves into the working area A in the process of the punch 16 moving toward the working area A.
[0054] The above description is only a preferred feasible embodiment of the present invention. Any equivalent changes made by applying the present invention specification and the scope of patent application should be included in the patent scope of the present invention.
Claims
1. A camera device for a punch press safety auxiliary system, comprising a first camera and a second camera arranged on a punch press; the punch press has a base, a working platform and a punch are arranged on the base along a Z-axis at intervals; a working area is defined in the space between the working platform and the punch; The first camera has a first lens, and the second camera has a second lens; the first camera and the second camera are arranged on two sides of opposite directions outside the working area, and the first lens and the second lens are facing each other; the field of view of the images taken by the first camera and the second camera at least covers the working area, and the images taken by the first camera and the second camera are transmitted to a punching machine safety assistance system for identifying human hands.
2. The photographic device of the punch press safety assistance system according to claim 1, wherein: The first lens has a first optical axis, the second lens has a second optical axis, and a line where the first optical axis and the second optical axis overlap is defined as an optical axis line; the optical axis line passes through the working area.
3. The photographic device of the punch press safety assistance system according to claim 2, wherein: There is a first offset angle between the first optical axis and the line connecting the optical axes, and the angle of the first offset angle is less than or equal to 15 degrees; there is a second offset angle between the second optical axis and the line connecting the optical axes, and the angle of the second offset angle is less than or equal to 15 degrees.
4. The photographic device of the punch press safety assistance system according to claim 3, wherein: The first offset angle is 0 degrees; the second offset angle is 0 degrees.
5. The photographic device of the punch press safety assistance system according to claim 1, wherein: The punch press is provided with a driving system on the machine base, and the driving system is used to drive the punch to move forward and backward along the Z axis toward the working platform; an electrical box is provided on the machine base, and the electrical box is electrically connected to the driving system to supply power required for the operation of the driving system.
6. The photographic device of the punch press safety assistance system according to claim 5, wherein: The first camera and the second camera are respectively connected to a control host of the punch press safety auxiliary system by signal, and transmit the captured images to the control host; the electrical box of the punch press is electrically connected to the control host and is powered off under the control of the control host.