How to operate an overhead crane equipped with a human detection system
The method enhances worker detection by combining camera views and coordinates to prevent collisions by stopping the crane if multiple cameras lose sight of a worker, addressing the challenge of obstructed views in conventional systems.
Patent Information
- Application Number
- JP2021137732
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-26
- Publication Date
- 2024-11-13
- Estimated Expiration
- 2041-08-26
AI Technical Summary
Conventional crane safety devices face challenges in detecting workers when their field of view is blocked by the load or when they are under the suspended load, leading to difficulty in accurately identifying potential collisions.
The method combines the field of view and coordinates of multiple cameras centered on the hook, establishing a security area where a person's presence is monitored, and the crane is stopped if the cameras lose sight of the person twice in a row, using a simple equipment configuration to prevent collisions.
Ensures reliable detection of workers by minimizing blind spots and preventing collisions through timely stopping of the crane, even when the camera view is obstructed by the load.
Smart Images

Figure 0007581576000003 
Figure 0007581576000004 
Figure 0007581576000005
Abstract
Description
[Technical field]
[0001] The present invention relates to a method for operating an overhead crane equipped with a human detection system that prevents accidents such as collisions between a worker and a load suspended by the crane in a crane work area. [Background technology]
[0002] Conventionally, a crane collision prevention device has been proposed that uses a distance sensor to determine the distance to an object, calculates the object's moving speed based on the change in distance over time, and obtains the relative speed of the crane to perform collision prevention control (see, for example, Patent Document 1).
[0003] The applicant of the present application has previously proposed the following devices 1 to 5 using a range finder, i.e., a scanning type light wave distance meter capable of outputting physical shape data of a space, also called "light detection and ranging" or "laser imaging detection and ranging" (LIDAR, an abbreviation for Light Detection and Ranging or Laser Imaging Detection and Ranging. It is a remote sensing technology that uses light, and measures scattered light in response to pulsed laser irradiation to analyze the distance to a distant object and the shape and properties of the object.): 1. A device that, when creating a 3D map of a crane work area, determines whether a blind spot has occurred and performs a scanning operation again at a position that compensates for the blind spot to create a 3D map without blind spots (see Patent Document 2). 2. A device that can confirm the safety of a crane work area by implementing measures against external light disturbance with a simple equipment configuration and reliably extracting the worker without being affected by the crane's work environment (see Patent Document 3). 3. A device with a simple equipment configuration that determines the size of the object being handled by the crane when it is hoisted, and changes the deceleration distance depending on that information to prevent collision with objects such as workers (see Patent Document 4). 4. A device with a simple equipment configuration that enables three-dimensional measurements of the object being handled and objects to be performed in real time, determines the size of the object being handled by the crane when it is hoisted, and decelerates and stops depending on that information to prevent collision with objects including moving objects such as workers (see Patent Document 5). 5. A safety device for a crane that can directly detect the inclination of the object being handled by the crane by enabling three-dimensional measurement of the object in real time with a simple equipment configuration (see Patent Document 6). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2017-71455 A [Patent Document 2] JP 2019-127372 A [Patent Document 3] JP 2019-127374 A [Patent Document 4] JP 2019-127375 A [Patent Document 5] Patent Publication No. 2021-54584 [Patent Document 6] Patent Publication No. 2021-54585 Summary of the Invention [Problem to be solved by the invention]
[0005] However, with the above-mentioned conventional crane safety devices, it could become difficult to detect an operator if the camera's field of view is blocked by luggage when working near a suspended load during hoisting, or if the operator goes under the suspended load during transport and is no longer visible on the camera.
[0006] In consideration of the problem with the above-mentioned conventional crane safety devices, particularly the human detection systems, that it becomes difficult to detect the worker due to the load being handled by the crane, the present invention aims to provide a method for operating an overhead crane equipped with a human detection system that is composed of simple equipment such as multiple cameras, making it possible to prevent accidents such as collisions between the worker and the load suspended by the crane in the crane work area. [Means for solving the problem]
[0007] In order to solve the above problems, the method of operating an overhead crane equipped with a human detection system of the present invention combines the fields of view and coordinates of multiple cameras into a reference coordinate centered on the hook, traces a person within the range where it can be detected, and sets up a warning area in which it is determined that the person will be in danger if the person's position information is suddenly lost.If all cameras tracing a person within the warning area lose sight of the person twice in a row, it is determined that the person has disappeared, and the crane is stopped along with an announcement to that effect.
[0008] In this case, the operating device used to operate the ceiling crane on the ground can be equipped with buttons for enabling and disabling the human detection system, inspecting the human detection system, and for rigging work, so that the range for detecting people can be switched and the human detection system can be inspected depending on whether or not a load is suspended.
[0009] The overhead crane can also be provided with a human detection status indicator light and a number of people display that displays the number of people detected by the human detection system, thereby indicating the status of the human detection system. Effect of the Invention
[0010] According to the method of operating an overhead crane equipped with a human detection system of the present invention, after the crane power is turned on, images are taken with a camera at short intervals of several times per second, for example every 250 msec, and people are traced in areas where they can be detected. A security zone is set up in the area close to the suspended load, and if all cameras tracing a person in the security zone are unable to detect them twice in a row, it is assumed that the person's position information has been lost, and the crane is stopped along with an announcement. With a simple equipment configuration, collisions with objects such as workers can be prevented when blind spots occur due to the items being handled by the crane. [Brief description of the drawings]
[0011] [Figure 1] 1 is a system configuration diagram showing an embodiment of a control device for implementing a method for operating an overhead crane equipped with a human detection system of the present invention. FIG. [Diagram 2] A diagram of the field of view of two cameras. [Diagram 3] This is a diagram of the concept of human disappearance. [Figure 4] FIG. [Diagram 5] FIG. [Figure 6] FIG. 13 is a diagram of a human detection count display and an example of the display. [Figure 7] FIG. 13 is a diagram showing camera dirt determination. [Figure 8] This is a diagram of how to consider load size (circumscribed circle). [Figure 9] FIG. 13 is a diagram of a human detection management area. [Figure 10] FIG. 1 is a diagram of the safety area of the hoisting operation. [Figure 11] FIG. 1 is a diagram of a safe area for traverse motion. [Figure 12] FIG. 1 is a diagram of a safe area for running motion. [Figure 13] FIG. 1 is a diagram of the safety area for simultaneous lateral travel operations. [Figure 14] This is a diagram of the concept of simultaneous traverse and travel operation. [Figure 15] This is a diagram of the concept of suspended load transport height. [Figure 16]FIG. 13 is a diagram of rope length correction. [Figure 17] FIG. 1 is a diagram illustrating the concept of crane speed. [Figure 18] This is a diagram showing a normal person disappearance timing chart. [Figure 19] This is a timing chart of human disappearance showing the first disappearance and second human detection. [Figure 20] This is a timing chart showing the first and second disappearances of people. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an embodiment of the method for operating an overhead crane according to the present invention will be described with reference to the drawings.
[0013] 1 to 20 show an embodiment of a method for operating an overhead crane equipped with a human detection system of the present invention.
[0014] FIG. 1 is a system configuration diagram showing an embodiment of a control device for implementing a method for operating an overhead crane equipped with a human detection system according to the present invention. Here, the load is registered in advance as its maximum standard size (length, width, height) in computer 16 via touch panel 17, and the shape of the load is defined as a circumscribing circle with a radius from the center of the load to the farthest point, as shown in Figure 8, and the distance from the end of the load to the person is calculated. During slinging work, calculations are made on the distance from the hook to the person while the "sling" button on the wireless controller in Figure 4 is pressed.
[0015] Overhead cranes equipped with human detection systems are inspected before crane operations begin, and inspection work is carried out to check the number of people detected and to determine whether the human detection system and the workers' helmets are dirty. The inspection method is to press the "Human Detection" selection button on the wireless controller to enable or disable the human detection system (Figure 4), confirm that it is enabled by checking that the blue human detection status indicator (signal tower) (Figure 5) is lit, and then press the inspection button to begin the inspection. During inspection, the human detection status indicator lights in Figure 5, which show the status of the human detection system, are displayed in order from top to bottom, and after testing all of the indicator lights, inspection is carried out according to the announcements. To determine whether the helmet mark is dirty, the images of the infrared spotlights turned on and off as shown in the system configuration diagram in Figure 1 are taken by the human detection cameras (human detection camera 1, human detection camera 2) 18, 20, which are imported into a computer, and the number detected is compared with the number of helmets installed under the crane. If the number detected is less than the number installed, it is determined to be dirty. To determine whether the camera and floodlight are dirty, the crane is moved for 10 seconds, and dirt is detected if a black object is always attached to the same position within the camera's field of view in the video captured by the camera as shown in Fig. 7, even though the background changes due to the movement of the crane. When personnel are replaced or increased during work, the number of people detected is constantly checked using the people detection count display in Fig. 6 as an inspection response for only the helmet condition.
[0016] After the camera inspection is completed before the crane begins operation, the human detection system switches to a detectable state and divides the area in which humans can be detected into the nine human detection control areas shown in Figure 9. For each operation, the crane operates at a speed that will not collide with the worker, while determining whether or not each area is a safe area. The safe area is defined as the location where the human detection system judges it is safe to detect a person, and it differs for each crane operation. For example, the safe area for the hoisting operation of a load is set to a location more than 2000 mm away from the end of the load, as shown in Figure 10. Here, "2000 mm from the end of the load" is based on the fact that "How to Proceed with Safe Rigging Work (2)" published in the April 2017 issue of the monthly magazine "Crane" states that 2000 mm from the end of the load is a safe evacuation position, so here it is tentatively defined as 2000 mm and can be changed by a parameter.
[0017] As shown in Figure 2, the function to detect people when lifting or lowering is performed by two cameras installed diagonally above the club, each with its own field of view and coordinates, and in order to accurately measure the relative positions of people, the respective coordinates are synthesized into one reference coordinate. In the case of a crane, as a person moves around the suspended load, the helmet mark is obscured by the wire rope or hook and goes undetected by a single camera, so by installing two cameras diagonally above the club, blind spots are eliminated. In coordinate synthesis, the camera can detect people within 750mm+β. The person is considered to be the same person, and 750mm is assumed to be the width of a person's shoulders. β is set to -250 to 250mm. The person disappearance function sets up a warning area around a suspended load that can be determined to be dangerous if a person disappears, as shown in Figure 3, and after the crane power is turned on, images are taken with two cameras at short intervals of several times per second, for example, every 250 ms. The person disappearance function detects the three states in Figures 18 to 20, and if the state in Figure 20 occurs, a person is deemed to have disappeared. Specifically, the timing chart in Figure 18 shows the normal state when the person disappearance function is not operating. After the power to the crane is turned on, images are taken every 250 ms with cameras 1 and 2 when the floodlights are on and off, and the coordinates are synthesized. Next, people whose positions in the first and second images are close to each other are considered to be the same person, and under normal circumstances, people are traced by comparing the distance from the previous position in the order of images taken from the second image onwards. The timing chart in Figure 19 shows the state of person disappearance the first time and person detection the second time. The second and third shots are compared, and if there is no person nearby, it is determined that person disappearance occurred the first time. In the fourth shot, the distance between the second and fourth shots, in which a person was being traced, is compared, and if a person is detected nearby, tracing of the person continues. The timing chart in Figure 20 shows the state of person disappearance the first time and the second time. The second and third shots are compared, and if there is no person nearby, it is determined that the first person disappearance has occurred. In the fourth shot, the distance between the second and fourth shots, which were tracing the person, is compared, and if there is no person nearby, it is determined that the second person disappearance has occurred, and the computer notifies the PLC control panel and stops the crane. The crane will still be stopped if a person is detected in the fifth shot. The condition for a person to have disappeared is when, while tracing a person within the surveillance area as shown in Table 1, neither camera 1 nor camera 2 detects a person two consecutive times. This makes it possible to prevent false detections caused by noise in the images captured by the human detection system while ensuring safety. In this embodiment, the case where the required field of view can be covered with two cameras has been described, but if the required field of view cannot be covered with two cameras, three or more cameras can be used. In this case, too, if all cameras tracing a person within the security area lose sight of the person twice in a row, it is determined that the person has disappeared.
[0018] [Table 1]
[0019] In the traverse-only operation shown in FIG. 11, the system designates the control areas “(1), (3), (4), (6), (7), (8), (9) and part of (5)” as the safe areas. The stopping area shall be within a range of 2000 mm in front of both the left and right ends of the suspended load in the direction of travel, and shall also include the area behind the load, taking into consideration the possibility of people jumping out from the side or entering under the suspended load from the rear. In Figure 11, if a person is detected in area (2) ahead in the direction of travel, it is determined that there is a possibility of danger to the person, so the crane slows down and the yellow lamp of the person detection status indicator in Figure 5 flashes. If a person is still detected in area (5), the crane stops and the yellow lamp lights up. do. In the case of driving alone as shown in Figure 12, if the safety area changes and a person is detected ahead in area (4) in the direction of travel, it will determine that there is a possibility of danger to the person, and the crane will switch to a slow speed and the yellow lamp of the person detection status indicator in Figure 5 will flash. If it continues to detect a person in area (5), it will stop and the yellow lamp will light up.
[0020] When traversing and traveling simultaneously, the safety area is the area controlled by (3), (6), (7), (8), (9) and part of (5) in Figure 13. In Figure 13, if a person is detected in areas (1), (2), and (4) ahead in the direction of travel, it is determined that there is a possibility of danger to the person, so the crane switches to a slow speed and the yellow lamp of the person detection status indicator in Figure 5 flashes. If it continues to detect a person in area (5), it stops and the yellow lamp lights up. When a safety area is set as in the control area in Figure 13 for simultaneous traverse and travel operations, the safety area setting should remain as in Figure 13 for simultaneous traverse and travel operations until the movement ends so that the operator can be sure to detect the person and stop the machine even if he or she releases his or her hand from either the traverse or travel button during simultaneous traverse operation as shown in Figure 14.
[0021] The transport height at which a person will not collide with a suspended load when hoisting it can be calculated as shown in Fig. 15. Let h / 2 be half the height of the suspended load registered on the touch panel, Lf be the hook rope length calculated from the hoisting speed, Ls be the length of the sling rope set in advance, and H be the distance from the pendulum fulcrum position to the floor. Conveying height = H-(h / 2+Ls+Lf) If the transport height does not reach 2000 mm, a height at which the crane will not hit a person, the crane will operate at low speed; if it reaches 2000 mm, the white human detection status indicator in Figure 5 will light up and high-speed operation will be possible. For example, if the height h of the suspended load is set to 2000 mm, half the height of the suspended load (h / 2) is 1000 mm. If the hook rope length Lf calculated from the hoisting speed is 8000 mm, the sling rope length Ls is 2000 mm, and the distance H from the pendulum fulcrum position to the floor surface is 12000 mm, the transport height is: Conveying height = 12000mm - (1000mm + 2000mm + 8000mm) = 1000mm Since this is lower than 2000mm, the crane will operate at a slow speed. When the hook rope length Lf is increased to 6000 mm by lifting the load from this state, the transport height is as follows: Conveying height = 12000mm - (1000mm + 2000mm + 6000mm) = 3000mm Since this is higher than 2000mm, the crane will operate at high speed. In addition, the transport height of the suspended load is corrected based on the upper limit operating position or the height at which the load is detected by the load cell as shown in FIG. 16.
[0022] The travel and traverse speeds at which a person will not collide with a suspended load are calculated based on the information on the maximum suspended load size registered on the touch panel, and the distances (1) to (6) from the camera field of view to the person are calculated as shown in Figure 17. The speed at which the person will not collide with the suspended load is determined as the stopping distance for the crane. This is the speed at which the person will not collide with the suspended load even if the crane is operating at high speed, regardless of the transport height of 2000 mm. Crane stopping distance = [(1) Half the field of view of one camera] + [(2) Camera installation distance in the direction of movement] - ([(3) Radius from the center of the load to the furthest point] + [(4) Distance traveled due to human detection processing time] + [(5) Average height of a person (similar)] + [(6) Safety distance from a person to the end of the load]) For example, (1) half the field of view of one camera is set to 7500 mm, (2) the camera is set to the direction of movement. (3) The attachment distance is 1500 mm, (3) The radius from the center of the load to the furthest point is 2500 mm, (4) The movement distance due to the human detection processing time is 1000 mm, (5) The average height of a person (similar) is 1700 mm, and (6) The safe distance from a person to the end of the load is 2000 mm. The crane stopping distance is: Crane stopping distance = [(1) 7500 mm] + [(2) 1500 mm] - ([(3) 2500 mm] + [(4) 1000 mm] + [(5) 1700 mm] + [(6) 2000 mm]) = 1800 mm It becomes. If the rated speed of a crane is 1 m / s, the deceleration time is 6 seconds. The speed and deceleration time are proportional, and the crane stopping distance is calculated as 1 / 2 * [crane speed] * [deceleration time]. Therefore, the relationship between crane speed, deceleration time, and crane stopping distance is shown in Table 2.
[0023] [Table 2]
[0024] In Table 2, the speed at which the crane stopping distance is 1800 mm or less is the speed at which a person will not be hit by the suspended load, so the speed at which a person will not be hit by the suspended load is 0.7 m / s.
[0025] The above describes the operating method of an overhead crane equipped with a human detection system of the present invention based on an embodiment thereof. However, the present invention is not limited to the configuration described in the above embodiment, and the configuration can be modified as appropriate within the scope of the spirit of the present invention. [Industrial Applicability]
[0026] The method of operating an overhead crane equipped with a human detection system of the present invention has a simple equipment configuration, and can stop the crane to prevent a worker from being crushed under a suspended load when the camera's field of view is blocked by luggage while working near the suspended load during hoisting, or when the worker goes under the suspended load and becomes invisible to the camera. Therefore, the method can be suitably used for overhead cranes, and can also be used for construction machinery that uses cranes, for example. Cut. [Explanation of symbols]
[0027] 01 Main motor 02 Main winding inverter 03 Auxiliary motor 04 Auxiliary winding inverter 05 Traverse motor 06 Traverse inverter 07 Driving motor 08 Travel inverter 09 PLC control panel 10 Person detection status indicator 11 People detection count indicator 12 Radio receiver 13 Load Cell 14 Upper limit switch 15 Audio loudspeaker 16. Computer 17 Touch Panel 18 Human detection camera 1 19 Person detection floodlight 1 20 Human detection camera 2 21 Person detection floodlight 2 22 Wireless transmitter (wireless control device)
Claims
1. A method for operating an overhead crane equipped with a human detection system, comprising the steps of: combining the fields of view and coordinates of multiple cameras into a reference coordinate centered on the hook; tracing an area in which a person can be detected; establishing a warning area in which it is determined that the person will be in danger if the person's position information is suddenly lost; and if, while tracing a person within the warning area, the human detection means determines that a person has not been detected twice consecutively in images taken by all of the cameras at specified time intervals, it is determined that the person has disappeared, and stopping the crane along with an announcement to that effect.
2. A method for operating an overhead crane equipped with a human detection system as described in claim 1, characterized in that an operating device for operating the overhead crane on the ground is provided with buttons for enabling and disabling the human detection system, inspecting the human detection system, and for rigging work, and the human detection range is switched and the human detection system is inspected depending on whether or not a load is suspended.
3. 3. A method for operating an overhead crane equipped with a human detection system according to claim 1 or 2, characterized in that the overhead crane is provided with a human detection status indicator light and a human detection number indicator, which indicate the status of the human detection system.
Citation Information
Patent Citations
Safety confirmation device of crane
JP2010241548A
Collision prevention device of cargo crane
JP2017071455A
Work procedure guide system
JP2017075001A
Work support device, and work support method
JP2018080054A
Crane work area safety confirmation device
JP2019127372A
