Method and system for detecting operation safety of portal crane

Abstract

The invention provides a portal crane operation safety detection method and system, and belongs to the technical field of operation safety detection.The method comprises the steps that the portal crane operation type is recognized based on a portal crane image, and the operation range is determined based on the portal crane operation type and portal crane position information; dividing the operation range into a first area and a second area based on the operation type of the portal crane; and performing image recognition on the first area and the second area to obtain a personnel evacuation detection result. According to the portal crane operation safety detection method and system provided by the invention, the accuracy of personnel evacuation detection can be improved.

Description

Technical Field

[0001] The present disclosure belongs to the technical field of operation safety detection, and more specifically, to a method and system for detecting the operation safety of a gantry crane. Background Art

[0002] Safety inspection of gantry crane operation is an important part to ensure the safe operation of gantry cranes in ports, docks, factories and other places. In many cases, workers need to enter the operating range of the gantry crane to carry out relevant inspections or repairs. At this time, the inspection of whether the operators have evacuated in time is an important part of the safety management of gantry crane operation. Its purpose is to ensure that during the operation of the gantry crane, when dangerous situations occur or before the gantry crane operation begins, all operators can evacuate the operating area in a timely and safe manner.

[0003] However, current detection technology for personnel evacuation still suffers from low accuracy. Summary of the invention

[0004] The purpose of the present disclosure is to provide a gantry crane operation safety detection method and system to improve the accuracy of personnel evacuation detection.

[0005] A first aspect of an embodiment of the present disclosure provides a method for detecting safety of a gantry crane operation, comprising: The operation type of the gantry crane is identified based on the gantry crane image, and the operation scope is determined based on the gantry crane operation type and the gantry crane position information.

[0006] The operation range is divided into a first area and a second area based on the operation type of the gantry crane.

[0007] Image recognition is performed on the first area and the second area respectively to obtain a personnel evacuation detection result.

[0008] A second aspect of the embodiments of the present disclosure provides a gantry crane operation safety detection system, including: The first calculation module is used to identify the door crane operation type based on the door crane image, and determine the operation range based on the door crane operation type and the door crane position information.

[0009] The second calculation module is used to divide the operation range into a first area and a second area based on the operation type of the gantry crane.

[0010] The image recognition module is used to perform image recognition on the first area and the second area respectively to obtain a personnel evacuation detection result.

[0011] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the above-mentioned gantry crane operation safety detection method when executing the computer program.

[0012] According to a fourth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned gantry crane operation safety detection method are implemented.

[0013] The beneficial effects of the gantry crane operation safety detection method and system provided by the embodiments of the present disclosure are: On the one hand, by identifying the gantry crane operation type in real time and defining the operation scope accordingly, the safety hazards caused by human misjudgment or delays in traditional methods are effectively avoided.

[0014] On the other hand, by carefully dividing the first area and the second area and conducting targeted image recognition, system resources are rationally allocated, the monitoring accuracy of personnel activities in the working area is improved, and the timely evacuation of personnel when working in dangerous areas is ensured, reducing the risk of accidents.

[0015] In summary, the disclosed embodiments achieve efficient and accurate division and monitoring of the gantry crane operating area through the comprehensive use of image recognition and positioning technology, and improve the accuracy of personnel evacuation safety detection. It realizes automated and intelligent safety detection, reduces the burden of manual supervision, improves operating efficiency and safety, and provides technical support for the continuous optimization and safety management of the gantry crane operating environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 A schematic diagram of a flow chart of a method for detecting safety of gantry crane operation provided in one embodiment of the present disclosure; Figure 2 A structural block diagram of a gantry crane operation safety detection system provided in an embodiment of the present disclosure; Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0018] In the following description, specific details such as specific system structures and technologies are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present disclosure. However, it should be clear to those skilled in the art that the present disclosure may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obstructing the description of the present disclosure with unnecessary details.

[0019] In order to make the purpose, technical solutions and advantages of the present disclosure more clear, specific embodiments will be described below in conjunction with the accompanying drawings.

[0020] Please refer to Figure 1 , Figure 1 A schematic flow chart of a method for detecting the safety of gantry crane operations provided in one embodiment of the present disclosure, the method may include S101 to S103.

[0021] S101: Identify the door crane operation type based on the door crane image, and determine the operation range based on the door crane operation type and door crane position information.

[0022] In this embodiment, the description of the gantry crane mainly refers to the mechanical arm and hook (or grab) structure of the gantry crane. For example, the distance between the gantry crane and the target material refers to the distance between the hook (or grab) and the target material. The gantry crane operation types may include material grabbing operation, material lifting operation, material transportation operation and unloading operation. Different gantry crane operation types have different ranges of activity and affected areas.

[0023] For example, for container loading and unloading, the operation scope may include the container stacking area on the ship, the container transfer area at the front of the wharf, and the container stacking and sorting area in the yard. For bulk cargo loading and unloading, the operation scope may include the ship's cargo hold, the bulk cargo conveying equipment at the wharf, and the bulk cargo stacking area in the yard. In either case, different types of gantry crane operations correspond to different areas in the above operation scope. The specific operation scope can be preliminarily determined based on the typical operation scope model corresponding to each operation type set in advance and the actual identified gantry crane operation type.

[0024] In this embodiment, the gantry crane position information is the specific geographical location of the gantry crane in the operating area. The gantry crane position information may include berth number, track position or coordinate information. Among them, the coordinate information may be a relative position coordinate determined according to a map of the wharf where the gantry crane is located. The gantry crane position information can further accurately correct the operating range based on the preliminary operating range determined based on the gantry crane operation type. For example, the relative operating range relative to the gantry crane can be determined based on the gantry crane operation type. The gantry crane operates at different berths, and the corresponding ships and yard areas will be different. The gantry crane position information can be used to accurately define the specific actual operating range related to the current position of the gantry crane.

[0025] In this embodiment, identifying the operation type of the door crane based on the door crane image may include: Recognize the door crane action based on the door crane image, and obtain the scene information of the door crane based on the door crane image; the scene information includes the target operation object information and the marker information of the door crane operation; Determine the gantry crane operation type based on the gantry crane action and scene information.

[0026] Exemplarily, the gantry crane action refers to the movement state and mode of each component of the gantry crane. The gantry crane action may include the lifting, lowering, rotating, walking, and opening and closing of the sling of the gantry crane. The combination and sequence of these actions reflect the specific operation of the gantry crane. Scene information refers to the surrounding environment and related feature information of the gantry crane during operation. The target operation object information may include container, bulk cargo, ship components and related shape, size, color, position and other feature information. Marker information refers to the specific identification of the terminal or the information of the object with symbolism. Marker information may include the identification signs of different areas of the terminal, the specific structure of the ship, special loading and unloading equipment, etc. These markers can assist in determining the operation position and related operation scenes of the gantry crane, and then infer the operation type of the gantry crane.

[0027] For example, at Port A, a gantry crane is operating. After collecting the gantry crane image, through analysis of the gantry crane image, it is identified that the gantry crane's action is lifting with rotation, and the target operation object is a container. At the same time, there are landmarks of the container stacking area and characteristic structures of the ship in the scene, and the operation type is determined to be a container lifting operation.

[0028] Combined with the gantry crane location information, it is known that it is located at berth 2. According to the pre-set mapping rules between the gantry crane operation type and the operation scope, the operation scope includes the area where the container is located on the ship, the transportation path from the front of the wharf to the corresponding yard, and the designated container stacking area in the yard. Within this operation scope, personnel safety management is carried out, and warning signs are set (such as turning on the indicator light in the operation scope) to prevent irrelevant personnel from entering and reminding personnel to evacuate. Within this operation scope, the operation path and speed of the gantry crane can also be planned to ensure the safe and efficient container loading and unloading operations. When the gantry crane operation type or gantry crane location information changes, the operation scope can be re-determined to adapt to different operation requirements.

[0029] S102: Divide the operation range into a first area and a second area based on the operation type of the gantry crane.

[0030] In this embodiment, according to the risk level and safety requirements of different gantry crane operation types, the corresponding operation range is divided into a first area and a second area. The risk level of the first area is higher than that of the second area.

[0031] Exemplarily, the first area is a high-risk core area. For example, in container loading and unloading operations, the area directly below the container and near the lifting path can be divided into the first area, because this is the area directly affected by heavy objects and the risk of accidents such as falling is higher; the second area is a relatively low-risk surrounding area, such as the surrounding yard area a certain distance away from the container lifting point.

[0032] S103: Perform image recognition on the first area and the second area respectively to obtain a personnel evacuation detection result.

[0033] In this embodiment, performing image recognition on the first area and the second area respectively includes: Performing image recognition on the first area based on a first image recognition strategy; Image recognition is performed on the second area based on a second image recognition strategy.

[0034] Exemplarily, for image recognition, a target detection algorithm is used to identify people in the image. In the first area, the first detection frequency and the first recognition accuracy can be used for image recognition to ensure that no people are stranded. If a person is detected, an alarm is immediately issued and corresponding measures are taken. In the second area, the detection is relatively loose, and the second detection frequency and the second recognition accuracy can be used for image recognition, but it is still necessary to ensure that the people are in a safe state. The first detection frequency is higher than the second detection frequency, and the first recognition accuracy is higher than the second recognition accuracy. For example, when the door machine is operating, the first area and the second area are monitored by cameras installed at multiple fixed positions around the door machine or on the door machine, and the image data is transmitted to the image processing system in the background to identify the personnel in the area and obtain the personnel evacuation detection result.

[0035] It can be concluded from the above that, on the one hand, this embodiment effectively avoids the safety hazards caused by human misjudgment or delay in traditional methods by real-time identification of the gantry crane operation type and demarcation of the operation scope accordingly.

[0036] On the other hand, this embodiment reasonably allocates system resources by finely dividing the first area and the second area and performing targeted image recognition, thereby improving the monitoring accuracy of personnel activities in the working area, ensuring the timely evacuation of personnel when working in dangerous areas, and reducing the risk of accidents.

[0037] In summary, this embodiment uses image recognition and positioning technology to achieve efficient and accurate division and monitoring of the gantry crane operating area, and improves the accuracy of personnel evacuation safety detection. It realizes automated and intelligent safety detection, reduces the burden of manual supervision, improves operating efficiency and safety, and provides technical support for the continuous optimization and safety management of the gantry crane operating environment.

[0038] In one embodiment of the present disclosure, the operation range is divided into a first area and a second area based on the operation type of the gantry crane, including: Determine the risk level of the operation scope based on the type of gantry crane operation.

[0039] The operation scope is divided into a first area and a second area based on the risk level, and the risk level of the first area is higher than the risk level of the second area.

[0040] In this embodiment, the intersection of the second area and the first area is empty, and the union of the first area and the second area constitutes the operating range.

[0041] In this embodiment, the risk level of the operation scope is determined based on the gantry crane operation type, including: Determine risk factors based on the type of gantry crane operation; Determine the risk level of the scope of work based on the risk factors.

[0042] For example, the possible risk factors are analyzed according to the type of gantry crane operation. The risk factors may include the risk of heavy objects falling, the risk of collision, and the risk of personnel exposure. For different types of operations, the degree and scope of these risks are different. The risk level of the operation scope is determined based on the risk assessment results of the risk factors. The part with a risk value greater than or equal to the preset risk threshold (i.e., a higher risk) is divided into the first area, and the part with a risk value less than the preset risk threshold (i.e., a lower risk) is the second area. In actual operations, the first area is focused on and stricter safety measures are taken, such as restricting personnel entry, adding safety protection facilities, and increasing the frequency of inspections, while the second area is relatively loosely managed, but still maintains a certain degree of safety monitoring.

[0043] This embodiment divides the operating scope into different areas based on risk levels, so that safety management and resource allocation can be carried out in a more targeted manner. The first high-risk area requires stricter monitoring and safety measures to minimize the possibility and degree of harm of accidents. The second relatively low-risk area can adopt a more conventional management method, which can not only ensure operational safety, but also improve management efficiency, reasonably allocate resources, and avoid excessively strict management of the entire operating scope. Increased costs and reduced efficiency. In addition, it is clear that the intersection of the two areas is an empty union that constitutes the operating scope, which ensures the clarity and completeness of the regional division and avoids management gaps or overlaps.

[0044] In one embodiment of the present disclosure, determining the operation range based on the door crane operation type and the door crane position information includes: The operation sequence is determined based on the operation type of the gantry crane. The operation sequence includes multiple operation procedures.

[0045] The working range corresponding to each working process is determined based on each working process and the door crane position information corresponding to each working process.

[0046] In this embodiment, the operation range corresponding to each operation process is determined based on each operation process and the door crane position information corresponding to each operation process, including: The first operation range is determined based on each operation step.

[0047] The second operating range is determined based on the gantry crane position information and the first operating range, and the second operating range is used as the corresponding operating range.

[0048] In this embodiment, the operation sequence refers to a series of sequential operation steps followed by the gantry crane when completing the operation task. For example, in the container loading and unloading operation at the terminal, the operation process includes moving the gantry crane to the ship position, lifting the container, transferring the container to the yard, and stacking it in the yard. Each operation step is an operation process.

[0049] The first operating range is determined based on the nature and characteristics of each operating process. The first operating range mainly considers the spatial range directly involved in the relevant operations of the operating process, and does not consider the correction of factors such as the specific position of the gantry crane. For example, in the container lifting process, the first operating range can be the space with a certain radius around the container as the center. This range is determined based on the normal impact range of the lifting operation.

[0050] The second operating range is the final operating range that is further adjusted and determined based on the first operating range and combined with the actual position information of the gantry crane. The specific geographical location of the gantry crane at the terminal, the surrounding environment and other factors are taken into consideration to make the operating range more accurate and in line with the actual operating conditions. For example, when the gantry crane is lifting a container at a specific berth at the terminal, the first operating range will be corrected according to the specific position of the gantry crane at the berth to obtain a more accurate second operating range.

[0051] For example, when the gantry crane at the dock performs container loading and unloading operations, the determined operation sequence includes the operation procedures of the gantry crane moving to the top of the ship, lifting the container, moving horizontally to the top of the yard, and lowering the container to the designated position of the yard. For the container lifting process, firstly, according to the industry standard, the first operation range is determined to be a circular area with a radius of 5 meters centered on the container, mainly considering factors such as the shaking of the container during the lifting process. After obtaining the specific location information of the gantry crane at a berth at the dock, for example, the gantry crane is close to the edge of the ship, in order to prevent the container from colliding with the ship structure during the lifting process, the first operation range will be adjusted according to the position of the gantry crane, and the range close to the edge of the ship will be reduced to obtain the second operation range. In actual operations, based on this second operation range, the evacuation of personnel is identified, warning signs are set, and the entry of personnel and other equipment is restricted to ensure the safe progress of the lifting operation. For other operation processes, their respective operation ranges are also determined in this way to achieve safe and efficient management of the entire container loading and unloading operation.

[0052] This embodiment combines the gantry crane operation type and real-time location information to accurately divide the operation scope of each operation process, taking into account the characteristics of the operation process itself and the actual situation on site, ensuring the scientific and reasonable operation scope. This embodiment can not only effectively improve the operation efficiency, but also significantly reduce safety risks. By accurately demarcating the operation area, it can effectively prevent accidents, ensure the safety of personnel and equipment, and achieve safe and efficient management of port operations.

[0053] In one embodiment of the present disclosure, determining the second operating range based on the door crane position information and the first operating range includes: The gantry crane coordinates are determined based on the gantry crane position information.

[0054] If the gantry crane coordinates belong to the target coordinate set, the first operating range is expanded to obtain the second operating range. The target coordinate set includes the coordinates of the preset area.

[0055] If the gantry crane coordinates do not belong to the target coordinate set, the first operating range is used as the second operating range.

[0056] In this embodiment, the target coordinate set is a set of gantry crane position coordinates with special significance or specific risk characteristics. The target coordinate set corresponds to the key area or high-risk area in the terminal. The target coordinate set may include the core area coordinates for ship loading and unloading, the coordinates of the densely stacked cargo area, and the coordinates of the area where cross-operation with other equipment is frequent. The preset area is an area with specific functions or risk attributes pre-set in the terminal, that is, the above-mentioned key area or high-risk area. Specifically, the preset area may also include the ship berthing area at the front of the terminal, the dedicated yard area for different types of cargo, the gantry crane walking track and the surrounding safety protection area, etc. The preset area can be determined based on the terminal's operating procedures, safety regulations and spatial layout to guide the determination and safety management of the gantry crane's operating range. When the gantry crane is located in these areas, the operating range needs to be specially handled to ensure safety.

[0057] In this embodiment, the door crane position information is obtained and its coordinates are determined by the positioning device on the door crane. Then the coordinates are matched with the target coordinate set. If the door crane coordinates belong to the target coordinate set, it means that the door crane is in a special area or a high-risk area. At this time, the first operating range is expanded to cover more areas that may be affected, thereby obtaining the second operating range and strengthening safety precautions. If the door crane coordinates do not belong to the target coordinate set, it is considered that the risk is relatively low or it is in a regular area, and the first operating range is directly used as the second operating range.

[0058] For example, when loading and unloading containers at the dock, when the gantry crane is located above the ship's cabin (the coordinates of this position belong to the target coordinate set) for lifting operations, its first operating range can be an area with a radius of r centered on the container. Because it is in the core loading and unloading area of ​​the ship, the risk is higher, and the system will expand the first operating range, for example, increase the radius by a meter, and cover a wider area around the cabin as the second operating range to prevent the container from shaking or other unexpected situations during the lifting process from affecting surrounding personnel and equipment. When the gantry crane moves on the regular walking track at the edge of the dock (the coordinates do not belong to the target coordinate set), its first operating range (such as the safety protection range around the gantry crane itself) can be directly used as the second operating range, because the risk is relatively low at this time, and it can be managed according to the conventional range.

[0059] This embodiment effectively enhances safety protection by identifying whether the gantry crane is in a high-risk area and dynamically adjusting the operating range. The operating range is expanded in high-risk areas to prevent potential dangers; the original range is maintained in conventional areas to improve operating efficiency, achieving dual optimization of safety and efficiency.

[0060] In one embodiment of the present disclosure, the door crane operation safety detection method further includes: The alarm information is determined based on the personnel evacuation detection result, and the door machine is controlled to perform the alarm operation based on the alarm information.

[0061] In this embodiment, the evacuation of personnel within the operating range of the door machine is detected by video image recognition, etc., to obtain the personnel evacuation detection result. If the detection result shows that there are still personnel who have not evacuated within the operating range, the corresponding alarm information is determined according to the preset rules. The alarm information may include the alarm level, alarm type, alarm mode, etc. The control system of the door machine controls the door machine to perform corresponding alarm operations, such as issuing an audible and visual alarm or stopping the operation of the door machine, etc., according to the received alarm information, to remind the on-site personnel to pay attention to safety and urge the personnel who have not evacuated to leave the dangerous area as soon as possible, so as to ensure the safe operation of the door machine.

[0062] For example, when a gantry crane is loading and unloading containers at a dock, when the gantry crane is preparing to lift the container, the personnel evacuation detection system finds that some staff members are still in the first area below the container and have not evacuated. At this time, a high-priority alarm message is generated, and the gantry crane immediately issues a strong sound and light alarm and stops the lifting action. The gantry crane will not resume normal operation until it is confirmed through detection that the personnel have evacuated the first area, thereby avoiding possible safety accidents and ensuring the safety and smooth progress of dock operations.

[0063] This embodiment effectively prevents safety accidents in the operation area, and ensures the safety of personnel on the operation site by real-time monitoring of personnel evacuation and linkage alarm mechanism. The rapid response alarm system promotes immediate evacuation and ensures the efficiency and safety of gantry crane operations.

[0064] In one embodiment of the present disclosure, image recognition is performed on the first area and the second area respectively to obtain a personnel evacuation detection result, including: Image recognition is performed on the first area based on the first detection mode to obtain a first detection result.

[0065] The second detection result is obtained by performing image recognition on the second area based on the second detection mode. The image acquisition frequency of the first detection mode is higher than the image acquisition frequency of the second detection mode. The image recognition accuracy of the first detection mode is higher than the image recognition accuracy of the second detection mode.

[0066] A personnel evacuation detection result is determined based on the first detection result and the second detection result.

[0067] In this embodiment, for the first area with higher risk, a high-frequency and high-precision first detection mode is used to capture the personnel situation more timely and accurately. For the second area with relatively low risk, a lower-frequency and lower-precision second detection mode is used for monitoring. Image recognition is performed on the corresponding areas through the two modes to obtain detection results, and the first detection results and the second detection results are comprehensively analyzed. If the first detection result shows that some people have not evacuated, it is directly determined that there is a safety hazard; if the first detection result is safe, the overall personnel evacuation situation is further confirmed in combination with the second detection result to ensure a comprehensive and accurate judgment of the safety status of personnel in the operating area.

[0068] Exemplarily, for the first detection mode, a complex image recognition algorithm is used, such as a high-precision target detection algorithm based on deep learning, which can accurately identify the subtle features and movements of personnel. A higher image acquisition frequency is set, such as collecting 5 frames of images per second, to monitor the dynamics of personnel in the first area in real time. If the operating range of the gantry crane is relatively fixed, high-definition and high-speed cameras with advanced image sensors and fast data transmission interfaces can be deployed in some high-risk fixed operating ranges, and ordinary definition cameras can be installed in the low-risk areas on the outer edge, which are relatively low-cost and can meet basic image acquisition needs.

[0069] For the second detection mode, a relatively simple image recognition algorithm can be used to mainly identify the general outline and position of the personnel. The image acquisition frequency is relatively low, for example, 2 frames of images are collected per second, which reduces the consumption of system resources while ensuring a certain monitoring effect. A data processing center is established to receive the detection results from the first area and the second area. When the first detection result shows that there is no one in the first area, the second detection result is further analyzed. If the second detection result also shows that there is no one in the second area, it is determined that the entire operating area has been evacuated. If any of the first detection result or the second detection result shows that there is a person, it is necessary to issue an alarm and take corresponding measures, such as stopping the operation of the gantry crane.

[0070] For example, when a gantry crane at a dock is performing container loading and unloading operations, the area directly affected by the crane hook and its vicinity is set as the first area, and the first detection mode is used. When the gantry crane is ready to lift the container, the first detection mode quickly identifies whether there are people in the area with high frequency and high accuracy. The surrounding area slightly away from the hook is set as the second area, and the second detection mode is used for monitoring. If the first detection result shows safety and the second detection result is also normal, the gantry crane will perform the lifting operation. Otherwise, the operation will be stopped immediately and an alarm will be sounded to remind personnel to evacuate and ensure the safety of the operation.

[0071] This embodiment uses regional and differentiated image recognition strategies to efficiently and accurately monitor the evacuation of personnel, ensuring that high-risk areas are monitored in key areas, while optimizing resource utilization and improving overall operational safety and efficiency.

[0072] Corresponding to the gantry crane operation safety detection method in the above embodiment, Figure 2 This is a structural block diagram of a door crane operation safety detection system provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Figure 2 The gantry crane operation safety detection system 20 includes: a first calculation module 21, a second calculation module 22 and an image recognition module 23.

[0073] Among them, the first calculation module 21 is used to identify the door crane operation type based on the door crane image, and determine the operation range based on the door crane operation type and the door crane position information.

[0074] The second calculation module 22 is used to divide the operation range into a first area and a second area based on the operation type of the gantry crane.

[0075] The image recognition module 23 is used to perform image recognition on the first area and the second area respectively to obtain a personnel evacuation detection result.

[0076] In one embodiment of the present disclosure, the second calculation module 22 is specifically configured to determine the risk level of the operation scope based on the gantry crane operation type.

[0077] The operation scope is divided into a first area and a second area based on the risk level, and the risk level of the first area is higher than the risk level of the second area.

[0078] In one embodiment of the present disclosure, the first calculation module 21 is specifically configured to determine an operation sequence based on the operation type of the gantry crane. The operation sequence includes a plurality of operation procedures.

[0079] The working range corresponding to each working process is determined based on each working process and the door crane position information corresponding to each working process.

[0080] In an embodiment of the present disclosure, the first calculation module 21 is further configured to determine a first operation range based on each operation process.

[0081] The second operating range is determined based on the gantry crane position information and the first operating range, and the second operating range is used as the corresponding operating range.

[0082] In an embodiment of the present disclosure, the first calculation module 21 is further configured to determine the door crane coordinates based on the door crane position information.

[0083] If the gantry crane coordinates belong to the target coordinate set, the first operating range is expanded to obtain the second operating range. The target coordinate set includes the coordinates of the preset area.

[0084] If the gantry crane coordinates do not belong to the target coordinate set, the first operating range is used as the second operating range.

[0085] In one embodiment of the present disclosure, the gantry crane operation safety detection system 20 further includes: The alarm module is used to determine the alarm information based on the personnel evacuation detection result, and control the door machine to perform the alarm operation based on the alarm information.

[0086] In an embodiment of the present disclosure, the image recognition module 23 is specifically configured to perform image recognition on the first area based on the first detection mode to obtain a first detection result.

[0087] The second detection result is obtained by performing image recognition on the second area based on the second detection mode. The image acquisition frequency of the first detection mode is lower than the image acquisition frequency of the second detection mode. The image recognition accuracy of the first detection mode is higher than the image recognition accuracy of the second detection mode.

[0088] A personnel evacuation detection result is determined based on the first detection result and the second detection result.

[0089] See also Figure 3 , Figure 3 A schematic block diagram of an electronic device provided by an embodiment of the present disclosure. Figure 3The electronic device 300 in the embodiment shown may include: one or more processors 301, one or more input devices 302, one or more output devices 303 and one or more memories 304. The processors 301, input devices 302, output devices 303 and memories 304 communicate with each other via a communication bus 305. The memory 304 is used to store computer programs, which include program instructions. The processor 301 is used to execute the program instructions stored in the memory 304. The processor 301 is configured to call the program instructions to execute the functions of the modules in the above-mentioned system embodiments, such as Figure 2 The functions of modules 21 to 23 are shown.

[0090] It should be understood that in the embodiment of the present disclosure, the processor 301 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0091] The input device 302 may include a touch panel, a fingerprint collection sensor (for collecting the user's fingerprint information and fingerprint direction information), a microphone, etc., and the output device 303 may include a display (LCD, etc.), a speaker, etc.

[0092] The memory 304 may include a read-only memory and a random access memory, and provide instructions and data to the processor 301. A portion of the memory 304 may also include a non-volatile random access memory. For example, the memory 304 may also store information about the device type.

[0093] In a specific implementation, the processor 301, input device 302, and output device 303 described in the embodiments of the present disclosure can execute the implementation methods described in the first and second embodiments of the door crane operation safety detection method provided in the embodiments of the present disclosure, and can also execute the implementation methods of the electronic device 300 described in the embodiments of the present disclosure, which will not be repeated here.

[0094] In another embodiment of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by the processor, all or part of the processes in the above-mentioned embodiment method are implemented, and the computer program can also be completed by instructing the relevant hardware through the computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, the steps of each of the above-mentioned method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium can include: any entity or system capable of carrying computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0095] The computer-readable storage medium may be an internal storage unit of the electronic device of any of the aforementioned embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of the electronic device and an external storage device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0096] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0097] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the electronic devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0098] In the several embodiments provided in the present application, it should be understood that the disclosed electronic device and method can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces or units, or it can be an electrical, mechanical or other form of connection.

[0099] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present disclosure.

[0100] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0101] The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present disclosure, and these modifications or replacements should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A method for detecting the safety of gantry crane operation, characterized in that: include: Identify the door crane operation type based on the door crane image, and determine the operation range based on the door crane operation type and door crane position information; Dividing the operation range into a first area and a second area based on the operation type of the gantry crane; Image recognition is performed on the first area and the second area respectively to obtain a personnel evacuation detection result.

2. The gantry crane operation safety detection method according to claim 1, characterized in that: The dividing the operation range into a first area and a second area based on the operation type of the gantry crane includes: Determining the risk level of the operation scope based on the gantry crane operation type; The operation range is divided into a first area and a second area based on the risk level, and the risk level of the first area is higher than the risk level of the second area.

3. The gantry crane operation safety detection method according to claim 1, characterized in that: The determining of the operation range based on the door crane operation type and the door crane position information includes: Determine an operation sequence based on the operation type of the gantry crane; the operation sequence includes multiple operation procedures; The working range corresponding to each working process is determined based on each working process and the door crane position information corresponding to each working process.

4. The gantry crane operation safety detection method according to claim 3, characterized in that: The determining of the operation range corresponding to each operation process based on each operation process and the door crane position information corresponding to each operation process includes: Determine a first operation scope based on each operation process; A second operating range is determined based on the door crane position information and the first operating range, and the second operating range is used as the corresponding operating range.

5. The gantry crane operation safety detection method according to claim 4, characterized in that: The determining the second operating range based on the door crane position information and the first operating range includes: Determine the door crane coordinates based on the door crane position information; If the gantry crane coordinates belong to a target coordinate set, the first operating range is expanded to obtain the second operating range; the target coordinate set includes coordinates of a preset area; If the gantry crane coordinates do not belong to the target coordinate set, the first operating range is used as the second operating range.

6. The gantry crane operation safety detection method according to claim 1, characterized in that: Also includes: Alarm information is determined based on the personnel evacuation detection result, and the door machine is controlled to perform an alarm operation based on the alarm information.

7. The gantry crane operation safety detection method according to claim 1, characterized in that: The performing image recognition on the first area and the second area respectively to obtain a personnel evacuation detection result includes: Performing image recognition on the first area based on a first detection mode to obtain a first detection result; performing image recognition on the second area based on the second detection mode to obtain a second detection result; the image acquisition frequency of the first detection mode is lower than the image acquisition frequency of the second detection mode; the image recognition accuracy of the first detection mode is higher than the image recognition accuracy of the second detection mode; The personnel evacuation detection result is determined based on the first detection result and the second detection result.

8. A gantry crane operation safety detection system, characterized in that: include: A first calculation module is used to identify the door crane operation type based on the door crane image, and determine the operation range based on the door crane operation type and the door crane position information; A second calculation module, used for dividing the operation range into a first area and a second area based on the operation type of the gantry crane; The image recognition module is used to perform image recognition on the first area and the second area respectively to obtain a personnel evacuation detection result.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images