Point monitoring method, system and device in tower crane jacking process
By acquiring images in real time on the tower crane and using a target detection model to identify key components, the problem of complex sensor installation was solved, and efficient point-to-point monitoring was achieved during the tower crane lifting process.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUNAN ZOOMLION CONSTR HOISTING MASCH CO LTD
- Filing Date
- 2025-01-23
- Publication Date
- 2026-04-21
AI Technical Summary
The existing tower crane jacking monitoring system has too many sensors installed, which makes wiring troublesome and requires a lot of debugging, thus affecting efficiency.
The target detection model is used to acquire images of key points of the tower crane in real time. The key components are identified by the preset target detection model to determine the working status and realize visual monitoring.
No sensor installation or debugging is required, simplifying wiring and improving the efficiency and accuracy of point monitoring during tower crane lifting.
Smart Images

Figure CN120004139B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of tower crane installation technology, specifically to a method for monitoring the location during the tower crane lifting process, a system for monitoring the location during the tower crane lifting process, and a device for monitoring the location during the tower crane lifting process. Background Technology
[0002] Tower crane is short for tower crane. The lifting and lowering of the tower crane is the most dangerous process and the most prone to major accidents. If an accident occurs during the lifting process, it usually leads to the collapse and damage of the tower crane, causing significant economic and personal losses.
[0003] In tower crane lifting accidents, the vast majority are caused by improper operation by installation and dismantling workers. For example, starting to unload the load before the lifting beam is properly attached to the steps, or starting to push out the hydraulic cylinder before the support rod is firmly planted. Therefore, monitoring every critical point in the tower crane lifting process and ensuring proper operation can significantly reduce the likelihood of tower crane lifting accidents.
[0004] Existing tower crane jacking monitoring systems often use sensors installed at key points to monitor whether the operation at those points is in place. However, tower cranes have many key points, and installing too many sensors can cause problems with installation and wiring. In addition, many sensors require parameter debugging, which requires a lot of effort to debug for each tower crane. Summary of the Invention
[0005] The purpose of this invention is to provide a method, system, and device for monitoring the location during tower crane jacking, in order to solve the problems in the prior art where installing too many sensors causes installation and wiring troubles, and where many sensors require parameter debugging, requiring a lot of effort to debug each tower crane.
[0006] To achieve the above objectives, the first aspect of the present invention provides a method for monitoring points during the tower crane jacking process, comprising:
[0007] Real-time acquisition of images of the working points, which include one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam;
[0008] Based on a preset target detection model, key components in the image of the working point are detected to obtain the working status of the working point.
[0009] Based on the working status of the work point, the monitoring results of the work point are obtained.
[0010] In this embodiment of the invention, the working point is the lifting cylinder and / or standard section lifting frame on the tower crane;
[0011] The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including:
[0012] A preset target detection model is used to identify the image of the working point to obtain a first identification result;
[0013] Based on the first recognition result, it is determined whether there is a corresponding key component in the image of the working point, and the first key component information is obtained.
[0014] Based on the information of the first key component, the working status of the working point is obtained.
[0015] In this embodiment of the invention, the working point is the upper pin and / or lower pin of the standard section on the tower crane;
[0016] The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including:
[0017] A preset target detection model is used to identify the image of the working point to obtain a second identification result;
[0018] Based on the second recognition result, it is determined whether there is a corresponding key component in the image of the working point, and the second key component information is obtained;
[0019] Based on the second key component information, it is determined whether the corresponding key component meets the preset length requirement, and the third key component information is obtained.
[0020] Based on the information of the second key component and the information of the three key components, the working status of the working point is obtained.
[0021] In this embodiment of the invention, the working point is the step-changing support rod on the tower crane, and the key components corresponding to the image of the working point include the support rod, the step, and the step support rod assembly.
[0022] The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including:
[0023] A preset target detection model is used to identify the image of the working point, and a third identification result is obtained;
[0024] Based on the third recognition result, it is determined whether there is a support rod, a step, or a step-support rod assembly in the image of the working point;
[0025] If a support rod and a step are present in the image of the working point, the working state of the step-changing support rod is determined to be that the support rod has not yet stepped into the step.
[0026] If the image at the determined working point contains a step support rod assembly and a step, the working state of the step-changing support rod is determined to be that the support rod has stepped into the step.
[0027] In this embodiment of the invention, the working point is the safety pin of the crossbeam on the tower crane, and the key components corresponding to the image of the working point include an ohmic ring, a pin ring, and a step.
[0028] The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including:
[0029] A preset target detection model is used to identify the image of the working point, resulting in a fourth identification result;
[0030] Based on the fourth identification result, determine whether there is an ohmic ring, a pin ring, or a step in the image of the working point;
[0031] If an ohm ring, a pin ring, and a step are found in the image of the working point, determine whether the distance between the ohm ring and the pin ring meets a preset threshold.
[0032] If the distance between the ohm ring and the pin ring meets a preset threshold, the working state of the beam safety pin is determined to be beam safety pin insertion.
[0033] In this embodiment of the invention, the step of detecting key components in the image of the working point based on a preset target detection model to obtain the working status of the working point includes:
[0034] A preset target detection model is used to identify key components in the image of the working point, and information on multiple key components is obtained.
[0035] Based on the information of the multiple key components, the key component information corresponding to different working points is matched;
[0036] Based on the key component information corresponding to the different working points, the working status of the different working points is obtained.
[0037] In this embodiment of the invention, the construction process of the preset target detection model includes:
[0038] Acquire training samples, which include key component information and corresponding working status of multiple working points;
[0039] The training samples are used to train the pre-set detection model to obtain the target detection model.
[0040] A second aspect of the present invention provides a point monitoring system for tower crane jacking process, including a camera and a monitoring host, wherein the camera is installed on the tower crane;
[0041] The camera is used to acquire images of the working point in real time. The working point includes one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam.
[0042] The monitoring host is used to detect key components in the image of the work point based on a preset target detection model to obtain the working status of the work point; and to obtain the monitoring result of the work point based on the working status of the work point.
[0043] In this embodiment of the invention, the position of the camera is determined based on the position of the working point.
[0044] A third aspect of the present invention provides a point monitoring device during the tower crane jacking process, comprising:
[0045] The acquisition module is used to acquire images of the working points in real time. The working points include one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam.
[0046] The detection module is used to detect key components in the image of the working point based on a preset target detection model, so as to obtain the working status of the working point.
[0047] The monitoring module is used to obtain the monitoring results of the work point based on its working status.
[0048] The above technical solution acquires images of working points in real time. These working points include one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam. Based on a pre-set target detection model, key components in the images of the working points are detected to obtain the working status of the working points. Based on the working status of the working points, the monitoring results of the working points are obtained. By detecting key components in the images of the working points using a pre-set target detection model, the working status of the working points can be quickly and accurately determined, thereby enabling monitoring of the working points. This allows for visual monitoring and identification of all key points during the tower crane lifting process. This method of monitoring points during tower crane lifting does not rely on sensors, eliminating the need for sensor installation and debugging, reducing wiring difficulty and debugging steps, improving the efficiency of point monitoring during tower crane lifting, and making point monitoring during tower crane lifting simpler and more convenient.
[0049] Other features and advantages of the embodiments of the present invention will be described in detail in the following detailed description section. Attached Figure Description
[0050] The accompanying drawings are provided to further illustrate embodiments of the present invention and form part of the specification. They are used together with the following detailed description to explain the embodiments of the present invention, but do not constitute a limitation thereof. In the drawings:
[0051] Figure 1 The illustration shows a schematic flowchart of a method for monitoring points during the jacking process of a tower crane according to an embodiment of the present invention;
[0052] Figure 2 This schematic diagram illustrates the structure of a point monitoring device during the jacking process of a tower crane according to an embodiment of the present invention.
[0053] Figure 3 The diagram illustrates the internal structure of a computer device according to an embodiment of the present invention.
[0054] Explanation of reference numerals in the attached figures
[0055] 410 - Acquisition module; 420 - Detection module; 430 - Monitoring module; A01 - Processor; A02 - Network interface; A03 - Internal memory; A04 - Display screen; A05 - Input device; A06 - Non-volatile storage medium; B01 - Operating system; B02 - Computer program. Detailed Implementation
[0056] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only for illustrating and explaining the embodiments of the present invention and are not intended to limit the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.
[0057] It should be noted that the acquisition, transmission, storage, use, and processing of data in the technical solution of this invention all comply with the relevant provisions of national laws and regulations. In the embodiments of this invention, certain existing solutions in the industry, such as software, components, and models, may be mentioned. These should be considered exemplary, intended only to illustrate the feasibility of implementing the technical solution of this invention, and do not imply that the applicant has already used or necessarily used such solutions.
[0058] It should be noted that if the embodiments of the present invention involve directional indicators (such as up, down, left, right, front, back, etc.), the directional indicators are only used to explain the relative positional relationship and movement of the components in a certain specific posture (as shown in the figure). If the specific posture changes, the directional indicators will also change accordingly.
[0059] Furthermore, if the embodiments of this invention involve descriptions such as "first" or "second," these descriptions are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. If the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed by this invention.
[0060] Figure 1 The illustration schematically shows a flowchart of a method for monitoring points during the jacking process of a tower crane according to an embodiment of the present invention. Figure 1 As shown in the figure, this embodiment of the invention provides a method for monitoring points during the tower crane jacking process, including the following steps:
[0061] Step 210: Acquire images of the working points in real time. The working points include one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam.
[0062] In this embodiment, the images of the aforementioned work points refer to images of the operational status of the work points acquired in real time during the tower crane's jacking process. These images can be captured in real-time by cameras installed at the corresponding locations of the work points. In practice, the camera installation positions can be set and adjusted according to actual conditions.
[0063] For example, for the working point of the lifting cylinder, a camera can be installed on the tower crane's crossbeam, and the image of the lifting cylinder can be obtained by reading the image captured by this camera. For the working point of the upper pin shaft of the standard section, a camera can be installed on the plane of the upper pin shaft, and the image of the upper pin shaft of the standard section can be obtained by reading the image from the camera installed on the plane of the upper pin shaft. For the working point of the standard section lifting frame, a camera can also be installed on the plane of the upper pin shaft, and the image of the standard section lifting frame can be obtained by reading the image from the camera installed on the plane of the upper pin shaft. This image of the standard section lifting frame can be used to determine the engagement of the standard section lifting frame. A camera can also be installed on the bottom traveling net of the superstructure, and the image of the standard section lifting frame can be obtained by reading the image from the camera installed on the bottom traveling net of the superstructure. This image of the standard section lifting frame can be used to determine the introduction and retraction of the standard section lifting frame. For the working point of the lower pin shaft of the standard section, a camera can also be installed on the bottom traveling net of the superstructure, and the image of the lower pin shaft of the standard section can be obtained by reading the image from the camera installed on the bottom traveling net of the superstructure. For the working point of the step-changing support rod, a camera can be installed on the bottom traveling net of the superstructure. The image of the step-changing support rod can be obtained by reading the image from the camera installed on the bottom traveling net of the superstructure. For the working point of the crossbeam safety pin, a camera can be installed on the crossbeam of the tower crane. The image of the crossbeam safety pin can be obtained by reading the image captured by this camera. It can be seen that images of the corresponding working points can be obtained by installing cameras on the crossbeam, the plane of the upper pin, and the bottom traveling net of the superstructure of the tower crane.
[0064] Step 220: Based on the preset target detection model, detect the key components in the image of the working point to obtain the working status of the working point;
[0065] In this embodiment, the aforementioned preset target detection model can be a pre-trained target detection model used to detect key components in the image of the working point. By detecting the information of the key components, the state of the working point is determined, thereby detecting the current working state of the working point. Different working points may correspond to different key components, which can be determined according to the actual situation.
[0066] For example: the key component corresponding to the working point of the lifting cylinder can be the cylinder sleeve; the key component corresponding to the working point of the upper pin of the standard section can be the pin; the key component corresponding to the working point of the standard section lifting frame can be the standard section lifting frame; the key component corresponding to the working point of the lower pin of the standard section can be the pin; the key component corresponding to the working point of the step-changing support rod can be a combination of support rod, step, and step support rod; and the key component corresponding to the safety pin of the crossbeam can be an ohm ring, pin ring, handle, and step. When the working point is the lifting cylinder, its corresponding working states include the retraction and extension of the lifting cylinder; when the working point is the upper pin of the standard section, its corresponding working states include the insertion and removal of the upper pin of the standard section; when the working point is the lifting frame of the standard section, its corresponding working states include the mounting, introduction, and retraction of the lifting frame of the standard section; when the working point is the lower pin of the standard section, its corresponding working points include the insertion and removal of the lower pin of the standard section; when the working point is the step-changing support rod, its corresponding working points include whether the step-changing support rod is stepped into the step; when the working point is the safety pin of the crossbeam, its corresponding working points include the insertion and removal of the safety pin of the crossbeam.
[0067] In some embodiments, the process of constructing the preset target detection model may include:
[0068] First, a training sample is obtained, which includes key component information and corresponding working status of multiple working points.
[0069] In this embodiment, the training samples can be obtained through historical tower crane lifting process data, including key component information of the working point and the corresponding working status.
[0070] Then, the training samples are used to train the preset detection model to obtain the target detection model.
[0071] In this embodiment, the aforementioned preset detection model can be a model pre-built based on an object detection algorithm, including Yolov10-based object detection algorithms, Transformer-based object detection algorithms, etc. The construction of the aforementioned preset detection model is prior art and will not be described in detail here.
[0072] By using training samples to train a pre-set detection model, an accurate target detection model can be obtained, which facilitates accurate detection of key components.
[0073] In some embodiments, when the working point is the lifting cylinder and / or standard section lifting frame on a tower crane, the step of detecting key components in the image of the working point based on a preset target detection model to obtain the working status of the working point includes the following steps:
[0074] First, a preset target detection model is used to identify the image of the working point to obtain a first identification result;
[0075] In this embodiment, the image of the working point can be identified by a target detection model. The target detection model can be a pre-trained model based on a target detection algorithm for identifying various key components.
[0076] Then, based on the first recognition result, it is determined whether there is a corresponding key component in the image of the working point, and the first key component information is obtained;
[0077] In this embodiment, the above determination may involve comparing the first identification result with the key components of a preset working point to determine whether the first identification result contains the key component. The obtained first key component information includes key component information corresponding to the working point and key component information not corresponding to the working point.
[0078] Finally, based on the information of the first key component, the working status of the working point is obtained.
[0079] In this embodiment, the working status of the working point can be determined based on whether the key component in the first key component information exists.
[0080] For example, when the working point is the lifting cylinder on the tower crane, the image from the camera placed on the crossbeam can be read, and a preset target detection model can be used to identify whether the cylinder sleeve exists in the image to determine whether the cylinder should be retracted.
[0081] For example, when the working point is the standard section lifting frame on the tower crane, the camera footage installed on the upper pin plane is read, and the target detection model is used to identify whether the standard section lifting frame is present in the image to determine whether it is engaged. Alternatively, the camera footage installed on the bottom traveling net of the superstructure can be read, and the target detection model can be used to identify whether the standard section lifting frame is present in the image to determine whether it is being introduced or withdrawn.
[0082] It should be noted that the image of the working point can include both the image of the lifting cylinder and the image of the standard section lifting frame. When inspecting key components, the two images can be inspected separately according to the above steps to obtain the working status of the lifting cylinder and the standard section lifting frame, which will not be elaborated here.
[0083] By identifying whether there are corresponding key components in the images of the working points, the working status of the lifting cylinder and the standard section lifting frame can be quickly and accurately determined.
[0084] In some embodiments, when the working point is the upper pin and / or lower pin of a standard section on a tower crane, the step of detecting key components in the image of the working point based on a preset target detection model to obtain the working status of the working point includes the following steps:
[0085] First, a preset target detection model is used to identify the image of the working point to obtain a second identification result;
[0086] In this embodiment, the image of the working point can be identified by a target detection model. The target detection model can be a pre-trained model based on a target detection algorithm for identifying various key components.
[0087] Then, based on the second recognition result, it is determined whether there is a corresponding key component in the image of the working point, and the second key component information is obtained;
[0088] In this embodiment, the above determination may involve comparing the second identification result with the key components of a preset working point to determine whether the second identification result contains the key component. The obtained second key component information includes key component information corresponding to the working point and key component information not corresponding to the working point.
[0089] Then, based on the second key component information, it is determined whether the corresponding key component meets the preset length requirement, and the third key component information is obtained;
[0090] In this embodiment, when the second key component information includes key component information corresponding to the working point, it is further determined whether the corresponding key component meets the preset length requirement. The preset length requirement can be pre-set according to the actual situation and can refer to the length requirement of the key component. The third key component information includes whether the corresponding key component meets the preset length requirement and whether the corresponding key component does not meet the preset length requirement.
[0091] Finally, based on the information of the second key component and the information of the three key components, the working status of the working point is obtained.
[0092] In this embodiment, the working status of the working point is finally determined by combining the information of the second key component and the information of the third key component.
[0093] For example, when the working point is the upper pin of the standard section, the image of the camera installed on the plane of the upper pin can be read. The target detection model can be used to identify whether there is a short pin in the image to determine the insertion and removal of the upper pin of the standard section of the hydraulic cylinder. The above identification of whether there is a short pin can be done by first identifying whether there is a pin, and then further identifying whether the length of the pin in the image meets the preset length requirements. If it meets the requirements, it means that there is a short pin; otherwise, it is considered that the upper pin has become longer.
[0094] It should be noted that the system can also count the inserted or removed upper pins. Once an upper pin is determined to be inserted or removed, the camera will move to the next upper pin location to take a picture, and then perform the target detection as described above. This process continues until all four upper pins are inserted or removed, completing the upper pin inspection step.
[0095] For example, when the working point is the lower pin of the standard section, the image of the camera installed on the bottom walking net of the upper body can be read. The target detection model can be used to identify whether there is a short pin in the image to determine the insertion and removal of the lower pin of the standard section of the hydraulic cylinder. The above identification of whether there is a short pin can be done by first identifying whether there is a pin, and then further identifying whether the length of the pin in the image meets the preset length requirements. If it meets the requirements, it means that there is a short pin; otherwise, it is considered that the lower pin has become longer.
[0096] It should be noted that the system can also count the inserted or removed pins. Once all the pins in a frame have been determined to be inserted or removed, the camera will move to the next pin location to take a picture, and then perform the target detection algorithm described above. This process continues until all four pins are inserted or removed, completing the pin inspection step.
[0097] It should be noted that the image of the working point can include both the image of the upper pin and the image of the lower pin of the standard section. When inspecting key components, the two images can be inspected separately according to the above steps to obtain the working state of the upper pin and the working state of the lower pin of the standard section, which will not be elaborated here.
[0098] By identifying whether there are corresponding key components in the image of the working point, and further determining whether the corresponding key components meet the preset length requirements, the working status of the upper pin and the lower pin of the standard section can be quickly and accurately determined.
[0099] In some embodiments, the working point is a step-changing support rod on a tower crane, and the key components corresponding to the image of the working point include the support rod, the step, and the step support rod assembly.
[0100] Accordingly, the step of detecting key components in the image of the working point based on a preset target detection model to obtain the working status of the working point includes the following steps:
[0101] First, a preset target detection model is used to identify the image of the working point to obtain a third identification result;
[0102] In this embodiment, the image of the working point can be identified by a target detection model. The target detection model can be a pre-trained model based on a target detection algorithm for identifying various key components.
[0103] Then, based on the third recognition result, it is determined whether there is a support rod, a step, or a step-support rod assembly in the image of the working point;
[0104] In this embodiment, the above judgment may be to determine whether the third identification result includes the presence of a support rod, a step, and a step support rod assembly.
[0105] Then, if a support rod and a step are found in the image of the working point, the working state of the step-changing support rod is determined to be that the support rod has not yet stepped into the step.
[0106] Then, if the step support rod assembly and the step are present in the image of the working point, the working state of the step-changing support rod is determined to be that the support rod has stepped into the step.
[0107] In this embodiment, if a support rod and a step are present, it indicates that the working state of the step-changing support rod is that the support rod has not yet stepped into the step. If a step-support rod assembly and a step are present, it indicates that the working state of the step-changing support rod is that the support rod has stepped into the step. If a support rod, a step, and a step-support rod assembly are present simultaneously, it indicates that an abnormal situation has occurred.
[0108] For example, when the working point is the step-changing support rod on the tower crane, the camera installed on the bottom walking net of the superstructure can be used to read the image. The target detection model can be used to identify whether there is a combination of support rod, step, and step support rod in the image to determine whether the step-changing support rod has stepped into the step.
[0109] By identifying whether support rods, steps, and step-support rod assemblies exist in the images of the working points, it is possible to quickly and accurately detect whether the step-changing support rod has stepped into the step.
[0110] In some embodiments, the working point is the safety pin of the crossbeam on the tower crane, and the key components corresponding to the image of the working point include an ohmic ring, a pin ring, and a step.
[0111] Accordingly, the step of detecting key components in the image of the working point based on a preset target detection model to obtain the working status of the working point includes the following steps:
[0112] First, a preset target detection model is used to identify the image of the working point, and a fourth identification result is obtained;
[0113] In this embodiment, the image of the working point can be identified by a target detection model. The target detection model can be a pre-trained model based on a target detection algorithm for identifying various key components.
[0114] Then, based on the fourth identification result, it is determined whether there is an ohmic ring, a pin ring, or a step in the image of the working point;
[0115] Then, if an ohm ring, a pin ring, and a step are found in the image of the working point, it is determined whether the distance between the ohm ring and the pin ring meets a preset threshold.
[0116] Then, if the distance between the ohm ring and the pin ring meets the preset threshold, the working state of the beam safety pin is determined to be beam safety pin insertion.
[0117] In this embodiment, the aforementioned preset threshold can be pre-set according to actual conditions, specifically by experimental measurement and input into the algorithm before the model runs. The camera image mounted on the crossbeam is read, and the ohm ring, pin ring, and step are identified in the image using a target detection algorithm. The condition for determining whether the crossbeam safety pin is inserted is: if the step exists, the distance between the center of the ohm ring's frame and the center of the pin ring's frame is less than the preset threshold; otherwise, it is determined that the crossbeam safety pin is not inserted.
[0118] It should be noted that for some tower cranes, there is no pin collar, and the crossbeam pin operating handle can be used as a substitute for the pin collar.
[0119] By determining whether an ohm ring, a pin ring, and a step are present in the image of the working point, and further determining whether the distance between the ohm ring and the pin ring meets a preset threshold when the ohm ring, pin ring, and step are present in the image of the working point, it is possible to quickly and accurately detect whether the crossbeam safety pin is in an inserted or withdrawn working state.
[0120] Step 230: Based on the working status of the working point, obtain the monitoring results of the working point.
[0121] In this embodiment, after obtaining the working status of the work point, the working status can be used as the monitoring result of the work point. This enables monitoring of key points during the tower crane lifting process based on a visual recognition algorithm. It should be noted that this method, in practical implementation, can be integrated into a tower crane safety lifting monitoring system to achieve artificial intelligence (AI) visual monitoring of the tower crane lifting process.
[0122] In the above implementation process, images of the working points are acquired in real time. These working points include one or more of the following: the lifting cylinder, the upper pin of the standard section, the lifting frame of the standard section, the lower pin of the standard section, the step-changing support rod, and the safety pin of the crossbeam. Based on a pre-set target detection model, key components in the images of the working points are detected to obtain the working status of the working points. Based on the working status of the working points, the monitoring results of the working points are obtained. By detecting key components in the images of the working points using a pre-set target detection model, the working status of the working points can be quickly and accurately determined, thereby enabling monitoring of the working points. This allows for visual monitoring and identification of all key points during the tower crane lifting process. This method for monitoring points during tower crane lifting does not rely on sensors, thus eliminating the need for sensor installation and debugging, reducing wiring difficulty and debugging steps, improving the efficiency of point monitoring during tower crane lifting, and making point monitoring during tower crane lifting simpler and more convenient. This method only calls an AI algorithm for target detection, requiring less computing power and saving computing resources.
[0123] In some embodiments, the step of detecting key components in the image of the working point based on a preset target detection model to obtain the working status of the working point includes:
[0124] First, a pre-set target detection model is used to identify key components in the image of the working point, and information on multiple key components is obtained.
[0125] In this embodiment, the image of the working point may include multiple key components corresponding to the working point, and correspondingly, the obtained key component information may include multiple components.
[0126] Then, based on the information of the multiple key components, the information of the key components corresponding to different working points is matched;
[0127] In this embodiment, corresponding working points can be pre-set for different key component information, and the matching can be performed according to pre-set rules. For example, the captured image of the working point includes information on four key components: cylinder liner, ohm ring, pin ring, and step. The working point corresponding to the cylinder liner is the lifting cylinder, and the working points corresponding to the ohm ring, pin ring, and step are the crossbeam safety pin.
[0128] Finally, based on the key component information corresponding to the different working points, the working status of the different working points is obtained.
[0129] In this embodiment, the working status of a corresponding working point can be determined by using the key component information corresponding to different working points. The process of determining the working status of the corresponding working point is the same as the process of determining the working status of each working point, and will not be repeated here.
[0130] By matching the key component information corresponding to different working points based on the information of the multiple key components, and obtaining the working status of the different working points based on the key component information corresponding to the different working points, it is possible to detect cases where the image of a working point includes multiple key components corresponding to the working points, which helps to improve the reliability of determining the working status of the working points.
[0131] This embodiment provides a point monitoring system during the tower crane jacking process, including a camera and a monitoring host, wherein the camera is installed on the tower crane;
[0132] The camera is used to acquire images of the working point in real time. The working point includes one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam.
[0133] The monitoring host is used to detect key components in the image of the work point based on a preset target detection model to obtain the working status of the work point; and to obtain the monitoring result of the work point based on the working status of the work point.
[0134] In this embodiment, the camera may be a detachable camera, and the number of cameras is determined according to the actual situation. The monitoring host may be a computer or a device with computing processing capabilities.
[0135] The position of the camera is determined based on the position of the working point.
[0136] In this embodiment, the camera can be set according to different working points. For example, for the working point of the upper pin shaft of the standard section, a camera can be set on the plane of the upper pin shaft, and the image of the upper pin shaft of the standard section can be obtained by reading the image of the camera installed on the plane of the upper pin shaft. For the working point of the standard section lifting frame, a camera can also be set on the plane of the upper pin shaft, and the image of the standard section lifting frame can be obtained by reading the image of the camera installed on the plane of the upper pin shaft. This image of the standard section lifting frame can be used to determine the insertion of the standard section lifting frame. A camera can also be installed on the bottom walking net of the upper structure, and the image of the standard section lifting frame can be obtained by reading the image of the camera installed on the bottom walking net of the upper structure. This image of the standard section lifting frame can be used to determine the introduction and withdrawal of the standard section lifting frame. For the working point of the lower pin shaft of the standard section, a camera can also be installed on the bottom walking net of the upper structure, and the image of the lower pin shaft of the standard section can be obtained by reading the image of the camera installed on the bottom walking net of the upper structure. For the working point of the step-changing support rod, a camera can also be installed on the bottom walking net of the upper structure, and the image of the step-changing support rod can be obtained by reading the image of the camera installed on the bottom walking net of the upper structure. For the working point of the crossbeam safety pin, a camera can be installed on the crossbeam of the tower crane, and the image of the crossbeam safety pin can be obtained by reading the image captured by the camera. Therefore, it can be seen that images of the corresponding working points can be obtained by installing cameras on the crossbeam, the upper pin plane, and the bottom traveling wire mesh of the tower crane.
[0137] In the above implementation process, cameras are installed on the tower crane to acquire real-time images of the working points. These working points include one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and crossbeam safety pin. The monitoring host detects key components in the images of the working points based on a pre-set target detection model to obtain the working status of the working points. Based on the working status of the working points, the monitoring results are obtained. By detecting key components in the images of the working points using a pre-set target detection model, the working status of the working points can be quickly and accurately determined, thereby enabling monitoring of the working points and achieving visual monitoring and identification of all key points during the tower crane lifting process. This system does not require the installation of sensors, eliminating the need for sensor installation and debugging, reducing wiring difficulty and debugging steps, improving the efficiency of point monitoring during tower crane lifting, and making point monitoring during tower crane lifting simpler and more convenient. The system only uses AI algorithms for target detection, requiring less computing power and saving computing resources.
[0138] Please refer to Figure 2 , Figure 2This schematic diagram illustrates the structure of a monitoring device for the location during tower crane jacking according to an embodiment of the present invention. This embodiment provides a monitoring device for the location during tower crane jacking, including an acquisition module 410, a detection module 420, and a monitoring module 430, wherein:
[0139] The acquisition module 410 is used to acquire images of the working point in real time. The working point includes one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam.
[0140] The detection module 420 is used to detect key components in the image of the working point based on a preset target detection model, so as to obtain the working status of the working point.
[0141] The monitoring module 430 is used to obtain the monitoring results of the work point based on the working status of the work point.
[0142] The tower crane lifting process point monitoring device includes a processor and a memory. The acquisition module 410, detection module 420 and monitoring module 430 are all stored in the memory as program units. The processor executes the program units stored in the memory to realize the corresponding functions.
[0143] The processor contains a kernel, which retrieves the corresponding program units from memory. One or more kernels can be configured, and point monitoring during the tower crane's lifting process can be achieved by adjusting kernel parameters.
[0144] The memory may include non-permanent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.
[0145] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 3As shown in the figure, the computer device includes a processor A01, a network interface A02, a display screen A04, an input device A05, and a memory (not shown) connected via a system bus. The processor A01 provides computing and control capabilities. The memory includes internal memory A03 and a non-volatile storage medium A06. The non-volatile storage medium A06 stores an operating system B01 and a computer program B02. The internal memory A03 provides an environment for the operation of the operating system B01 and the computer program B02 stored in the non-volatile storage medium A06. The network interface A02 is used for communication with external terminals via a network connection. When the computer program is executed by the processor A01, it implements a method for monitoring the position during the tower crane jacking process. The display screen A04 can be an LCD screen or an e-ink display screen. The input device A05 can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the computer device casing, or an external keyboard, touchpad, or mouse.
[0146] Those skilled in the art will understand that Figure 3 The structure shown is merely a block diagram of a portion of the structure related to the present invention and does not constitute a limitation on the computer device to which the present invention is applied. A specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0147] In one embodiment, the tower crane jacking monitoring device provided by the present invention can be implemented as a computer program, which can be implemented in the form of, for example... Figure 3 The computer device shown runs on this system. The computer device's memory can store the various program modules that make up the point monitoring device during the tower crane's jacking process, for example... Figure 2 The acquisition module 410, detection module 420, and monitoring module 430 are shown. The computer program comprised of these modules causes the processor to execute the steps in the tower crane jacking monitoring method described in the various embodiments of the present invention.
[0148] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0149] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0150] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0151] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0152] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0153] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, like read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.
[0154] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.
[0155] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0156] The above are merely embodiments of the present invention and are not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of the present invention should be included within the scope of the claims of the present invention.
Claims
1. A method for monitoring points during the jacking process of a tower crane, characterized in that, include: Real-time acquisition of images of the working points, which include one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam; Based on a preset target detection model, key components in the image of the working point are detected to obtain the working status of the working point. The detection includes: when the working point is a lifting cylinder and / or a standard section lifting frame on a tower crane, determining whether there are corresponding key components in the image of the working point; when the working point is an upper pin and / or a lower pin on a standard section of a tower crane, determining whether there are corresponding key components in the image of the working point and whether the corresponding key components meet preset length requirements; when the working point is a step-changing support rod on a tower crane, and the key components corresponding to the image of the working point include a support rod, a step, and a step support rod assembly, determining whether there are support rods, steps, and step support rod assemblies in the image of the working point; when the working point is a crossbeam safety pin on a tower crane, and the key components corresponding to the image of the working point include an ohm ring, a pin ring, and a step, determining whether there are ohm rings, pin rings, and steps in the image of the working point and whether the distance between the ohm ring and the pin ring meets a preset threshold. Based on the working status of the work point, the monitoring results of the work point are obtained.
2. The method according to claim 1, characterized in that, The working point is the lifting cylinder and / or standard section lifting frame on the tower crane; The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including: A preset target detection model is used to identify the image of the working point to obtain a first identification result; Based on the first recognition result, it is determined whether there is a corresponding key component in the image of the working point, and the first key component information is obtained. Based on the information of the first key component, the working status of the working point is obtained.
3. The method according to claim 1, characterized in that, The working point is the upper pin and / or lower pin of the standard section on the tower crane; The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including: A preset target detection model is used to identify the image of the working point to obtain a second identification result; Based on the second recognition result, it is determined whether there is a corresponding key component in the image of the working point, and the second key component information is obtained; Based on the second key component information, it is determined whether the corresponding key component meets the preset length requirement, and the third key component information is obtained. Based on the information of the second key component and the information of the three key components, the working status of the working point is obtained.
4. The method according to claim 1, characterized in that, The working point is the step-changing support rod on the tower crane, and the key components corresponding to the image of the working point include the support rod, the step, and the step support rod assembly. The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including: A preset target detection model is used to identify the image of the working point, and a third identification result is obtained; Based on the third recognition result, it is determined whether there is a support rod, a step, or a step-support rod assembly in the image of the working point; If a support rod and a step are present in the image of the working point, the working state of the step-changing support rod is determined to be that the support rod has not yet stepped into the step. If the image at the determined working point contains a step support rod assembly and a step, the working state of the step-changing support rod is determined to be that the support rod has stepped into the step.
5. The method according to claim 1, characterized in that, The working point is the safety pin of the crossbeam on the tower crane. The key components corresponding to the image of the working point include the ohm ring, the pin ring, and the step. The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including: A preset target detection model is used to identify the image of the working point, resulting in a fourth identification result; Based on the fourth identification result, determine whether there is an ohmic ring, a pin ring, or a step in the image of the working point; If an ohm ring, a pin ring, and a step are found in the image of the working point, determine whether the distance between the ohm ring and the pin ring meets a preset threshold. If the distance between the ohm ring and the pin ring meets a preset threshold, the working state of the beam safety pin is determined to be beam safety pin insertion.
6. The method according to claim 1, characterized in that, The method based on a preset target detection model detects key components in the image of the working point to obtain the working status of the working point, including: A preset target detection model is used to identify key components in the image of the working point, and information on multiple key components is obtained. Based on the information of the multiple key components, the key component information corresponding to different working points is matched; Based on the key component information corresponding to the different working points, the working status of the different working points is obtained.
7. The method according to claim 1, characterized in that, The construction process of the pre-set target detection model includes: Acquire training samples, which include key component information and corresponding working status of multiple working points; The training samples are used to train the pre-set detection model to obtain the target detection model.
8. A point monitoring system for tower crane jacking process, characterized in that, Includes a camera and a monitoring host, wherein the camera is mounted on the tower crane; The camera is used to acquire images of the working point in real time. The working point includes one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam. The monitoring host is used to detect key components in the image of the working point based on a preset target detection model, and to obtain the working status of the working point. Based on the working status of the working point, the monitoring result of the working point is obtained; the detection includes: when the working point is the lifting cylinder and / or standard section lifting frame on the tower crane, determining whether there are corresponding key components in the image of the working point; When the working point is the upper pin and / or lower pin of a standard section on the tower crane, determine whether the image of the working point contains corresponding key components and whether the corresponding key components meet the preset length requirements; when the working point is the step-changing support rod on the tower crane, and the key components corresponding to the image of the working point include the support rod, the step, and the step support rod assembly, determine whether the image of the working point contains the support rod, the step, and the step support rod assembly; when the working point is the crossbeam safety pin on the tower crane, and the key components corresponding to the image of the working point include the ohm ring, the pin ring, and the step, determine whether the image of the working point contains the ohm ring, the pin ring, and the step, and determine whether the distance between the ohm ring and the pin ring meets the preset threshold.
9. The system according to claim 8, characterized in that, The position of the camera is determined based on the position of the working point.
10. A point monitoring device for tower crane jacking process, characterized in that, include: The acquisition module is used to acquire images of the working points in real time. The working points include one or more of the following: lifting cylinder, upper pin of standard section, lifting frame of standard section, lower pin of standard section, step-changing support rod, and safety pin of crossbeam. The detection module is used to detect key components in the image of the working point based on a preset target detection model to obtain the working status of the working point. The detection includes: when the working point is a lifting cylinder and / or a standard section lifting frame on a tower crane, determining whether a corresponding key component exists in the image of the working point; when the working point is an upper pin and / or a lower pin of a standard section on a tower crane, determining whether a corresponding key component exists in the image of the working point and whether the corresponding key component meets a preset length requirement. When the working point is a step-changing support rod on a tower crane, and the key components corresponding to the image of the working point include a support rod, a step, and a step-support rod assembly, it is determined whether the image of the working point contains a support rod, a step, and a step-support rod assembly. When the working point is a crossbeam safety pin on a tower crane, and the key components corresponding to the image of the working point include an ohm ring, a pin ring, and a step, it is determined whether the image of the working point contains an ohm ring, a pin ring, and a step, and whether the distance between the ohm ring and the pin ring meets a preset threshold. The monitoring module is used to obtain the monitoring results of the work point based on its working status.
Citation Information
Patent Citations
System and method for detecting connection state of key part of tower crane in jacking and dismounting process of tower crane
CN116675127A