Method and system for supervising pole and tower assembling process based on machine vision

Through the machine vision supervision system, the spatial coordinates and attitude angle of the mechanical gripper are analyzed, and early warning signals are generated, which solves the problem of position deviation of gripper during tower assembly, ensures the accuracy and safety of construction, and prevents risks caused by improper attitude. .

CN119031102AActive Publication Date: 2024-11-26STATE GRID ANHUI ELECTRIC POWER CO LTD +1
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
CN202411132338.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-26
Estimated Expiration
2044-08-16

AI Technical Summary

Technical Problem

During the tower assembly process, it is impossible to detect the spatial position deviation of the mechanical gripper when grasping the construction components in time, which affects the accuracy of component installation and structural stability.

Method used

Adopt a machine vision-based supervision system, conduct all-round inspections through the robot dog platform and high-power fixed-focus digital camera, record and analyze the spatial coordinates and attitude angles of the mechanical grippers, generate spatial warning signals, attitude warning signals or violation signals, and promptly Correct the position and posture of the gripper.

Benefits of technology

Ensure construction quality and safety, prevent construction accidents caused by improper attitude, and reduce the risk of abnormal stress and collapse of the tower during use.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031102A_ABST
    Figure CN119031102A_ABST
Patent Text Reader

Abstract

The invention discloses a machine vision-based pole and tower assembly process supervision method and system, and relates to the technical field of pole and tower monitoring, and the system comprises a historical grabbing position obtaining module, a reference grabbing position range obtaining module, a robot dog platform, an image obtaining and processing module, an image acquisition and recognition module and an analysis and alarm module. The violation signal indicates that when the mechanical gripper grabs the construction assembly, serious deviation of the spatial position and the attitude angle occurs at the same time, operation needs to be stopped immediately, comprehensive inspection and correction need to be conducted, errors of the mechanical gripper in the pole and tower assembling process can be found and corrected in time, the construction accuracy, safety and quality are guaranteed, and the construction efficiency is improved. Construction accidents caused by improper postures can be prevented, for example, components fall off due to wrong postures of grippers, and on-site personnel and equipment can be possibly damaged.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of pole tower monitoring, and in particular to a method and system for supervising a pole tower assembly process based on machine vision. Background Art

[0002] Tower assembly refers to installing towers (including poles and iron towers) at predetermined locations according to design requirements through specific methods and processes to support the conductors and ground wires of transmission lines. In modern transmission line construction, tower assembly is a key and complex engineering and technical task. Whether it is an overall assembly or a disassembled assembly, it provides a solid foundation for the stable operation of the power system.

[0003] However, in the process of tower assembly, it is impossible to timely discover the deviation in the spatial position of the mechanical gripper when grasping the construction component. For example, if the grasping position of the mechanical gripper deviates too much from the reference range, it may cause inaccurate installation of the component and affect the overall structural stability of the tower. For example, when building a power tower, if the grasping position of a key component is too high or too low, the subsequent assembly may not proceed smoothly. Based on this, a tower assembly process supervision method and system based on machine vision are proposed. Summary of the invention

[0004] The purpose of the present invention is to provide a tower assembly process supervision method and system based on machine vision, which solves the technical problem that the deviation of the spatial position of the mechanical gripper when grasping the construction component cannot be discovered in time during the tower assembly process.

[0005] The purpose of the present invention can be achieved through the following technical solutions:

[0006] A tower assembly process monitoring system based on machine vision, comprising:

[0007] The historical grasping position acquisition module records the posture angle and spatial coordinates of the mechanical gripper when grasping each component of the tower;

[0008] Reference grabbing position range acquisition module: analyzes the posture angle and spatial coordinates of the mechanical gripper to each component of the tower, and obtains the reference grabbing position range corresponding to each component of the tower;

[0009] The robot dog platform uses the robot dog as a mobile carrier to conduct a full range of inspections on the tower assembly site;

[0010] The image acquisition processing module processes the parameters of the robot dog's image shooting;

[0011] The image acquisition and recognition module acquires the spatial coordinates and posture angles of the mechanical gripper when it grasps the construction components in real time;

[0012] The analysis and alarm module obtains the spatial coordinates and posture angles of the mechanical gripper when grasping the construction component in real time, and compares and analyzes them with the benchmark grasping position range corresponding to the construction component, and generates a spatial warning signal, posture warning signal or violation signal according to the comparison and analysis results.

[0013] As a further solution of the present invention, the reference grabbing position ranges corresponding to the respective components of the tower are obtained in the following specific manner:

[0014] S1: Randomly select one component from each tower component as the target component;

[0015] S2: Obtain the spatial coordinates Dn and posture angle En when the mechanical gripper grasps the target component in the preset number of times n, calculate the standard deviation U of the horizontal coordinate Xn in the spatial coordinate when the mechanical gripper grasps the target component of the tower in the preset number of times n, analyze the standard deviation U, and obtain the reference horizontal coordinate BX corresponding to the spatial horizontal coordinate of the target component according to the analysis result, and at the same time generate the reference grasping range AX1 [BX-CX, BX+CX] corresponding to the spatial horizontal coordinate of the target component according to the reference horizontal coordinate BX and the threshold value CX corresponding to the spatial horizontal coordinate of the target component, and the threshold value CX is the absolute value of the maximum and minimum values ​​in the horizontal coordinate Xn, where n is the sequence number of grasping times, n≥1;

[0016] S3: Repeat steps S1-S2 to obtain the reference grasping ranges AXj, AYj, AZj, Aαj, Aβj and Aγj corresponding to the parameters in the spatial coordinates and attitude angles of each component of the tower, where j represents the different components of the tower, j is a positive integer, and j≥1.

[0017] As a further solution of the present invention: the specific method of analyzing the standard deviation U is:

[0018] When the standard deviation is less than the preset threshold Q1, Xp is used as the reference horizontal coordinate BX corresponding to the horizontal coordinate of the target component space. When the standard deviation is greater than or equal to the preset threshold Q1, the average of the maximum and minimum values ​​in the horizontal coordinate Xn is used as the reference horizontal coordinate BX corresponding to the horizontal coordinate of the target component space, where Xp is the average of the horizontal coordinate Xn.

[0019] As a further solution of the present invention: the specific method of generating a space warning signal, a posture warning signal or a violation signal is:

[0020] The spatial coordinates and posture angles of the mechanical gripper when grasping the construction component in real time are marked as R (RX, RY, RZ) and T (Tα, Tβ, Tγ), respectively. The reference grasping position range corresponding to the construction component is obtained from the reference grasping position range acquisition module, and they are marked as FX, FY, FZ, Fα, Fβ and Fγ, respectively. The number of parameters in the spatial coordinates of the construction component that do not belong to the corresponding reference grasping position range is marked as e, and the number of parameters in the posture angles of the construction component that do not belong to the corresponding reference grasping position is marked as r; when e is greater than the preset value Q1, a spatial warning signal is generated, and when r is greater than the preset value Q2, a posture warning signal is generated. Otherwise, no processing is performed;

[0021] When the space warning signal and the attitude warning signal are generated at the same time, a violation signal is generated and the violation signal is output at the same time; when only the space warning signal or the attitude warning signal is generated, the corresponding signal is output.

[0022] As a further solution of the present invention: the specific method of processing the image taken by the robot dog is:

[0023] The integrated high-magnification fixed-focus digital camera installed on the robot dog automatically adjusts the focal length and exposure parameters to capture clear images of the tower assembly process.

[0024] As a further solution of the present invention: a grayscale correction method is used to pre-process the collected images to remove noise and enhance contrast, while image segmentation technology is used to remove cluttered and useless background information and retain images of key construction areas.

[0025] A tower tower assembly process supervision method based on machine vision, the method is executed by a tower tower assembly process supervision system based on machine vision, and specifically comprises the following steps:

[0026] Step 1: Record the posture angle and spatial coordinates of the mechanical gripper when it grabs each component of the tower;

[0027] Step 2: Obtain the reference grabbing position range corresponding to each component of the tower;

[0028] Step 3: Use the robot dog to conduct a comprehensive inspection of the tower assembly site;

[0029] Step 4: Process the parameters for the robot dog to take images;

[0030] Step 5: Acquire the spatial coordinates and posture angles of the mechanical gripper when it grasps the construction component in real time;

[0031] Step 6: Generate a space warning signal, attitude warning signal or violation signal.

[0032] Beneficial effects of the present invention:

[0033] (1) The present invention helps to timely discover the deviation of the spatial position of the mechanical gripper when grasping the construction component through the spatial warning signal, reminding the operator to take measures to make adjustments, so as to avoid greater problems caused by the accumulation of spatial position deviations, such as timely correcting the gripper position to ensure the accuracy of subsequent grasping, which helps to ensure the quality and safety of construction. If the spatial deviation is not discovered and corrected in time, it may cause the tower to be subjected to abnormal stress during use, increasing the risk of collapse.

[0034] (2) The present invention can, through posture warning signals, prompt the mechanical gripper to grasp the construction component when the posture angle is abnormal. For example, the tilt angle of the gripper is too large, which may affect the docking accuracy of the component, prompting the operator to pay attention to the posture of the gripper and make adjustments in time to ensure the accuracy and stability of the component during the installation process.

[0035] (3) The present invention, through the violation signal, indicates that the mechanical gripper has serious deviations in spatial position and posture angle when grasping the construction component. This is a very serious situation that requires immediate attention; it means that there may be major errors or risks in the construction process, and it is necessary to immediately stop the operation and conduct a comprehensive inspection and correction, which provides an important basis for construction management and facilitates the subsequent analysis and improvement of illegal operations to avoid similar problems from happening again; it can promptly discover and correct the errors of the mechanical gripper in the tower assembly process, ensure the accuracy, safety and quality of the construction, and help prevent construction accidents caused by improper posture, such as the falling of components due to incorrect gripper posture, which may cause harm to on-site personnel and equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The present invention will be further described below in conjunction with the accompanying drawings.

[0037] Figure 1 It is a schematic diagram of the system framework structure of the present invention;

[0038] Figure 2 It is a schematic diagram of the framework structure of the method of the present invention. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0040] Embodiment 1

[0041] See also Figure 1 As shown, the present invention is a tower assembly process monitoring system based on machine vision, comprising:

[0042] The historical grasping position acquisition module acquires the historical grasping positions of the mechanical gripper on each component of the tower. The specific method is to establish a global coordinate system in the workspace, and all grasping positions are recorded relative to this coordinate system. This global coordinate system is usually consistent with the base coordinate system of the robotic arm. Position sensors (such as encoders) and visual systems (such as stereo cameras and laser scanners) are used to record the position and posture of the mechanical gripper. The data provided by these sensors can be used to calculate the specific position of the gripper in the global or local coordinate system. Each grasping position not only records the spatial coordinates, but also the posture angle of the gripper to fully describe its position and direction in space.

[0043] The reference grasping position range acquisition module acquires and analyzes the historical grasping positions of each component of the tower by the mechanical gripper, and then obtains the reference grasping position range corresponding to each component of the tower. The specific method is as follows:

[0044] S1: Randomly select one component from each tower component as the target component;

[0045] S2: Obtain the spatial coordinates Dn (Xn, Yn, Zn) and posture angles En (αn, βn, γn) when the mechanical gripper grasps the target component for a preset number of times n, where n is the sequence number of grasping times, n ≥ 1;

[0046] pass Calculate the standard deviation U of the horizontal coordinate Xn in the spatial coordinate when the mechanical gripper grasps the target component of the tower in the preset number of times n, where n≥a≥1, where Xp is the mean of the horizontal coordinate Xn, when the standard deviation is less than the preset threshold Q1, Xp is used as the reference horizontal coordinate BX corresponding to the spatial horizontal coordinate of the target component, when the standard deviation is greater than or equal to the preset threshold Q1, the mean of the maximum and minimum values ​​in the horizontal coordinate Xn is used as the reference horizontal coordinate BX corresponding to the spatial horizontal coordinate of the target component, that is, BX=(Xmin+Xmax) / 2, and the threshold value CX corresponding to the horizontal coordinate is calculated by CX=|Xmin-Xmax|, and the specific value of Q1 is formulated by relevant personnel based on experience and actual application needs;

[0047] Generate a reference grabbing range AX1 [BX-CX, BX+CX] corresponding to the spatial abscissa of the target component according to the reference abscissa BX and the threshold value CX corresponding to the spatial abscissa of the target component;

[0048] S3: In the same way as the reference grasping range corresponding to the spatial horizontal coordinate of the target component, each parameter in the spatial coordinate Dn (Xn, Yn, Zn) and the posture angle En (αn, βn, γn) is analyzed one by one, and then the reference grasping ranges AX1, AY1, AZ1, Aα1, Aβ1 and Aγ1 corresponding to each parameter in the spatial coordinate Dn (Xn, Yn, Zn) and the posture angle En (αn, βn, γn) are obtained respectively;

[0049] S4: Repeat steps S1-S3 to obtain the reference grasping ranges AXj, AYj, AZj, Aαj, Aβj and Aγj corresponding to the parameters in the spatial coordinates and attitude angles of each component of the tower, where j is a different component of the tower, j is a positive integer, and j≥1;

[0050] The robot dog platform uses the robot dog as a mobile carrier and is equipped with a high-power fixed-focus digital camera. It records the position and posture of the mechanical gripper in real time through the set position sensor and visual system, and conducts a full-scale inspection of the tower assembly site;

[0051] It should be noted that the robot dog can move flexibly and adapt to complex terrain environments to ensure full coverage of the working area of ​​the tower assembly. The robot dog's movement path can be pre-set or adjusted in real time according to the on-site construction situation;

[0052] The image acquisition and processing module can automatically adjust the focal length and exposure parameters through the integrated high-magnification fixed-focus digital camera installed on the robot dog to capture clear images of the tower assembly process. The camera has a built-in image stabilization system to ensure the stability of the image quality captured during the movement;

[0053] For example, when the mechanical gripper assembles the various components of the tower, it can quickly capture clear images of the process. In order to obtain the best image quality, the camera will automatically adjust the focus, whether it is the assembly details at close range or the overall scene at long distance, it can be clearly imaged. In a strong light environment, the camera can automatically reduce the exposure to avoid overexposure of the image; in a weak light environment, the camera will automatically increase the sensitivity to ensure the clarity of the image;

[0054] At the same time, the grayscale correction method is used to pre-process the collected images to remove noise and enhance contrast. At the same time, the image segmentation technology is used to remove cluttered and useless background information and retain the images of key construction areas. The above are existing and mature technologies, so no further description is made here.

[0055] For example, if an image is partially too dark or too bright due to uneven lighting, the grayscale correction method can balance the grayscale distribution of the image, making the various component structures of the tower and the construction actions of the mechanical gripper in the image more clearly discernible, while effectively filtering out irrelevant debris in the background, temporarily placed tools and other messy and useless image content. For blurry images due to weather conditions (such as fog and dust), the visual correction module can also perform defogging and dust removal to restore the real construction scene.

[0056] The image acquisition and recognition module identifies the tower components grasped by the mechanical gripper in the image, identifies the construction components grasped by the mechanical gripper in real time, and acquires the spatial coordinates and posture angles of the mechanical gripper when grasping the construction components in real time;

[0057] The analysis and alarm module obtains the spatial coordinates and posture angles of the mechanical gripper when grasping the construction component in real time, and compares and analyzes them with the reference grasping position range corresponding to the construction component. According to the comparison and analysis results, a spatial warning signal, a posture warning signal or a violation signal is generated. The specific method is as follows:

[0058] The spatial coordinates and posture angles of the mechanical gripper when grasping the construction component in real time are marked as R (RX, RY, RZ) and T (Tα, Tβ, Tγ), respectively. The reference grasping position range corresponding to the construction component is obtained from the reference grasping position range acquisition module, and they are marked as FX, FY, FZ, Fα, Fβ and Fγ, respectively. The parameters RX, RY, RZ, Tα, Tβ and Tγ in the spatial coordinates and posture angles are compared with the corresponding reference grasping position ranges one by one. The number of parameters in the spatial coordinates of the construction component that do not belong to the corresponding reference grasping position ranges FX, FY and FZ is obtained and marked as e, and the number of parameters in the posture angles of the construction component that do not belong to the corresponding reference grasping position ranges Fα, Fβ and Fγ is obtained and marked as r;

[0059] When e is greater than the preset value Q1, a space warning signal is generated, otherwise, no processing is performed; when r is greater than the preset value Q2, a posture warning signal is generated, otherwise, no processing is performed. The preset values ​​Q1 and Q2 are both formulated by relevant personnel according to actual needs;

[0060] When the space warning signal and the attitude warning signal are generated at the same time, a violation signal is generated and the violation signal is output at the same time; when only the space warning signal or the attitude warning signal is generated, the corresponding signal is output;

[0061] The spatial warning signal helps to promptly detect the deviation in the spatial position of the mechanical gripper when grasping the construction components, reminding the operator to take measures to make adjustments to avoid greater problems caused by the accumulation of spatial position deviations, such as correcting the gripper position in time to ensure the accuracy of subsequent grasping, which helps to ensure construction quality and safety. If the spatial deviation is not discovered and corrected in time, it may cause the pole tower to be subjected to abnormal stress during use, increasing the risk of collapse.

[0062] The posture warning signal can be used to indicate abnormal posture angles of the mechanical gripper when grasping construction components. For example, if the gripper’s tilt angle is too large, it may affect the docking accuracy of the components, prompting the operator to pay attention to the gripper’s posture and make timely adjustments to ensure the accuracy and stability of the components during installation.

[0063] The violation signal indicates that when the mechanical gripper grasped the construction components, there were serious deviations in both the spatial position and the attitude angle. This is a very serious situation that requires immediate attention. It means that there may be major errors or risks in the construction process, and the operation needs to be stopped immediately for a comprehensive inspection and correction. For example, when assembling important key nodes of the tower, simultaneous violations of space and attitude may lead to major hidden dangers in the entire tower structure. It can promptly detect and correct errors made by the mechanical gripper during the tower assembly process, ensure the accuracy, safety and quality of the construction, and help prevent construction accidents caused by improper attitude. For example, components may fall due to incorrect gripper attitude, which may cause harm to on-site personnel and equipment.

[0064] Embodiment 2

[0065] See also Figure 2 As shown, this embodiment also provides a tower assembly process supervision method based on machine vision, which is implemented by a tower assembly process supervision system based on machine vision disclosed above, and specifically includes the following steps:

[0066] Step 1: Record the posture angle and spatial coordinates of the mechanical gripper when it grabs each component of the tower;

[0067] Step 2: Obtain the reference grabbing position range corresponding to each component of the tower;

[0068] Step 3: Use the robot dog as a mobile carrier, equipped with a high-power fixed-focus digital camera, to record the position and posture of the mechanical gripper in real time through the set position sensor and visual system, and conduct a full-scale inspection of the tower assembly site;

[0069] Step 4: The integrated high-power fixed-focus digital camera on the robot dog can automatically adjust the focal length and exposure parameters to capture clear images of the tower assembly process. The camera has a built-in image stabilization system to ensure the stability of the image quality captured during the movement. The parameters for the robot dog's image shooting are processed.

[0070] Step 5: Identify the tower component grasped by the mechanical gripper in the image, identify the construction component that the mechanical gripper is grasping in real time, and obtain the spatial coordinates and posture angle of the mechanical gripper when grasping the construction component in real time;

[0071] Step six: The spatial coordinates and posture angles of the mechanical gripper when grasping the construction component in real time are obtained and compared with the reference grasping position range corresponding to the construction component, and a spatial warning signal, posture warning signal or violation signal is generated according to the comparison and analysis results.

[0072] Embodiment 3

[0073] As the third embodiment of the present invention, when the present application is specifically implemented, compared with the first and second embodiments, the technical solution of this embodiment is to combine the solutions of the first and second embodiments mentioned above for implementation.

[0074] The above formulas are all dimensionless and numerical calculations. The formula is a formula for the most recent real situation obtained by collecting a large amount of data and performing software simulation. The preset parameters and thresholds in the formula are set by technicians in this field according to actual conditions.

[0075] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A tower assembly process monitoring system based on machine vision, characterized in that: include; The historical grasping position acquisition module records the posture angle and spatial coordinates of the mechanical gripper when grasping each component of the tower; Reference grabbing position range acquisition module: analyzes the posture angle and spatial coordinates of the mechanical gripper to each component of the tower, and obtains the reference grabbing position range corresponding to each component of the tower; The robot dog platform uses the robot dog as a mobile carrier to conduct a full range of inspections on the tower assembly site; The image acquisition processing module processes the parameters of the robot dog's image shooting; The image acquisition and recognition module acquires the spatial coordinates and posture angles of the mechanical gripper when it grasps the construction components in real time; The analysis and alarm module obtains the spatial coordinates and posture angles of the mechanical gripper when grasping the construction component in real time, and compares and analyzes them with the benchmark grasping position range corresponding to the construction component, and generates a spatial warning signal, posture warning signal or violation signal according to the comparison and analysis results.

2. A tower assembly process monitoring system based on machine vision according to claim 1, characterized in that: The reference grab position ranges corresponding to each component of the tower are obtained as follows: S1: Randomly select one component from each tower component as the target component; S2: Obtain the spatial coordinates Dn and posture angle En when the mechanical gripper grasps the target component in the preset number of times n, calculate the standard deviation U of the horizontal coordinate Xn in the spatial coordinate when the mechanical gripper grasps the target component of the tower in the preset number of times n, analyze the standard deviation U, and obtain the reference horizontal coordinate BX corresponding to the spatial horizontal coordinate of the target component according to the analysis result, and at the same time generate the reference grasping range AX1[BX-CX, BX+CX] corresponding to the spatial horizontal coordinate of the target component according to the reference horizontal coordinate BX and the threshold value CX corresponding to the spatial horizontal coordinate of the target component, the threshold value CX is the absolute value of the maximum and minimum values ​​in the horizontal coordinate Xn, where n is the sequence number of grasping times, n≥1; S3: Repeat steps S1-S2 to obtain the reference grasping ranges AXj, AYj, AZj, Aαj, Aβj and Aγj corresponding to the parameters in the spatial coordinates and attitude angles of each component of the tower, where j represents the different components of the tower, j is a positive integer, and j≥1.

3. A tower assembly process monitoring system based on machine vision according to claim 2, characterized in that: The specific method for analyzing the standard deviation U is: When the standard deviation is less than the preset threshold Q1, Xp is used as the reference horizontal coordinate BX corresponding to the horizontal coordinate of the target component space. When the standard deviation is greater than or equal to the preset threshold Q1, the average of the maximum and minimum values ​​in the horizontal coordinate Xn is used as the reference horizontal coordinate BX corresponding to the horizontal coordinate of the target component space, where Xp is the average of the horizontal coordinate Xn.

4. A tower assembly process monitoring system based on machine vision according to claim 3, characterized in that: The specific method of generating a space warning signal, an attitude warning signal or a violation signal is: The spatial coordinates and posture angles of the mechanical gripper when grasping the construction component in real time are marked as R (RX, RY, RZ) and T (Tα, Tβ, Tγ), respectively. The reference grasping position range corresponding to the construction component is obtained from the reference grasping position range acquisition module, and they are marked as FX, FY, FZ, Fα, Fβ and Fγ, respectively. The number of parameters in the spatial coordinates of the construction component that do not belong to the corresponding reference grasping position range is marked as e, and the number of parameters in the posture angles of the construction component that do not belong to the corresponding reference grasping position is marked as r; when e is greater than the preset value Q1, a spatial warning signal is generated, and when r is greater than the preset value Q2, a posture warning signal is generated. Otherwise, no processing is performed; When the space warning signal and the attitude warning signal are generated at the same time, a violation signal is generated and the violation signal is output at the same time; when only the space warning signal or the attitude warning signal is generated, the corresponding signal is output.

5. The tower assembly process monitoring system based on machine vision according to claim 1 is characterized in that: The specific method of processing the images taken by the robot dog is as follows: The integrated high-magnification fixed-focus digital camera installed on the robot dog automatically adjusts the focal length and exposure parameters to capture clear images of the tower assembly process.

6. A tower assembly process monitoring system based on machine vision according to claim 5, characterized in that: The grayscale correction method is used to preprocess the collected images to remove noise and enhance contrast. At the same time, image segmentation technology is used to remove cluttered and useless background information and retain images of key construction areas.

7. A tower assembly process supervision method based on machine vision according to any one of claims 1-6, characterized in that: The method is implemented by a tower assembly process supervision system based on machine vision, and specifically includes the following steps: Step 1: Record the posture angle and spatial coordinates of the mechanical gripper when it grabs each component of the tower; Step 2: Obtain the reference grabbing position range corresponding to each component of the tower; Step 3: Use the robot dog to conduct a comprehensive inspection of the tower assembly site; Step 4: Process the parameters for the robot dog to take images; Step 5: Acquire the spatial coordinates and posture angles of the mechanical gripper when it grasps the construction component in real time; Step 6: Generate a space warning signal, attitude warning signal or violation signal.

Citation Information

Patent Citations

  • Mechanical arm grasping control system and method based on multi-azimuth visual positioning

    CN103963058A

  • Detection method and device for calibrating mounting position of tower crane mechanism

    CN114604769A

  • Electric power tower online monitoring device and method based on Beidou

    CN115218951A

  • Tower inclination monitoring method and system based on binocular vision

    CN115410156A

  • Six-robot object grabbing system

    CN115464651A