Photovoltaic module installation method and module installation robot

By fine-tuning above the installation position of the photovoltaic module, and using the robotic arm and the camera to identify the linear position relationship of the component, the precise installation of the photovoltaic module is achieved, solving the problem of large installation errors in the prior art and improving the installation accuracy.

CN119036043APending Publication Date: 2024-11-29LEAPTING TECH CO LTD

Patent Information

Application Number
CN202411554284.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-04
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

During the installation process of photovoltaic modules, the installation errors caused by data instability and long distance movement of the robotic arm are large, and the repeatability accuracy is low, so accurate installation cannot be achieved.

Method used

By presetting the fine-tuning position above the photovoltaic assembly is about to be installed, the robot arm and the camera use to identify the linear position relationship between the reference assembly and the component to be installed, and fine-tuning is carried out to make the horizontal and vertical lines parallel and the vertical lines aligned, and at the target installation position Press down to complete the installation.

Benefits of technology

It reduces installation errors, improves the installation accuracy of photovoltaic modules, and ensures the accurate position and distance consistency of the modules.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119036043A_ABST
    Figure CN119036043A_ABST
Patent Text Reader

Abstract

The invention provides an installation method of a photovoltaic module and a module installation robot. The method comprises the following steps: acquiring a target installation position of a to-be-installed module; the to-be-installed assembly is grabbed through a mechanical arm, the to-be-installed assembly is moved to a target fine adjustment position and suspended, the target fine adjustment position is located above the target installation position, and the distance between the target fine adjustment position and the target installation position is a first preset distance; identifying straight lines on the surfaces of the reference assembly and the to-be-mounted assembly at the target fine adjustment position, and performing fine adjustment on the to-be-mounted assembly according to the position relationship between the straight lines; and then the to-be-installed assembly which is finely adjusted in place is pressed down to a target installation position. According to the invention, the installation error is reduced, and the installation precision of the photovoltaic module is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the field of photovoltaic component installation, and in particular to a photovoltaic component installation method and a component installation robot. Background Art

[0002] Photovoltaic modules can convert solar energy into electrical energy and are important devices for using clean energy. However, building a photovoltaic power station requires a lot of labor costs and is extremely dangerous. Now, the autonomous installation of photovoltaic modules can be achieved through module installation robots. The module installation robot uses visual recognition to determine the installation position of the photovoltaic module and then installs the photovoltaic module. However, due to factors such as data instability and long-distance movement of the robot arm, the installation error is large. Currently, only rough installation can be achieved with low repetition accuracy. Summary of the invention

[0003] One of the purposes of the present invention is to provide a photovoltaic module installation method and a module installation robot in view of the problems existing in the prior art.

[0004] The technical solution provided by the present invention is as follows: A photovoltaic module installation method is used for a module installation robot, the module installation robot includes a mechanical arm and a camera located at the end of the mechanical arm, and the installation method includes: Get the target installation location of the component to be installed; Grab the component to be installed by the robotic arm, move it to a target fine-tuning position and hover it, wherein the target fine-tuning position is located above the target installation position and is a first preset distance away from the target installation position; Acquire a first image including a reference component and a component to be installed by a camera; the reference component is a photovoltaic component that has been installed in place before the component to be installed; Identify the horizontal straight lines on the reference component and the component to be installed in the first image, and perform a first fine-tuning process on the component to be installed according to the positional relationship between the horizontal straight line of the reference component and the horizontal straight line of the component to be installed in the first image, so that the reference component is parallel to the horizontal straight line of the component to be installed; Acquire, by a camera, a second image including the reference component and the component to be installed after the first fine-tuning process; identifying vertical lines on the reference component and the component to be installed in the second image; According to the distance between a vertical line of a reference component and a vertical line of a component to be installed in the second image, the component to be installed is translated along a horizontal straight line direction so that the corresponding vertical lines of the reference component and the component to be installed are aligned; Press the component to be installed to the target installation position.

[0005] In some embodiments, after aligning the reference component with the corresponding vertical line of the component to be installed, the method further includes: Acquire a third image including the reference component and the component to be installed in vertical alignment by a camera; identifying a horizontal and straight line on the reference component and the component to be installed in the third image; The component to be installed is translated along the vertical direction according to the distance between the horizontal lines of the edges of the reference component and the component to be installed in the third image, so that the reference component and the component to be installed maintain a second preset distance in the vertical direction.

[0006] In some embodiments, identifying the horizontal and vertical lines on the reference component and the component to be installed in the first image, the second image, and the third image includes: Detecting straight lines on the reference component and the component to be installed in the first image, the second image, and the third image; Filter out vertical or horizontal lines from straight lines; Calculate the distances between each adjacent vertical line and each adjacent horizontal line respectively; Line fusion is performed on vertical lines or horizontal lines. Line fusion is to merge multiple lines of the same type whose distance is less than a threshold into one.

[0007] In some embodiments, performing a first fine-tuning process on the component to be installed according to the positional relationship between the horizontal straight line of the reference component and the horizontal straight line of the component to be installed in the first image includes: Calculating the average slope of the horizontal straight line of the reference component and the average slope of the horizontal straight line of the component to be installed in the first image; If the average slope of the horizontal straight line of the reference component in the first image is not equal to the average slope of the horizontal straight line of the component to be installed, the average angle between the horizontal straight line of the reference component in the first image and the horizontal straight line of the component to be installed is calculated according to the average slope of the horizontal straight line of the reference component and the average slope of the horizontal straight line of the component to be installed; Fine-tune the rotational freedom of the component to be installed around the Z axis based on the average angle.

[0008] In some embodiments, it also includes: obtaining the equation of a fitted straight line between the second pixel distance and the first pixel distance, the first pixel distance being the distance between two straight lines of the same type in an image obtained by a camera at a target fine-tuning position, and the second pixel distance being the distance between two straight lines of the same type in an image obtained by a camera at a target installation position, wherein one straight line is located at a reference component and the other straight line is located at a component to be installed.

[0009] In some embodiments, translating the component to be installed along the horizontal straight line direction according to the distance between the vertical line of a reference component and the vertical line of a component to be installed in the second image includes: Select two vertical lines closest to the center of the second image as a target vertical line pair, one of which is a vertical line of the reference component and the other is a vertical line of the component to be installed; Calculate the first pixel distance of the target vertical line pair; Input the first pixel distance of the target vertical line pair into the fitted line equation to obtain the second pixel distance of the target vertical line pair; Obtain the proportional relationship between a single pixel in the image captured by the camera at the target installation location and the actual distance it represents; Multiply the second pixel distance of the target vertical line pair by the proportional relationship to obtain the translation amount of the component to be installed in the horizontal straight line direction; The translational freedom of the assembly to be installed in the horizontal and straight directions is adjusted according to the translational amount in the horizontal and straight directions.

[0010] In some embodiments, translating the component to be installed along the vertical line direction according to the distance between the reference component and the horizontal line of the edge of the component to be installed in the third image includes: Selecting the lower edge horizontal straight line of the reference component and the upper edge horizontal straight line of the component to be installed in the third image as the target horizontal straight line pair; Calculate the first pixel distance between the target horizontal and straight line pairs; Input the first pixel distance of the target horizontal and straight line pair into the fitting line equation to obtain the second pixel distance of the target horizontal and straight line pair; Obtain the proportional relationship between a single pixel in the image captured by the camera at the target installation location and the actual distance it represents; Multiply the second pixel distance of the target horizontal line pair by the proportional relationship to obtain the translation amount of the component to be installed in the vertical direction; The translational freedom of the assembly to be installed in the vertical direction is adjusted according to the translation amount in the vertical direction.

[0011] In some embodiments, before formal installation, the fitting straight line equation between the second pixel distance and the first pixel distance is obtained by the following steps: Move a component to be installed to a first fine-tuning position, adjust the component to be installed so that the component to be installed is parallel to the horizontal straight line of the reference component, and then take an image 1 at the first fine-tuning position; Selecting two vertical lines closest to the center of the image 1 as a first vertical line pair, wherein one vertical line is located at the reference component and the other vertical line is located at the component to be installed; Calculate a first pixel distance of a first vertical line pair according to image one; Pressing the component to be installed down to a first installation position corresponding to the first fine-tuning position, capturing a second image at the first installation position, and calculating a second pixel distance of the first vertical line pair according to the second image; Update the first fine-tuning position along the horizontal straight line direction, move the component to be installed to the new first fine-tuning position, repeat the above process, calculate the new first pixel distance and second pixel distance, until N sets of first pixel distance and second pixel distance are obtained; Use the least squares method to fit N groups of first pixel distances and second pixel distances to obtain the slope k and intercept b of the fitting straight line equation: ; in, is the first pixel distance, is the second pixel distance, i=1,2,...N.

[0012] In some embodiments, the ratio r between a single pixel in the image captured by the camera at the target installation position and the actual distance it represents is calculated according to the following formula: ; in, is the second pixel distance, i=1,2,...N.

[0013] In some embodiments, grabbing the component to be installed includes: Adjust the gripping position of the component to be installed so that the camera can see both the reference component and the component to be installed at the target fine-tuning position.

[0014] The present invention also provides a component installation robot, comprising: A robotic arm to grab, move and adjust components to be installed; a camera, located at the end of the robotic arm, for acquiring an image containing the reference component and the component to be installed; Memory for storing computer programs; A processor is used to implement any of the above photovoltaic assembly installation methods when running a computer program.

[0015] The photovoltaic module installation method and module installation robot provided by the present invention can at least bring the following beneficial effects: 1. The present invention sets a fine-tuning position at a preset distance above the position where the photovoltaic component is to be installed, and identifies the straight lines on the surface of the reference component and the component to be installed at the fine-tuning position, and fine-tunes the two degrees of freedom of the component to be installed (the rotational degree of freedom around the Z axis and the translational degree of freedom along the horizontal straight line direction) through the positional relationship of these straight lines, so that the component to be installed is parallel to the horizontal straight line of the reference component and aligned with the vertical straight line; then the component to be installed that has been fine-tuned to the right position is pressed down to the installation position to complete the installation. The above method reduces the installation error and improves the installation accuracy of the photovoltaic component.

[0016] 2. The present invention fine-tunes the three degrees of freedom (rotational freedom around the Z axis, translational freedom along the horizontal and vertical directions) of the component to be installed at the fine-tuning position, thereby not only making the horizontal line of the component to be installed parallel to that of the reference component and aligning the vertical line, but also maintaining a second preset distance between the component to be installed and the reference component, thereby further improving the installation accuracy of the photovoltaic component. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The preferred implementation scheme will be described below in a clear and understandable manner with reference to the accompanying drawings, and the above-mentioned characteristics, technical features, advantages and implementation methods of a photovoltaic component installation method and a component installation robot will be further explained.

[0018] Figure 1 is a flow chart of an embodiment of a method for installing a photovoltaic module of the present invention; Figure 2 is a schematic structural diagram of an embodiment of a component installation robot of the present invention; Figure 3 It is a schematic diagram of the structure of the reference component and the component to be installed as seen from the robot camera perspective when the target position is fine-tuned; Figure 4 is a schematic diagram of a first image according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the specific implementation methods of the present invention will be described below with reference to the accompanying drawings. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings and other implementation methods can be obtained based on these drawings without creative work.

[0020] In order to simplify the drawings, only the parts related to the present invention are schematically shown in each figure, and they do not represent the actual structure of the product. In addition, in order to simplify the drawings and facilitate understanding, in some figures, only one of the parts with the same structure or function is schematically drawn, or only one of them is marked. In this article, "one" not only means "only one", but also means "more than one"; "robot" and "component installation robot" have the same meaning.

[0021] One embodiment of the present invention, as Figure 1 As shown, a photovoltaic module installation method is used for a module installation robot, the module installation robot includes a mechanical arm and a camera located at the end of the mechanical arm, and the installation method includes: Step S100: obtaining a target installation location of a component to be installed; Step S200: The robot arm grabs the component to be installed, moves it to a target fine-tuning position and makes it hover; the target fine-tuning position is located above the target installation position and is a first preset distance away from the target installation position.

[0022] Specifically, the module installation robot is used to install the photovoltaic module on the photovoltaic support, and the end of the mechanical arm of the robot grabs and moves the photovoltaic module. A camera is also installed at the end of the mechanical arm to provide visual positioning information for the robot.

[0023] The component to be installed refers to the photovoltaic component to be installed. The target installation position can be identified by the position of a preset point in the installation area of ​​the photovoltaic component. The target installation position of the component to be installed can be predetermined according to the design plan of the photovoltaic power station and input into the component installation robot. The target fine-tuning position is above the target installation position, and the height difference between the two is a first preset distance, such as 5 cm. For example, the target installation position is set to the center position of the installation area, and the robot grabs the component to be installed through the mechanical arm and moves it so that the center point of the component to be installed reaches the target fine-tuning position and the component to be installed hovers at the target fine-tuning position.

[0024] Step S300 is to obtain a first image including a reference component and a component to be installed by a camera; the reference component is a photovoltaic component that has been installed in place before the component to be installed.

[0025] The reference component is the previously installed photovoltaic component. Taking the installation from left to right as an example, the first photovoltaic component can be installed in a traditional way and used as the reference component for the next photovoltaic component. Then, the second photovoltaic component can be installed at the adjacent position to the right of the reference component using the method described in this embodiment. Then, the third photovoltaic component can be installed using the second photovoltaic component as the reference component, and the cycle is repeated until the installation of photovoltaic components in a line is completed. It can also be installed from right to left, or from top to bottom, or from bottom to top. There is no restriction on this. It only needs to use the previously installed photovoltaic component as the reference component for the next component to be installed.

[0026] The camera is located above the grasped component to be installed, with a certain height difference. When the robotic arm moves the component to be installed to the target fine-tuning position, the robot can look down through the assembled camera to capture an image containing the reference component and the component to be installed. Figure 3 It is a structural diagram of the image seen within the camera's field of view at the target fine-tuning position. The upper part of the image is the reference component or a part thereof, and the lower part is a part of the component to be installed. Figure 4 It is a specific image taken by the camera, the upper part is part of the reference component, and the lower part is part of the component to be installed.

[0027] Step S400 identifies the horizontal and straight lines on the reference component and the component to be installed in the first image.

[0028] There are some white lines on the photovoltaic panel, including horizontal and vertical lines. These white lines are the connecting lines between multiple battery cells. Their main function is to connect the battery cells in series or in parallel to form a complete circuit, thereby achieving the purpose of power generation.

[0029] In the first image there are these straight lines, such as Figure 4 As shown, an xyz coordinate system is established with the upper left corner of the image as the origin, the horizontal direction of the image is the X-axis, the vertical direction is the Y-axis, the plane of the reference component is the xy plane, and the Z axis is established perpendicular to the xy plane.

[0030] It should be noted that the vertical lines and horizontal lines in this article mainly refer to the white lines on the surface of the reference component / component to be installed. The horizontal lines of the reference component / component to be installed in the image obtained by the camera are not necessarily parallel to the X-axis, and the vertical lines are not necessarily parallel to the Y-axis.

[0031] Through existing straight line detection algorithms, for example, the Canny edge detection algorithm and the Hough transform algorithm, the straight lines on the reference component and the component to be installed in the first image can be detected, and then the vertical lines (straight lines with larger absolute values) and horizontal lines (straight lines with absolute values ​​close to 0) can be screened out according to the absolute values ​​of the slopes of the straight lines.

[0032] Step S500 performs a first fine-tuning process on the component to be installed according to the positional relationship between the horizontal straight line of the reference component and the horizontal straight line of the component to be installed in the first image, so that the horizontal straight line of the reference component is parallel to the horizontal straight line of the component to be installed.

[0033] There are two situations in which the positional relationship between the horizontal straight line of the reference component and the horizontal straight line of the component to be installed in the first image is parallel or intersecting. For example, the positional relationship between the two straight lines can be determined based on the slope of the straight line. If the horizontal straight line of the reference component is parallel to the horizontal straight line of the component to be installed, skip this step and do not need to perform the first fine-tuning process. Otherwise, further calculate the average angle between the two horizontal straight lines, and adjust the rotational freedom of the component to be installed around the Z axis based on the average angle, so that the horizontal straight line of the reference component is parallel to the horizontal straight line of the component to be installed.

[0034] Step S600: acquiring, by means of a camera, a second image including the reference component and the component to be installed after the first fine-tuning process; Step S700 identifies vertical lines on the reference component and the component to be installed in the second image; Step S800 translates the component to be installed along a horizontal straight line direction according to the distance between a vertical line of a reference component and a vertical line of a component to be installed in the second image, so as to align the corresponding vertical lines of the reference component and the component to be installed.

[0035] After the first fine-tuning process, the horizontal line of the component to be installed is parallel to the horizontal line of the reference component. Therefore, in the second image, the horizontal line of the component to be installed is parallel to the horizontal line of the reference component, and the vertical line of the component to be installed is also parallel to the vertical line of the reference component, but the corresponding vertical lines of the reference component and the component to be installed may not be aligned.

[0036] The minimum distance between the reference component and the adjacent vertical line of the component to be installed can be obtained based on the distance between the vertical line of the reference component and the vertical line of the component to be installed. The minimum distance is used to determine whether the vertical lines are aligned. If the minimum distance exceeds a threshold, it means that the vertical lines are not aligned. If the vertical lines are not aligned, it is necessary to calculate the translation amount of the component to be installed in the horizontal and straight line direction, and translate the component to be installed in the horizontal and straight line direction based on the translation amount so that the reference component is aligned with the vertical line corresponding to the component to be installed.

[0037] The first pixel distance is the distance between two straight lines of the same type in the image taken at the target fine-tuning position, that is, the distance between the two straight lines seen by the camera at the target fine-tuning position. The second pixel distance is the distance between two straight lines of the same type in the image obtained by the camera at the target installation position.

[0038] The first pixel distance and the second pixel distance between the two vertical lines in the second image are not equal to the actual distance between the two vertical lines. Since the image taken by the camera has "distortion" that the near is larger and the far is smaller, and the target fine-tuning position is higher than the target installation position, the first pixel distance is smaller than the actual distance. The first pixel distance between the two vertical lines in the second image can be calculated first, such as the first pixel distance between the vertical line of a reference component and the vertical line of the corresponding component to be installed in the second image, and then the first pixel distance is converted into the corresponding second pixel distance; then the second pixel distance is converted into the actual distance in the real world, that is, the translation amount of the component to be installed in the horizontal and straight directions; then the component to be installed is adjusted according to the translation amount in the horizontal and straight directions, so that the corresponding vertical lines of the reference component and the component to be installed are aligned.

[0039] According to the imaging principle of the camera, the distance between the two corresponding straight lines at the target fine-tuning position is linearly related to the distance at the target installation position, that is, the first pixel distance is linearly related to the second pixel distance, which can be predetermined before the photovoltaic module is installed.

[0040] The relationship between the second pixel distance and the actual distance depends on the actual distance represented by a single pixel in the image taken at the installation location. This depends on the resolution of the camera, the object distance and the phase distance when shooting, so it can also be predetermined before the PV module is installed.

[0041] Step S1000: Press the component to be installed to the target installation position.

[0042] Through the above processing, the component to be installed is parallel to the horizontal line of the reference component and aligned with the corresponding vertical line. At this time, the component to be installed is pressed down to the target installation position to complete the installation of the component.

[0043] In this embodiment, without adding additional sensors, the component to be installed is first fine-tuned at the target fine-tuning position according to the appearance characteristics of the photovoltaic component (i.e., the straight lines on the surface), so that the component to be installed is parallel to the horizontal straight line of the reference component and aligned with the corresponding vertical line, and then the component to be installed is pressed down to the target installation position, thereby reducing the installation error and improving the installation accuracy of the photovoltaic component.

[0044] In one embodiment, between step S800 and step S1000, the following steps are further included: Step S900 identifies the horizontal and straight lines on the reference component and the component to be installed in the second image; Step S910 translates the component to be installed along the vertical direction according to the distance between the horizontal lines of the edges of the reference component and the component to be installed in the second image, so that the reference component and the component to be installed maintain a second preset distance in the vertical direction.

[0045] Specifically, for example, the Hough detection algorithm can be used to identify the horizontal straight line at the lower edge of the reference component and the horizontal straight line at the upper edge of the component to be installed in the second image, calculate the first pixel distance between the two horizontal straight lines, and convert the first pixel distance into a corresponding second pixel distance, that is, the distance between the two horizontal straight lines seen by the camera at the target installation position; then, the second pixel distance is converted into an actual distance, and then the translation amount of the component to be installed in the vertical direction is obtained according to the difference between the actual distance and the second preset distance; then, the component to be installed is adjusted according to the translation amount in the vertical direction, so that the reference component and the component to be installed maintain the second preset distance in the vertical direction.

[0046] The linear relationship between the first pixel distance and the second pixel distance, and the relationship between the second pixel distance and the actual distance can be predetermined before the photovoltaic module is installed, as described above.

[0047] Through steps S900 and S910, the component to be installed and the reference component are not only parallel to the horizontal lines and aligned with the corresponding vertical lines, but also maintain a second preset distance in the vertical direction, thereby further improving the installation accuracy of the component.

[0048] In one embodiment, between step S800 and step S1000, the method further includes: Step S920: acquiring a third image including the reference component and the component to be installed aligned with the vertical line through the camera; Step S930: identifying the horizontal and straight lines on the reference component and the component to be installed in the third image; Step S940 translates the component to be installed along the vertical direction according to the distance between the horizontal lines of the edges of the reference component and the component to be installed in the third image, so that the reference component and the component to be installed maintain a second preset distance in the vertical direction.

[0049] In this embodiment, after fine-tuning the component to be installed so that the horizontal lines of the reference component and the component to be installed are parallel and the vertical lines are aligned, a third image is taken at the target fine-tuning position, and the distance between the two components in the vertical direction is adjusted according to the distance between the horizontal lines of the reference component and the component to be installed in the third image.

[0050] Specifically, for example, the Hough detection algorithm can be used to identify the horizontal straight line at the lower edge of the reference component and the horizontal straight line at the upper edge of the component to be installed in the third image, calculate the first pixel distance between the two horizontal straight lines, and convert the first pixel distance into the corresponding second pixel distance; then convert the second pixel distance into an actual distance, and then obtain the translation amount of the component to be installed in the vertical direction based on the difference between the actual distance and the second preset distance; then adjust the component to be installed based on the translation amount in the vertical direction, so that the reference component and the component to be installed maintain the second preset distance in the vertical direction.

[0051] In one embodiment, in step S400, step S700, step S900, and step S930, identifying the vertical lines and horizontal lines on the reference component and the component to be installed in the first image, the second image, and the third image includes: Step S10 detects straight lines on the reference component and the component to be installed in the first image, the second image, and the third image; Step S20: selecting a vertical line or a horizontal line from the detected lines; Step S30: respectively calculating the distances between adjacent vertical lines and adjacent horizontal lines; Step S40 performs line fusion on the vertical lines or horizontal lines according to the distance between the lines. Line fusion refers to fusion of multiple lines of the same type whose distance is less than a threshold into one line.

[0052] Specifically, the straight lines on the reference component and the component to be installed in the image may be detected by using the Canny edge detection algorithm and the Hough transform algorithm.

[0053] A vertical line or a horizontal line can be selected from the straight lines according to the absolute value of the slope of the straight line. The vertical line is a straight line whose absolute value of the slope of the straight line is greater than a first preset value, and the horizontal line is a straight line whose absolute value of the slope of the straight line is less than a second preset value. The first preset value is greater than the second preset value. The second preset value can be set to a value close to 0.

[0054] For vertical or horizontal lines, the distance between the lines is calculated, and the lines with distances less than the threshold are merged into one by averaging.

[0055] Since two straight lines are not necessarily parallel, the distance between two parallel or nearly parallel straight lines can be calculated in one of the following ways: 1. For vertical lines, calculate the distance between the intersections of the two vertical lines and the X-axis; for horizontal lines, calculate the distance between the intersections of the two horizontal lines and the Y-axis. 2. Determine a point on a straight line, preferably with the horizontal or vertical coordinate of this point equal to the horizontal or vertical coordinate of the center point of the image, and calculate the distance between this point and the other straight line.

[0056] In one embodiment, step S500 of performing a first fine-tuning process on the component to be installed according to the positional relationship between the horizontal straight line of the reference component and the horizontal straight line of the component to be installed in the first image includes: Step S510 calculates the average slope of the horizontal straight line of the reference component and the average slope of the horizontal straight line of the component to be installed in the first image; Step S520: If the average slope of the horizontal straight line of the reference component in the first image is not equal to the average slope of the horizontal straight line of the component to be installed, then the average angle between the horizontal straight line of the reference component in the first image and the horizontal straight line of the component to be installed is calculated according to the average slope of the horizontal straight line of the reference component and the average slope of the horizontal straight line of the component to be installed; otherwise, jump to step S600; Step S530 is to fine-tune the rotational freedom of the assembly to be installed around the Z axis according to the average angle.

[0057] In one embodiment, step S800 translates the component to be installed along the horizontal straight line direction according to the distance between the vertical line of a reference component and the vertical line of a component to be installed in the second image, including: Step S810 obtains the equation of the fitted straight line between the second pixel distance and the first pixel distance, where the first pixel distance is the distance between two straight lines of the same type in the image obtained by the camera at the target fine-tuning position, and the second pixel distance is the distance between two straight lines of the same type in the image obtained by the camera at the target installation position, wherein one straight line is located at the reference component and the other is located at the component to be installed.

[0058] Step S820 selects two vertical lines in the second image that are closest to the center of the image as a target vertical line pair, one of which is a vertical line of the reference component and the other is a vertical line of the component to be installed.

[0059] Step S830 calculates the first pixel distance of the target vertical line pair.

[0060] Step S840: Input the first pixel distance of the target vertical line pair into the fitted line equation to obtain the second pixel distance of the target vertical line pair.

[0061] Step S850 obtains the proportional relationship between a single pixel in the image captured at the target installation position and the actual distance it represents.

[0062] Step S860 multiplies the second pixel distance of the target vertical line pair by the proportional relationship to obtain the translation amount of the component to be installed in the horizontal line direction.

[0063] Step S870 adjusts the translational freedom of the assembly to be installed in the horizontal and straight lines according to the translational amount in the horizontal and straight lines.

[0064] Specifically, since images captured by the camera are "distorted" with objects appearing larger near and smaller far away, it is more accurate to select lines based on the center of the image, and the two vertical lines closest to the center of the image are preferably selected as the target vertical line pair.

[0065] The first pixel distance between two vertical lines can be calculated in one of the following ways: 1. Calculate the distance between the intersection points with the X-axis; 2. Determine a point on a straight line and calculate the distance between the point and another straight line.

[0066] Assume that the equation of the vertical line of the selected reference component is: , is the corresponding slope, is the corresponding intercept; the equation of the vertical line of the component to be installed is: , is the corresponding slope, is the corresponding intercept.

[0067] Using method 1, the distance d between the two vertical lines in the second image is: .

[0068] Using method 2, select a point on the vertical line of the above reference component , is the ordinate of the center point of the image, When The horizontal coordinate at the time; calculate the distance d from this point to another vertical line as: .

[0069] You can also select other points. Since the images taken by the camera are "distorted" and appear larger when they are near and smaller when they are far away, it is preferred to select a point close to the center of the image.

[0070] In one embodiment, step S910 or step S940 translates the component to be installed along the vertical line direction according to the distance between the reference component and the horizontal line of the edge of the component to be installed in the second image / the third image, including: Step S911 obtains the equation of the fitted straight line between the second pixel distance and the first pixel distance; the first pixel distance is the distance between two straight lines of the same type in the image obtained by the camera at the target fine-tuning position, and the second pixel distance is the distance between two straight lines of the same type in the image obtained by the camera at the target installation position, wherein one straight line is located at the reference component and the other is located at the component to be installed.

[0071] Step S912 selects the lower edge horizontal straight line of the reference component and the upper edge horizontal straight line of the component to be installed in the second image / third image as a target horizontal straight line pair.

[0072] Step S913 calculates the first pixel distance between the target horizontal and straight line pairs; Step S914: Input the first pixel distance of the target horizontal and straight line pair into the fitted straight line equation to obtain the second pixel distance of the target horizontal and straight line pair; Step S915 obtains the proportional relationship between a single pixel in the image captured at the target installation position and the actual distance it represents; Step S916: Multiply the second pixel distance of the target horizontal straight line pair by the proportional relationship to obtain the translation amount of the component to be installed in the vertical straight line direction; Step S917 adjusts the translational freedom of the assembly to be installed in the vertical direction according to the translation amount in the vertical direction.

[0073] The lower edge horizontal straight line of the reference component and the upper edge horizontal straight line of the component to be installed in the second image / third image can be identified by the Hough detection algorithm, and these two horizontal straight lines constitute a target horizontal straight line pair.

[0074] The processing methods of steps S913 to S917 are similar to those of steps S830 to S870 and will not be repeated here. Through steps S913 to S917, a second preset distance is maintained between the reference component and the component to be installed in the vertical direction.

[0075] In one embodiment, before formal installation, the equation of the fitted straight line between the second pixel distance and the first pixel distance is obtained by the following steps: First, a reference component is preset.

[0076] Step S811: Move a component to be installed to a first fine-tuning position, adjust the component to be installed so that the horizontal line of the component to be installed is parallel to the horizontal line of the reference component, and then capture image 1 at the first fine-tuning position. The first fine-tuning position corresponds to the first installation position, the height of the first installation position is equal to the height of the target installation position, and the height of the first fine-tuning position is equal to the height of the target fine-tuning position.

[0077] Step S812 selects two vertical lines in image 1 that are closest to the center of the image as a first vertical line pair, wherein one vertical line is located at the reference component and the other vertical line is located at the component to be installed.

[0078] Step S813 calculates a first pixel distance of a first pair of vertical lines according to the first image.

[0079] Step S814: Press the component to be installed to the first installation position, capture a second image at the first installation position, and calculate a second pixel distance of the first vertical line pair according to the second image; Step S815 updates the first fine-tuning position along the horizontal straight line direction, moves the assembly to be installed to the new first fine-tuning position, captures image 1 at the new first fine-tuning position, and repeats steps S813 to S815 to obtain new first pixel distances and second pixel distances, until N sets of first pixel distances and second pixel distances are obtained; Step S816 uses the least squares method to fit N groups of first pixel distances and second pixel distances to obtain the slope k and intercept b of the fitting straight line equation: ; in, is the first pixel distance, is the second pixel distance, i=1,2,...N, and the equation of the fitting line is , y represents the second pixel distance, and x represents the first pixel distance.

[0080] The proportional relationship r between a single pixel in the image taken at the target installation location and the actual distance it represents is calculated according to the following formula: .

[0081] In one embodiment, capturing the components to be installed in step S200 includes: Step S210 adjusts the position of the robot arm to grab the component to be installed so that the camera can see the reference component and the component to be installed at the target fine-tuning position at the same time. Figure 3 shown.

[0082] Improper grasping position will result in the robot camera not being able to see enough reference components and components to be installed at the fine-tuning position, which will affect the accuracy of subsequent fine-tuning actions. The appropriate grasping area can be determined in advance, and the robot arm can select a grasping position from it when grasping.

[0083] One embodiment of the present invention, as Figure 2 As shown, a component installation robot 10 includes: The robot arm 400 is used to grab and move the components to be installed, and adjust the degrees of freedom of the components to be installed, the degrees of freedom including the rotational degree of freedom around the Z axis, the translational degree of freedom along the horizontal straight line direction, and the translational degree of freedom along the vertical straight line direction; A camera 500, located at the end of the robotic arm, is used to obtain an image containing the reference component and the component to be installed; A memory 100, for storing a computer program 200; The processor 300 is configured to implement the photovoltaic assembly installation method described in any of the above embodiments when running the computer program 200.

[0084] The memory 100 may be any internal storage unit and / or external storage device capable of storing data and programs, for example, a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, or a flash memory card.

[0085] As needed, the processor 300 can be a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a general-purpose processor or other logic devices, etc.

[0086] It should be noted that the above embodiments can be freely combined as needed. The above are only preferred embodiments of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention.

Claims

1. A method for installing a photovoltaic module, for a module installation robot, wherein the module installation robot comprises a mechanical arm and a camera located at the end of the mechanical arm, wherein: include: Get the target installation location of the component to be installed; Grabbing the component to be installed by the mechanical arm, moving it to a target fine-tuning position and hovering it, wherein the target fine-tuning position is located above the target installation position and is a first preset distance away from the target installation position; Acquiring a first image including the reference component and the component to be installed by the camera; the reference component is a photovoltaic component that has been installed in place before the component to be installed; Identify the horizontal straight line on the reference component and the component to be installed in the first image, and perform a first fine-tuning process on the component to be installed according to the positional relationship between the horizontal straight line of the reference component and the horizontal straight line of the component to be installed in the first image, so that the reference component is parallel to the horizontal straight line of the component to be installed; Acquire, by the camera, a second image including the reference component and the component to be installed after the first fine-tuning process; identifying vertical lines on the reference component and the component to be installed in the second image; According to the distance between a vertical line of the reference component and a vertical line of the component to be installed in the second image, the component to be installed is translated along a horizontal straight line direction, so that the reference component is aligned with the vertical line corresponding to the component to be installed; Press the component to be installed down to the target installation position.

2. A method for installing a photovoltaic module according to claim 1, characterized in that: After aligning the reference component with the corresponding vertical line of the component to be installed, the method further comprises: Acquire, by the camera, a third image including the vertically aligned reference component and the component to be installed; Identifying the horizontal and straight lines on the reference component and the component to be installed in the third image; The component to be installed is translated along a vertical line direction according to the distance between the reference component and the edge horizontal line of the component to be installed in the third image, so that the reference component and the component to be installed maintain a second preset distance in the vertical line direction.

3. A method for installing a photovoltaic module according to any one of claims 1-2, characterized in that: Identifying the horizontal and vertical lines on the reference component and the component to be installed in the first image, the second image, and the third image includes: Detecting straight lines on the reference component and the component to be installed in the first image, the second image, and the third image; Selecting a vertical line or a horizontal line from the straight lines; Calculating the distances between each adjacent vertical line and each adjacent horizontal line respectively; Line fusion is performed on the vertical line or the horizontal line, and the line fusion is to fuse multiple lines of the same type whose distance is less than a threshold into one line.

4. A method for installing a photovoltaic module according to claim 1, characterized in that: The first fine-tuning process is performed on the component to be installed according to the positional relationship between the horizontal straight line of the reference component and the horizontal straight line of the component to be installed in the first image, including: Calculating an average slope of the horizontal straight line of the reference component and an average slope of the horizontal straight line of the component to be installed in the first image; If the average slope of the horizontal straight line of the reference component in the first image is not equal to the average slope of the horizontal straight line of the component to be installed, then the average angle between the horizontal straight line of the reference component in the first image and the horizontal straight line of the component to be installed is calculated according to the average slope of the horizontal straight line of the reference component and the average slope of the horizontal straight line of the component to be installed; The rotational freedom of the component to be installed around the Z axis is fine-tuned according to the average angle.

5. A method for installing a photovoltaic module according to claim 1 or 2, characterized in that: Also includes: Obtain a fitting straight line equation between a second pixel distance and a first pixel distance, wherein the first pixel distance is a distance between two straight lines of the same type in an image obtained by the camera at the target fine-tuning position, and the second pixel distance is a distance between two straight lines of the same type in an image obtained by the camera at the target installation position, wherein one straight line is located at the reference component and the other straight line is located at the component to be installed.

6. A method for installing a photovoltaic module according to claim 5, characterized in that: According to the distance between a vertical line of the reference component and a vertical line of the component to be installed in the second image, translating the component to be installed along the horizontal line direction includes: Selecting two vertical lines closest to the center of the second image as a target vertical line pair, one of which is a vertical line of the reference component and the other is a vertical line of the component to be installed; Calculating a first pixel distance of the target vertical line pair; Inputting the first pixel distance of the target vertical line pair into the fitted straight line equation to obtain a second pixel distance of the target vertical line pair; Obtaining a proportional relationship between a single pixel in an image captured by the camera at the target installation position and the actual distance it represents; Multiplying the second pixel distance of the target vertical line pair by the proportional relationship to obtain the translation amount of the component to be installed in the direction of the horizontal line; The translational freedom of the component to be installed in the horizontal and straight line directions is adjusted according to the translational amount in the horizontal and straight line directions.

7. A method for installing a photovoltaic module according to claim 5, characterized in that: The step of translating the component to be installed along the vertical line according to the distance between the reference component and the horizontal line of the edge of the component to be installed in the third image comprises: Selecting the lower edge horizontal straight line of the reference component and the upper edge horizontal straight line of the component to be installed in the third image as a target horizontal straight line pair; Calculate the first pixel distance of the target horizontal and straight line pair; Inputting the first pixel distance of the target horizontal and straight line pair into the fitted straight line equation to obtain the second pixel distance of the target horizontal and straight line pair; Obtaining a proportional relationship between a single pixel in an image captured by the camera at the target installation position and the actual distance it represents; Multiplying the second pixel distance of the target horizontal straight line pair by the proportional relationship to obtain the translation amount of the component to be installed in the direction of the vertical line; The translational freedom of the component to be installed in the vertical direction is adjusted according to the translational amount in the vertical direction.

8. A method for installing a photovoltaic module according to claim 5, characterized in that: Before formal installation, the fitting straight line equation between the second pixel distance and the first pixel distance is obtained by the following steps: Move a component to be installed to a first fine-tuning position, adjust the component to be installed so that the component to be installed is parallel to the horizontal line of the reference component, and then take an image 1 at the first fine-tuning position; Selecting two vertical lines closest to the center of the image 1 as a first vertical line pair, wherein one vertical line is located at the reference component and the other vertical line is located at the component to be installed; Calculate a first pixel distance of the first pair of vertical lines according to the image 1; Pressing the component to be installed down to a first installation position corresponding to the first fine-tuning position, capturing a second image at the first installation position, and calculating a second pixel distance of the first vertical line pair according to the second image; Update the first fine-tuning position along the horizontal straight line direction, move the component to be installed to the new first fine-tuning position, repeat the above process, calculate the new first pixel distance and the second pixel distance, until N groups of the first pixel distance and the second pixel distance are obtained; The least square method is used to fit N groups of the first pixel distances and the second pixel distances to obtain the slope k and intercept b of the fitting straight line equation: ; in, is the first pixel distance, is the second pixel distance, i=1,2,...N.

9. A method for installing a photovoltaic module according to claim 8, characterized in that: The proportional relationship r between a single pixel in the image captured by the camera at the target installation position and the actual distance it represents is calculated according to the following formula: ; in, is the second pixel distance, i=1,2,...N.

10. A method for installing a photovoltaic module according to claim 1, characterized in that: Capturing the component to be installed includes: The grasping position of the component to be installed is adjusted so that the camera can simultaneously see the reference component and the component to be installed at the target fine-tuning position.

11. A component installation robot, characterized in that: include: A robotic arm to grab, move and adjust components to be installed; a camera, located at the end of the robotic arm, for acquiring an image containing the reference component and the component to be installed; Memory for storing computer programs; A processor, configured to implement the photovoltaic assembly installation method according to any one of claims 1 to 10 when running the computer program.

Citation Information

Patent Citations

  • Floor mounting method and robot

    CN110405773A

  • Mechanical arm grabbing method and system based on adaptive dynamic force balance

    CN112720487A

  • Installation method, device and installation system of photovoltaic module

    CN116455300A

  • Method for actively sensing target distance by monocular vision robot

    CN118493394A

  • Photovoltaic module installation method based on surface linear characteristics and module installation robot

    CN119057431A

Cited By

  • Photovoltaic module installation method based on surface linear characteristics and module installation robot

    CN119057431A

  • Photovoltaic module installation method and module installation robot based on surface straight line features

    CN119057431B

  • Double-arm robot smart assembly system and method for optical fiber-fiber distribution box

    CN119635679A