Paving equipment and paving system

Through the camera, the image is collected and combined with the processor and the robot arm, the precise positioning of the photovoltaic panel is achieved, which solves the problem of low positioning accuracy in existing photovoltaic panel paving equipment and improves the efficiency and accuracy of photovoltaic panel paving.

CN118712113BActive Publication Date: 2024-11-26SHENZHEN KAIZHICHENG INTELLIGENT EQUIP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411190055.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2024-11-26
Estimated Expiration
2044-08-28

AI Technical Summary

Technical Problem

In the existing photovoltaic panel paving equipment, radar is used to achieve positioning, which is costly and has low positioning accuracy, making it difficult to effectively improve the paving and positioning accuracy of photovoltaic panels.

Method used

Image acquisition through the camera, combined with the processor and the robotic arm, the precise positioning and movement of the photovoltaic panels are achieved, and the positioning accuracy of the photovoltaic panels in the paving rack is improved.

Benefits of technology

The precise positioning of photovoltaic panels is achieved through the images collected by the camera, which improves the positioning accuracy of the paving equipment, reduces costs, and improves the efficiency and accuracy of photovoltaic panel paving.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118712113B_ABST
    Figure CN118712113B_ABST
Patent Text Reader

Abstract

The present application provides a paving device and a paving system, wherein the paving device includes a processor, a mechanical arm connected to the processor, and a carrier, and the mechanical arm includes a mobile device and a camera arranged on the mobile device. The carrier is used to carry at least one photovoltaic panel; the processor is used to control the mobile device to move to a reference position, control the camera to collect a first image of a target position corresponding to the reference position, and control the mobile device to move the photovoltaic panel in the carrier to the target area of ​​the photovoltaic panel in the paving frame based on the first image. By implementing the embodiments of the present application, the photovoltaic panel can be paved through the images collected by the camera, which can improve the accuracy of positioning.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, specifically to a paving equipment and paving system. Background Technology

[0002] Photovoltaics is short for solar photovoltaic power generation system. It is a new type of power generation system that uses the photovoltaic effect of solar cell semiconductor materials to directly convert solar radiation energy into electrical energy. A solar photovoltaic panel is a power generation device that generates direct current when exposed to sunlight. Photovoltaic modules can be made into different shapes, and the modules can be connected to each other to generate more electricity.

[0003] Existing photovoltaic panel installation equipment uses radar for positioning, which is costly and has low accuracy. Therefore, improving the positioning accuracy of photovoltaic panel installation is a technical problem that needs to be solved by those skilled in the art. Summary of the Invention

[0004] This application provides a paving device and paving system that uses images captured by a camera to pave photovoltaic panels, thereby improving the accuracy of positioning.

[0005] In a first aspect, embodiments of this application provide a paving device, including a processor, a robotic arm connected to the processor, and a carrier. The robotic arm includes a moving device and a camera disposed on the moving device. The carrier is used to support at least one photovoltaic panel.

[0006] The processor is configured to control the mobile device to move to a reference position; control the camera to acquire a first image, the first image including an image of the target position corresponding to the reference position; and control the mobile device to move the photovoltaic panel within the carrier to the target area of ​​the photovoltaic panel in the mounting frame based on the first image.

[0007] In one possible implementation, the target position is the initial position of the paving frame or the position of the already placed photovoltaic panels, the at least one photovoltaic panel includes a first photovoltaic panel and a second photovoltaic panel, the paving frame includes a first target area and a second target area, the first target area is the target area of ​​the first photovoltaic panel, the first target area is the initial position of the paving frame, the second target area is the target area of ​​the second photovoltaic panel, and the second photovoltaic panel is the next photovoltaic panel to be paved after the first photovoltaic panel;

[0008] The processor is configured to: determine a set of position parameters for the first target area based on the first image and parameters of the camera; generate a first removal path and a first return path for the first photovoltaic panel based on the set of position parameters and the gripping area of ​​the carrier; generate a second removal path for the second photovoltaic panel based on the set of position parameters, the gripping area, and the relative position of the second target area and the first target area; the processor is further configured to: control the moving device to move from the reference position to the gripping area; control the moving device to move the first photovoltaic panel in the gripping area to the first target area based on the first removal path; control the moving device to move to the gripping area based on the first return path; and control the moving device to move the second photovoltaic panel in the gripping area to the second target area based on the second removal path.

[0009] In one possible implementation, the paving equipment further includes a counter, the number of the first photovoltaic panels is 1, the number of the second photovoltaic panels is M-1, the at least one photovoltaic panel further includes at least one third photovoltaic panel, the paving frame further includes a third target area of ​​the third photovoltaic panel, M is an integer greater than 2, and the third photovoltaic panel is the next photovoltaic panel to be paved after M-1 of the second photovoltaic panels;

[0010] The processor is further configured to control the counter to count the number of photovoltaic panels moved to the paving frame, and to reset the counter to zero when the count value is M; control the camera to acquire a second image when the count value of the counter is 0, the second image including an image of at least one second target area or the third target area; and control the moving device to move the third photovoltaic panel in the grasping area to the third target area based on the second image.

[0011] In one possible implementation, the first image includes multiple first frames and second frames, wherein the acquisition time of the first frames is before the acquisition time of the second frames; the processor is configured to determine a location dataset of the environment in which the paving equipment and the paving frame are located based on the multiple first frames; identify the second frame based on the location dataset to obtain the current position of the mobile device; and control the mobile device to move from the current position to a target position, wherein the target position includes the gripping area of ​​the carrier and the target area of ​​the photovoltaic panel in the paving frame.

[0012] In one possible implementation, the processor is configured to acquire multiple associated images based on the plurality of first frames; and determine a location dataset of the environment in which the paving equipment and the paving frame are located based on the plurality of associated images.

[0013] In one possible implementation, the processor is configured to acquire similarity values ​​between the second frame and each of the first frames to obtain a plurality of similarity values; search for a target frame from the plurality of first frames based on the plurality of similarity values; search for the location data of the target frame from the location dataset; and determine the current location of the mobile device based on the location data.

[0014] In one possible implementation, the processor is further configured to control the camera to acquire a third image, the third image including an image of the photovoltaic panel in the mounting frame; control the mobile device to determine the placement area of ​​the photovoltaic panel based on the third image; obtain a deviation value between the placement area of ​​the photovoltaic panel and the target area of ​​the photovoltaic panel; and if the deviation value is greater than a preset threshold, control the mobile device to move the photovoltaic panel to the target area of ​​the photovoltaic panel based on the deviation value.

[0015] In one possible implementation, the moving device includes a clamping member and a moving frame connected to the clamping member; the processor is configured to control the clamping member to grasp the photovoltaic panel from the placement area of ​​the photovoltaic panel; control the moving frame to move the photovoltaic panel to a target area of ​​the photovoltaic panel based on the deviation value; and control the clamping member to place the photovoltaic panel in the target area of ​​the photovoltaic panel.

[0016] In one possible implementation, the carrier includes a lifting device; the processor is configured to control the lifting device to lift the photovoltaic panel within the carrier to the grasping area.

[0017] Secondly, embodiments of this application provide a control method, including: controlling a mobile device to move to a reference position; controlling a camera to capture a first image, the first image including an image of a target position corresponding to the reference position; and controlling the mobile device to move a photovoltaic panel inside a carrier to the target area of ​​the photovoltaic panel in a mounting frame based on the first image.

[0018] In one possible implementation, the target position is the initial position of the paving frame or the position of the already placed photovoltaic panels. The photovoltaic panels include a first photovoltaic panel and a second photovoltaic panel. The paving frame includes a first target area and a second target area. The first target area is the target area of ​​the first photovoltaic panel and the initial position of the paving frame. The second target area is the target area of ​​the second photovoltaic panel and the second photovoltaic panel is the next photovoltaic panel to be paved after the first photovoltaic panel. The control and movement device moves a photovoltaic panel within a carrier to a target area of ​​the photovoltaic panel in a mounting frame based on a first image, including: determining a set of position parameters for the first target area based on the first image and parameters of the camera; generating a first removal path and a first return path for the first photovoltaic panel based on the set of position parameters and a gripping area of ​​the carrier; generating a second removal path for the second photovoltaic panel based on the set of position parameters, the gripping area, and the relative position of the second target area to the first target area; controlling the movement device to move from the reference position to the gripping area; controlling the movement device to move the first photovoltaic panel in the gripping area to the first target area based on the first removal path; controlling the movement device to move to the gripping area based on the first return path; and controlling the movement device to move the second photovoltaic panel in the gripping area to the second target area based on the second removal path.

[0019] In one possible implementation, the paving equipment further includes a counter, wherein the number of the first photovoltaic panels is 1, the number of the second photovoltaic panels is M-1, the at least one photovoltaic panel further includes at least one third photovoltaic panel, the paving frame further includes a third target area for the third photovoltaic panel, M is an integer greater than 2, and the third photovoltaic panel is the next photovoltaic panel to be paved after M-1 of the second photovoltaic panels. The method further includes: controlling the counter to count the number of photovoltaic panels moved to the paving frame, and resetting the counter to zero when the count value is M; controlling the camera to acquire a second image when the counter count value is 0, the second image including an image of at least one of the second target areas or the third target area; and controlling the moving device to move the third photovoltaic panel from the grasping area to the third target area based on the second image.

[0020] In one possible implementation, the first image includes multiple first frames and second frames, with the first frames acquired before the second frames are acquired. The control of the moving device, based on the first image, to move a photovoltaic panel within a carrier to a target area of ​​the photovoltaic panel within a paving frame includes: determining a location dataset of the environment in which the paving equipment and the paving frame are located based on the multiple first frames; identifying the second frame based on the location dataset to obtain the current position of the moving device; and controlling the moving device to move from the current position to a target position, the target position including the gripping area of ​​the carrier and the target area of ​​the photovoltaic panel within the paving frame.

[0021] In one possible implementation, determining the location dataset of the environment in which the paving equipment and the paving frame are located based on the plurality of first frames includes: acquiring a plurality of associated images based on the plurality of first frames; and determining the location dataset of the environment in which the paving equipment and the paving frame are located based on the plurality of associated images.

[0022] In one possible implementation, identifying the second frame based on the location dataset to obtain the current location of the mobile device includes: obtaining similarity values ​​between the second frame and each of the first frames to obtain multiple similarity values; searching for a target frame from the multiple first frames based on the multiple similarity values; searching for the location data of the target frame from the location dataset; and determining the current location of the mobile device based on the location data.

[0023] In one possible implementation, the method further includes: controlling the camera to acquire a third image, the third image including an image of the photovoltaic panel in the mounting frame; controlling the mobile device to determine the placement area of ​​the photovoltaic panel based on the third image; obtaining a deviation value between the placement area of ​​the photovoltaic panel and the target area of ​​the photovoltaic panel; if the deviation value is greater than a preset threshold, controlling the mobile device to move the photovoltaic panel to the target area of ​​the photovoltaic panel based on the deviation value.

[0024] In one possible implementation, the moving device includes a clamping member and a moving frame connected to the clamping member; controlling the moving device to move the photovoltaic panel to a target area of ​​the photovoltaic panel based on the deviation value includes: controlling the clamping member to grasp the photovoltaic panel from the placement area of ​​the photovoltaic panel; controlling the moving frame to move the photovoltaic panel to the target area of ​​the photovoltaic panel based on the deviation value; and controlling the clamping member to place the photovoltaic panel in the target area of ​​the photovoltaic panel.

[0025] In one possible implementation, the carrier includes a lifting device; the method further includes controlling the lifting device to lift the photovoltaic panel within the carrier to the grasping area.

[0026] Thirdly, embodiments of this application provide a paving device, including a processor and a memory, wherein the memory is used to store computer-readable instructions, and the processor is used to invoke the instructions stored in the memory to execute the steps of the method as described in the second aspect or any possible implementation of the second aspect.

[0027] Optionally, the paving equipment further includes: a robotic arm and a carrier connected to the processor, the robotic arm including a moving device and a camera mounted on the moving device.

[0028] Fourthly, embodiments of this application provide a chip including a data interface and a processor, wherein the processor is used to execute the methods in the second aspect or any possible implementation thereof.

[0029] Fifthly, embodiments of this application provide a computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the methods described in the second aspect and any possible implementation thereof.

[0030] In a sixth aspect, embodiments of this application provide a computer program product including program instructions that, when executed by a processor, cause the processor to perform the method described in the second aspect or any possible implementation thereof.

[0031] Implementing the embodiments of this application has the following beneficial effects:

[0032] The camera captures a first image of a reference position, and the moving device uses this first image to move the photovoltaic panel inside the carrier to the target area of ​​the photovoltaic panel in the mounting frame. Thus, positioning the photovoltaic panel in the mounting frame using images captured by the camera improves positioning accuracy. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 This is a schematic diagram of the structure of a paving device provided in an embodiment of this application;

[0035] Figure 2 This is a schematic diagram of a mounting frame supporting photovoltaic panels provided in an embodiment of this application;

[0036] Figure 3 This is a schematic diagram of the structure of a robotic arm provided in an embodiment of this application;

[0037] Figure 4 This is a flowchart illustrating a control method provided in an embodiment of this application. Detailed Implementation

[0038] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used only to distinguish different objects and not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0039] "At least one item" refers to one or more items; "more than one" refers to two or more items; "at least two items" refers to two or three or more items; "and / or" describes the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after it are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items. For example, at least one of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c".

[0040] This application provides a paving system, which includes paving equipment, a paving frame, and photovoltaic panels. In this embodiment, the paving equipment is used to move the photovoltaic panels to a target area within the paving frame. Specifically, it is applicable to applications requiring the movement of photovoltaic panels, such as cleaning or replacing them; however, the specific application scenarios are not limited here.

[0041] This application does not limit the devices within the paving system. In addition to paving equipment, paving frames, and photovoltaic panels, the paving system may also include other devices such as auxiliary vehicles. Among them, the auxiliary vehicle can be used to carry personnel or other robotic arms to assist in placing the photovoltaic panels on the target position of the paving frame.

[0042] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0043] Please refer to Figure 1 , Figure 1 This is a structural schematic diagram of a paving device provided in an embodiment of this application. Figure 1 As shown, the paving equipment 10 can adopt the following... Figure 1 The vehicle shown can be powered by an electric system, a fuel system, a hybrid system, etc. This application does not limit the type of power for the vehicle, nor does it limit the driving method of the paving equipment 10.

[0044] The driving method for paving equipment 10 is given below. Figure 1 Two forms not shown, wherein:

[0045] Form 1: The paving equipment 10 is equipped with a drive system for operating power, and the paving equipment 10 is moved by a person holding the drive or by an unmanned driving strategy.

[0046] Option 2: Set up a remote control that is compatible with the paving equipment 10, so that the movement of the paving equipment 10 can be controlled by the remote control of the paving equipment 10.

[0047] Optionally, the remote control can be a physical remote control with buttons related to the operation type of the paving equipment 10. For example, buttons to control the movement of the paving equipment 10 in the left, right, forward, and backward directions. Other examples include buttons to control the operation of devices such as the robotic arm 102 and the support member 103. This application does not limit the type of buttons on the remote control.

[0048] Alternatively, the remote control can be a virtual remote control for an electronic device.

[0049] Among them, electronic devices can be smartphones, tablets, laptops, PDAs, mobile internet devices (MIDs), wearable devices (such as smartwatches, smart bracelets, etc.), smart voice interaction devices, smart home appliances (such as smart TVs, etc.), and in-vehicle devices, etc., without limitation.

[0050] Electronic devices may be servers, which may be independent physical servers, server clusters or distributed systems composed of multiple physical servers, or cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms. There are no restrictions on this.

[0051] The virtual remote control can be configured with virtual buttons for the aforementioned functions, or with trigger gestures for those functions. This application does not limit the implementation method of the virtual remote control. It is understood that using a remote control to trigger the paving equipment 10 to perform operations can improve control efficiency.

[0052] It should be noted that the above two forms are merely examples. In reality, other forms of devices can also exist to drive the paving equipment 10 to move.

[0053] Please refer to Figure 2 , Figure 2 This is a schematic diagram of a mounting frame supporting photovoltaic panels, provided as an embodiment of this application. Figure 2 As shown, the photovoltaic panel 30 can be placed on the mounting frame 20.

[0054] In this embodiment, the paving device 10 is used to place the photovoltaic panel 30 onto the paving rack 20. The paving device 10 can also be used to move the photovoltaic panel 30 within the paving rack 20 to other locations, which is not limited here. The paving rack 20 is used to place at least one photovoltaic panel, and the placement area corresponding to the paving rack 20 includes the target area of ​​each photovoltaic panel 30.

[0055] This application does not limit the location of the target area for the photovoltaic panel 30, and it can be determined according to a preset placement rule. The preset placement rule can be used to determine the placement order and position of the photovoltaic panels 30 on the mounting rack 20. This placement rule can be to place the photovoltaic panels 30 from left to right or from right to left; or, if the mounting rack 20 includes multiple layers, to place the photovoltaic panels 30 layer by layer from left to right, or layer by layer from right to left, or place one photovoltaic panel 30 per layer, etc.

[0056] Optionally, at least two placement rules may be included. For example, the photovoltaic panels 30 of the upper layer of the mounting rack are placed from left to right, and the photovoltaic panels 30 of the lower layer of the mounting rack are placed from right to left. This allows the upper layer of the mounting rack to be installed first and then the lower layer, or vice versa, which helps to improve installation efficiency.

[0057] Alternatively, the paving rack 20 can be as follows: Figure 2 The diagram shows at least a first layer of mounting rack 201 and a second layer of mounting rack 202, so that at least two layers of photovoltaic panels can be placed.

[0058] Alternatively, the paving rack 20 can be as follows: Figure 2 The diagram includes a support member 203 to maintain a certain distance between the photovoltaic panel 30 and the ground. This application does not limit the form of the support member 203; it can be as follows: Figure 2 The image shows an upright form, or it can be used... Figure 2 The paving frame 20, not shown in the tripod form, can also be made of wheels, etc. A wheeled paving frame 20 facilitates movement. A tripod-type paving frame 20 offers high stability.

[0059] It should be understood that, Figure 1 In this example, paving equipment 10 is used. Figure 2 In this example, a single mounting rack 20 is used. In practice, the mounting equipment 10 can place different photovoltaic panels 30 on different mounting racks 20. The mounting equipment 10 and the mounting racks can also take other forms.

[0060] For the sake of brevity, details are not shown in the accompanying drawings. The structure of the paving equipment 10 is described in detail below. Please refer to [the provided text]. Figure 1 The paving equipment 10 may include a processor 101, a robotic arm 102 connected to the processor 101, and a carrier 103.

[0061] In this application embodiment, the processor 101 may include, but is not limited to, a control board or a control chip. Exemplarily, the processor 101 may include a battery management system (BMS), a microcontroller unit (MCU), a central processing unit (CPU), other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), pulse width modulation (PWM) devices, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0062] This application does not limit the location of the processor 101; it can be located at any position on the paving equipment 10 or disposed within the aforementioned electronic equipment. The processor 101 is used to control the operation of the paving equipment 10 or the devices or components within the paving equipment 10.

[0063] In this embodiment, the carrier 103 is used to carry at least one photovoltaic panel 30, specifically, at least one photovoltaic panel 30 can be carried within the gripping area of ​​the carrier 103.

[0064] Optionally, the carrier 103 can be as follows: Figure 1 The diagram includes a first panel 1031, a second panel 1032, a third panel 1033, and a fourth panel 1034. The first panel 1031 and the second panel 1032 are arranged opposite each other, and the third panel 1033 and the fourth panel are arranged opposite each other.

[0065] Optionally, at least one of the first panel 1031 and the second panel 1032 moves horizontally relative to the other panel, and at least one of the third panel 1033 and the fourth panel 1034 moves horizontally relative to the other panel. For example, the first panel 1031 is fixed, the second panel 1032 moves horizontally relative to the first panel 1031, and the third panel 1033 and the fourth panel 1034 each move horizontally relative to the other panel to surround (or clamp) the photovoltaic panel 30, thereby preventing the photovoltaic panel 30 from falling off during movement.

[0066] Optionally, the carrier 103 may also include Figure 1A lifting device (not shown) is used to lift the photovoltaic panel 30 of the carrier 103 to the gripping area of ​​the carrier 103 so that the robotic arm 102 can move the photovoltaic panel 30 from the gripping area to other areas, such as the target area of ​​the photovoltaic panel 30 in the paving frame 20.

[0067] The lifting device can be a combination of a motor and a base plate, similar to the function of an elevator. Photovoltaic panels 30 are stacked on the base plate, and the motor lifts the photovoltaic panels 30 on the base plate to a preset height. The preset height can be the thickness of the photovoltaic panel 30, and the area corresponding to the preset height is called the gripping area. Thus, each time a photovoltaic panel 30 is gripped, the motor lifts the base plate by the thickness of one photovoltaic panel 30, allowing the next photovoltaic panel 30 to be gripped within the gripping area.

[0068] In another implementation, the position of the photovoltaic panel 30 can be moved in other ways. For example, the support member 103 may also include... Figure 1 A conveyor device (such as a conveyor belt, not shown) is used to move the photovoltaic panel 30 of the carrier 103 to the gripping area of ​​the carrier 103.

[0069] This application does not limit the number of photovoltaic panels 30 supported within the carrier 103. Optionally, the installation equipment 10 may also include... Figure 1 A counter (not shown) connected to the processor 101 is used to count the photovoltaic panels 30 within the carrier 103. The processor 101 controls the carrier 103 to stop supporting the photovoltaic panels and resets the counter when the count value reaches a preset value.

[0070] Optionally, the counter can be connected to a weighing device. This weighing device can be installed at the bottom of the support 103 to determine the number of photovoltaic panels 30 by measuring the weight of the photovoltaic panels 30 inside the support 103, and then determine the number of installed photovoltaic panels 30 by the number of remaining photovoltaic panels 30.

[0071] In this embodiment of the application, the robotic arm 102 can be as follows: Figure 1 As shown, the support member 103 is positioned in the middle of the paving equipment 10, and can be positioned as follows: Figure 1 The positions shown are located at both ends of the paving equipment 10. Alternatively, they may be... Figure 1 In a form not shown, for example, the robotic arm 102 may be located at both ends of the paving equipment 10, and the carrier 103 may be located in the middle of the paving equipment 10. Alternatively, the robotic arm 102 and the carrier 103 may be separately mounted on the vehicle body of the paving equipment 10, or the robotic arm 102 and the carrier 103 may be connected and mounted on the vehicle body of the paving equipment 10.

[0072] This application does not limit the number of robotic arms 102 and carriers 103. For example, the number of robotic arms 102 is 1, and the number of carriers 103 is 2. In this way, while the photovoltaic panels 30 in one carrier 103 are used for loading, the photovoltaic panels 30 in another carrier 103 are used for unloading, which can improve work efficiency.

[0073] Optionally, the paving equipment 10 may also include Figure 1 A support member (not shown) is used to support the robotic arm 102, facilitating its movement and preventing it from colliding with other devices and being damaged during movement. Other devices may include a protective housing containing the power system.

[0074] Please refer to Figure 3 , Figure 3 This is a schematic diagram of the structure of a robotic arm provided in an embodiment of this application. Figure 3 As shown, the robotic arm 102 includes a moving device 1021 and a camera 1022 mounted on the moving device 1021. The camera 1022 is used to acquire images. Specifically, it can acquire a first image at a reference position, or acquire a second image when a counter value is reset to zero. This application embodiment does not limit the type, location, or number of cameras 1022; the number can be at least one.

[0075] In this embodiment, the moving device 1021 is used to move its position, specifically to a reference position so that the camera 1022 can capture a first image of the reference position, or to move the photovoltaic panel 30 to a target position. For example, the photovoltaic panel 30 in the carrier 103 can be moved to the target area of ​​the photovoltaic panel 30 in the mounting frame 20.

[0076] Optionally, the mobile device 1021 can be as follows: Figure 3 As shown, it includes an upper mechanical arm 10211, a lower mechanical arm 10212, a first rotating shaft 10213, and a second rotating shaft 10214.

[0077] The first rotating shaft 10213 connects the upper mechanical arm 10211 and the paving equipment 10, and is used to rotate the upper mechanical arm 10211 so that the upper mechanical arm 10211 rotates relative to the paving equipment 10. The second rotating shaft 10214 connects the upper mechanical arm 10211 and the lower mechanical arm 10212, and is used to rotate the lower mechanical arm 10212 so that the lower mechanical arm 10212 rotates relative to the upper mechanical arm 10211. The path formed by the first rotating shaft 10213 rotating the upper mechanical arm 10211 and / or the second rotating shaft 10214 rotating the lower mechanical arm 10212 can be referred to as the movement path.

[0078] Optionally, the path by which the moving device 1021 moves the photovoltaic panel 30 from the gripping area of ​​the carrier 103 to the target area of ​​the photovoltaic panel 30 in the mounting frame 20 is called the removal path, and the path by which the moving device 1021 moves the photovoltaic panel 30 from the target area to the gripping area within the carrier 103 is called the return path. The removal path and return path of the same photovoltaic panel 30 can be in opposite directions to achieve a return along the original route.

[0079] It should be noted that the moveout path and the moveback path can include multiple sub-paths, and the direction of each sub-path can be different.

[0080] Optionally, the robotic arm 102 can be as follows: Figure 3 As shown, it also includes a clamping member 1023 connected to the moving device 1021. The clamping member 1023 is used to grip the photovoltaic panel 30 and can also be used to place the photovoltaic panel 30. For example, the clamping member 1023 grips the photovoltaic panel 30 from the gripping area of ​​the carrier 103 and holds the gripping state until the photovoltaic panel 30 reaches its target area.

[0081] Clamping component 1023 can be used as Figure 3 The device shown includes multiple suction cups 10231, which grip the photovoltaic panel 30 using their suction force. Alternatively, the clamping member 1023 may include multiple magnets, which hold the photovoltaic panel 30 in place using their magnetic force, etc., without limitation.

[0082] Optionally, the robotic arm 102 may also include Figure 3 The mobile frame 1024 shown is connected to the mobile device 1021. Figure 3 In this device, the movable frame 1024 is connected to the clamping member 1023 and is used to move the clamping member 1023 to extend the position of the movable device 1021, so that the clamping member 1023 can be moved to a more distant position.

[0083] Optionally, the robotic arm 102 may also include, for example, Figure 3 The turntable 1025 shown is connected to the moving device 1021. Figure 3 In this configuration, the turntable 1025 can be connected to the movable frame 1024 for rotating the angle of the clamping member 1023, for example, rotating it 180 degrees, so that the clamping member 1023 can grip the photovoltaic panel 30 from another direction.

[0084] The working method of the paving equipment 10 is described in detail below.

[0085] In this embodiment, the processor 101 is used to control the mobile device 1021 to move to a reference position. The processor 101 is also used to control the camera 1022 to acquire a first image, and to control the mobile device 1021 to move the photovoltaic panel 30 in the carrier 103 to the target area of ​​the photovoltaic panel 30 in the paving frame 20 based on the first image.

[0086] The first image includes an image of the target location corresponding to the reference location. The reference location refers to the moving position of the mobile device 1021, and the camera 1022 captures the first image when the mobile device 1021 is at the reference location. The mobile device 1021 or the processor 101 knows the reference location, and the target location is the location corresponding to the first image captured by the camera 1022 when the mobile device 1021 is at the reference location.

[0087] When the mobile device 1021 moves to the reference position, the camera 1022 also moves accordingly to capture a first image including the target position. Camera parameters of the camera 1022, such as focal length, pixels, ISO, exposure time, and frame rate, affect the shooting range of the captured image. Position parameters of the camera 1022, such as tilt, also affect the shooting range. Therefore, based on the camera parameters and position parameters of the camera 1022, the target position of the mobile device 1021 at the reference position when the camera 1022 captures the first image can be determined. Then, based on the relative positions of the camera 1022 and the mobile device 1021 at the same time (the time of capturing the first image), and the target position corresponding to the reference position, the position of the target position relative to the mobile device 1021 can be determined.

[0088] Among them, the camera parameters and position parameters of the camera 1022 can be some known information, and the relative position between the camera 1022 and the mobile device 1021 can also be considered as known information of the mobile device 1021 or the processor 101. The first image can be considered as unknown information due to the different reference positions. Therefore, the position parameter set of the target position corresponding to the unknown reference position can be determined according to the relationship between these known and unknown information, so as to locate the target position or the position near the target position. That is, the position parameter set of the target position relative to the mobile device 1021 can be determined through the first image.

[0089] The position parameter set can include different position parameters in the same coordinate system. The origin of this coordinate system can be the initial position of the moving device 1021, i.e., the position where the moving device 1021 returns to its original position. Position parameters include, for example, the values ​​corresponding to the x-axis, y-axis, and z-axis, and may also include the angles corresponding to the x-axis, y-axis, and z-axis, or may include matrices representing the values ​​and angles corresponding to the x-axis, y-axis, and z-axis. The x-axis, y-axis, and z-axis can be referenced... Figure 2The directions are shown. The x-axis represents the width of the rectangle corresponding to the pavement frame 20, the y-axis represents the length of the rectangle corresponding to the pavement frame 20, and the z-axis represents the height of the pavement frame 20. This matrix can be called the point pose matrix based on the base of the robotic arm 102, used to represent the position relative to the moving device 1021. Thus, the position relative to the origin of the coordinate system, that is, the position of the target position relative to the moving device 1021 (robotic arm 102), can be determined according to the position parameter set.

[0090] Optionally, the target position can be equal to the product of the first matrix and the second matrix.

[0091] The first matrix represents the position of the reference position relative to the mobile device 1021 when the camera 1022 captures the first image. The second matrix represents the position of the target position relative to the reference position. The product of the first and second matrices can be used to represent the position of the target position relative to the mobile device 1021.

[0092] In this embodiment, the target location can be the initial location of the mounting frame 20, which refers to the preset location of the first photovoltaic panel 30 placed on the mounting frame 20. Thus, the location of the first photovoltaic panel 30 placed in the mounting frame 20 is determined by the image captured by the camera 1022, and then the locations of the other photovoltaic panels 30 are determined sequentially according to the preset placement rules.

[0093] The target location could be the position of the photovoltaic panels 30 already placed in the mounting rack 20. In this way, the position of the photovoltaic panels 30 already placed in the mounting rack 20 is determined by the image captured by the camera 1022, and then the positions of other unplaced photovoltaic panels 30 are placed sequentially according to the preset placement rules, thereby avoiding duplicate placement.

[0094] The target location can be any location in the environment where the paving frame 20 and the paving equipment 10 are located, and there can be multiple first images. In this way, the current location is determined by the image captured by the camera 1022, and then the position of the moving device 1021 is dynamically adjusted so that the photovoltaic panel 30 moves to the target area following the position located by the image.

[0095] The following describes the method by which the paving equipment 10 moves the photovoltaic panel 30 in the carrier 103 to the target area of ​​the photovoltaic panel 30 in the paving frame 20, for different reference positions, target positions or first images.

[0096] Example 1: The target location is the initial position of the mounting frame 20 or the position of the already placed photovoltaic panels 30. The photovoltaic panels 30 include a first photovoltaic panel and a second photovoltaic panel. The mounting frame 20 includes a first target area of ​​the first photovoltaic panel and a second target area of ​​the second photovoltaic panel. The processor 101 is used to determine a set of position parameters for the first target area based on a first image and the parameters of the camera; generate a first removal path and a first return path for the first photovoltaic panel based on the set of position parameters and the gripping area of ​​the carrier 103; generate a second removal path for the second photovoltaic panel based on the set of position parameters, the gripping area, and the relative position of the second target area and the first target area; control the moving device 1021 to move from a reference position to the gripping area; control the moving device 1021 to move the first photovoltaic panel within the gripping area to the first target area based on the first removal path; control the moving device 1021 to move to the gripping area based on the first return path; control the moving device 1021 to move the second photovoltaic panel within the gripping area to the second target area based on the second removal path.

[0097] The camera parameters can be the aforementioned camera parameters and position parameters. The position parameter set can be referenced above and will not be repeated here. In this embodiment, the first target area can be the initial position of the paving frame 20. As mentioned earlier, the position parameter set of the target position is determined by the first image. Therefore, when the target position is the initial position of the paving frame 20 and the first target area is the initial position of the paving frame 20, the position parameter set of the first target area can be determined by the first image.

[0098] In this embodiment, a reference image set can be pre-stored, including multiple reference images and a set of position parameters for each reference image. Specifically, the position parameters of the reference images can be their positions relative to the mobile device 1021. Thus, based on the similarity values ​​between the first image and the reference images in the reference image set, the reference image most similar to the first image can be determined. Then, based on the position parameter sets of the reference images, the position parameter set of the first target region can be determined, thereby determining the position of the first target region relative to the mobile device 1021.

[0099] In this embodiment, the first removal path refers to the movement path of the moving device 1021 from the gripping area of ​​the carrier 103 to the target area (first target area) of the first photovoltaic panel in the mounting frame 20. The gripping area of ​​the carrier 103 can be understood as the starting position of the first photovoltaic panel, and the position corresponding to the position parameter set of the first target area can be understood as the ending position of the first photovoltaic panel. The starting position of the first removal path of the first photovoltaic panel can be the starting position of the first photovoltaic panel, i.e., the gripping area of ​​the carrier 103. The ending position of the first removal path of the first photovoltaic panel can be the ending position of the first photovoltaic panel, i.e., the first target area. Thus, the first removal path of the first photovoltaic panel can be determined based on the starting position and the ending position of the first photovoltaic panel. In other words, a first removal path for the first photovoltaic panel can be generated based on the termination position of the first photovoltaic panel determined by the position parameter set of the first target area and the starting position of the first photovoltaic panel determined by the gripping area of ​​the carrier 103, and the moving device 1021 can be controlled to move the first photovoltaic panel in the gripping area from the gripping area to the first target area according to the first removal path.

[0100] In this embodiment, the first return path refers to the movement path of the moving device 1021 from the target area (first target area) of the first photovoltaic panel in the mounting frame 20 to the gripping area of ​​the carrier 103. The starting position of the first return path of the first photovoltaic panel can be the ending position of the first outward path of the first photovoltaic panel, that is, the ending movement position of the first photovoltaic panel (first target area). The ending position of the first return path of the first photovoltaic panel can be the starting movement position of the first photovoltaic panel, that is, the gripping area of ​​the carrier 103. Thus, the first return path of the first photovoltaic panel can be determined according to the ending movement position of the first photovoltaic panel and the gripping area of ​​the carrier 103. After the first photovoltaic panel is placed in the first target area, the moving device 1021 is controlled to move from the first target area to the gripping area of ​​the carrier 103 according to the first return path.

[0101] In this embodiment, the second photovoltaic panel is the next photovoltaic panel to be installed after the first photovoltaic panel. The relative position of the second target area and the first target area can be determined based on the aforementioned placement rules. For example, if the placement rule is that the photovoltaic panels are placed from left to right, the second target area is to the right of the first target area. Therefore, the position of the second target area can be determined based on the relative position of the first and second target areas and the position of the first target area. For example, the offset of the first photovoltaic panel relative to the target position is... , At that time, the offset of the second photovoltaic panel relative to the target position is , And so on. Where x represents the offset along the x-axis, and y represents the offset along the y-axis. Height represents the height of the photovoltaic panel 30, and Width represents the width of the photovoltaic panel 30.

[0102] The starting position of the first photovoltaic panel and the starting position of the next photovoltaic panel (the second photovoltaic panel) can be the same. That is to say, if the position of the paving equipment 10 remains unchanged, the starting position of each photovoltaic panel to be grabbed is the same, that is, the position of the grabbing area of ​​the bearing 103 remains unchanged.

[0103] The second removal path refers to the movement path of the moving device 1021 from the gripping area of ​​the carrier 103 to the target area (second target area) of the second photovoltaic panel in the mounting frame 20. The gripping area of ​​the carrier 103 can be understood as the starting position of the second photovoltaic panel, and the second target area can be understood as the ending position of the second photovoltaic panel. The starting position of the second removal path of the second photovoltaic panel can be the starting position of the second photovoltaic panel, that is, the gripping area of ​​the carrier 103. The ending position of the second removal path of the second photovoltaic panel can be the ending position of the second photovoltaic panel, that is, the second target area. Thus, the second removal path of the second photovoltaic panel can be determined based on the starting position and the ending position of the second photovoltaic panel. In other words, the second photovoltaic panel can be moved out of the first target area based on the position parameter set of the first target area, the relative position of the first target area and the position of the second target area determined by the position of the first target area, and the starting position of the second photovoltaic panel determined by the gripping area of ​​the carrier 103. The second removal path of the second photovoltaic panel can be generated, and the moving device 1021 can be controlled to move the second photovoltaic panel in the gripping area from the gripping area to the second target area according to the second removal path.

[0104] The first removal path, second removal path, and first return path can be referred to the description of the removal path and return path described above. This application does not limit the method for determining the first removal path, second removal path, and first return path. The first removal path and first return path can be generated according to the starting and ending positions of the first removal path and first return path, the lengths of the upper mechanical arm 10211 and lower mechanical arm 10212 in the moving device 1021, and the rotation angles of the first rotating shaft 10213 and the second rotating shaft 10214. Similarly, the second removal path can be generated according to the starting and ending positions of the second removal path, the lengths of the upper mechanical arm 10211 and lower mechanical arm 10212 in the moving device 1021, and the rotation angles of the first rotating shaft 10213 and the second rotating shaft 10214. It is understood that for the mobile device 1021 to move to any position, it requires the cooperation of structures such as the upper mechanical arm 10211, the lower mechanical arm 10212, the first rotating shaft 10213, and the second rotating shaft 10214. Therefore, after determining the starting and ending positions of the path, it is also necessary to consider the cooperation of the various structures on the mobile device 1021 that support the movement in order to generate the path.

[0105] Optionally, the position parameter set of the first target area can be the third matrix described above, and the position parameter set of the gripping area of ​​the carrier 103 relative to the moving device 1021 can be the fourth matrix. The processor 101 is also configured to generate a first removal path and a first return path based on the third matrix and the fourth matrix.

[0106] In this matrix, the fourth matrix corresponds to the starting position of the first photovoltaic panel, and the target position corresponding to the third matrix is ​​the ending position of the first photovoltaic panel. Thus, a first outgoing path and a first returning path can be generated based on the third and fourth matrices.

[0107] Optionally, the processor 101 is also configured to generate an initial return path based on the first matrix and the fourth matrix; and control the moving device 1021 to move from the reference position to the gripping area of ​​the carrier 103.

[0108] The initial return path refers to the path taken by the mobile device 1021 back to the gripping area of ​​the carrier 103, which can be understood as the preparation path before gripping the first photovoltaic panel.

[0109] Furthermore, the first removal path includes a first sub-removal path and a second sub-removal path. The first return path includes a first sub-return path and a second sub-return path. The processor 101 is also configured to determine a safe position; determine the first sub-removal path and the second sub-return path based on the grasping area and the safe position; determine the second sub-removal path and the first sub-return path based on the safe position and the position parameter set of the first target area; control the moving device 1021 to move the first photovoltaic panel in the grasping area to the safe position based on the first sub-removal path; control the moving device 1021 to move the first photovoltaic panel from the safe position to the first target area based on the second sub-removal path; control the moving device 1021 to move from the first target area to the safe position based on the first sub-return path; and control the moving device 1021 to move from the safe position to the grasping area based on the second sub-return path.

[0110] The safe position can be understood as the position where the mobile device 1021 will not avoid collisions during movement. The safe position can be determined based on the length of the robotic arm 102, the movement range of the mobile device 1021, and the surrounding environment of the paving equipment 10. Specifically, the safe position can be a set of position parameters relative to the mobile device 1021, such as a matrix representation. The safe positions in the first sub-movement path and the second sub-return path can be the same or different, and the safe positions in the second sub-movement path and the first sub-return path can also be the same or different; this is not limited here, and an example using the same safe position is provided.

[0111] After adding a safe position, the moving device 1021 can first move from the gripping area of ​​the carrier 103 to the safe position along a first sub-movement path, and then move from the safe position to the first target area along a second sub-movement path. After placing the first photovoltaic panel in the first target area, the moving device 1021 can first move from the first target area to the safe position along a first sub-return path, and then move from the safe position to the gripping area of ​​the carrier 103 along a second sub-return path, so as to grip the next photovoltaic panel 30 to be installed. It can be understood that by setting a safe position, the safety of moving the photovoltaic panel 30 can be improved, avoiding damage caused by the photovoltaic panel 30 falling due to collision.

[0112] Optionally, the processor 101 can also be used to generate a second return path for the second photovoltaic panel based on the position parameter set of the first target area and the grasping area, as well as the relative position of the second target area and the first target area; and control the moving device 1021 to move to the grasping area based on the second return path.

[0113] In this embodiment, the second return path refers to the movement path of the moving device 1021 from the target area (second target area) of the second photovoltaic panel in the mounting frame 20 to the gripping area of ​​the carrier 103. The starting position of the second return path of the second photovoltaic panel can be the ending position of the second exit path of the second photovoltaic panel, that is, the ending movement position of the second photovoltaic panel (second target area). The ending position of the second return path of the second photovoltaic panel can be the starting movement position of the second photovoltaic panel, that is, the gripping area of ​​the carrier 103. Thus, the second return path of the second photovoltaic panel can be determined according to the ending movement position of the second photovoltaic panel and the gripping area of ​​the carrier 103. After the second photovoltaic panel is placed in the second target area, the moving device 1021 is controlled to move from the second target area to the gripping area of ​​the carrier 103 according to the second return path. In this way, the next photovoltaic panel 30 in the gripping area can be moved to the target area of ​​the photovoltaic panel 30 in the mounting frame 20.

[0114] Optionally, the number of first photovoltaic panels is 1, and the number of second photovoltaic panels is M-1. At least one photovoltaic panel 30 also includes a third photovoltaic panel, and the mounting frame 20 also includes a third target area for the third photovoltaic panel. The processor 101 is also configured to control a counter to count the number of photovoltaic panels 30 moved to the mounting frame, and to reset the counter when the count value is M; control the camera 1022 to capture a second image when the counter count value is 0; and control the moving device 1021 to move the third photovoltaic panel in the grasping area to the third target area based on the second image.

[0115] The sum of the number of the first photovoltaic panel and the second photovoltaic panel is M. This application does not limit M, for example, 6, etc. M can be a fixed value, or it can be determined based on the distance between the paving equipment 10 and the paving frame 20, the size of the photovoltaic panel 30, etc., or it can be determined based on the deviation value between the placement position of the photovoltaic panel 30 and the target area, etc., and is not limited here.

[0116] The second image includes images of at least one second target region or a third target region. That is, when the second image includes images of at least one second target region, the target region of the already installed photovoltaic panels is used as a reference to determine the location parameter set of the target region for the next photovoltaic panel to be installed. When the second image includes images of a third target region, the location parameter set of that target region is determined directly based on the image of the target region of the pre-installed photovoltaic panels.

[0117] It is understandable that using a single image to determine the target area of ​​a photovoltaic panel 30 outside that image may result in inaccuracies. Therefore, limiting the determination of the target area of ​​M photovoltaic panels 30 to the same image, and then determining the target area of ​​the subsequent M photovoltaic panels 30 using a different image, helps to improve the accuracy of the positioning.

[0118] Optionally, the processor 101 is also configured to control the mobile device 1021 to move when the counter count value is 0, so that the camera 1022 can capture a second image. This improves the clarity and accuracy of the image acquisition target area, thereby improving the accuracy of positioning.

[0119] Example 2: The reference locations are multiple locations of the environment where the paving frame 20 and the paving equipment 10 are located. The first image includes multiple first frames and second frames. The processor 101 is used to determine the location dataset of the environment where the paving equipment 10 and the paving frame 20 are located based on the multiple first frames; to identify the second frame based on the location dataset to obtain the current position of the mobile device 1021; and to control the mobile device 1021 to move from the current position to the target position.

[0120] The first frame is acquired before the second frame. The first frame can include images of different locations within the environment where the paving equipment 10 and the paving frame 20 are situated. Specifically, it can include structural images of the paving equipment 10 and the paving frame 20, as well as environmental images. The first frame can be understood as an environmental image used to determine the location dataset of the paving system. The location dataset includes multiple sets of location parameters, the contents of which are described above and represent the location parameters of each area relative to the mobile device 1021; these details will not be repeated here. The second frame can be understood as an image of the actual location. Based on the location dataset determined by the multiple first frames, the current location corresponding to the second frame can be determined, thereby enabling the mobile device 1021 to move from the current location to the target location.

[0121] In this example, the target location may include the gripping area of ​​the carrier 103 and the target area of ​​the photovoltaic panel 30 in the paving frame 20, thereby controlling the moving device 1021 to move from the current position to the gripping area of ​​the carrier 103, and also controlling the moving device 1021 to move from the current position to the target area of ​​the photovoltaic panel 30 in the paving frame 20.

[0122] It should be noted that the target location may also include other locations, such as the aforementioned safe locations, which can be determined according to the actual situation.

[0123] Optionally, the processor 101 is used to acquire multiple associated images based on multiple first frames; and to determine a location dataset of the environment in which the paving equipment 10 and the paving frame 20 are located based on the associated images.

[0124] Among them, associated images refer to at least two images of the same object in the first frame, or different images of the same object. The objects in these associated images are related and can be determined based on the connection relationship of the same structure and the relative positional relationship of different structures. Specifically, it can be to find local images of the paving equipment 10, the paving frame 20 and other objects in the environment from the first frame, and determine the associated images of different objects based on the local images.

[0125] It is understood that by determining the positional relationship of associated objects through associated images, the positional relationship between different objects in the environment where the paving equipment 10 and the paving frame 20 are located can be determined based on multiple associated images. These positions are all relative to the mobile device 1021. Therefore, the positional dataset of the paving equipment 10, the paving frame 20 and their environment can be determined.

[0126] Furthermore, the images captured by camera 1022 are often acquired at adjacent times. Therefore, the image set can be divided based on these adjacent times. For example, the first frame with a time interval of no more than 5 seconds can be considered as an image set of objects with associated locations. Then, images of the objects with associated locations within each image set are acquired individually. Based on these images, associated images are obtained, and the positions of the objects within the associated images are determined. For instance, the presence of locally identical or similar images within an image set can be used to determine the first frame of the object with the actual associated location in that image set. These first frames can be used as associated images, and the location dataset can be determined based on these associated images. Alternatively, an environmental image can be generated based on the first frame of the object with the actual associated location and the acquisition time of each first frame. This environmental image can be used to mark the location data of the paving equipment 10, the paving frame 20, and the objects in the environment, thus obtaining the location dataset corresponding to the various positions of the paving equipment 10, the paving frame 20, and the different objects in the environment.

[0127] Optionally, the processor 101 is configured to obtain similarity values ​​between the second frame and each of the first frames to obtain a plurality of similarity values; search for a target frame from the plurality of first frames based on the plurality of similarity values; search for the location data of the target frame from the location dataset; and determine the current location of the mobile device 1021 based on the location data.

[0128] The similarity value describes the similarity between the second frame and the first frame. It can be understood that the greater the similarity between the second and first frames, the higher the probability of them being at the same location. The number of target frames can be one or more, determined based on the magnitude of the similarity value. For example, the target frame is the first frame whose similarity value to the second frame is greater than a first threshold (e.g., 80%). The current location of the mobile device 1021 is determined based on the location data of the target frames in the location dataset. This allows for location tracking even when there is a difference between the first and second frames, improving the accuracy and efficiency of the positioning process.

[0129] It should be noted that the two examples above are used to describe how to move the photovoltaic panel 30 within the carrier 103 to the target area of ​​the photovoltaic panel 30 in the mounting frame 20 based on the first image. In reality, other implementation methods may exist.

[0130] Optionally, the processor 101 is also used to control the camera 1022 to acquire a third image, control the mobile device 1021 to determine the placement area of ​​the photovoltaic panel 30 based on the third image; obtain the deviation value between the placement area of ​​the photovoltaic panel 30 and the target area of ​​the photovoltaic panel 30; if the deviation value is greater than a preset threshold, control the mobile device 1021 to move to the target area of ​​the photovoltaic panel 30.

[0131] The third image includes an image of the photovoltaic panels 30 in the mounting frame 20, thereby allowing the placement area of ​​the photovoltaic panels 30 to be determined based on the third image. The deviation value between the placement area of ​​the photovoltaic panels 30 and the target area is used to describe the accuracy of the moving device 1021 in placing the photovoltaic panels 30 to the target position. It can be determined based on the difference between position parameters of the same dimension between the placement area and the target area, or based on whether the placement area blocks or occupies the position of other photovoltaic panels 30, and if so, based on the area of ​​the blocked or occupied position, etc.

[0132] This application does not limit the preset threshold; it can be 0 or 0.1, etc. It is understood that if there is a deviation between the placement area of ​​the photovoltaic panel 30 and its target area, and this deviation exceeds the preset threshold, the position of the photovoltaic panel 30 needs to be adjusted to prevent it from falling and to improve working efficiency, thereby increasing the accuracy of placement.

[0133] This application does not limit the adjustment method of the photovoltaic panel 30. Optionally, the processor 101 is used to control the clamping member 1023 to grab the photovoltaic panel 30 from the placement area of ​​the photovoltaic panel 30; control the moving frame 1024 to move the photovoltaic panel 30 to the target area of ​​the photovoltaic panel 30 based on the deviation value; and control the clamping member 1023 to place the photovoltaic panel 30 in the target area of ​​the photovoltaic panel 30.

[0134] The clamping member 1023 and the movable frame are as described above. It is understood that the clamping member 1023 can grip the photovoltaic panel 30 and also be used to place the photovoltaic panel 30. The movable frame 1024 can be used to move the clamping member 1023, so that the photovoltaic panel 30 gripped by the clamping member 1023 can be moved from its current position to the target area of ​​the photovoltaic panel 30, thereby adjusting the position of the photovoltaic panel 30 and improving the accuracy of placement.

[0135] Please refer to Figure 4 , Figure 4 This is a flowchart illustrating a control method provided in an embodiment of this application. The control method can be executed by the paving equipment 10 or the processor 101 within the paving equipment 10. For example... Figure 4 As shown, the method includes steps S401 to S403, wherein:

[0136] S401: Control the moving device to move to the reference position.

[0137] S402: Control the camera to acquire a first image, the first image including the image of the target position corresponding to the reference position.

[0138] S403: The control moving device moves the photovoltaic panel inside the carrier to the target area of ​​the photovoltaic panel in the paving frame based on the first image.

[0139] Optionally, the target position is the initial position of the paving frame or the position of the already placed photovoltaic panels. The photovoltaic panels include a first photovoltaic panel and a second photovoltaic panel. The paving frame includes a first target area and a second target area. The first target area is the target area of ​​the first photovoltaic panel and the initial position of the paving frame. The second target area is the target area of ​​the second photovoltaic panel and the second photovoltaic panel is the next photovoltaic panel to be paved after the first photovoltaic panel. Step S403 includes: determining a set of position parameters for the first target area based on the first image and the parameters of the camera; generating a first removal path and a first return path for the first photovoltaic panel based on the set of position parameters and the gripping area of ​​the carrier; generating a second removal path for the second photovoltaic panel based on the set of position parameters, the gripping area, and the relative position of the second target area and the first target area; controlling the moving device to move from the reference position to the gripping area; controlling the moving device to move the first photovoltaic panel in the gripping area to the first target area based on the first removal path; controlling the moving device to move to the gripping area based on the first return path; and controlling the moving device to move the second photovoltaic panel in the gripping area to the second target area based on the second removal path.

[0140] Optionally, the paving equipment further includes a counter, wherein the number of the first photovoltaic panel is 1, the number of the second photovoltaic panels is M-1, the at least one photovoltaic panel further includes at least one third photovoltaic panel, the paving frame further includes a third target area of ​​the third photovoltaic panel, M is an integer greater than 2, and the third photovoltaic panel is the next photovoltaic panel to be paved after M-1 of the second photovoltaic panels. The method further includes: controlling the counter to count the number of photovoltaic panels moved to the paving frame, and resetting the counter to zero when the count value is M; controlling the camera to acquire a second image when the counter count value is 0, the second image including an image of at least one second target area or the third target area; and controlling the moving device to move the third photovoltaic panel from the grasping area to the third target area based on the second image.

[0141] Optionally, the first image includes multiple first frames and second frames, wherein the acquisition time of the first frame is before the acquisition time of the second frame; step S403 includes: determining a location dataset of the environment in which the paving equipment and the paving frame are located based on the multiple first frames; identifying the second frame based on the location dataset to obtain the current position of the mobile device; controlling the mobile device to move from the current position to the target position, wherein the target position includes the gripping area of ​​the carrier and the target area of ​​the photovoltaic panel in the paving frame.

[0142] Optionally, determining the location dataset of the environment where the paving equipment and the paving frame are located based on the plurality of first frames includes: acquiring a plurality of associated images based on the plurality of first frames; and determining the location dataset of the environment where the paving equipment and the paving frame are located based on the plurality of associated images.

[0143] Optionally, the step of identifying the second frame based on the location dataset to obtain the current location of the mobile device includes: obtaining similarity values ​​between the second frame and each of the first frames to obtain multiple similarity values; searching for a target frame from the multiple first frames based on the multiple similarity values; searching for the location data of the target frame from the location dataset; and determining the current location of the mobile device based on the location data.

[0144] Optionally, the method further includes: controlling the camera to acquire a third image, the third image including an image of the photovoltaic panel in the mounting frame; controlling the mobile device to determine the placement area of ​​the photovoltaic panel based on the third image; obtaining a deviation value between the placement area of ​​the photovoltaic panel and the target area of ​​the photovoltaic panel; if the deviation value is greater than a preset threshold, controlling the mobile device to move the photovoltaic panel to the target area of ​​the photovoltaic panel based on the deviation value.

[0145] Optionally, the moving device includes a clamping member and a moving frame connected to the clamping member; controlling the moving device to move the photovoltaic panel to the target area of ​​the photovoltaic panel based on the deviation value includes: controlling the clamping member to grab the photovoltaic panel from the placement area of ​​the photovoltaic panel; controlling the moving frame to move the photovoltaic panel to the target area of ​​the photovoltaic panel based on the deviation value; and controlling the clamping member to place the photovoltaic panel in the target area of ​​the photovoltaic panel.

[0146] Optionally, the carrier includes a lifting device; the method further includes: controlling the lifting device to lift the photovoltaic panel within the carrier to the grasping area.

[0147] exist Figure 4 The method shown uses images captured by a camera to install photovoltaic panels, which can improve the accuracy of positioning.

[0148] This application provides a paving device, including a processor and a memory. The memory stores computer-readable instructions, and the processor calls the instructions stored in the memory to execute, for example... Figure 4 The instructions for the steps in the described method.

[0149] Optionally, the paving equipment further includes: a robotic arm and a carrier connected to the processor, the robotic arm including a moving device and a camera mounted on the moving device.

[0150] This application also provides a computer-readable storage medium storing a computer program. The computer program includes program instructions, which, when executed by a processor, cause the processor to perform actions such as... Figure 4 Some or all of the steps of the method described.

[0151] This application also provides a computer program product, the computer program product including a non-transitory computer-readable storage medium storing a computer program, the computer program being operable to cause a computer to perform, as... Figure 4 Some or all of the steps of the method described.

[0152] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this application.

[0153] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0154] In the embodiments claimed in this application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical or other forms.

[0155] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of this application, depending on actual needs.

[0156] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software program module.

[0157] If the integrated unit is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, RAM, ROM, portable hard drives, magnetic disks, or optical disks.

[0158] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A paving device, characterized in that: It comprises a processor, a mechanical arm connected to the processor and a carrier, the mechanical arm comprises a mobile device and a camera arranged on the mobile device, wherein; The carrier is used to carry at least one photovoltaic panel; The processor is used to control the mobile device to move to a reference position; The processor is further used to control the camera to collect a first image, wherein the first image includes an image of a target position corresponding to the reference position; The processor is further used to control the moving device to move the photovoltaic panel in the carrier to a target area of ​​the photovoltaic panel in the installation frame based on the first image; Wherein, the target position is the initial position of the paving frame or the position of the placed photovoltaic panel, the at least one photovoltaic panel includes a first photovoltaic panel and a second photovoltaic panel, the paving frame includes a first target area and a second target area, the first target area is the target area of ​​the first photovoltaic panel, the second target area is the target area of ​​the second photovoltaic panel, the first target area is the initial position of the paving frame, and the second photovoltaic panel is the next photovoltaic panel to be paved after the first photovoltaic panel; The processor is used to determine a position parameter set of the first target area based on the first image and the parameters of the camera; based on the position parameter set and the gripping area of ​​the carrier, generate a first outgoing path and a first returning path of the first photovoltaic panel, wherein the first outgoing path includes a first sub-outgoing path and a second sub-outgoing path, and the first returning path includes a first sub-returning path and a second sub-returning path; The processor is further configured to determine a safe position; determine the first sub-moving-out path and the second sub-moving-back path according to the grasping area and the safe position, and determine the second sub-moving-out path and the first sub-moving-back path according to the safe position and the position parameter set; The processor is further configured to generate a second removal path for the second photovoltaic panel based on the position parameter set and the grasping area, and a relative position between the second target area and the first target area; The processor is further configured to control the mobile device to move from the reference position to the grasping area; control the mobile device to move the first photovoltaic panel in the grasping area to the safe position based on the first sub-moving-out path; control the mobile device to move the first photovoltaic panel from the safe position to the first target area based on the second sub-moving-out path; control the mobile device to move from the first target area to the safe position based on the first sub-moving-back path; and control the mobile device to move from the safe position to the grasping area based on the second sub-moving-back path. The processor is further configured to control the moving device to move the second photovoltaic panel in the grabbing area to the second target area based on the second moving-out path.

2. The paving equipment according to claim 1, characterized in that: The paving equipment further includes a counter, the number of the first photovoltaic panels is 1, the number of the second photovoltaic panels is M-1, the at least one photovoltaic panel further includes at least one third photovoltaic panel, the paving frame further includes a third target area of ​​the third photovoltaic panel, M is an integer greater than 2, and the third photovoltaic panel is the next photovoltaic panel to be paved after M-1 of the second photovoltaic panels; The processor is further used to control the counter to count the number of the photovoltaic panels moved to the paving frame, and to reset the counter when the count value is M; The processor is further configured to control the camera to capture a second image when the count value of the counter is 0, wherein the second image includes at least one image of the second target area or the third target area; The processor is further configured to control the moving device to move the third photovoltaic panel in the grabbing area to the third target area based on the second image.

3. The paving equipment according to claim 1, characterized in that: The first image includes a plurality of first frames and a second frame, and the acquisition time of the first frame is before the acquisition time of the second frame; The processor is used to determine a location data set of the environment in which the paving equipment and the paving frame are located based on the multiple first frames; recognizing the second frame based on the location data set to obtain a current location of the mobile device; The processor is further used to control the moving device to move from the current position to the target position, where the target position includes a grabbing area of ​​the carrier and a target area of ​​the photovoltaic panel in the installation frame.

4. The paving equipment according to claim 3, characterized in that: The processor is used to acquire a plurality of associated images based on the plurality of first frames; and determine a location data set of the environment in which the paving equipment and the paving frame are located based on the plurality of associated images.

5. The paving equipment according to claim 4, characterized in that: The processor is used to obtain similarity values ​​between the second frame and each of the first frames to obtain a plurality of similarity values; search for a target frame from the plurality of first frames according to the plurality of similarity values; and search for position data of the target frame from the position data set; A current location of the mobile device is determined based on the location data.

6. The paving equipment according to any one of claims 1 to 5, characterized in that: The processor is further used to control the camera to collect a third image, wherein the third image includes an image of the photovoltaic panel in the paving frame; The processor is further used to control the mobile device to determine the placement area of ​​the photovoltaic panel based on the third image; and obtain a deviation value between the placement area of ​​the photovoltaic panel and the target area of ​​the photovoltaic panel; If the deviation value is greater than a preset threshold, the moving device is controlled to move the photovoltaic panel to a target area of ​​the photovoltaic panel based on the deviation value.

7. The paving equipment according to claim 6, characterized in that: The moving device comprises a clamping member and a moving frame connected to the clamping member; The processor is used to control the clamp to grab the photovoltaic panel from the placement area of ​​the photovoltaic panel; The processor is further configured to control the mobile frame to move the photovoltaic panel to a target area of ​​the photovoltaic panel based on the deviation value; The processor is further used to control the clamping member to place the photovoltaic panel in a target area of ​​the photovoltaic panel.

8. The paving equipment according to any one of claims 1 to 5, characterized in that: The carrier includes a lifting device; The processor is used to control the lifting device to lift the photovoltaic panel in the carrier to the grabbing area.

9. A paving system, characterized in that: It comprises a laying frame, a photovoltaic panel and a laying device according to any one of claims 1 to 8, wherein the laying device is used for moving the photovoltaic panel to a target area of ​​the photovoltaic panel in the laying frame.