Method and system for collision avoidance in a 3D robotic concrete printer

A model-based collision prediction system for 3D robotic concrete printers addresses the inadequacies of existing methods by generating real-time 3D geometry to prevent collisions, ensuring safe and precise printing operations.

JP2024541697APending Publication Date: 2024-11-08SYDDANSK UNIV +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024547820
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-10-20
Filing Date
2022-10-13
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing collision detection methods for 3D robotic concrete printers are inadequate for large-scale operations, particularly in 3D concrete printing tasks, leading to potential damage from unforeseen collisions with printed structures and printers due to human intervention or unforeseen circumstances.

Method used

A model-based collision prediction system that infers and generates a 3D geometry of the concrete structure in real-time, using G-code instructions, motion commands, and sensor data to predict and avoid collisions by updating a 3D collision model during the printing process, allowing both manual and automatic control.

Benefits of technology

Ensures collision-free operation by rejecting potentially harmful commands and generating collision-free motion paths, enhancing safety and precision in 3D concrete printing processes, especially with gantry-type robotic systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024541697000001_ABST
    Figure 2024541697000001_ABST
Patent Text Reader

Abstract

[Solution] The present invention relates to a collision avoidance method for a 3D robotic concrete printer, the method comprising the steps of: performing an application and / or treatment process using the 3D robotic concrete printer by executing instructions, e.g. based on G-code, by moving a tool within a path for applying and / or treating concrete material; and moving the tool in response to commands to a motion planner, the movements being assisted by a model-based collision prediction system, the model-based collision prediction system comprising the steps of: inferring and generating a 3D geometry of a concrete structure from the application and / or treatment of the concrete structure by instructions to the 3D robotic concrete printer; and using the 3D geometry as a 3D collision model, which can be checked at any time whether parts of the 3D robotic concrete printer will cause a collision when performing the movements, the 3D collision model of the concrete structure being improved in parallel with the application and / or treatment process and being updated as the execution of the process instructions progresses.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method and system for collision avoidance for 3D robotic concrete printers, including concrete application, such as extrusion and printing, and processing (post-processing) of concrete structures. [Background technology]

[0002] In general, it is known in the prior art to provide collision detection methods for robotized concrete application and / or machining processes, however, such 3D collision detection methods are based either on pre-available geometry "as designed", such as global / static BIM data, or on in-situ generated geometry "as built" from local / dynamic sensor data.

[0003] US Patent No. 5,399,633 discloses a cable-based parallel robot with a mobile tool intended to move along a target path in a working environment. The tool, preferably an extrusion tool for concrete injection, is connected to anchor points of a fixed structure via a number of cables and cable actuators. The cable actuators are controlled to move the tool along the target path. US Patent No. 5,399,633 discloses model-based collision detection of the cable robot when the tool moves to avoid collisions between the cables and the printed concrete structure, but does not disclose the use of collision detection for manual control.

[0004] 3D concrete printing sporadically requires pausing the printing process or moving the extrusion tool away from the printed structure for cleaning or other maintenance. These tasks are usually performed by on-site personnel who do not fully understand the operation of the machine, and therefore run the risk of accidentally driving the tool into the freshly printed structure and damaging the print and / or the printer.

[0005] In normal operation, 3D concrete printing is performed without human intervention, where a print program is sent to the 3D robotic concrete printer for automatic execution. Print programs are usually generated in a collision-free manner. However, unforeseen circumstances can cause accidental collisions with the print or the printer. These circumstances include workers, materials and tools in the printer's workspace, as well as additional attachments to the printed structure and printing with several independently generated print programs.

[0006] Other collision scenarios can occur after the actual printing process, for example if the 3D robotic concrete printer setup is used for post-processing of the printed object with additional processing such as material injection or finishing of the printed surface. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] International Publication No. 2019 / 025698 Summary of the Invention [Problem to be solved by the invention]

[0008] Therefore, for large scale 3D printing operations, especially for 3D concrete printing tasks, known collision detection methods are not satisfactory. It is therefore an object of the present invention to provide an improved method and system for collision avoidance in 3D robotic concrete printers. [Means for solving the problem]

[0009] A first aspect of the present invention is a collision avoidance method for a 3D robotic concrete printer, comprising the steps of: The collision avoidance method includes: performing an application and / or processing process by executing process instructions based on G-code with the 3D robotic concrete printer to move a tool in a path to apply and / or process the concrete material; operating the tool in response to motion commands to a motion planner, said motion being assisted by a model-based collision prediction system; Including, The model-based collision prediction system includes: Inferring and generating a 3D geometry of the concrete structure from the application and / or processing of the concrete structure by commands to the 3D robotic concrete printer; using the 3D geometry as a 3D collision model to check at any time whether a part of the 3D robotic concrete printer causes a collision during the operating step; Including, The 3D collision model of the concrete structure is evolved in parallel with the application process and / or the machining process to provide a collision avoidance method that is updated according to the progress of the process instructions.

[0010] A second aspect of the present invention is a collision avoidance system for a 3D robotic concrete printer, comprising: The collision avoidance system comprises: a motion planner that generates motion commands from inputs that can be selected from fully automated operation according to a predefined program, manual operation from a joystick and similar input device for an operator, or sensor-based operation that moves the printer tool according to sensor data; a motion controller that interprets the motion commands from the motion planner and physically executes them on the physical printer; a model-based collision prediction system that tests the motion commands from the motion planner for collisions and allows the motion controller to execute motion commands that are collision-free and does not allow the motion controller to execute commands that would cause a collision; Equipped with The model-based collision prediction system includes: A prediction generating unit for predicting and generating a 3D geometry of a concrete structure from a coating and / or machining process control commanding the 3D robotic concrete printer; a checking unit that uses the 3D geometry as a 3D collision model to check at any time whether a part of the 3D robotic concrete printer causes a collision during the operation; Equipped with The motion controller has a 3D model of the concrete structure, and a collision avoidance system is provided where the 3D model is updated according to the progress of process instructions.

[0011] The method and system of the present invention generates a 3D model of the print on-the-fly in parallel with the process as a basis for model-based collision detection, allowing the system to support either manual or automatic control states at any point in the process.

[0012] In this specification, the term 3D robotic concrete printer is understood as a programmable device for the application and / or processing of 3D concrete.

[0013] As used herein, the term "concrete" is understood to include all concrete-type materials, mortar-type materials, and recipes that contain high amounts of recycled materials.

[0014] In accordance with the present invention, the methods and systems can be used for a variety of different application and / or machining processes associated with concrete 3D printing, whereby the printer tools may include print heads, injection heads for injecting concrete material or insulation, robotic arm applications such as drilling tool members for performing machining operations, and the like.

[0015] Advantageously, the model-based collision prediction system comprises the steps of instructing the 3D robotic concrete printer to estimate and generate a 3D geometry of the concrete structure by applying and / or processing the concrete structure, and using the estimated and generated 3D geometry as a 3D collision model, which can be used at any time to check whether parts of the 3D robotic concrete printer cause a collision when operating. Preferably, the model-based collision prediction system further comprises the step of combining the generated 3D collision model with supplementary data, in particular sensor data obtained from laser scanning, predefined 3D obstacle data obtained from CAD data, etc.

[0016] Furthermore, it is advantageous that a 3D collision model of the concrete structure is developed in parallel with the application and / or machining process and updated according to the progress of said process instructions, thereby achieving superior collision avoidance.

[0017] In one embodiment of the invention, the step of operating the tool is performed by manual operation by an operator controlling the operation, automatic operation, or sensor-guided operation. In 3D concrete printing, this step corresponds to a manual interruption of the printing process to move the tool to perform ancillary tasks such as maintenance or cleaning operations. Thus, the printer may include a maintenance area for cleaning and / or replacing printheads, etc.

[0018] It has proven advantageous that the collision detection step is performed by a model-based collision prediction system, whereby a proposed trajectory based on the movement of the 3D robotic concrete printer in response to the motion commands is compared with a 3D collision model corresponding to the concrete structure.

[0019] According to the present invention, if the model-based collision prediction system predicts a collision using the 3D collision model, the potentially harmful command is rejected. Thereafter, or alternatively, a collision-free motion command is generated from an algorithm or further operator input to avoid the collision. If the model-based collision prediction system predicts no collision using the 3D collision model, the motion command is executed as intended.

[0020] In a preferred embodiment of the present invention, the application process is a 3D concrete printing process by operating an extruder tool, including the 3D robotic concrete printer being a gantry type 3D robotic concrete printer operating an extruder tool to deposit concrete in a predetermined printing pattern. The system and method according to the present invention proves to be particularly advantageous for 3D concrete printing by a gantry type robotic system.

[0021] The invention will now be described in more detail with reference to the accompanying drawings. [Brief description of the drawings]

[0022] [Figure 1] FIG. 1 is a schematic perspective view of a gantry-type 3D robotic concrete printer with a print head such as an extruder. [Diagram 2] FIG. 2 is a flow chart of a collision avoidance method according to the present invention. [Diagram 3] FIG. 3 illustrates 3D collision avoidance during the printing process. [Figure 4]FIG. 4 is a schematic perspective view of a pouring head operating on a gantry-type 3D robotic concrete printer for pouring concrete into the printed structure. [Diagram 5] FIG. 5 is a schematic perspective view of a robot arm operating in a gantry-type 3D robotic concrete printer to process printed structures, such as drilling holes. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations, numerical values, process flows, functional elements, etc. described in the following embodiments are merely examples, and are free to be modified or changed, and are not intended to limit the technical scope of the present invention to the following description.

[0024] FIG. 1 shows an example of a gantry-type 3D robotic concrete printer. The gantry-type 3D robotic concrete printer includes side beams 1 arranged parallel to each other along the sides of a workspace 6 of the 3D printer. Between the side beams 1, a traverse beam 2 is movably arranged in a perpendicular direction to the side beams 1 so that the traverse beam 2 can move along the side beams 1. The side beams 1 may be supported by vertically oriented corner poles 3 so that the side beams 1 can move up and down the corner poles 3. A print head 4, such as an extruder, is movably arranged on the traverse beams 2. This provides a Cartesian system for 3D printing to concretely print an architectural structure 5 on the workspace 6.

[0025] One advantage of printing with a gantry printer is that such a printer is suitable for printing both large and small buildings, for example with a working space of about 6.8 x 7.7 x 5.8 meters (width x depth x height). Printing high-storey walls is no problem, and even two-storey buildings are possible.

[0026] Gantry printers can also print intricate building components with great detail. The printer can be precisely controlled in the X, Y and Z directions, and the print head 4 can operate at variable speeds, allowing slower or faster printing (and even pausing if non-continuous printing is required). Tools such as the print head 4 can be exchanged and selected depending on the printing process, for example, if fine detail is required, a smaller nozzle and / or a different extruder nozzle design can be selected to address the challenge of how concrete materials behave. Thus, the tools can be one of the following: a print head, an injection head for injecting concrete material or insulation, a robotic arm application such as a drilling tool member to perform machining operations, etc.

[0027] The advantage of gantry printers for 3D concrete printing on building sites is that this printer type is mobile and can be used on-site or off-site. The printer is mobile.

[0028] The movement of the printhead 4 (printhead tool), such as the extruder nozzle that deposits the concrete material, is controlled during the printing process. As mentioned above, it is sporadically necessary to pause the printing process and move the extrusion tool away from the currently printed structure in order to perform maintenance such as cleaning. This action interrupts the programmed printing process and there is a risk that the tool will collide with already printed structures or other obstacles at the site. To avoid this, a collision avoidance system and method is provided.

[0029] Thus, one embodiment of the collision avoidance method is shown in Fig. 2. For automatic operations 1.1, an operator starts a specific program, e.g. for printing or planned maintenance work that is performed periodically. For manual operations 1.2, e.g. maintenance, the operator can use a controller, e.g. a game controller with buttons and a joystick. For sensor-guided operations 1.3, the program or manual commands are modified using sensor data, e.g. laser scans, to guide the tool to the printed structure. In the motion planner 2.1, the output of operations 1.1-1.3 are mapped and scaled to the motion and movement of the gantry. The motion of the print head 4 in the gantry is the X, Y, Z axis and angular rotation of the print head, and the movement can be turning the extruder on / off. The 3D robotic concrete printer finally has a known pose (at time t), which, when added to the mapped and scaled motion and movement output from the motion planner 2.1, results in a commanded pose (at time t+T). This commanded pose is assumed by the simulated 3D robotic concrete printer geometry 3.1, whereby the simulated 3D robotic concrete printer, in particular the tool 4 (print head) and the crossbeam 2, reflects how the printer's parts are positioned at time t+T according to the input. In the step of model-based collision detection 4.1, the shape of the simulated 3D concrete robotic printer is compared with the shape of the printed structure, the collision model 7.1. The collision model 7.1 is a 3D model that is developed in parallel with the printing process and reflects the latest progress of the printing (7.2). Optionally, other 3D models representing other static obstacles in the workspace, for example from 3D CAD data 8.1 or sensor data 8.2, can be added to the collision model 7.1. The sensor data can be obtained, for example, from sensors connected to the 3D printer that can detect unplanned obstacles such as tools or construction workers.If the model-based collision detection step 4.1 results in a collision reaction, and the geometry of the simulated 3DCP system and the printed structure (or obstacle) overlap, a collision may occur based on the input, and execution of this commanded pose is not allowed (4.2). The method then returns to 2.1, where the motion can be re-planned, for example, or the user can be asked for new input. On the other hand, if the geometry of the simulated 3DCP system and the printed structure (or obstacle) do not overlap, i.e., no collision occurs based on the input, this commanded pose is allowed to be executed (4.3). All pose commands that are allowed to be executed are registered in a list for execution on the physical gantry. For all pose commands in this list, a GCode is generated by the motion controller 5.1, which communicates the motion to the physical gantry 6.1 for physical execution.

[0030] The effect of this method is illustrated in FIG. 3, which shows a 3D collision model of a concrete structure during the printing process. On the left side of FIG. 3A, an example of a collision case (i.e., step 4.2 in FIG. 2) is shown. In the simulation at time t, the print head 4 is located in front of the obstacle 5 (architectural structure). In the motion test simulating the position of the print head 4' at time t+T, the simulated print head 4' overlaps with the collision model of the print structure 5 (obstacle). As a result, the simulated motion is detected as a motion with a collision and is not allowed. On the right side of FIG. 3B, an example of a non-collision case (i.e., step 4.3 in FIG. 2) is shown. In the simulation at time t, the print head 4 is located in front of the obstacle 5. In the motion test simulating the position of the print head 4' at time t+T, the simulated print head 4' does not overlap with the collision model of the print structure 5 (obstacle). As a result, the simulated motion is detected as a motion without a collision, is allowed and transferred to execution.

[0031] Figure 4 shows a schematic perspective view of one embodiment of the present invention, in which a pouring head 4a is operated from a gantry-type 3D robotic concrete printer of the type shown in Figure 1. Here, the print head 4 is a pouring head 4a that pours concrete into a printed structure 5.

[0032] FIG. 5 shows a schematic perspective view of another embodiment of a gantry-type 3D robotic concrete printer according to the invention, from which a robotic arm 4b is operated for processing the printed structure 5, such as performing drilling operations.

[0033] The present invention has been described above with reference to certain preferred embodiments. However, it is understood by the present invention that other embodiments or variations of the above-described examples of systems and methods for collision avoidance for 3D robotic concrete printers according to the present invention may be provided without departing from the scope of the appended claims.

Claims

1. A collision avoidance method for a 3D robotic concrete printer, comprising: The collision avoidance method includes: executing G-code based process instructions on the 3D robotic concrete printer to perform an application and / or processing process by moving a tool in a path to apply and / or process the concrete material; operating the tool in response to motion commands to a motion planner, said motion being assisted by a model-based collision prediction system; Including, The model-based collision prediction system includes: Inferring and generating a 3D geometry of the concrete structure from the application and / or processing of the concrete structure by commands to the 3D robotic concrete printer; using the 3D geometry as a 3D collision model to check at any time whether a part of the 3D robotic concrete printer causes a collision during the operation step; Including, A collision avoidance method, wherein the 3D collision model of the concrete structure is evolved in parallel with the application process and / or the machining process and updated according to the progress of the process instructions.

2. The method of claim 1 , wherein the actuating step is performed by manual, automatic, or sensor-guided actuation by an operator controlling the operation of the tool.

3. and further comprising a collision detection step performed by the model-based collision prediction system.

3. The collision avoidance method of claim 1 or 2, wherein in the collision detection step, a proposed trajectory based on the movement of the 3D robotic concrete printer operating in response to motion commands is compared to the 3D collision model corresponding to the concrete structure.

4. A collision avoidance method as claimed in any one of claims 1 to 3, wherein if the model-based collision prediction system predicts a collision using the 3D collision model, potentially harmful commands are rejected, and / or if the model-based collision prediction system predicts no collision using the 3D collision model, the motion commands are executed as intended.

5. A method according to any one of claims 1 to 4, wherein further collision-free motion commands are generated from an algorithm or further operator input to avoid the collision.

6. The collision avoidance method according to any one of claims 1 to 5, wherein the application process is a 3D concrete printing process by operating an extruder tool.

7. A collision avoidance system for a 3D robotic concrete printer, comprising: The collision avoidance system includes: a motion planner that generates motion commands from inputs that can be selected from fully automated operation according to a predefined program, manual operation from a joystick and similar input device for an operator, or sensor-based operation that moves the printer tool according to sensor data; a motion controller that interprets the motion commands from the motion planner and physically executes them on the physical printer; a model-based collision prediction system that tests the motion commands from the motion planner for collisions and allows the motion controller to execute motion commands that are collision-free and does not allow the motion controller to execute commands that would cause a collision; Equipped with The model-based collision prediction system includes: an inference generator for inferring and generating a 3D geometry of a concrete structure from application and / or machining process controls that instruct the 3D robotic concrete printer; a checking unit for checking at any time whether a part of the 3D robotic concrete printer causes a collision during the operation, using the 3D geometry as a 3D collision model; Equipped with A collision avoidance system in which the motion controller has a 3D model of the concrete structure, the 3D model being updated according to the progress of process instructions.

8. 8. The collision avoidance system of claim 7, wherein the tool is one of a robotic arm application that is a print head, an injection head for injecting concrete or insulation, and a drilling tool member for performing machining operations.

9. The collision avoidance system of claim 8 , wherein the physical printer comprises a maintenance area for cleaning and / or replacing the printhead.

10. the model-based collision prediction system comprises a combination unit for combining the generated 3D collision model with supplementary data, the supplementary data being sensor data obtained from a laser scan and / or a predefined 3D obstacle as CAD data; 8. The collision avoidance system of claim 7, wherein a digital twin of a static obstacle in the 3D robotic concrete printer's workspace can be added as a supplemental 3D model to the model-based collision prediction system.

11. A collision avoidance system according to any one of claims 7 to 10, adapted to carry out a method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Cable-based parallel robot and method for controlling such a robot

    WO2019025698A1