Procedure for providing a digital twin of a construction site

Abstract

The invention relates to a method (100) for providing a digital twin of a construction site (1), comprising the following steps: - Providing (101) a task specification for the construction site (1) in order to assign one or more tasks to the construction site (1), wherein the task specification comprises at least one position specification for a position (50) on the construction site (1) at which the respective task is to be carried out, and at least one tool specification for a tool (60) which is provided for carrying out the task at the respective position (50), - processing (102) the recorded task specification in order to update a digital model of the construction site (1) with regard to the respective task, - generating (103) a usage specification for handling and / or configuring the respective tool (60) on the basis of the task for which the tool (60) is intended to perform, in order to assist a user (70) in performing the task, - Providing (104) the updated digital model and the generated usage specification as the digital twin for user support (70).

Description

[0001] The invention relates to a method for providing a digital twin of a construction site. Furthermore, the invention relates to a system, a computer program, a device, and a storage medium for this purpose. State of the art

[0002] On construction sites, the exchange of information between the various departments, such as planning, determining the work to be performed, the spatial locations where the task must be carried out, and the required tools and materials, is often still very inefficient. There is often no systematic coordination between these departments, which leads to inefficient use of resources.

[0003] Conventional solutions are also known from the documents US 2021 295048 A1, US 2022 0163959 A1 and US 11024088 B2. Disclosure of the invention

[0004] The subject matter of the invention is a method having the features of claim 1, a system having the features of claim 6, a computer program having the features of claim 8, a device having the features of claim 9, and a computer-readable storage medium having the features of claim 10. Further features and details of the invention emerge from the respective subclaims, the description, and the drawings. Features and details described in connection with the method according to the invention naturally also apply in connection with the system according to the invention, the computer program according to the invention, the device according to the invention, and the computer-readable storage medium according to the invention, and vice versa, so that with regard to the disclosure of the individual aspects of the invention, reference is or can always be made to each other.

[0005] The invention particularly relates to a method for providing a digital twin of a construction site. The construction site can be a real construction site, including, for example, a building, a bridge, and / or a road. The digital twin can be a virtual construction site that maps the real construction site with regard to spatial structural properties and / or functionality.

[0006] The method can comprise providing a task specification for the construction site in order to assign one or more tasks to the construction site. These are preferably tasks that actually have to be carried out as planned on the actual construction site in order to achieve project progress. The task specification can comprise at least one position specification for a position on the construction site at which the respective task is to be carried out and at least one tool specification for a tool that is intended to carry out the task at the respective position. In other words, the task specification can also specify several positions on the construction site at each of which at least one task is to be carried out with at least one tool. Furthermore, the task specification can also specify the tool required to carry out the task and the task itself for each of these positions.

[0007] The method can further comprise processing the recorded task specification in order to update a digital model of the construction site with regard to the respective task. For example, for this purpose, the information in the task specification is related to the structural and / or functional information of the digital model. It is also possible for the task specification to be saved for this purpose, which is then made available for selection by a user. The task specification, in particular the saved one, can preferably update the digital model and / or represent an updated digital model of the construction site in that the at least one position specification specifies the at least one position, in particular spatial position, on the construction site and thus relates to the spatial structure of the construction site. In the same way, the tasks can relate to the functional aspects of the construction site.

[0008] Furthermore, the method can comprise generating a usage specification for handling and / or configuring the respective tool based on the task the tool is intended to perform. This can provide support to a user when performing the task. The handling can, for example, be implemented as instructions, and the configuration can comprise at least one setting for the tool, e.g. in the form of concrete setting values such as a rotational speed or a drilling depth. The instructions can, for example, also comprise information on the materials required to perform the task and / or a sequence and / or information on the work to be carried out. To generate the usage specification, a database can be retrieved, for example, in which corresponding templates for handling and / or configuration are provided depending on the task and tool combination.Depending on the combination specified in the task specification, the template can then be retrieved from the database.

[0009] Furthermore, the method may comprise providing the updated digital model and / or the generated usage specification, in particular as the digital twin, to support the user. This allows a digital twin to be provided that represents the construction site with the current tasks on the site. One advantage of the invention may be that it improves coordination between construction site tasks such as planning, determining the work to be performed, the spatial positions where the task must be performed, and the required tools and materials, thereby increasing the productivity of the construction industry.

[0010] A further improvement can be achieved by the invention with regard to the time required to complete construction work / tasks from the planning phase to the final phase of execution and completion. Thus, efficiency can be further improved.

[0011] Further improvement may be possible regarding errors caused by an improper, inefficient, and error-prone communication process. Some examples include drilling a hole of the wrong size or using the wrong drill bits for a material, performing an activity in the wrong location, cutting a hole with the wrong dimensions, etc., resulting in significant cost and time losses.

[0012] The invention may include the use of measurement and planning tools and / or computer vision and / or artificial intelligence and / or machine learning to create a digital twin of the construction site containing all necessary and additional information required and accessible by a tradesperson equipped with an augmented reality device. By using the technology, a tradesperson can perform their work efficiently, accurately, and with as little stress as possible.

[0013] The task specification can, for example, include digital data resulting from user input. The task specification can include a list of position information about positions on the construction site and tool information about the tools for performing the tasks at these positions. Therefore, at least one task can be defined for each of the positions, which is to be performed at this position. For this purpose, the task specification can, for example, include an identifier for each of the tasks that is assigned to the position. For example, at least one tool is specified for each position that is intended to perform the task there. A corresponding data structure that is used to transmit and / or store the task specification can, for example, contain a position specification (e.g. as coordinates or via at least one digit) and / or a task specification (e.g.predefined labels of the tasks) and / or a tool specification (e.g. predefined labels of the tools).

[0014] Examples of tasks on a construction site that are carried out using tools, particularly power tools, and for which appropriate markings may be required are: drilling a hole, cutting a hole, sanding surfaces, sawing wood or metal, fastening screws or nails, removing paint or rust, cleaning surfaces or joints.

[0015] Possible tools, especially power tools, can include: handheld power tools, stationary power tools, drills, hole saws, angle grinders, jigsaws, screwdrivers, sanders, paint or rust removers, and high-pressure cleaners. Examples of handheld power tools include drills, sanders, milling machines, or saws. Examples of stationary power tools include lathes, planers, grinders, or milling machines. A unique identification can be provided for each of these tools to assign a specific tool to the position and / or task based on the job specification.Possible parameters for setting tools are: speed and / or drilling depth (particularly for a drill) and / or drill bit selection and / or diameter and / or cutting depth (particularly for a hole saw) and / or grinding wheel diameter (particularly for an angle grinder or a sander) and / or stroke rate (particularly for a jigsaw) and / or torque (particularly for a screwdriver) and / or nozzle and / or pressure (particularly for a paint or rust remover or high-pressure cleaner).

[0016] Furthermore, within the scope of the invention, it can be provided that the usage specification includes at least one configuration specification for the tool configuration, which is suitable and / or predetermined and / or optimized for performing the task for which the tool is intended. The configuration specification includes, for example, specific setting values for setting, in particular setting parameters such as rotational speed and / or drilling depth.

[0017] Furthermore, providing the updated digital model and the generated usage specification can include the following step: sending the configuration specification to the tool, preferably via a radio connection, preferably via a Bluetooth connection, to initiate an automated configuration of the tool based on the transmitted configuration specification. This allows for automatic configuration of the tool, i.e., without manual intervention by a user. For this purpose, the tool itself can also have a radio interface, such as a Bluetooth interface.

[0018] According to a further advantage, it can be provided that the provision of the updated digital model and the generated usage specification comprises the following step: generating an output for a visualization device based on the updated digital model and the generated usage specification, wherein the visualization device can be provided in the form of an augmentation device and / or mobile device and / or wearable device for augmented reality (AR). An augmentation device is, for example, AR glasses that a user can put on to prepare and / or carry out their work. This enables the user, in particular supported by AR, to select the tasks and / or to have the appropriate tool and / or the intended position on the construction site displayed, if necessary with a current location and / or status of the tool, and / or to carry out the tool settings automatically and / or if necessary.to be given further instructions on how to complete the task.

[0019] Furthermore, it is advantageous if the provision of the updated digital model and the generated usage specification includes the following step: displaying visual and / or acoustic instructions for handling and / or configuration and / or for the respective position and task based on the generated usage specification, preferably via a visual and / or acoustic output device. This enables the user, particularly with the support of AR, to select the tasks and / or to be shown the appropriate tool and / or the intended position on the construction site, possibly with the current location and / or status of the tool, and / or to automate the tool settings and / or to be guided with further details for the execution of the task.

[0020] Advantageously, the invention can provide that the provision of the updated digital model and the generated usage specification comprises at least one of the following steps: - detecting a user selection of at least one of the plurality of tasks and / or at least one of the positions at which the tasks are to be performed, preferably by means of a gesture selection and / or via the augmentation device, - Determining the tool which is intended to perform the selected task and / or which is intended to perform the task at the selected position, wherein for this purpose a user selection from several suitable tools is preferably recorded, wherein the tool is preferably determined on the basis of the updated digital model, - Determining instructions for handling, in particular user instructions, and / or settings for configuring the identified tool, preferably based on the generated usage specification, - Providing the user with the instruction(s), preferably in the form of step-by-step instructions, to carry out the task at the respective position using the identified tool, and / or - Output, preferably transfer, the settings for configuring the identified tool.

[0021] The instructions may also include directions, where the user is guided via AR to the position on the construction site where the task is to be carried out and / or to the tool with which the task is to be carried out.

[0022] The invention also relates to a system for providing a digital twin of a construction site, comprising: - a recording device for recording a task specification for the construction site in order to assign one or more tasks to the construction site, in particular based on a user input, wherein the task specification may comprise at least one position specification about a position on the construction site at which the respective task is to be carried out and / or at least one tool specification about a tool that is intended to carry out the task at the respective position, - a processing device for, in particular digitally, processing the recorded task specification in order to update a digital model of the construction site with regard to the respective task, and / or for generating a usage specification for handling and / or configuring the respective tool on the basis of the task for which the tool is intended to perform, in order to assist a user in performing the task, - an output device for outputting, preferably visually, the generated usage specification in order to provide the updated digital model as the digital twin to assist the user in performing the one or more tasks.

[0023] The system according to the invention thus provides the same advantages as those described in detail with reference to a method according to the invention. Furthermore, the system can be suitable for carrying out a method according to the invention.

[0024] Furthermore, it is optionally provided that the respective tool is designed as a power tool, preferably as a drill or a screwdriver or a drill driver or an impact drill driver or an impact wrench or a hammer or a rotary hammer. In particular, the tool can have an interface such as a radio interface for automated configuration based on the usage specification.

[0025] The invention also relates to a computer program, in particular a computer program product, comprising instructions that, when executed by a computer, cause the computer to execute the method according to the invention. Thus, the computer program according to the invention provides the same advantages as those described in detail with reference to a method according to the invention.

[0026] The invention also relates to a data processing device configured to carry out the method according to the invention. The device can be, for example, a computer that executes the computer program according to the invention. The computer can have at least one processor for executing the computer program. A non-volatile data memory can also be provided, in which the computer program is stored and from which the computer program can be read by the processor for execution.

[0027] The invention may also provide a computer-readable storage medium that has the computer program according to the invention and / or includes instructions that, when executed by a computer, cause the computer to carry out the method according to the invention. The storage medium is designed, for example, as a data storage device such as a hard disk and / or a non-volatile memory and / or a memory card. The storage medium can, for example, be integrated into the computer.

[0028] Furthermore, the method according to the invention can also be implemented as a computer-implemented method.

[0029] Further advantages, features, and details of the invention will become apparent from the following description, which describes exemplary embodiments of the invention in detail with reference to the drawings. The features mentioned in the claims and in the description may be essential to the invention individually or in any combination. They show: Fig. 1 a schematic visualization of a method, a device, a storage medium and a computer program according to embodiments of the invention. Fig. 2 a schematic representation of a construction site and a system according to embodiments of the invention. Fig. 3 a schematic representation of a visualization device.

[0030] In Fig. 1 schematically illustrates a method 100, a device 10, a storage medium 15, and a computer program 20 according to exemplary embodiments of the invention. The method 100 serves to provide a digital twin of a construction site 1. According to a first method step 101, a task specification for the construction site 1 is provided in order to assign one or more tasks to the construction site 1. To provide the task specification, a user input can be recorded, which can be made, for example, via a keyboard or a voice input. The task specification can include at least one position specification for a position 50 on the construction site 1 at which the respective task is to be performed, and at least one tool specification for a tool 60 that is provided for performing the task at the respective position 50 (see Fig. 2). According to a second method step 102, the recorded task specification can be processed to update a digital model of the construction site 1 with regard to the respective task. The data processing device 10, which is also shown, can be used for processing. Subsequently, according to a third method step 103, a usage specification for handling and / or configuring the respective tool 60 can be generated based on the task for which the tool 60 is intended to perform. The usage specification can serve to support a user 70 in performing the task. For this purpose, according to a fourth method step 104, the updated digital model and the generated usage specification can then be provided as the digital twin to support the user 70.

[0031] Embodiments of the invention accordingly comprise a method 100 for supporting the activities on a construction site 1 by providing a digital twin and, if necessary, by means of augmented reality.

[0032] It is possible that providing 104 the updated digital model and the generated usage specification includes the following step: generating an output for a Fig. 3 based on the updated digital model and the generated usage specification, wherein the visualization device 80 can be designed in the form of an augmentation device 80 for an augmented reality AR. It can be provided that a three-dimensional (3D) map of the Fig. 2 is provided by the digital twin of the real construction site 1 and displayed via the visualization device 80. In this digital twin, in the generated output, for example, all positions 50 can be marked with 3D coordinates exactly where tasks are to be performed, possibly together with additional information such as a tool 60, in particular a power tool, that must be used to perform the task, the accessory to be used, the angle at which the hole or cut must be made, the recommended torque or force that must be used to perform the task, etc.

[0033] A digital twin is understood in particular to be a virtual image of one or more physical objects, for which real-time data can also be collected via sensors and displayed in a digital environment if necessary. The virtual twin of the construction site 1 can thus be obtained, for example, by virtually displaying at least objects and / or an environment of the construction site 1. A view of the virtual image can then be made available to a user via a visualization device 80 such as an augmentation device. It is possible for the digital twin to be provided by a digital model of the real construction site 1. A digital model is understood in particular to mean that a virtual image of the real construction site 1 is created, e.g. by a manual digital replica and / or the use of 3D scans, drone photography or other digital recording methods. The digital model includes, for example:a geographical and / or spatial digital replica in which different positions on construction site 1 can be identified (see . Fig. 2). For this purpose, the digital model can be implemented as a 3D model, e.g., using a format such as .obj or .stl. The data of the digital twin and, if applicable, the relationship data can also be stored in JSON format. Furthermore, functional or physical properties of the digital twin can be simulated.

[0034] It is possible for the usage specification to include at least one configuration specification for the tool 60, which is suitable and / or predetermined and / or optimized for performing the task for which the tool 60 is intended. A user 70 can use the required power tool based on the provided usage specification and set the correct configurations for the power tool. Communication exchange between an augmentation device, a backend, and the power tool during work can be provided. A user 70 can further use gestures and eye movements to select the task to be performed on their augmentation device.

[0035] Furthermore, the provision 104 of the updated digital model and the generated usage specification may include the following step: sending the configuration specification to the tool 60, preferably via a radio connection, preferably via a Bluetooth connection, in order to initiate an automated configuration of the tool 60 based on the transmitted configuration specification. It is therefore possible for the tool parameters or the configuration to be downloaded directly from the backend via the augmentation device or directly to the power tool at the workplace. In this way, all required settings can be transferred to the power tool, and the user does not have to worry about configuring the tool for the respective task, e.g., profile parameters such as torque settings, the mode the tool is in, etc. The Fig. The device 10 shown in Figure 1 can accordingly be part of the backend.

[0036] It is conceivable that the provision 104 of the updated digital model and the generated usage specification comprises the following steps: outputting the instructions, preferably in the form of step-by-step instructions, for the user to perform the task at the respective position with the identified tool 60, and / or outputting, preferably transferring, the settings for configuring the identified tool 60. With the help of measuring and planning tools, a 3D map of the construction site on which the work is to be carried out can be created. This 3D map can be a digital twin of the real construction site 1.In this digital twin, all the positions can be marked with 3D coordinates exactly where the work has to be done, along with additional information like the tool to be used for the job, the accessory to be used, the angle at which the hole or cut has to be made, the recommended torque / force to perform the task, etc. This created digital twin can also include the resources that the user may find useful to perform the task, such as the correct use of the tool for the task, a link to a video that shows how the work has to be done for a particular task, the tips and tricks for performing such tasks, the expected quality level to communicate that the work is completed.

[0037] On the construction site, depending on the role and activity assigned to each individual, the full or partial digital plan can be shared with the assigned user. Users can equip themselves with visualization devices such as virtual augmentation / mixed reality devices that overlay the virtual map with the real world, allowing them to clearly see where on the construction site each activity needs to be performed.

[0038] As a further step, a recording of a user selection of at least one of the plurality of tasks and / or at least one of the positions at which the tasks are to be performed can be provided, preferably by means of a gesture selection and / or via the augmentation device 80. Embodiments of the invention further provide an extension of the described ideas, in which a communication exchange is provided between the visualization device 80, such as a virtual augmentation device, the backend, i.e. in particular the device 10, and the tool 60, in particular a power tool, during work. The user can, for example, use gestures / eye movements to select the task to be performed on their augmentation device, and after the task has been completed, the tool parameters / configuration can be downloaded directly from the backend via the visualization device or directly to the power tool at the workplace.In this way, all necessary settings can be transferred to the power tool and the user does not have to worry about configuring the tool for the specific task, e.g., profile parameters such as torque settings, mode the tool is in, etc.

[0039] In Fig. 2 further shows a system 5 for providing a digital twin of a construction site 1 according to embodiments of the invention, comprising a detection device 90, a processing device 10 and an output device 80 in order to carry out a method 100 by means of these components.

[0040] The above explanation of the embodiments describes the present invention exclusively within the scope of examples. Of course, individual features of the embodiments can be freely combined with one another, provided they are technically feasible, without departing from the scope of the present invention. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] US 2021 295048 A1

[0003] US 2022 0163959 A1

[0003] US 11024088 B2

[0003]

Claims

[1] Method (100) for providing a digital twin of a construction site (1), comprising the following steps: - Providing (101) a task specification for the construction site (1) in order to assign one or more tasks to the construction site (1), wherein the task specification comprises at least one position specification for a position (50) on the construction site (1) at which the respective task is to be carried out, and at least one tool specification for a tool (60) which is provided for carrying out the task at the respective position (50), - processing (102) the recorded task specification in order to update a digital model of the construction site (1) with regard to the respective task, - generating (103) a usage specification for handling and / or configuring the respective tool (60) on the basis of the task for which the tool (60) is intended to perform, in order to assist a user (70) in performing the task, - Providing (104) the updated digital model and the generated usage specification as the digital twin for user support (70). [2] Method (100) according to claim 1, characterized by that the usage specification comprises at least one configuration specification for the configuration of the tool (60), which is suitable and / or predetermined and / or optimized for performing the task for which the tool (60) is intended, wherein the provision (104) of the updated digital model and the generated usage specification comprises the following step: - Sending the configuration specification to the tool (60), preferably via a radio connection, preferably via a Bluetooth connection, in order to initiate an automated configuration of the tool (60) based on the transmitted configuration specification. [3] Method (100) according to one of the preceding claims, characterized by that the provision (104) of the updated digital model and the generated usage specification comprises the following step: - generating an output for a visualization device (80) based on the updated digital model and the generated usage specification, wherein the visualization device (80) is provided in the form of an augmentation device (80) for augmented reality (AR). [4] Method (100) according to one of the preceding claims, characterized bythat the provision (104) of the updated digital model and the generated usage specification comprises the following step: - Displaying visual and / or acoustic instructions for handling and / or configuration and / or for the respective position and task based on the generated usage specification, preferably via a visual and / or acoustic output device (80). [5] Method (100) according to one of the preceding claims, characterized by that the provision (104) of the updated digital model and the generated usage specification comprises the following steps: - detecting a user selection of at least one of the plurality of tasks and / or at least one of the positions at which the tasks are to be performed, preferably by means of a gesture selection and / or via the augmentation device (80), - Determining the tool (60) which is intended to perform the selected task and / or which is intended to perform the task at the selected position, wherein for this purpose a user selection from several suitable tools (60) is preferably recorded, wherein the determination of the tool (60) is carried out on the basis of the updated digital model, - Determining instructions for handling, in particular user instructions, and / or settings for configuring the determined tool (60), each on the basis of the generated usage specification, - outputting the instructions, preferably in the form of step-by-step instructions, for the user to carry out the task at the respective position with the determined tool (60), and / or - Output, preferably transfer, of the settings for configuring the identified tool (60). [6] System (5) for providing a digital twin of a construction site (1), comprising: - a recording device (90) for recording a task specification for the construction site (1) in order to assign one or more tasks to the construction site (1), wherein the task specification comprises at least one position specification about a position (50) on the construction site (1) at which the respective task is to be carried out, and at least one tool specification about a tool (60) which is provided for carrying out the task at the respective position (50), - a processing device (10) for processing the acquired task specification in order to update a digital model of the construction site (1) with regard to the respective task, and for generating a usage specification for handling and / or configuring the respective tool (60) on the basis of the task for which the tool (60) is intended to perform in order to assist a user (70) in performing the task, - an output device (80) for outputting the generated usage specification to provide the updated digital model as the digital twin for assisting the user (70) in performing the one or more tasks. [7] System (5) according to claim 6, characterized bythat the respective tool (60) is designed as a power tool, preferably as a drill or a screwdriver or a drill driver or an impact drill driver or an impact wrench or a hammer or a hammer drill. [8] Computer program (20) comprising instructions which, when the computer program (20) is executed by a computer (10), cause the computer (10) to carry out the method (100) according to one of claims 1 to 5. [9] Device (10) for data processing which is arranged to carry out the method (100) according to one of claims 1 to 5. [10] A computer-readable storage medium (15) comprising instructions which, when executed by a computer (10), cause the computer (10) to perform the steps of the method (100) according to any one of claims 1 to 5.

Images