Procedure and control device for monitoring construction work

Abstract

Method for monitoring construction work, wherein the construction work is carried out with a construction machine (4) within a work environment, comprising the steps of: reading (S2) image information about the work environment, wherein the image information is independent of the positioning of the construction machine (4) in the work environment, determining (S3), depending on the image information, whether a hazardous situation exists for a person in the work environment by checking whether, according to the image information, a person is in the work environment, and, if a hazardous situation exists, controlling (S4) a display device (12) of the construction machine (4), wherein the display device (12) is a display in the construction machine (4).

Description

Technical field

[0001] The technical area concerns a procedure for monitoring construction work, as well as a control device and a system for monitoring construction work. State of the art

[0002] Camera-based pedestrian detection systems for cars are known from the prior art. These pedestrian detection systems are based on the principle of a motion detector. Vehicles equipped with microphones for pedestrian detection are also known. Description of the invention

[0003] The invention relates to a method for monitoring construction work, wherein the construction work is carried out with a construction machine within a work environment. The construction machine can be, for example, a wheel loader, excavator, or bulldozer. The construction work can include construction work, demolition work, or grading work. The work environment can be located in a building or wholly or partially outdoors. The work environment can be continuous or, alternatively, it can consist of at least two separate sub-areas. The monitoring can be fully or at least partially automated.

[0004] The process includes a step of reading image information about the work environment. Image information about the work environment can include a photograph of the work environment. Alternatively or additionally, audio information about the work environment can be read. Audio information can include an audio recording of sounds occurring in the work environment. Alternatively or additionally, acceleration information can be read. Acceleration information can include accelerations acting on an accelerometer located within the work environment during construction work. These accelerations on the accelerometer can occur as a result of the construction work. Work environment information can include one or more photographs, audio recordings, or acceleration data of the work environment. Read-in information can pertain to the same area of ​​the work environment or to different areas of the work environment.Information can pertain to the entire work environment or to a specific area within it. Any information captured about the work environment can relate to a single point in time, or alternatively or additionally, to multiple points in time over a period of time. Image information about the work environment can include image information about the construction machine. This image information is independent of the machine's position within the work environment and can also be independent of its orientation within the work environment.

[0005] The procedure further includes a step of determining, based on the image information, whether a hazardous situation exists for a person in the work environment. This step involves checking whether a person is present in the work environment according to the image information. Alternatively or additionally, this determination step can be performed based on audio information and, alternatively or additionally, based on acceleration information. During this determination step, it can be checked whether the image information contains a movement sequence that would be expected from a person. This can be determined based on the image information, which is available for different time points. Alternatively or additionally, this determination step can access information stored in a database to check whether a person is present in the work environment according to the image information.The image information can be segmented and compared with information regarding known work attire worn by people in a work environment. A hazardous situation can exist if a person is present in the work environment. In particular, a hazardous situation can exist if a person is in a specific area of ​​the work environment, for example, an area where construction machinery is also located.

[0006] The procedure further includes, in the event of a hazardous situation, a step of activating a display device on the construction machine. This display device can be a screen on the machine. During this activation step, a signal can be sent to the machine, whereupon a warning regarding the existing hazardous situation can be displayed on the machine's display device. Alternatively or additionally, a control center, separate from the construction machine, can be activated, in particular so that a warning can be displayed on another display device in the control center. Alternatively or additionally, more than one construction machine can be activated, so that each display device on each machine is activated.For example, a fleet of construction machinery can be informed of a hazardous situation by activating a display on each machine to show a warning. This activation can be communicated directly to each machine individually, or alternatively or additionally via a central control center. The steps of reading, determining, and activating the display can be performed separately from the machine's display, either geographically or temporally. Furthermore, visual information about the work environment can be sent to the display. This allows the operator to receive additional monitoring information, along with the visual information on which the warning is based.

[0007] Advantageously, a method has been demonstrated whereby construction work with a construction machine can be monitored within a work environment. Additional personnel for monitoring the work environment, particularly for the presence of people, are therefore unnecessary. This represents a more efficient monitoring of construction work, as fewer personnel are required to carry out and monitor the construction work. Furthermore, any additional risk to these monitoring personnel can be advantageously eliminated.

[0008] According to a further embodiment, the method can also include a step for acquiring image information about the work environment, wherein the image information is acquired at various locations within the work environment. Alternatively or additionally, the method can include a step for acquiring audio information or, alternatively or additionally, acceleration information about the work environment at various locations within the work environment. Image information about the work environment can also be acquired in parts of the work environment that are not directly visible from the construction machine. In the acquisition step, the acquired image information about the work environment can be imported. Image information can be acquired from stationary locations within the work environment, for example, at an elevated position on a post, and alternatively or additionally from mobile locations within the work environment, for example, from a construction machine.Advantageously, a method has been shown whereby more precise and therefore better monitoring of the work environment is possible by capturing image information about the work environment at various points in the work environment.

[0009] According to a further embodiment, the method can also include a step for defining the work environment, wherein image information about the defined work environment is acquired in the acquisition step. The acquisition step of image information at various locations within the work environment can be performed by cameras at these different locations. During the work environment definition step, the cameras can be positioned at these locations, particularly by a person. Alternatively or additionally, the work environment definition step can include specifying GPS data for the work environment, whereby the area of ​​the work environment can be delimited using the specified GPS data. After defining the work environment, which may be done by a person within the work environment, that person can leave the work area.The working environment can also be defined by defining a predetermined area, in particular a concentric circular area around the construction machine, as the working environment.

[0010] Advantageously, a method is presented whereby, by defining the work environment, specific areas requiring monitoring can be identified and monitored during processing. This definition step allows the method to be adapted to different work environments at different construction sites. In particular, the area of ​​the work environment where construction work is being carried out can be monitored.

[0011] According to a further embodiment, the method can also include a step of determining information about the hazardous situation based on the image information if a hazardous situation exists. Information about the hazardous situation can describe the nature of the hazardous situation, for example, a risk to a person from potentially falling parts, approaching construction machinery, or building materials to be moved by construction machinery. The step of controlling the display device of the construction machinery can be performed based on the step of determining information about the hazardous situation. Information about the hazardous situation can be displayed on the display device of the construction machinery; for example, potentially falling parts in the work environment can be displayed to the operator of the construction machinery on the display device of the construction machinery.

[0012] According to another embodiment, the person can be located within the work environment during the step of determining information about the hazard. The person's location can be determined based on image information about the work environment. This step can occur before or during the determination of information about the hazard. Alternatively or additionally, the hazard source can be located within the work environment during the step of determining information about the hazard. This step can also be dependent on the location of the hazard source within the work environment. Information about the hazard can thus describe, for example, the spatial distance between the hazard source, such as a moving construction machine, and the person.

[0013] According to another embodiment, the step of determining information about the hazardous situation can involve manual input. This manual input can be performed, for example, by the operator of the construction machine or another person, such as in the control center. The input can be made, for example, via an input device on the construction machine, an input device in the control center, or another input device. The display device can include the input device, for example, by being designed as a touchscreen. The step of activating the display device on the construction machine can be dependent on the manual input. For example, the display device can indicate to the operator of the construction machine that a hazardous situation exists. The operator can then use the display device, which can also be used as an input device, to classify the hazardous situation.The display unit of the construction machine can then be controlled to show the hazard level according to its classification. This classification can be categorized into classes. For example, the operator can classify hazards as minor, medium, or major. Based on this classification, the hazard level can then be displayed on the control unit in yellow, orange, or red, respectively.

[0014] According to a further embodiment, the method, in the event of a hazardous situation, may include a step of controlling the construction machine. This involves controlling a tool of the construction machine, for example, a shovel or a demolition tool. The controlling process may include specifying a maximum radius of movement and, alternatively or additionally, a maximum speed of movement of the construction machine, particularly the tool. Following such a controlling process, the operator of the construction machine may only be able to control the machine, particularly the tool, within the specified radius of movement at a specified speed and acceleration. Alternatively or additionally, the controlling process may constitute a complete control of the movement of the construction machine, particularly the tool.In this process, the operator can no longer directly influence the movement of the construction machine, particularly the movement of the tool, through control inputs at the machine itself. During the initial control phase, the construction machine can be controlled in such a way that it, and especially the tool, is brought into a safe state. This safe state can be achieved by holding loads on the tool in the air, or alternatively or additionally by placing them on the ground. A safe state can also be achieved by braking the movement of the entire construction machine, particularly the tool. The initial control phase can also include delaying the actions to be performed by the construction machine. The machine can be controlled in such a way that, after a certain period of time, it can again be directly controlled by the operator. The initial control phase can be dependent on information regarding the hazardous situation.For example, if the person in the dangerous situation is standing close to the construction machine, it can be controlled differently than if the person is standing further away from the construction machine.

[0015] According to a further embodiment, the traction motors of the construction machine can be activated during the control step. The activation of the traction motors can be dependent on information about the hazardous situation. For example, braking, particularly emergency braking, of the construction machine can be initiated if it moves towards a person in the work area; alternatively or additionally, the construction machine can be maneuvered around a curve in such a way that it no longer endangers the person in the work area.

[0016] According to a further embodiment, the operator of the construction machine can, in a further step of the acknowledgment process, acknowledge the hazardous situation displayed on the display device. This acknowledgment step can be performed by the operator through input, in particular input on the display device, which may be designed as a touchpad. The step of controlling the construction machine can depend on the acknowledgment step; in particular, the construction machine can be controlled after the operator has acknowledged the hazardous situation, whereas before the operator has acknowledged the displayed hazardous situation, the construction machine may not be controllable or only partially controllable. This allows the operator's attention to be drawn to the existing hazardous situation before using the construction machine. This can increase the safety of people in the work environment. Alternatively or additionally, a person in the control center can acknowledge the displayed hazardous situation.The hazardous situation displayed in other construction machines, which represents the same hazardous situation, can also be acknowledged by a single acknowledgement, either by the operator of a construction machine or by a person in the control center.

[0017] According to a further embodiment, the method can also include a step of storing the image information if a hazardous situation exists. In addition to the image information, information about the hazardous situation can also be stored. This storage can take place on a storage medium. For example, the image information can be stored in a central memory, such as at the control center. Alternatively or additionally, the image information can be stored in a memory on the construction machine. Alternatively or additionally, image information can also be stored even if no hazardous situation exists. In this case, if no hazardous situation exists, the image information can be stored in a compressed format, and if a hazardous situation exists, the image information can be stored in an uncompressed format.This allows access to stored image information relating to past hazardous situations for documentation purposes. By compressing image information when no hazardous situation exists, storage space can be used optimally.

[0018] Another aspect of the invention relates to a control device for monitoring construction work, wherein the construction work is carried out with a construction machine within a work environment. The control device can be configured to perform the method according to the preceding aspect of the invention. The control device has a first interface for reading image information about the work environment. The control device has a processing unit for determining, based on the image information, whether a hazardous situation exists for a person in the work environment by checking whether a person is present in the work area according to the image information. Furthermore, the control device has a second interface for outputting a control signal to activate a display device of the construction machine.By activating the display unit of the construction machine, a warning can be issued on the machine's display unit if a hazardous situation exists. The control unit can be configured to control the display units of multiple construction machines and, alternatively or additionally, to control a display unit in a control center. The first and second interfaces can be physically separate or combined. The control unit is portable, housed in a box, and can also be mobile, for example, within the construction machine. Alternatively, the control unit can be stationary, for example, in a control center.

[0019] Another aspect of the invention relates to a system for monitoring construction work, comprising a control device according to a preceding aspect of the invention and a camera for capturing image information about the working environment of the construction machine. Alternatively or additionally, the system includes an audio microphone for capturing audio information, in particular voices. Alternatively or additionally, the system includes an accelerometer for capturing acceleration information about the working environment. For example, the control device, or at least the accelerometer, can be located on the construction machine or, alternatively or additionally, at a stationary location within the working environment. During construction work, acceleration can act on the accelerometer, which can be detected by the accelerometer and used for monitoring construction work in the form of acceleration information.The control unit and the camera can form a compact system, meaning a system located at a single point. Alternatively, the system can be a distributed system, with the control unit and the camera located at two different locations. The system can also include one or more additional cameras. Advantageously, the control unit can be located at one of the cameras or, alternatively or additionally, at the control station or on the construction machine. Transceiver devices can be provided for communication within the distributed system between the control unit and the camera, and especially between the control unit and the display unit. The system, particularly as a distributed system, can include a battery, allowing the camera and, alternatively or additionally, the control unit to operate autonomously. This enables flexible deployment of the system on construction sites, particularly independent of a power supply.The system can further comprise a box, in particular a robust box, containing parts of the system or the entire system. By providing the box, the control unit and, alternatively or additionally, one or more cameras can be protected from unwanted interference caused by construction work in the work environment. Each box can, for example, contain a control unit and a camera. In the case of the distributed system, one of the control units can function as the master control unit and all other control units as slave control units. The master control unit can execute the method according to a preceding aspect of the invention, and the slave control units can be configured to transmit only the image information captured by the respective cameras to the master control unit.

[0020] This results in a particularly robust and flexible system. Furthermore, the boxes can be marked with highly visible colors, especially yellow or orange. This allows the box to be easily located after completion of the work, particularly demolition work, and reused at another construction site in the future.

[0021] According to a further embodiment, the system can also include a construction machine, wherein the construction machine has a receiver for receiving the control signal to actuate a display device and a display device for indicating the hazardous situation. Alternatively, the system can include more than one construction machine, each with its own display device. In the case of multiple construction machines, distributed work within the work environment can be implemented by the system, with the work environment being monitored. Brief description of the characters Fig. Figure 1 shows steps of a procedure for monitoring construction work according to one embodiment. Fig. Figure 2 shows a control device for monitoring construction work and a system with such a control device and a construction machine according to one embodiment. Detailed description of embodiments

[0022] Fig. Figure 1 shows steps of a procedure for monitoring construction work according to one embodiment. Fig.Figure 2 shows a control device 2 for monitoring construction work and a system comprising such a control device 2 and a construction machine 4 according to one embodiment. In step S1.0, the work environment is defined. In this step, personnel place cameras 14a, 14b, and 14c within the work environment, independently of the construction machine 4. The cameras 14a-c are positioned so that the work environment can be captured as completely as possible by the cameras 14a-c. The method further includes step S1 for acquiring image information about the defined work environment. Each camera 14a-c captures a sub-area of ​​the work environment. The method further includes step S2 for reading image information about the work environment. In the embodiment shown, camera 14a is placed in a box 16 with the control device 2. Cameras 14b and 14c are placed in separate boxes (not shown) with their respective control devices (not shown).Each box also contains a transceiver for communication between the boxes. The control units and transceivers associated with cameras 14b and 14c are configured to send the image information captured by cameras 14b and 14c to control unit 2. Camera 14a is configured to send the image information captured by camera 14a to control unit 2. The image information is read in step S2 via a first interface 6 of control unit 2. A processing unit 8, which is part of control unit 2, is connected to the first interface 6. The processing unit 8 is configured to determine, in step S3, whether a hazardous situation exists for a person. Specifically, the processing unit 8 is configured to check the image information from cameras 14a-c to see if a person is present in the work area.The processing unit 8 is configured to determine information about the hazardous situation. Specifically, the processing unit 8 determines the distance between the person in the work environment and the construction machine 4 located in the work environment. Based on the image information received about the work environment, the processing unit 8 locates the person and the construction machine 4. Image information from at least two of the cameras 14a-c is used for this purpose. The control unit 2 has a second interface 10, which is connected to the processing unit 8. The processing unit 8 is configured to control a display unit 12 of the construction machine 4 in step S4. Specifically, the processing unit 8 is configured to send a signal to the construction machine 4 via the second interface 10. This transmission is wireless via radio using transmitter / receiver devices not shown.In step S4.1, the operator of construction machine 4, located inside the machine, acknowledges the hazardous situation displayed on the display unit 12. This is made possible by the display unit 12 acting as an additional input device. The display / input device 12 is designed as a touchpad. In step S5, the processing unit 8 is configured to control construction machine 4. This control is triggered based on information about the hazardous situation, specifically the distance between the person in the work environment and construction machine 4. The processing unit 8 controls the machine in such a way that, before acknowledging the displayed hazardous situation in step S4.1, the operator cannot operate construction machine 4. After acknowledging the hazardous situation in step S4.1, the operator can again operate and control construction machine 4.Furthermore, the procedure includes a step S6 for storing the image information. The processing unit 8 is configured to store image information and information about the hazard situation in a storage device not shown in detail. Reference sign 2 Control unit 4 Construction machine 6 first interface 8 computing units 10 second interface 12 Display device 14a-c camera 16 Box S1.0 (Step) Defining the work environment S1 (Step) Capturing image information about the defined work environment S2 (Step) Reading in image information about the work environment S3 (Step) Determine whether a person is in danger S3.1 (Step) Determining information about the hazard situation S4 (Step) Controlling a display device S4.1 (Step) Acknowledging the indicated hazard S5 (Step) Controlling the construction machine S6 (Step) Saving image information

Claims

[1] Method for monitoring construction work, wherein the construction work is carried out with a construction machine (4) within a work environment, comprising the steps: reading (S2) image information about the work environment, wherein the image information is independent of the positioning of the construction machine (4) in the work environment, determining (S3) depending on the image information whether a hazardous situation exists for a person in the work environment by checking whether, according to the image information, a person is in the work environment, and, if a hazardous situation exists, controlling (S4) a display device (12) of the construction machine (4), wherein the display device (12) is a display in the construction machine (4). [2] Method according to claim 1, further comprising a step of capturing (S1) image information about the work environment, wherein the image information is captured at different locations in the work environment. [3] Method according to claim 2, further comprising a step of defining (S1.0) the working environment, wherein in the step of capturing (S1) image information about the defined working environment is captured. [4] Method according to one of the preceding claims, further comprising, if a dangerous situation exists, a step of determining (S3.1) information about the dangerous situation depending on the image information. [5] Method according to claim 4, wherein for the step of determining (S3.1) information on the hazard situation the person is located in the work environment. [6] Method according to claim 4 or 5, wherein manual input is performed for the step of determining (S3.1) information on the hazard situation. [7] Method according to one of the preceding claims, further comprising, if a dangerous situation exists, a step of controlling (S5) the construction machine (4). [8] Method according to claim 7, wherein in the actuation step (S5) traction motors of the construction machine (4) are actuated. [9] Method according to one of the preceding claims, wherein in a further step of acknowledgment (S4.1) a vehicle operator of the construction machine (4) can acknowledge the dangerous situation displayed in the display device (12). [10] Method according to any of the preceding claims, further comprising, if a dangerous situation exists, a step of storing (S6) the image information. [11] Control device (2) for monitoring construction work, wherein the construction work is carried out with a construction machine (4) within a work environment and wherein the control device (2) is portable in a box (16), the control device (2) comprising: a first interface (6) for reading image information about the work environment, a computing unit (8) for determining, depending on the image information, whether there is a hazardous situation for a person in the work environment by checking whether a person is present in the work environment according to the image information, and a second interface (10) for outputting a control signal to control a display device (12) of the construction machine (4), wherein the display device (12) is a display in the construction machine (4). [12] System for monitoring construction work, comprising a control device (2) according to claim 11 and a camera (14a; 14b; 14c) for capturing image information about the working environment of the construction machine (4), further comprising a construction machine (4), wherein the construction machine (4) has a receiver device for receiving the control signal for controlling a display device (12) and a display device (12) for indicating the hazardous situation, wherein the display device (12) is a display in the construction machine (4).

Images