Construction management device

Abstract

To provide a construction management device, method, and program capable of grasping a progress state of construction of a building.SOLUTION: A construction management device 100 comprises: a three-dimensional model data creation unit 201 that creates three-dimensional model data of an entire construction site on the basis of three-dimensional models of terrains and buildings based on surveying data of the construction site and surrounding terrains and buildings; a construction plan data acquisition unit 202 that acquires construction plan data of the construction site; a simulation site model generation unit 203 that generates a simulation site model representing a state of the construction site at a specified time point on the basis of the construction plan data, the three-dimensional model data, and three-dimensional models of construction machines used at the construction site; an image acquisition unit 204 that acquires an image of the construction site from an imaging instrument installed at the construction site; a data acquisition unit 205 that acquires orientation data of the imaging instrument and capture date-and-time data of the image; and a display control unit 206 that displays the simulation site model and the image on a display instrument on the basis of the acquired orientation data and capture date-and-time data.SELECTED DRAWING: Figure 2A

Description

[Technical Field]

[0001] The present invention relates to a construction management device. [Background technology]

[0002] In the above technical field, Patent Document 1 discloses that a simulation image of the sunlight conditions in an apartment and the view from the apartment is generated based on data such as the layout and number of floors of the apartment and data such as the topography of the city in which the apartment is located (see paragraphs

[0036] to

[0046] of the same document, etc.). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2000-149049 Summary of the Invention [Problem to be solved by the invention]

[0004] However, although the technology described in Patent Document 1 can simulate a living environment, it cannot grasp the progress of construction of a building, for example, and therefore cannot manage the construction of a building. [Means for solving the problem]

[0005] In order to achieve the above object, the construction management device according to the present invention comprises: a three-dimensional model data creation unit that creates a three-dimensional model of the terrain and the buildings based on survey data obtained by surveying the construction site and its surrounding terrain, and the buildings existing at the construction site and its surrounding terrain, and further creates three-dimensional model data of the entire construction site based on the three-dimensional models of the terrain and the buildings; a construction plan data acquisition unit that acquires construction plan data for construction work to be carried out at the construction site; a simulation site model generation unit that simulates the state of the construction site based on the construction plan data, the three-dimensional model data, and a three-dimensional model of a construction machine used at the construction site, and generates a simulation site model; an image acquisition unit that acquires an actual image of the construction site from at least one imaging device installed at the construction site; a data acquisition unit that acquires data on the orientation of the at least one imaging device and data on the date and time of capture of the video; a display control unit that adjusts the display of the simulation site model based on the orientation data and the shooting date and time data acquired by the data acquisition unit, and displays the simulation site model and the video on a predetermined display device; Equipped with.

[0006] In order to achieve the above object, the construction management method according to the present invention comprises: a three-dimensional model data creation step of creating a three-dimensional model of the topography and the buildings on the construction site based on survey data obtained by measuring the topography and the surrounding areas, and the buildings on the construction site and the surrounding areas, and further creating three-dimensional model data of the entire construction site based on the three-dimensional models of the topography and the buildings; a construction plan data acquisition step for acquiring construction plan data for construction work to be performed at the building site; a simulation site model generation step of simulating the state of the construction site based on the construction plan data, the three-dimensional model data, and a three-dimensional model of a construction machine used at the construction site, and generating a simulation site model; an image capturing step of capturing an actual image of the construction site from at least one imaging device installed at the construction site; a data acquisition step of acquiring data on the orientation of the at least one imaging device and data on the date and time of capturing the video; a display control step of adjusting the display of the simulation site model based on the orientation data and the shooting date and time data acquired by the data acquisition unit, and displaying the simulation site model and the video on a predetermined display device; Includes:

[0007] Furthermore, in order to achieve the above object, the construction management program according to the present invention comprises: a three-dimensional model data creation step of creating a three-dimensional model of the topography and the buildings on the construction site based on survey data obtained by measuring the topography and the surrounding areas, and the buildings on the construction site and the surrounding areas, and further creating three-dimensional model data of the entire construction site based on the three-dimensional models of the topography and the buildings; a construction plan data acquisition step for acquiring construction plan data for construction work to be performed at the building site; a simulation site model generation step of simulating the state of the construction site based on the construction plan data, the three-dimensional model data, and a three-dimensional model of a construction machine used at the construction site, and generating a simulation site model; an image capturing step of capturing an actual image of the construction site from at least one imaging device installed at the construction site; a data acquisition step of acquiring data on the orientation of the at least one imaging device and data on the date and time of capturing the video; a display control step of adjusting the display of the simulation site model based on the orientation data and the shooting date and time data acquired by the data acquisition unit, and displaying the simulation site model and the video on a predetermined display device; to be executed by the computer. [Effects of the Invention]

[0008] According to the present invention, construction management of a building can be carried out. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 2 is a diagram for explaining an outline of the operation of the construction management device according to the first embodiment of the present invention. [Figure 2A] 1 is a block diagram for explaining the configuration of a construction management device according to a first embodiment of the present invention. [Figure 2B] 3 is a diagram showing an example of a screen displayed by the construction management device according to the first embodiment of the present invention. FIG. [Figure 2C] 3 is a diagram showing an example of a screen displayed by the construction management device according to the first embodiment of the present invention. FIG. [Figure 2D] 3 is a diagram showing an example of a screen displayed by the construction management device according to the first embodiment of the present invention. FIG. [Figure 2E] 3 is a diagram showing an example of a screen displayed by the construction management device according to the first embodiment of the present invention. FIG. [Figure 2F] 3 is a diagram showing an example of a screen displayed by the construction management device according to the first embodiment of the present invention. FIG. [Figure 3A] 3 is a diagram for explaining an example of a display position control table included in the construction management device according to the first embodiment of the present invention. FIG. [Figure 3B] 3 is a diagram for explaining an example of a viewpoint information table included in the construction management device according to the first embodiment of the present invention. FIG. [Figure 4] 1 is a diagram for explaining the hardware configuration of a construction management device according to a first embodiment of the present invention. [Figure 5] 3 is a flowchart for explaining a processing procedure of the construction management device according to the first embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described in detail by way of example with reference to the drawings. However, the configurations, numerical values, processing flows, functional elements, etc. described in the following embodiments are merely examples, and are open to modification and alteration, and are not intended to limit the technical scope of the present invention to the following description.

[0011] [First embodiment] A construction management device 100 according to a first embodiment of the present invention will be described with reference to FIGS. 1 to 5. An overview of building construction management using the construction management device 100 will be described with reference to FIG. 1. The construction management device 100 is a device that adjusts a simulation site model 120 representing the progress of construction at a construction site 110 and an actual video 130 of the construction site 110 so that they are viewed from the same viewpoint, and displays them on a display 140. The construction management device 100 is used, for example, for construction management of a building 150. Note that buildings whose construction is managed by the construction management device 100 are not limited to buildings, and may also be, for example, houses, sports facilities, roads, bridges, port facilities, dams, airports, etc.

[0012] First, the construction management device 100 creates three-dimensional model data 121 that is a three-dimensional model of the entire construction site 110 based on survey data 113 of the construction site 110 and its surrounding terrain 111, and of buildings 112 that exist at the construction site and its surroundings. The survey data 113 was obtained by surveying the construction site 110 before construction began. In other words, the three-dimensional model data 121 is a three-dimensional model of the construction site 110 before construction began.

[0013] Next, the construction management device 100 simulates the state of the building site 110 at all times during the construction period based on the construction plan data 160, the three-dimensional model data 121, and the three-dimensional model 122 of the construction machinery, and generates the simulation site model 120. In the simulation site model 120, a three-dimensional model 123 of the portion of the construction work scheduled to be completed at each time point during the construction period, and a three-dimensional model 122 of the construction machinery required for the construction work scheduled to be performed at that time, are arranged at the locations where they are scheduled to be arranged.

[0014] The construction site 110 is also photographed in real time by imaging equipment such as at least one fixed camera 131. The construction management device 100 acquires, in real time, video footage photographed by the fixed camera 131, i.e., actual video 130 of the construction site 110. Furthermore, the construction management device 100 acquires data 131a on the orientation of the fixed camera 131 that photographed the video 130, and data 131b on the date and time the video 130 was photographed.

[0015] Then, construction management device 100 displays simulation site model 120 and video 130 on display 140. At this time, construction management device 100 adjusts the display of simulation site model 120 based on data 131a on the orientation of fixed camera 131 and data 131b on the date and time of shooting of video 130. Specifically, the simulation site model 120, whose date and time during the construction period is the same as the date and time of shooting of video 130, is adjusted so that it is viewed from the same viewpoint as the viewpoint of fixed camera 131 in video 130, and then displayed on display 140.

[0016] An operator of the construction management device 100 can understand the progress of construction at the construction site 110 by comparing the simulated site model 120 and the video 130 displayed on the display 140. For example, by comparing the construction machinery 133 that is actually placed and the portion 134 where construction has actually been completed in the video 130 with the three-dimensional models 122, 123 in the simulated site model 120, the operator can understand whether the construction work at the construction site 110 is progressing as planned. In addition, the simulated site model 120 and the video 130 displayed on the display 140 are adjusted so that they appear to be viewed from the same viewpoint, making it easy to compare the two.

[0017] 2A, the configuration of the construction management device 100 will be described. The construction management device 100 includes a three-dimensional model data creation unit 201, a construction plan data acquisition unit 202, a simulation site model generation unit 203, an image acquisition unit 204, a data acquisition unit 205, and a display control unit 206.

[0018] The three-dimensional model data creation unit 201 creates a three-dimensional model of the terrain 111 and the buildings 112 based on surveying data obtained by surveying the construction site 110 and its surrounding terrain 111, as well as the construction site 110 and the buildings 112 existing therein, and further creates three-dimensional model data 121 of the entire construction site 110 based on the three-dimensional models of the terrain 111 and the buildings 112.

[0019] Specifically, the three-dimensional model data creation unit 201 first creates three-dimensional models of the terrain 111 and the building 112 based on the survey data 113. Then, the three-dimensional model of the terrain 111 and the three-dimensional model of the building 112 are combined to create three-dimensional model data 121 of the entire construction site 110.

[0020] The survey of the terrain 111 and the buildings 112 may be carried out by workers or the like using rulers such as a straight ruler, a curved ruler, or a tape measure. Alternatively, workers or the like may carry out the survey using a transit, a theoride, a total station, or the like. Furthermore, the survey may be carried out using three-dimensional surveying such as aerial photogrammetry, airborne laser surveying, vehicle-mounted photo laser surveying, UAV photo point cloud surveying, UAV laser surveying, terrestrial laser surveying, airborne laser sounding, and multi-beam sounding. The terrain 111 and the buildings 112 may be surveyed separately, or the terrain 111 and the buildings 112 may be surveyed together.

[0021] The three-dimensional model data creation unit 201 may acquire survey data directly or indirectly from a surveying instrument. For example, the survey data acquired by the surveying instrument may be stored in a storage medium separate from the surveying instrument, and the survey data may be acquired from the storage medium. Alternatively, an operator may input the survey data into the construction management device 100 using an input device such as a keyboard, and the three-dimensional model data creation unit 201 may acquire the input survey data.

[0022] The construction plan data acquisition unit 202 acquires construction plan data 160 for construction work to be carried out at the construction site 110. The construction plan data 160 includes information such as the type, number, and location of construction machinery to be used, a blueprint for the building 150, and a schedule for the construction work to be carried out at the construction site 110. The construction plan data 160 may be created by a device other than the construction management device 100, for example, a device equipped with software required to create the construction plan data 160. An example of the aforementioned software is CAD (Computer Aided Design). The construction plan data acquisition unit 202 may acquire the construction plan data 160 directly or indirectly from a device other than the construction management device 100.

[0023] The simulation site model generation unit 203 simulates the state of the construction site 110 at all times during the construction period based on the construction plan data 160, the three-dimensional model data 121, and the three-dimensional model 122 of the construction machinery used at the construction site 110, and generates the simulation site model 120.

[0024] Specifically, the simulation site model generation unit 203 generates a three-dimensional model 123 of the planned completed portion of the building 150 at each point in time during the construction period based on the construction plan data 160. The simulation site model generation unit 203 also acquires information such as the type, number, and location of construction machinery required for the construction work being carried out at each point in time during the construction period from the construction plan data 160. Next, the simulation site model generation unit 203 acquires a three-dimensional model 122 of the construction machinery included in the acquired information from a storage medium that stores three-dimensional models of all construction machinery used in the construction work being carried out at the building site 110. Then, for each point in time during the construction period, the three-dimensional models 122, 123 and the three-dimensional model data 121 are arranged in a predetermined positional relationship planned in the construction plan data 160 to generate the simulation site model 120. The simulation site model 120 simulates the state of the construction site 110 if the construction work up to each point in time during the construction period were to proceed according to the construction plan data 160. It should be noted that if the construction plan data 160 includes the three-dimensional model 122, it is not necessarily necessary to acquire the three-dimensional model 122 from the storage medium described above.

[0025] The video acquisition unit 204 acquires a real video 130 of the construction site 110 from at least one imaging device installed at the construction site 110. The video acquisition unit 204 acquires the video 130 in real time. The video acquisition unit 204 also acquires the video 130 directly from the imaging device.

[0026] An example of the imaging device is a fixed camera 131. The fixed camera 131 is an optical camera capable of capturing visible light. The orientation and magnification of the fixed camera 131 are changeable. It is preferable that the fixed camera 131 constantly captures the construction site 110 during the construction period. It is also preferable that the fixed camera 131 be able to record the orientation of the fixed camera and the date and time of capture along with the video 130.

[0027] The number of fixed cameras 131 may be one or more. The fixed cameras 131 are preferably installed so as to avoid blind spots at the construction site 110. The installation position of the fixed cameras 131 may remain the same throughout the construction period or may be changed according to the progress of the construction. By changing the installation position of the fixed cameras 131 according to the progress of the construction, the fixed cameras 131 can be placed at positions at the construction site 110 where the areas of the construction site 110 where progress is desired to be confirmed can be reliably photographed. A camera mounted on a UAV (unmanned aerial vehicle) such as a drone may be used as a measuring device in combination with the fixed cameras 131. By using a camera mounted on a drone or the like as a measuring device, it is possible to easily capture images of any position at the construction site 110. For example, it is possible to photograph areas that cannot be photographed by the fixed cameras 131, capture areas that require more attention up close, or photograph the construction site 110 from a bird's-eye view.

[0028] The data acquisition unit 205 acquires orientation data 131a of at least one image capture device and image capture date and time data 131b. As described above, the orientation data 131a and the image capture date and time data 131b are recorded in association with the image 130 and can be acquired from the image 130.

[0029] The orientation data 131a is data on the orientation of the fixed camera 131 when the video 130 was captured, specifically data on the horizontal angle of the fixed camera 131. The capture date and time data 131b is data indicating the date and time when the fixed camera 131 captured the video 130.

[0030] In this embodiment, before starting to capture the video 130 with the fixed camera 131, it is preferable to store data on the orientation of the fixed camera 131 when the fixed camera 131 is facing north in the construction management device 100 as reference data for the orientation of the fixed camera 131. Specifically, first, the needle of a compass is captured by the fixed camera 131. Then, the left-right angle of the fixed camera 131 is set so that the direction pointed by the needle of the compass in the captured video is parallel to the up-down direction of the screen displaying the captured video. In this way, the fixed camera 131 is directed north. Then, data on the left-right angle of the fixed camera 131 when the fixed camera 131 is facing north is stored as reference data.

[0031] The data acquisition unit 205 also acquires vertical angle data and height data of the fixed camera 131 that acquired the orientation data 131a. The vertical angle data may be acquired from the fixed camera 131, as with the orientation data 131a, or may be acquired from the recorded data of the video 130. The height data can be acquired, for example, by measuring the height of the fixed camera 131 installed at the construction site 110. The height of the fixed camera 131 is, for example, the height of the fixed camera 131 from a benchmark near the construction site 110. The height of the fixed camera 131 is the same as the height of the viewpoint of the video 130.

[0032] The display control unit 206 adjusts the display of the simulation site model 120 based on the orientation data 131a and the shooting date and time data 131b acquired by the data acquisition unit 205, and displays the simulation site model 120 and the video 130 on a predetermined display device. Specifically, first, based on the shooting date and time data 131b, from all of the generated simulation site models 120, selects one whose date and time during the construction period is the same as the shooting date and time of the video 130. Then, based on the orientation data 131a, adjusts the display of the selected simulation site model 120 so that it is displayed as seen from the same viewpoint as the viewpoint of the video 130. In this embodiment, the display control unit 206 uses the vertical angle data and height data of the fixed camera 131 in addition to the orientation data 131a to adjust the display of the simulation site model 120.

[0033] The following describes a method for adjusting the display of the selected simulation site model 120. First, the orientation data 131a is compared with the reference data to calculate the azimuth angle of the fixed camera 131 with north as the reference. Furthermore, the elevation and depression angles of the fixed camera 131 are calculated from the data on the vertical angle of the fixed camera 131.

[0034] Then, the simulation site model 120 is adjusted so that the azimuth angle, elevation angle, and viewpoint height of the simulation site model 120 are the same as the azimuth angle, elevation angle, and height of the fixed camera 131. In this way, the display of the simulation site model 120 is adjusted so that it is displayed from the same viewpoint as the viewpoint of the video 130.

[0035] The predetermined display device that displays the simulation site model 120 and the video 130 is, for example, the display 140. The display device may also be a smartphone, a tablet terminal, or the like. FIG. 2B shows an example of a display screen 250 that the display control unit 206 causes the display 140 to display. On the display screen 250, the simulation site model 120 and the video 130 are displayed side by side, specifically side by side. The simulation site model 120 and the video 130 may also be displayed side by side vertically.

[0036] The simulation site model 120 and the video 130 displayed on the display screen 250 are viewed from the same viewpoint. Therefore, when viewing the display screen 250, the simulation site model 120 and the video 130 can be easily compared.

[0037] Comparing the simulation site model 120 and the video 130 displayed on the display screen 250, it can be seen that the three-dimensional model 123 of the portion of the building 150 for which construction is scheduled to be completed in the simulation site model 120 is taller than the portion 134 of the building 150 for which construction has been completed in the video 130. In other words, it can be seen that the portion that has been constructed in the simulation site model 120 is not yet constructed in the video 130. Therefore, an operator looking at the display screen 250 can understand that the construction at the building site 110 is behind schedule as planned in the construction plan data 160. If there is a delay in the progress of construction, the operator can take the necessary measures to ensure the construction proceeds smoothly, such as adjusting the construction schedule or increasing the number of workers working at the building site 110.

[0038] Furthermore, by comparing the simulation site model 120 with the video 130, it is possible to determine whether, for example, the placement positions of the construction machinery 133 and the three-dimensional model 122 are different. In Fig. 2B, the placement positions of the construction machinery 133 and the three-dimensional model 122 are the same. Therefore, it can be seen that the construction work is progressing according to the construction plan data 160.

[0039] On the other hand, if the placement position of the construction machine 133 differs between the construction site 110 and the three-dimensional model 122, this may be due to, for example, the presence of an unexpected obstacle at the actual construction site 110, making it impossible to place the construction machine 133 at the planned location. Examples of obstacles include utility poles and roadside trees. Other examples of obstacles include debris of a previous building or rocks exposed by excavation work. When such an obstacle is present, the operator can promptly consider whether the obstacle can be removed, and whether the order of work processes to be performed at the construction site 110 or the access route for the construction machine 152, etc., needs to be changed from those planned in the construction plan data 160.

[0040] The following may also be considered as a reason why the placement positions of the construction machinery 133 and the three-dimensional model 122 differ: During construction work, it is discovered that an underground structure such as a sewer pipe is buried underground where the three-dimensional model 122 is placed, and the weight of the construction machinery 133 exceeds the upper limit of the weight of construction machinery that can be placed at that location. Even in such a case, the operator can promptly consider whether or not it is necessary to change the order of work processes to be performed at the construction site 110 or the access route for the construction machinery 152 from what was planned in the construction plan data 160.

[0041] Another possible cause is that construction machinery used for a construction project other than the construction being carried out at the construction site 110 is located near the construction site 110, and if the construction machinery 133 is located at the planned position, it may interfere with the construction machinery used for the other project. Even in such a case, the operator can consider in a timely manner whether or not it is necessary to change the order of the work processes to be carried out at the construction site 110 or the access route for the construction machinery 152 from what was planned in the construction plan data 160.

[0042] The image 130 displayed by the display control unit 206 is an image of the construction site 110 at the current time. To display the image of the construction site 110 at the current time in real time, first, the fixed camera 131 captures an actual image of the construction site 110 in real time. Then, the image acquisition unit 204 acquires the actual image of the construction site 110 captured in real time in real time. Furthermore, the display control unit 206 displays the image 130 acquired in real time in real time.

[0043] In order to display the current video 130 in real time, it is preferable that the fixed camera 131 and the construction management device 100 are connected via a wireless or wired communication network. The fixed camera 131 and the construction management device 100 may be connected directly or via a repeater. The wireless communication network may be compatible with, for example, LTE (Long Term Evolution), a fourth-generation mobile communication system, a fifth-generation mobile communication system, satellite communication, Bluetooth (registered trademark), Wi-Fi (registered trademark), etc. The communication network connecting the fixed camera 131 and the construction management device 100 may also be a combination of a wireless communication network and a wired communication network. Furthermore, when a communication standard with a relatively short communication distance, such as Bluetooth (registered trademark) or Wi-Fi (registered trademark), is used to connect the fixed camera 131 and the construction management device 100, one or more repeaters may be used between them.

[0044] Furthermore, a viewpoint change controller 258 is also displayed on the display screen 250. The viewpoint change controller 258 is used to change the orientation of the fixed camera 131 and change the range (the viewpoint of the image) projected as the image 130. By operating the viewpoint change controller 258, the orientation of the fixed camera 131 can be changed as desired.

[0045] When the viewpoint of the video 130 is changed by the viewpoint change controller 258, the viewpoint of the simulation site model 120 is changed accordingly by the display control unit 206. Specifically, when the viewpoint of the video 130 is changed by the viewpoint change controller 258 and the azimuth angle and elevation / depression angle of the fixed camera 131 are changed, the azimuth angle and elevation / depression angle of the simulation site model 120 become the same as the azimuth angle and elevation / depression angle of the fixed camera 131 after the change. In this way, the viewpoint of the simulation site model 120 is changed in accordance with the viewpoint of the video 130, so that both are maintained as viewed from the same viewpoint, making it even easier to compare the simulation site model 120 and the video 130.

[0046] The display screen 250 may also display a zoom controller for zooming in and out of the image 130. When the image 130 is zoomed in and out using the zoom controller, the display control unit 206 preferably zooms in and out of the simulation site model 120 in conjunction with the image 130.

[0047] For example, by enlarging the part of the construction site 110 where construction work is currently being carried out, or by reducing the size of the video 130 so that the construction site 110 can be viewed from above, it is possible to make it easier to see the parts of the video 130 that you want to focus on.

[0048] Here, the display control unit 206 may store the video 130 and the simulation site model 120 displayed on the display screen 250 in a storage medium. For example, the display screen 250 on which the video 130 and the simulation site model 120 are displayed may be stored as video. The storage medium may be provided in the fixed camera 131 or the construction management device 100, or may be provided in a device other than the construction management device 100 or the imaging device. When storing the video on the display screen 250 in a storage medium, the video may be stored as is, or the frame rate of the video may be reduced and the video may be stored as so-called time-lapse video. Storing the video on the display screen 250 as time-lapse video reduces the amount of data for the video.

[0049] A seek bar 259 is displayed on the display screen 250. The seek bar 259 is used to change the video 130 displayed on the display screen 250 to the video 130 at any date and time. Specifically, when the seek bar 259 is operated, the display control unit 206 displays the display screen 250 at a past time, and can display the video 130 of the past construction site 110 and the simulation site model 120.

[0050] For example, the current progress of construction work can be understood by displaying past video 130. Also, if a problem occurs at the current construction site 110, the cause of the problem can be identified by reviewing past video 130.

[0051] 2B , the display control unit 206 may also display information other than the simulation site model 120 and the video 130 simultaneously with the simulation site model 120 and the video 130. Specifically, at least one of construction information 251, equipment information 252, personnel information 253, work information 254, weather information 255, warning information 256, and environmental information 257 may also be displayed.

[0052] The construction information 251 is information about construction work being carried out at the construction site 110. Examples of the construction information 251 include the name of the construction work, the contractor for the construction work, the address of the construction site 110, the construction price, and the construction details.

[0053] The equipment information 252 is information about the equipment delivered to the construction site 110. Examples of the equipment information 252 include the name of the equipment, the total number of pieces of equipment, the number of pieces of equipment in operation, the operating hours of the operating equipment, the names of users of the operating equipment, and the number of pieces of equipment that are out of service.

[0054] The personnel information 253 is information about personnel working at the construction site 110. Examples of the personnel information 253 include the total number of personnel at the construction site 110, the number of personnel for each task being performed at the construction site 110, and the number of personnel for each company involved in the construction work.

[0055] The work information 254 is information about work to be performed at the construction site 110. Examples of the work information 254 include a work schedule for a specific date, such as a time specified when creating the simulation site model 120, the progress rate for each work process to be performed at the construction site 110, and the progress rate for all work to be performed at the construction site 110.

[0056] The weather information 255 includes, for example, the weather at the construction site 110, temperature, humidity, air pressure, sunrise time, sunset time, and the like.

[0057] The warning information 256 includes, for example, warnings and advisories regarding strong winds, thunderstorms, photochemical smog, heat stroke, and the like.

[0058] The environmental information 257 may include, for example, noise levels at the construction site 110, vibration measurements, PM2.5 measurements, PM10 measurements, wind direction, wind speed, CO2 emissions, and whether or not there are traffic restrictions around the construction site 110.

[0059] Next, another method in which the display control unit 206 displays the simulation site model 120 and the video 130 will be described with reference to FIGS. 2C to 2F.

[0060] 2C, a model display section 261a and an appearance display section 262a are displayed as main display sections. The model display section 261a displays the simulation site model 120 as viewed obliquely. The appearance display section 262a displays an image 130 of the actual construction site 110 as viewed obliquely. A model list display section 261b is displayed to the left of the model display section 261a. An appearance list display section 262b is displayed to the right of the appearance display section 262a.

[0061] The model list display section 261b displays an image of the simulation site model 120 as viewed from a different viewpoint from that of the simulation site model 120 displayed in the model display section 261a. Specifically, the model list display section 261b displays, in order from the top, images of the simulation site model 120 as viewed from the front, right side, left side, and back.

[0062] Note that the model list display section 261b may display an image of the simulation site model 120 as viewed from a viewpoint different from the viewpoints described above. Furthermore, the number of images of the simulation site model 120 displayed in the model list display section 261b is not limited to four, and may be three or less, or five or more.

[0063] The appearance list display section 262b displays images of the video 130 when the actual construction site 110 is viewed from a different viewpoint than the video 130 displayed in the appearance display section 262a. Specifically, the appearance list display section 262b displays, from top to bottom, images of the video 130 when the actual construction site 110 is viewed from the front, right side, left side, and back.

[0064] The appearance list display section 262b may display images of the video 130 when the actual construction site 110 is viewed from a viewpoint different from the viewpoints described above. Furthermore, the number of images of the video 130 displayed in the appearance list display section 262b is not limited to four, and may be three or less, or five or more.

[0065] The following description will be given taking the simulation site model 120, the model display section 261a, and the model list display section 261b as examples, but the same description also applies to the image 130, the appearance display section 262a, and the appearance list display section 262b.

[0066] The model list display section displays a list of images of the simulation site model 120 that can be displayed in the model display section 261a. The image of the simulation site model 120 displayed in the model list display section 261b can be used as the simulation site model 120 displayed in the model display section 261a.

[0067] Specifically, when any of the images displayed in the model list display section 261b is clicked, the clicked image is displayed as the simulation site model 120 in the model display section 261a.

[0068] For example, when the top image of the images displayed in the model list display section 261b is clicked, the image of the simulation site model 120 as viewed from the front, which has been displayed at the top of the model list display section 261b until now, is displayed in the model display section 261a as the simulation site model 120. Then, the image of the simulation site model 120 as viewed obliquely, which has been displayed in the model display section 261a until now, is displayed at the top of the model list display section 261b.

[0069] In this way, by clicking on an image of the simulation site model 120 from the model list display section 261b that corresponds to a viewpoint that the user wishes to display in the model display section 261a, the image can be displayed in the model display section 261a as the simulation site model 120. In other words, the image from the viewpoint that the user wishes to observe in detail can be displayed in the model display section 261a, which is the main display section.

[0070] By displaying the simulation site model 120 and the video 130 from multiple different viewpoints, it is possible to compare the simulation site model 120 and the video 130 from each viewpoint at once, allowing for a more detailed comparison of the two.

[0071] In FIG. 2D, the simulation site models 120 and the images 130 are displayed in chronological order with different specified dates and times. For example, the simulation site models 120 for the current time, one week prior to the current time, and two weeks prior to the current time are displayed in the first time point model display area 271a, the second time point model display area 271b, and the third time point model display area 271c, respectively. Note that the simulation site models 120 displayed in the first to third time point model display areas 271a to 271c are not limited to those for the above-mentioned time points. Furthermore, the simulation site models 120 for two different time points may be displayed, or the simulation site models 120 for four or more different time points may be displayed.

[0072] The images 130 are also displayed in chronological order, similar to the simulation site model 120. For example, images 130 from the current time point, one week prior to the current time point, and two weeks prior to the current time point are displayed in the first time point appearance display section 272a, the second time point appearance display section 272b, and the third time point appearance display section 272c, respectively. Note that the images 130 displayed in the first to third time point appearance display sections 272a to 272c are not limited to those from the above-mentioned time points. Furthermore, images 130 from two different time points may be displayed, or images 130 from four or more different time points may be displayed.

[0073] By displaying the simulation site model 120 and the video 130 with different specified dates and times in chronological order, it is possible to easily grasp the transition of the construction status of the building site 110 over time. In addition, for example, after the construction is completed, it is also possible to verify and evaluate the merits of the construction plan and the actual construction work.

[0074] 2B to 2D, the display control unit 206 displays the video 130 and the simulation site model 120 side by side, but the method of displaying the video 130 and the simulation site model 120 is not limited to this. For example, the display control unit 206 may display the video 130 and the simulation site model 120 overlapping or by switching between them.

[0075] In FIG. 2E, the video 130 and the simulation site model 120 are displayed overlapping each other. The video 130 and the simulation site model 120 are displayed in a manner that allows them to be distinguished from each other. Specifically, when they are overlapped, the one located on top, i.e., the simulation site model 120, is transparent, and the one located on the bottom, i.e., the video 130, is visible. The overlapping order may be reversed. Furthermore, the video 130 and the simulation site model 120 have the same size and viewpoint. By displaying the video 130 and the simulation site model 120 overlapping each other, it becomes easier to understand whether there are any differences between them. Also, in FIG. 2E, a viewpoint change controller 258 and a seek bar 259 are displayed.

[0076] In FIG. 2F, video 130 and simulation site model 120 are alternately displayed. A changeover switch 290 is displayed on display screen 250, and changeover switch 290 is used to alternately display video 130 and simulation site model 120. Video 130 and simulation site model 120 have the same size, viewpoint, and display position. By alternately displaying video 130 and simulation site model 120, it becomes easier to determine whether there are any differences between the two.

[0077] FIG. 3A is a diagram illustrating an example of a display position control table 301 included in the construction management device 100. The display position control table 301 stores basic information 312 and associated information 313 in association with a display method 311. The display method 311 is a method by which the display control unit 206 displays the simulation site model 120 and the video 130, and includes settings such as parallel mode, superimposition mode, and switching mode. The basic information 312 indicates the display positions of the simulation site model 120 and the video 130, i.e., the display positions on the display screen 250. The associated information 313 indicates the display positions of information other than the simulation site model 120 and the video 130, such as construction information 251 and equipment information 252, i.e., the display positions on the display screen 250. The display control unit 206 references the display position control table 301 to display the simulation site model 120, the video 130, and other information on the display 140.

[0078] 3B is a diagram illustrating an example of a camera viewpoint information table 302 possessed by the construction management device 100. The camera viewpoint information table 302 is a table that stores reference data 322, an azimuth angle 323, an elevation / depression angle 324, and a height 325 in association with a fixed camera ID 321. The fixed camera ID 321 is an identifier (ID) that identifies the fixed camera 131 installed at the construction site 110. The azimuth angle 323 is the azimuth angle of the fixed camera 131 calculated from the orientation data 131a of the fixed camera 131 acquired by the data acquisition unit 205. The elevation / depression angle 324 is the azimuth angle of the fixed camera 131 calculated from the data of the vertical angle of the fixed camera 131 acquired by the data acquisition unit 205. The height 325 is the height data of the fixed camera 131 acquired by the data acquisition unit 205. The display control unit 206 refers to the camera viewpoint information table 302 to adjust the display of the simulation site model 120 .

[0079] The hardware configuration of the construction management device 100 will be described with reference to FIG. 4. The CPU (Central Processing Unit) 410 is a processor for arithmetic and control, and executes programs to realize the various functional components of the construction management device 100 shown in FIG. 2A. The CPU 410 may have multiple processors and execute different programs, modules, tasks, threads, etc. in parallel. The ROM (Read Only Memory) 420 stores fixed data such as initial data and programs, as well as other programs. The network interface 430 communicates with other devices via a network. The CPU 410 is not limited to a single CPU, and may include multiple CPUs or a GPU (Graphics Processing Unit) for image processing. The network interface 430 preferably has a CPU independent of the CPU 410 and writes and reads transmission / reception data 446 to and from an area of ​​the RAM (Random Access Memory) 440. It is also preferable to provide a DMAC (Direct Memory Access Controller) (not shown) for transferring data between the RAM 440 and storage 450. Furthermore, the CPU 410 processes the data after recognizing that the data has been received or transferred to the RAM 440. The CPU 410 also prepares the processing results in the RAM 440, and leaves the subsequent transmission or transfer to the network interface 430 or DMAC.

[0080] The RAM 440 is a random access memory used by the CPU 410 as a temporary storage work area. The RAM 440 has a storage area reserved for storing data necessary for implementing this embodiment. The survey data 441 is survey data obtained by surveying the terrain 111 and the building 112. The three-dimensional model data 442 is the three-dimensional model data 121 of the entire construction site 110 created by the three-dimensional model data creation unit 201. The construction plan data 443 is the construction plan data 160 acquired by the construction plan data acquisition unit 202. The simulation site model data 444 is the simulation site model 120 generated by the simulation site model generation unit 203. The video data 445 is the video 130 acquired by the video acquisition unit 204. The orientation data 446 is data on the orientation of the fixed camera 131 acquired by the data acquisition unit 205. The shooting date and time data 447 is data on the date and time when the fixed camera 131 captured the video 130 acquired by the data acquisition unit 205.

[0081] The transmitted / received data 448 is data transmitted and received via the network interface 430. The RAM 440 also has an application execution area 449 for executing various application modules.

[0082] The storage 450 stores a database, various parameters, or the following data or programs required to implement this embodiment. The storage 450 stores a display position control table 301 and a camera viewpoint information table 302. The display position control table 301 is a table that manages the relationship between the display method 311, basic information 312, and associated information 313 shown in FIG. 3A. The camera viewpoint information table 302 is a table that manages the relationship between the fixed camera ID 321, reference data 322, azimuth angle 323, elevation / depression angle 324, and height 325 shown in FIG. 3B.

[0083] The storage 450 further stores a three-dimensional model data creation module 451, a construction plan data acquisition module 452, a simulation site model generation module 453, an image acquisition module 454, a data acquisition module 455, and a display control module 456. The three-dimensional model data creation module 451 is a module that creates the three-dimensional model data 121. The construction plan data acquisition module 452 is a module that acquires the construction plan data 160. The simulation site model generation module 453 is a module that generates the simulation site model 120. The image acquisition module 454 is a module that acquires the image 130. The data acquisition module 455 is a module that acquires data 131a on the orientation of the fixed camera 131 and data 131b on the date and time the image 130 was captured. The display control module 456 is a module that displays the simulation site model 120 and the image 130 on the display 140. These modules 451 to 456 are read into the application execution area 449 of the RAM 440 by the CPU 410 and executed. The control program 457 is a program for controlling the entire construction management device 100.

[0084] The input / output interface 460 interfaces input / output data with input / output devices. A display unit 461 and an operation unit 462 are connected to the input / output interface 460. A storage medium 464 may also be connected to the input / output interface 460. A speaker 463 serving as an audio output unit, a microphone (not shown) serving as an audio input unit, or a GPS position determination unit may also be connected. Note that the RAM 440 and storage 450 shown in FIG. 4 do not include programs or data related to the general-purpose functions of the construction management device 100 or other feasible functions.

[0085] Next, the processing procedure of the construction management device 100 will be described with reference to the flowchart shown in Fig. 5. This flowchart is executed by the CPU 410 in Fig. 4 using the RAM 440, and realizes each functional configuration of the construction management device 100 in Fig. 2A.

[0086] In step S501, the three-dimensional model data creation unit 201 acquires survey data of the terrain 111 and the building 112. In step S503, the three-dimensional model data creation unit 201 creates three-dimensional model data 121 based on the survey data. In step S505, the construction plan data acquisition unit 202 acquires the construction plan data 160. In step S507, the simulation site model generation unit 203 simulates the construction status of the building site 110 at a specified time based on the construction plan data 160, and generates the simulation site model 120. In step S509, the video acquisition unit 204 acquires the video 130. In step S511, the data acquisition unit 205 acquires data 131a on the orientation of the fixed camera 131, data on the vertical angle of the fixed camera 131, data on the height of the fixed camera 131, and data 131b on the date and time the video was taken. In step S513, the display control unit 206 adjusts the display of the simulation site model 120 based on the orientation data 131a, the data on the vertical angle of the fixed camera 131, the data on the height of the fixed camera 131, and the data 131b on the date and time of shooting. In step S515, the display control unit 206 causes the display 140 to display the adjusted simulation site model 120 and video 130.

[0087] According to this embodiment, construction management of a building can be performed. For example, the simulation site model 120 and the video 130 are adjusted so that they are viewed from the same viewpoint and then displayed on the display 140, so the operator of the construction management device 100 can easily compare the two. This allows the operator of the construction management device 100 to easily grasp the construction status of the building site 110. Furthermore, the operator can grasp the progress of the construction work and consider whether or not changes to the construction plan are necessary without actually visiting the building site 110.

[0088] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-described embodiments and can be modified as appropriate. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. Furthermore, systems or devices that combine separate features included in each embodiment in any manner are also included in the scope of the present invention.

[0089] The present invention may also be applied to a system consisting of multiple devices or to a single device. Furthermore, the present invention may also be applied when an information processing program that realizes the functions of the embodiments is supplied to a system or device and executed by a built-in processor. Therefore, the technical scope of the present invention also includes a program installed on a computer to realize the functions of the present invention, a medium storing the program, a WWW (World Wide Web) server from which the program is downloaded, and a processor that executes the program. In particular, the technical scope of the present invention also includes a non-transitory computer-readable medium storing a program that causes a computer to execute at least the processing steps included in the above-described embodiments.

Claims

1. a three-dimensional model data creation unit that creates a three-dimensional model of the terrain and the buildings based on survey data obtained by surveying the construction site and its surrounding terrain, and the buildings existing at the construction site and its surrounding terrain, and further creates three-dimensional model data of the entire construction site based on the three-dimensional models of the terrain and the buildings; a construction plan data acquisition unit that acquires construction plan data for construction work to be carried out at the construction site; a simulation site model generation unit that simulates the state of the construction site based on the construction plan data, the three-dimensional model data, and a three-dimensional model of a construction machine used at the construction site, and generates a simulation site model; an image acquisition unit that acquires an actual image of the construction site from at least one imaging device installed at the construction site; a data acquisition unit that acquires data on the orientation of the at least one image capture device and data on the capture date and time of the video; a display control unit that adjusts the display of the simulation site model based on the orientation data and the shooting date and time data acquired by the data acquisition unit, and displays the simulation site model and the video on a predetermined display device; A construction management device equipped with the above.

2. The construction management device according to claim 1 , wherein the display control unit displays the video and the simulation site model side by side.

3. The construction management device according to claim 1 , wherein the display control unit displays the video and the simulation site model in an overlapping manner or in a switchable manner.

4. a three-dimensional model data creation step of creating a three-dimensional model of the topography and the buildings on the construction site based on survey data obtained by measuring the topography and the surrounding areas, and the buildings on the construction site and the surrounding areas, and further creating three-dimensional model data of the entire construction site based on the three-dimensional models of the topography and the buildings; a construction plan data acquisition step for acquiring construction plan data for construction work to be performed at the building site; a simulation site model generation step of simulating the state of the construction site based on the construction plan data, the three-dimensional model data, and a three-dimensional model of a construction machine used at the construction site, and generating a simulation site model; an image capturing step of capturing an actual image of the construction site from at least one imaging device installed at the construction site; a data acquisition step of acquiring data on the orientation of the at least one imaging device and data on the date and time of capturing the video; a display control step of adjusting the display of the simulation site model based on the orientation data and the shooting date and time data acquired by the data acquisition unit, and displaying the simulation site model and the video on a predetermined display device; Construction management methods including.

5. a three-dimensional model data creation step of creating a three-dimensional model of the topography and the buildings on the construction site based on survey data obtained by measuring the topography and the surrounding areas, and the buildings on the construction site and the surrounding areas, and further creating three-dimensional model data of the entire construction site based on the three-dimensional models of the topography and the buildings; a construction plan data acquisition step for acquiring construction plan data for construction work to be performed at the building site; a simulation site model generation step of simulating the state of the construction site based on the construction plan data, the three-dimensional model data, and a three-dimensional model of a construction machine used at the construction site, and generating a simulation site model; an image capturing step of capturing an actual image of the construction site from at least one imaging device installed at the construction site; a data acquisition step of acquiring data on the orientation of the at least one imaging device and data on the date and time of capturing the video; a display control step of adjusting the display of the simulation site model based on the orientation data and the shooting date and time data acquired in the data acquisition step, and displaying the simulation site model and the image on a predetermined display device; A construction management program that runs the above on a computer.

Images