Construction progress display system

Abstract

We provide a construction progress display system that is easier to operate and makes it easier to understand the progress status. [Solution] The construction progress display system 1 is a construction progress display system 1 that displays the progress of various construction work within a construction site, and comprises a time lapse generation unit 45 that generates a time lapse representing the progress of various construction work by extracting multiple specified location images taken from the captured images, including the location and direction of movement history of the site worker or mobile body, based on captured images and movement information including the location and direction of movement history of the site worker or mobile body associated with the captured images, and arranging them consecutively in order of the time of capture, when a location and direction within the construction site are specified, and a display unit 5 that displays the time lapse

Description

Technical Field

[0001] The present invention relates to a construction progress status display system for displaying the progress status of construction work at a construction site.

Background Art

[0002] At a construction site of a building such as a building or a condominium, it is necessary to grasp the progress status of the construction work. For this reason, for example, a site supervisor walks around the construction site to grasp the progress status of each place in the construction site, but this takes time and effort. On the other hand, for example, in Patent Document 1, after grasping a plurality of operations performed in each room of a building, based on the plurality of grasped operations and the operations currently being performed in each room, a configuration for grasping the progress of operations related to oneself is disclosed. In this configuration, a plurality of reading targets indicating information related to a plurality of tasks are read, based on the reading state, the states of the plurality of tasks corresponding to the plurality of reading targets are specified, and based on the specified states of the plurality of tasks, state-related information related to the states of the plurality of tasks performed in the plurality of target areas is stored in a storage means. When one or more tasks among the plurality of tasks are selected, based on the state-related information stored in the storage means with the selected task as a reference, at least information corresponding to the state of the task selected by the selection information for each of the plurality of target areas is displayed. Here, a task indicates an operation of interior construction work, door construction work, exterior construction work, etc. of a building under construction. Also, the reading target is, for example, a two-dimensional barcode, and a code sheet on which the two-dimensional barcode is displayed is provided individually in each room of the building. In a configuration as disclosed in Patent Document 1, for example, after a worker finishes the construction work, it is necessary to paint over the two-dimensional barcode in order to indicate that the construction work is completed, and the operation is not simple. Also, in the configuration of Patent Document 1, as described above, it is necessary to provide the code sheet individually in each room of the building. Therefore, it becomes difficult to perform progress management for each fine part in the room. Therefore, with a configuration as disclosed in Patent Document 1, it is difficult to perform accurate and detailed progress status management for each part. In the configuration of Patent Document 1, it is possible to manage progress more accurately and in detail by providing a code sheet for each small part of the room. However, in this case, the number of code sheets to be managed increases, making operation even less convenient.

[0003] Furthermore, Patent Document 2 discloses a configuration in which an identification code placed at a construction site and the construction site itself are photographed, and based on the location information and construction information obtained from the image showing the identification code, the image data of the image showing the construction site is stored in a state that can be classified for each construction site and associated with information representing a specific process among multiple processes in the construction applied to the construction site. Here, the identification code represents location information that represents the location of the construction site in the building under construction, and information regarding the construction applied to the construction site. The construction information includes information representing the type of work and information representing the construction method, etc. With such a configuration, by photographing the identification code placed at the construction site and then photographing the construction site, images based on the image data of the image showing the construction site can be displayed in the order of the processes for each construction site, making it easy to grasp the progress of the construction at each construction site. However, with the configuration disclosed in Patent Document 2, it is necessary to individually set an identification code for each construction site, making it difficult to easily manage the progress status.

[0004] Furthermore, Patent Document 3 discloses a configuration in which images taken at a construction site are stored in association with an identifier that identifies the date and time of shooting and the location of shooting; a prediction model predicts the proportion of each building element in the images; the element model in which each building element predicted by the prediction model is recorded in its attributes is identified; the process associated with the identified element model is identified; and progress management data, which records the proportion of building elements included in the images along with the identified process, is recorded in the progress information storage unit. GPS (Global Positioning System) is used to identify the location where the images were taken. Patent Document 3 does not disclose how to clearly display the progress status. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2021-12677 [Patent Document 2] Japanese Patent Publication No. 2020-30519 [Patent Document 3] Japanese Patent Publication No. 2021-47715 [Overview of the project] [Problems that the invention aims to solve]

[0006] The problem that this invention aims to solve is to provide a construction progress display system that is easier to operate and allows for easy monitoring of the progress of a construction project. [Means for solving the problem]

[0007] To solve the above problems, the present invention employs the following means. In other words, the construction progress display system of the present invention is a construction progress display system that displays the progress of various construction work within a construction site, and is characterized by comprising a time-lapse generation unit that extracts a plurality of designated position images taken from designated positions within the construction site based on images taken by on-site workers or mobile objects as they move, and generates a time-lapse representing the progress of the various construction work. With this configuration, based on images captured by on-site workers or moving objects, multiple images taken from specified locations within the construction site can be extracted to generate a time-lapse video. By displaying the generated time-lapse video, the progress can be easily understood. The images used to generate time-lapses can be easily acquired, for example, by having site workers or mobile units carry cameras or other recording devices that can capture still images or videos while patrolling the construction site. In other words, there is no need to introduce special equipment to acquire the images. In addition, the images can be acquired incidentally, for example, by site workers or mobile units as part of their normal duties while patrolling the construction site, and there is no need to perform any special work separately when generating time-lapses. Therefore, it can be operated simply.

[0008] In one embodiment of the present invention, the time lapse generation unit extracts the designated position image based on the captured image and movement information associated with the captured image, which includes a history of the position and direction of movement of the site worker or the moving body, and the movement information includes a time corresponding to each of the history entries; autonomous navigation means equipped with an autonomously operating sensor and configured to be held or worn by the site worker or the moving body to acquire the movement information of the site worker or the moving body; a shooting recording device configured to be held or worn by the site worker or the moving body to photograph the construction site and acquire the captured image; and an information integration unit that, for each of the captured images, compares the shooting time of the captured image with the time of the movement information to associate the captured image and the movement information by time and stores them in a database. With this configuration, a site worker or mobile body moves around the construction site while holding or wearing an autonomous navigation system and a photography / recording device. The photography / recording device takes pictures of the construction site, and the autonomous navigation system acquires information about the movement of the site worker or mobile body. The photography / recording device also acquires images of the construction work within the construction site by taking pictures of the site. The information integration unit matches the time the images are taken with the time the movement information is taken, and stores the images and movement information in a database, associating them by time. As a result, the time-lapse generation unit can generate a time-lapse by arranging the images taken as the site worker or mobile body moves around the construction site and the movement information, in order of the time the images were taken, in sequence. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a construction progress display system that is easier to operate and allows for easy monitoring of the progress status. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing the configuration of a construction progress display system according to an embodiment of the present invention. [Figure 2] Figure 1 shows an example of a construction site for which the construction progress status will be displayed using the construction progress display system. [Figure 3] This figure shows an example of a PDR record indicating the movement information of on-site workers. [Figure 4] This figure shows an example of a photograph taken with an identification tag. [Figure 5] This figure shows an example of a history in which an identification tag was detected from a captured image. [Figure 6] This figure shows an example of integrated data created in the Information Integration Department. [Figure 7] This is a diagram showing the drawing data for the specified hierarchy displayed on the display unit. [Figure 8]It is a diagram showing an example of a captured image taken at a position close to a specified position. [Figure 9] It is a diagram showing a specified direction. [Figure 10] It is a diagram showing an example of a range set to create a specified position image from a captured image. [Figure 11] It is a diagram showing an example of a specified position image created from a captured image. [Figure 12] It is a diagram showing an example of a time-lapse generated from a plurality of specified position images. [Figure 13] It is a flowchart showing the flow of a method for displaying the progress of construction work, which is executed using the construction progress status display system of the present embodiment.

Mode for Carrying Out the Invention

[0011] The present invention is a construction progress status display system equipped with a time-lapse representing the progress status of various construction works within a construction site. Instead of taking construction photos with a fixed-point camera to create a time-lapse, the present invention can simply create a time-lapse representing the construction progress at any location and direction on the patrol route by simply patrolling while shooting video with a shooting recording device within the site. It is a construction progress status display system. Hereinafter, a form for implementing the construction progress status display system according to the present invention will be described based on the accompanying drawings. FIG. 1 shows a block diagram showing the configuration of a construction progress status display system according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of a construction site that is the target for displaying the progress status of construction work in the construction progress status display system of FIG. 1. As shown in FIG. 1, the construction progress status display system 1 mainly includes an autonomous navigation means 2, a shooting recording device 3, a management system main body 4, a display unit 5, and an input unit 6. The construction progress status display system 1 displays the progress status of construction work within the construction site G. In the present embodiment, the construction site G is a site where construction work and construction of a building having a plurality of floors, such as a high-rise building, are carried out. As shown in Figure 2, the autonomous navigation means 2 and the image recording device 3 are used by a site worker Q when moving around within the construction site G of a building under construction and taking photographs of the construction site G. The autonomous navigation means 2 and the image recording device 3 are configured to be held or worn by the site worker Q. That is, the autonomous navigation means 2 and the image recording device 3 may be held by the site worker Q in their hand or stored in a pocket. Furthermore, the autonomous navigation means 2 and the image recording device 3 may be attached to a part of the site worker Q's body (e.g., head) or to equipment (helmet or clothing). Alternatively, the site worker Q may wear a helmet or bag to which the autonomous navigation means 2 and the image recording device 3 are attached. In addition, the autonomous navigation means 2 and the image recording device 3 may be separate devices, or they may be used as an integrated device. In this embodiment, as described above, the autonomous navigation means 2 and the image recording device 3 are used by a site worker Q when moving around the construction site G and taking pictures of the construction site G, but this is not limited to this. For example, instead of the site worker Q, the autonomous navigation means 2 and the image recording device 3 may be attached to a mobile body such as a drone or robot that is configured to move around the construction site G, and the mobile body may use them when patrolling and moving around the construction site G and taking pictures of the construction site G.

[0012] The autonomous navigation means 2 is a device that acquires movement information of the field worker Q by pedestrian autonomous navigation, or PDR (Pedestrian Dead-Reckoning). As the autonomous navigation means 2 described above, a dedicated device equipped with the following functions may be used, or a smartphone, tablet terminal, etc. equipped with an application program capable of realizing the following functions may be used. As shown in Figure 1, the autonomous navigation means 2 functionally includes a sensor 21, a movement information calculation unit 22, a data storage unit 23, and a data output unit 24. Sensor 21 may include, for example, an acceleration sensor, a gyroscope, or a geomagnetic sensor. After positioning is initiated, sensor 21 detects changes in acceleration, angular velocity, geomagnetic field, etc., that occur as a result of the movement of the field worker Q who is holding or wearing the autonomous navigation means 2. Note that sensor 21 is not limited to acceleration sensors, gyroscopes, or geomagnetic sensors; any sensor capable of detecting other parameters within the construction site G may be used.

[0013] The movement information calculation unit 22 generates movement information for the field worker Q by calculating the amount of movement from the positioning start position, i.e., the relative position to the positioning start position, when the field worker Q moves from the positioning start position, based on the detection data from the sensor 21. More specifically, the movement information calculation unit 22 uses PDR to measure the amount of movement from the position at the previous time, i.e., the relative position, at regular time intervals, and calculates the position by accumulating these measurements. The movement information calculation unit 22 also uses PDR to acquire the direction that the field worker Q is facing, as the direction of movement of the field worker Q, from the detection data from the sensor 21 at regular time intervals. The movement information for the field worker Q generated in this way includes a history of the field worker Q's position and direction of movement. More specifically, in the movement information for the field worker Q, information indicating the movement path (amount of movement) based on the relative position measured as described above, the direction of movement of the field worker Q at each position on the movement path, and the time information at each position are all related to each other. Figure 3 shows an example of a PDR record that displays information on the movement of field workers. In the movement information shown in Figure 3, at predetermined time intervals, for example, time information (date and time), the position of the field worker Q at that time (X coordinate, Y coordinate), and the direction of movement are associated with each other and recorded as text data where, for example, one pair of associated relationships is written on a single line.

[0014] The data storage unit 23 stores the movement information of field worker Q, which is generated by the movement information calculation unit 22. The data output unit 24 outputs the movement information of field worker Q stored in the data storage unit 23 to the management system main unit 4. The data output unit 24 can output the movement information in various ways, including data transfer via wireless LAN (Local Area Network) such as Wi-Fi and Bluetooth®, mobile phone communication networks, or via connection cables or various portable memory devices.

[0015] The shooting and recording device 3 takes photographs of the construction site G. The shooting and recording device 3 consists of, for example, a portable digital camera, a digital video camera (including a wearable camera that can be attached to the body), etc. In this embodiment, the shooting and recording device 3 is a so-called omnidirectional camera (360-degree camera) that can capture 360-degree images of the surrounding 360 degrees, as will be explained later in Figure 8. The shooting and recording device 3 functionally includes a shooting unit 31, a shooting data storage unit 32, and a shooting data output unit 33. The imaging unit 31 is equipped with an image sensor using a CCD (Charge Coupled Device), CMOS (Complementary Metal Oxide Semiconductor), etc., and captures at least one of a 360-degree still image and a video.

[0016] The shooting data storage unit 32 stores the images captured by the shooting unit 31 as shooting data, associated with the time the images were taken, i.e., the shooting time. Field worker Q moves along a movement path R, for example, as shown by the dashed line in Figure 2. During this movement of field worker Q, images are captured by the image recording device 3. If the captured images are still images, images are captured at predetermined time intervals. For example, in Figure 2, images are captured by the image capture unit 31 at multiple positions K along the movement path R where field worker Q was positioned at predetermined time intervals. The time of capture is associated with each of these captured images. When the captured image is a video, the video can be configured so that, for example, the time when the video was started is associated with the shooting time. However, a video can be thought of as a series of still images taken at predetermined time intervals, arranged sequentially as frames. Therefore, by extracting each frame from the video as a still image and saving the extracted still image in association with the time that has elapsed from the time the video was started until that still image was taken, it is possible to make the video into a series of captured images taken at predetermined time intervals. Accordingly, in the following explanation, the captured image will be described as a still image taken at predetermined time intervals, but it goes without saying that even when the captured image is a video, an explanation of the same nature is possible.

[0017] The shooting data storage unit 32 may use memory built into the shooting recording device 3, or a portable memory that is detachably provided to the shooting recording device 3. Alternatively, the shooting data storage unit 32 may transfer and store the shooting data to a smartphone or tablet device that can connect to the shooting recording device 3 via Wi-Fi or other wireless LAN communication. The image data output unit 33 outputs the image data stored in the image data storage unit 32 within the construction site G to the management system main unit 4. The data output unit 24 can output movement information in the same way as the data output unit 24, for example, via wireless LAN such as Wi-Fi, mobile phone communication networks, or via connection cables or various portable memory devices.

[0018] The management system unit 4 displays the progress of construction work within the construction site G based on the movement information of the field worker Q obtained by the autonomous navigation means 2 and the image recording device 3, as well as the image data. The management system unit 4 consists of a computer device such as a personal computer. The management system unit 4 functionally includes a data input receiving unit 41, a detection means 42, an information integration unit 43, a database 44, and a time-lapse generation unit 45. The data input receiving unit 41 receives input of data output from the data output unit 24 of the autonomous navigation means 2 and the image data output unit 33 of the image recording device 3.

[0019] Database 44 stores various data necessary for the management system unit 4 to display the progress of construction work within the construction site G. Database 44 stores data related to the construction work being carried out within the construction site G, as well as data related to the identification tags M. Construction-related data, such as drawing data for each floor within construction site G, is stored in database 44. This drawing data for each floor within construction site G includes CAD (Computer-Aided Design) data, BIM (Building Information Modeling) data, and image data in formats such as JPG.

[0020] The identification tags M are placed within the construction site G, as shown in Figure 2. In this embodiment, if the construction site G has multiple levels, the identification tags M are provided on each level if the construction site G has multiple levels. The identification tags M are, for example, two-dimensional barcodes, AR markers, etc., and each identification tag M is associated with and recorded with individual identification information (ID). The database 44 stores the correspondence between the identification information recorded in association with the identification tag M, the horizontal position and floor (number of floors) within the construction site G where the identification tag M is installed, and the orientation (direction or angle) in which the identification tag M is displayed. Information regarding the horizontal position within the construction site G where identification tags M are installed can include the planar position (XY coordinates: absolute or relative coordinates on the image data of the design drawings) on the level where each identification tag M is installed. Identification tags M should be placed near stairwells and elevator rooms within the construction site G, where there is a high volume of foot traffic and where people tend to start moving around on each floor. Identification tags M may be placed in multiple locations on each floor. It is preferable to place the identification tag M on the surface of columns or walls under construction, for example. In particular, when the building under construction has multiple floors, it is common to post a piece of paper indicating the floor number on the columns or other surfaces on each floor. In such cases, by placing the identification tag M near this floor number display, the identification tag M can be placed at the same time as the floor number display. This eliminates the need to patrol the building to install the identification tag M. Furthermore, if the identification tag M is attached using a magnet or adhesive, it will be easier to remove later.

[0021] The detection means 42 detects the identification tag M from multiple images captured by the imaging unit 31 at each level within the construction site G. If the captured image to be processed contains an identification tag M, the detection means 42 detects (identifies) the identification tag M from the captured image using a known image processing method or the like. If the captured image contains an identification tag M, the detection means 42 obtains the time the image in which the identification tag M was detected was taken, and the file name of the captured image. Furthermore, the detection means 42 reads the identification information written on the identification tag M by processing the captured image in which the identification tag M was detected using an appropriate image processing means. Figure 4 shows an example of a photograph taken of an identification tag. In the following explanation, as shown in Figure 8, the photographs will be denoted by the code P, but in particular, the photograph taken of the identification tag M will be referred to as photograph Pa and denoted by the code Pa. The detection means 42 detects the coordinates of the corners Mc of the identification tag M within the captured image Pa. In this embodiment, the identification tag M has a rectangular shape, and therefore, the detection means 42 detects the coordinates of each of the four corners Mc of the identification tag M. The detection means 42 creates an identification tag detection history, which is a history of when identification tags M have been detected. Figure 5 shows an example of an identification tag detection history created by the detection means. The identification tag detection history includes the time of capture (date and time), which is the time when the captured image Pa containing the identification tag M was taken; the identification information (ID) of the detected identification tag M; and the corner coordinates (corner coordinates), which are the coordinate values ​​of the pixels at the corner Mc of the identification tag M in the captured image Pa. These are all associated with each other and stored in the database 44 as text data, for example, with one pair of associated correspondences written on one line.

[0022] The information integration unit 43 associates the captured images P with the movement information based on time. For each captured image P taken within the construction site G, the information integration unit 43 calculates the shooting location of the captured image P by comparing the shooting time of the image P with the time of the movement information, associates the shooting location with the captured image P, integrates them to create integrated data, and stores it in the database 44. Specifically, the information integration unit 43 performs the following processing on each captured image P. First, the information integration unit 43 obtains the time of capture of the captured image P. The information integration unit 43 refers to the time of capture in the identification tag detection history and extracts from the identification tag detection history any identification tags M detected at the time the image P was taken, or at the most recent past time, i.e., immediately before the image P was taken, and obtains the identification information (ID) of the identification tag M. As already explained, the identification tags M are installed near stairwells and elevator rooms, which are likely to be the starting points of people's movement on each floor. Therefore, for each image P, it is assumed that the identification tag M detected immediately before the image P was taken is located on the same floor as the image P was taken. For this reason, the information integration unit 43 identifies the floor on which the image P was taken by referring to the floor corresponding to the identification information of the identification tag M detected immediately before, based on the correspondence relationships regarding the identification tags M stored in the database 44.

[0023] Furthermore, the information integration unit 43 obtains the coordinates of the corner Mc in the captured image Pa in which the detected identification tag M was photographed from the identification tag detection history. From the correspondence relationships related to identification tag M stored in the database 44, the information integration unit 43 obtains the horizontal position within the construction site G where the identification tag M is installed and the orientation in which the identification tag M is displayed, corresponding to the identification information of the extracted identification tag M. Based on the coordinates of the corner Mc in the captured image Pa in which the identification tag M was photographed, the information integration unit 43 considers the shape of the identification tag M in the captured image Pa and calculates the relative position of the captured image Pa from the identification tag M in which the image Pa was photographed. From this relative position, the horizontal position of the identification tag M, and the orientation in which the identification tag M is displayed, the information integration unit 43 estimates, for example, the horizontal position and the shooting direction of the captured image Pa in which the identification tag M was photographed as an absolute position within the construction site G. In this way, the information integration unit 43 estimates the shooting position of the captured image Pa in which the identification tag M that was detected immediately before was taken, using the position where the identification tag M that was detected immediately before was placed as a starting point.

[0024] The information integration unit 43 further calculates the shooting position of the currently processed image P, using the shooting position as a starting point, based on the movement information of the field worker Q generated by the movement information calculation unit 22. More specifically, the information integration unit 43 obtains, for example, the relative amount of movement from the time of capture of the image Pa in which the identification tag M detected immediately before was taken, to the time of capture of the image P, from the movement information calculation unit 22's movement information of the field worker Q. By adding this relative amount of movement to the capture position of the image Pa in which the identification tag M detected immediately before was taken, the unit calculates the capture position of the image P as, for example, an absolute position within the construction site G. Furthermore, the information integration unit 43 obtains the direction (orientation) of the field worker Q's movement at the time the image P was taken, based on the time the image P was taken, from the field worker Q's movement information.

[0025] The information integration unit 43 associates and integrates these data to create integrated data. Figure 6 shows an example of integrated data created in the Information Integration Unit. As shown in Figure 6, for each captured image P, the following information is associated with each other: the time (date and time) the image was taken, the file name (image file name), the location where the image was taken, the direction of movement of the field worker Q at that location (XY coordinates, direction of movement), and the hierarchical level in which the image was taken. These associated relationships are stored in the database 44 as text data, with each associated relationship written on a single line.

[0026] The time-lapse generation unit 45 will be explained after the display unit 5 and the input unit 6 have been described. The display unit 5 may be a monitor device provided in the management system main unit 4, or it may be a smartphone, tablet terminal, or the like that can communicate with the management system main unit 4 via wireless communication. The input unit 6 accepts operations from the operator. The input unit 6 may be a keyboard, mouse, etc., provided on the management system main unit 4. Alternatively, if the display unit 5 is a smartphone or tablet device, the input unit 6 may be a touch panel, etc. Figure 7 shows the drawing data for the specified hierarchical level displayed on the display unit. The display unit 5 shows a combo box (not shown) or the like, which allows the user to select any floor level of the construction site G. When the combo box or the like is operated from the input unit 6 and a floor level is specified, the display unit 5 displays the drawing data corresponding to that floor level, for example, as a floor plan of that floor level, as shown in Figure 7. The construction progress display system 1 of this embodiment, when a location (floor level and horizontal position within that floor level) and a direction from that location are specified within the construction site G, extracts multiple images taken from that location looking in that direction as specified location images, and generates a time lapse by arranging the specified location images consecutively in order of the time they were taken. To do this, the worker specifies the floor level as described above via the input unit 6, and then further specifies the horizontal position within that floor level and the direction from that horizontal position, which will serve as the base point for generating the time lapse, on the drawing data displayed on the display unit 5. In this way, the input unit 6 receives input from the worker regarding the position (hierarchy and the horizontal position within that hierarchy) and the direction from that position.

[0027] When a request is received from the input unit 6, the time-lapse generation unit 45 generates a time-lapse representing the progress of various construction work by sequentially arranging captured images P in order of capture time, corresponding to the location (layer and horizontal position within that layer) and direction within the construction site G specified in the request. The time-lapse generation unit 45 comprises an image acquisition unit 47, an image creation unit 48, and a time-lapse generation processing unit 49. When the input unit 6 specifies the location (hierarchy and horizontal position within that hierarchy) and direction within the construction site G, the image acquisition unit 47 extracts from the integrated data stored in the database 44 images in which the hierarchy in the integrated data matches the specified hierarchy. The images P extracted in this way are images taken at the hierarchy specified by the input unit 6.

[0028] Furthermore, the image acquisition unit 47 acquires an image P taken at a specified horizontal position from among the multiple images P of the specified hierarchy extracted as described above. In reality, there may not be an image P taken at exactly the same position as the horizontal position specified by the input unit 6. Therefore, the image acquisition unit 47 extracts an image P taken at a position close to the specified horizontal position and treats this as an image P taken at the specified horizontal position. Specifically, as shown in Figure 7, the image acquisition unit 47 identifies a position Kx from among multiple positions (horizontal positions) K where the captured image P was taken in the specified hierarchy, where the distance from the specified position X is closer than a threshold (e.g., 1 m). The image acquisition unit 47 acquires all captured images P taken at the identified position Kx close to the specified position X, regardless of the time of capture, and treats these as captured images P taken at the specified position X. Figure 8 shows an example of an image P taken at a location close to the specified position. As shown in Figure 8, the image P taken by the image acquisition unit 47 at a location Kx close to the specified position X is a 360-degree image centered on the direction of movement of the field worker Q at the time the image P was taken. Note that the field worker Q walks while always holding the 360-degree camera facing forward, so the center of the 360-degree image is the direction of movement.

[0029] Figure 9 shows the specified direction Xd. Figure 10 shows an example of the range to set to create a specified position image from the captured image. Figure 11 shows an example of a specified position image created from the captured image. If the specified direction Xd is any of the 360 ​​degrees in the horizontal direction, the image creation unit 48 determines that the time lapse generation unit 45 extracts a preset size area from the captured image (360-degree image) P taken at the specified position X as described above, around the specified direction, that is, including the specified direction, converts this into a planar image, and creates a specified position image Ps. For example, in Figure 9, if the specified direction Xd is direction Xd1, the direction of movement of the field worker Q coincides with the specified direction Xd1. Therefore, as shown as region A in Figure 10, the area near the center of the captured image P, which is a 360-degree image, is extracted, and based on this, the specified position image Ps shown in Figure 11 is created. Alternatively, if the specified direction Xd is direction Xd2, which is 90 degrees to the left of the direction of movement of the field worker Q, then as shown as region B in Figure 10, the left portion of region A is extracted, and based on this, the specified position image Ps is created. The specified position image Ps generated in this way is an image taken from the position specified by the input unit 6, i.e., the specified horizontal position K of the specified hierarchy, including the specified direction Xd.

[0030] In this embodiment, the display unit 5 displays a floor plan of the specified floor, and the horizontal position and direction are specified on this floor plan. Therefore, the direction that can be specified is limited to the horizontal direction. For example, when specifying the horizontal direction, if the elevation angle from the horizontal direction is also specified, it is possible to obtain a specified position image Ps in a direction other than the horizontal direction. For example, by setting the elevation angle after specifying the direction as Xd1, the upper part of region A, i.e., the ceiling side, as shown as region C in Figure 10, may be cut out, and the specified position image Ps may be created based on this. Alternatively, by setting the depression angle after specifying the direction as Xd1, the lower part of region A, i.e., the floor side, as shown as region D in Figure 10, may be cut out, and the specified position image Ps may be created based on this.

[0031] In this way, the image creation unit 48 extracts a specified position image Ps from all the integrated data stored in the database 44, which is captured from the specified horizontal position K of the specified position, i.e., the specified hierarchy, including the specified direction Xd, as specified by the input unit 6. It is expected that site worker Q will patrol construction site G a considerable number of times from the start of construction until the completion of the project. Therefore, multiple images P should be taken at the designated location. In this embodiment, since the image recording device 3 is an omnidirectional camera, the multiple images P taken at the designated location capture all directions at that location. Consequently, the number of designated location images Ps created by the image creation unit 48, which capture images at the designated location and including the designated directions, will be multiple.

[0032] Figure 12 shows an example of a time lapse generated from multiple images at specified locations. As shown in Figure 12, the time-lapse generation processing unit 49 generates a time-lapse Pt representing the progress of various construction work by arranging multiple designated position images Ps created by the image creation unit 48 in chronological order based on the shooting time of the captured image P. The time-lapse Pt may be a planar arrangement of multiple designated position images Ps as shown in Figure 12, or it may be a video in which each designated position image Ps is a still image of one frame. The time-lapse generation processing unit 49 outputs the time-lapse Pt data, which is a sequence of time-lapse images Ps taken from a specified location including a specified direction, to the display unit 5.

[0033] The management system unit 4 transmits the time-lapse Pt data generated by the time-lapse generation processing unit 49 to the display unit 5 via data transfer, for example, through a communication cable, a wireless LAN such as Wi-Fi, or a mobile phone communication network. The display unit 5 displays a time-lapse Pt based on the time-lapse Pt data transmitted from the management system main unit 4, which consists of specified position images Ps taken from a specified location including a specified direction, arranged in chronological order.

[0034] Figure 13 is a flowchart showing the flow of the method for displaying the progress of construction work, as performed using the construction progress display system of this embodiment. As shown in Figure 13, in order to display the progress of construction using the construction progress display system 1 in this embodiment, identification tags M are installed in the construction site G in advance (step S11). After the identification tags M are installed, information about the identification tags M is registered in the database 44 of the management system unit 4 (step S12). Specifically, as described above, the database 44 stores the identification information of each identification tag M, the horizontal position and floor (number of floors) within the construction site G where the identification tag M is installed, and the orientation (direction or angle) in which the identification tag M is displayed, in association with each other. The above process S12 only needs to be performed once at the construction site G, in conjunction with the installation of the identification tag M in process S11.

[0035] In step S13, the site worker Q holds or wears the autonomous navigation means 2 and the photography and recording device 3, and moves around the construction site G on foot while taking photographs of the construction site G. At this time, for example, as shown in Figure 2, it is preferable for the site worker Q to move within each floor along a movement path R that starts near the location where the identification tag M is installed. At this time, the autonomous navigation means 2 generates movement information of the field worker Q based on the detection data from the sensor 21. Also, if the identification tag M is located in front of the shooting unit 31 of the shooting recording device 3, the shooting recording device 3 will photograph the identification tag M. Considering the purpose of the construction progress display system 1 to display the progress of construction work within construction site G, it is desirable for site worker Q to move around construction site G in such a way that as many of the planned construction areas within construction site G as possible are captured by the camera recording device 3. However, during regular patrols of construction site G for purposes such as safety inspections, site worker Q may carry or wear the autonomous navigation means 2 and the camera recording device 3, thereby combining movement within construction site G for displaying the progress of construction work with the patrol. Alternatively, multiple site workers Q can carry the autonomous navigation means 2 and the camera recording device 3 at all times in a manner that does not interfere with their respective work, thereby improving the comprehensiveness of the images captured by the camera recording device 3 within construction site G.

[0036] As a result, in the autonomous navigation means 2, the sensor 21 and the movement information calculation unit 22 acquire movement information of the site worker Q within the construction site G, and store it in the data storage unit 23 in association with time information. Furthermore, in the shooting and recording device 3, the shooting unit 31 captures images of the construction site G located around the movement path R of the on-site worker Q, and the resulting 360-degree image P is stored in the shooting data storage unit 32 as shooting data associated with the shooting time, which is the time when the image P was taken. Next, the movement information of the field worker Q obtained by the autonomous navigation means 2 and the photographic data of the construction site G taken by the photographic recording device 3 are transferred from the data output unit 24 and the photographic data output unit 33 to the management system main unit 4 (step S14). When the management system main unit 4 receives the input of the movement information of the field worker Q and the photographic data of the construction site G transferred in step S14, it stores them in the database 44. Note that this step S14 may be performed after the completion of step S13, or it may be performed at any time using communication such as wireless LAN while step S13 is being executed.

[0037] Next, integrated data on the progress of the construction is generated (process S15). First, the detection means 42 of the management system main unit 4 detects the identification tag M from the captured image P to be processed using a known image processing method. The detection means 42 then creates an identification tag detection history, which is a record of when the identification tag M was detected. Next, the information integration unit 43 calculates the shooting location of each image P taken within the construction site G by comparing the shooting time of the image P with the time of movement information, associates the shooting location with the image P, integrates them to create integrated data, and stores it in the database 44. Specifically, the information integration unit 43 performs the following processing on each captured image P. First, the information integration unit 43 obtains the time of capture of the captured image P. The information integration unit 43 refers to the time of capture in the identification tag detection history and extracts from the identification tag detection history any identification tags M that were detected at the time the image P was taken, or at the most recent past time, i.e., immediately before the image P was taken, and obtains the identification information (ID) of the identification tag M. The information integration unit 43 identifies the hierarchical level in which the image P was taken by referring to the hierarchy corresponding to the identification information of the most recently detected identification tag M, based on the correspondence relationships for the identification tags M stored in the database 44.

[0038] Furthermore, the information integration unit 43 obtains the coordinates of the corner Mc in the captured image Pa in which the detected identification tag M was photographed from the identification tag detection history. From the correspondence relationships related to the identification tag M stored in the database 44, the information integration unit 43 obtains the horizontal position within the construction site G where the identification tag M is installed and the orientation in which the identification tag M is displayed, corresponding to the identification information of the extracted identification tag M. Based on the coordinates of the corner Mc in the captured image Pa in which the identification tag M was photographed, the information integration unit 43 considers the shape of the identification tag M in the captured image Pa and calculates the relative position from the identification tag M in which the captured image Pa was photographed. From this relative position, the horizontal position of the identification tag M, and the orientation in which the identification tag M is displayed, the information integration unit 43 estimates, for example, the shooting position and shooting direction of the captured image Pa in which the identification tag M was photographed, as an absolute position within the construction site G. In this way, the information integration unit 43 estimates the shooting position of the captured image Pa in which the identification tag M that was detected immediately before was taken, using the position where the identification tag M that was detected immediately before was placed as a starting point.

[0039] The information integration unit 43 further calculates the shooting position of the currently processed image P, using the shooting position as a starting point, based on the movement information of the field worker Q generated by the movement information calculation unit 22. More specifically, the information integration unit 43 obtains, for example, the relative amount of movement from the time of capture of the image Pa in which the identification tag M detected immediately before was taken, to the time of capture of the image P, from the movement information calculation unit 22's movement information of the field worker Q. By adding this relative amount of movement to the capture position of the image Pa in which the identification tag M detected immediately before was taken, the unit calculates the capture position of the image P as, for example, an absolute position within the construction site G. Furthermore, the information integration unit 43 obtains the direction (orientation) of the field worker Q's movement at the time the image P was taken, based on the time the image P was taken, from the field worker Q's movement information. The information integration unit 43 associates and integrates these data to create integrated data.

[0040] In this way, after the creation of integrated data in the management system main unit 4 is completed, when an operator requests via the input unit 6 to display the progress of construction at a specific location (hierarchical and horizontal position) X and direction Xd within the construction site G, the time-lapse generation unit 45 creates a time-lapse Pt that displays the progress of construction at the location (hierarchical and horizontal position) X and direction Xd within the construction site G in accordance with the request (step S16). First, the image acquisition unit 47 of the time-lapse generation unit 45 extracts captured images P from the integrated data stored in the database 44, in which the hierarchy within the integrated data matches a specified hierarchy. Furthermore, the image acquisition unit 47 acquires a captured image P taken at a specified horizontal position from among the multiple captured images P of a specified hierarchy extracted as described above. Specifically, as shown in Figure 7, the image acquisition unit 47 identifies a position Kx from among multiple positions (horizontal positions) K where the captured image P was taken in the specified hierarchy, where the distance from the specified position X is closer than a threshold (e.g., 1 m). The image acquisition unit 47 acquires all captured images P taken at the identified position Kx close to the specified position X, regardless of the time of capture, and treats these as captured images P taken at the specified position X.

[0041] Next, the image creation unit 48 extracts a pre-set area from the captured image P (360-degree image) P obtained as described above, which was taken at the specified position X, around the specified direction Xd (see Figure 9), that is, including the specified direction, converts this into a planar image, and creates the specified position image Ps. Furthermore, as shown in Figure 12, the time-lapse generation processing unit 49 generates a time-lapse Pt representing the progress of various construction projects by arranging multiple specified position images Ps created by the image creation unit 48 in chronological order based on the shooting time of the captured image P. The time-lapse generation processing unit 49 outputs the generated time-lapse Pt data to the display unit 5. The display unit 5 displays the time-lapse Pt transmitted from the management system main unit 4. (Step S17)

[0042] The construction progress display system 1 described above is a construction progress display system 1 that displays the progress of various construction work within a construction site G, and comprises a time-lapse generation unit 45 that generates a time-lapse Pt representing the progress of various construction work by extracting a number of specified location images Ps taken from the captured image P, including the location and direction of movement history of the site worker Q or the mobile body, based on movement information associated with the captured image P, and the location and direction of movement history of the site worker Q or the mobile body, and arranging them consecutively in order of the time of capture, when a location and direction within the construction site G are specified, and a display unit 5 that displays the time-lapse Pt. With this configuration, images P taken as a field worker Q or mobile object moves within the construction site G are associated with movement information that includes the history of the field worker Q or mobile object's position and direction of movement. Therefore, when a position X within the construction site G and a direction Xd from that position X are specified, by comparing the position and direction of movement in the movement information with the specified position and direction, it is possible to obtain images P taken when the field worker Q or mobile object was moving at the specified position, including the specified direction Xd. Here, for example, if the field worker Q or mobile object periodically patrols within the construction site G, there should be multiple images P taken at the specified position X at multiple different times. Therefore, by extracting multiple images P that include the specified direction Xd from these multiple images P corresponding to the specified position, and arranging them consecutively in order of shooting time, it is possible to generate a time-lapse Pt that represents the progress of the construction as it changes over time. By displaying the time-lapse Pt generated in this way, the progress can be easily grasped. The captured images P and movement information, which form the basis for generating the time-lapse Pt, can be easily acquired by, for example, a field worker Q or a mobile body carrying a camera or other recording device 3 that can capture still images or videos, and an autonomous navigation means 2 such as a smartphone with a built-in gyro sensor 21, while patrolling the construction site G. In other words, there is no need to introduce special equipment to acquire the captured images P and movement information. In addition, the captured images P and movement information can be acquired incidentally, for example, by a field worker Q or a mobile body patrolling the construction site G as part of their normal duties, and there is no need to perform any special work separately when generating the time-lapse Pt. Therefore, it can be operated simply.

[0043] Furthermore, the construction progress display system 1 includes an autonomous navigation means 2 equipped with an autonomously operating sensor 21 that can be held or worn by a site worker Q or a moving object to acquire movement information of the site worker Q or the moving object; a shooting recording device 3 equipped with a sensor 21 that can be held or worn by a site worker Q or a moving object to take pictures within the construction site G and acquire captured images P; and an information integration unit 43 that, for each captured image P, compares the time of shooting of the captured image P with the time of movement information to associate the captured images P and the movement information by time and stores them in a database 44. With this configuration, while a field worker Q or a mobile body is holding or wearing the autonomous navigation means 2 and the image recording device 3, it moves within the construction site G, and the image recording device 3 takes pictures of the construction site G, while the autonomous navigation means 2 acquires information about the movement of the field worker Q or the mobile body. The image recording device 3 also acquires images P of the construction work within the construction site G by taking pictures of the construction site G. The information integration unit 43 matches the time of capture of the images P with the time of movement information, and stores the images P and movement information in the database 44, associating them by time. As a result, the time-lapse generation unit 45 can generate a time-lapse Pt by arranging the images P taken as the field worker Q or mobile body moves within the construction site G and the movement information, and specifying position images Ps at specified locations in order of capture time.

[0044] Furthermore, the captured image P is a 360-degree image, and the time-lapse generation unit 45 selects from the captured image P an image in which the distance between the specified position X and the shooting position is closer than a threshold, and then cuts out the area around the specified direction Xd from the acquired captured image P to create an image Ps of the specified position. With this configuration, it is possible to easily create images Ps at a specified position around a specified direction Xd from the captured image P, which is a 360-degree image.

[0045] In the above embodiment, the system relates to construction progress management in construction work, and allows for easy confirmation and recording of the progress process of interior work at any location within the building as a time lapse. Furthermore, as a construction progress monitoring system, it can also estimate the progress of various construction works by linking information on the progress of construction with BIM data. Here, BIM data is defined as a building database that adds attribute data such as cost, finishes, and management information to a 3D digital model of the building.

[0046] (Modified examples of the embodiment) It should be noted that the construction progress display system of the present invention is not limited to the embodiments described above with reference to the drawings, and various modifications are conceivable within its technical scope. For example, in the above embodiment, an omnidirectional camera is used as the image recording device 3, but a normal camera that captures a planar image in only one direction can also be used as the image recording device 3. In this case, the shooting direction of the captured image P is considered to be the direction of movement of the field worker Q when the captured image P was taken, and when the position (hierarchy and horizontal position) and direction are specified, images Ps at the specified position may be extracted from all captured images P registered in the integrated data, where the hierarchy matches the specified hierarchy, the distance between the horizontal position K where the captured image P was taken and the specified horizontal position is closer than a threshold, and the angle between the shooting direction (direction of movement) and the specified direction is smaller than a threshold. [Explanation of symbols]

[0047] 1. Construction progress display system G Construction site 2. Autonomous navigation means P Captured image 3. Image recording device Ps: Image at specified position 5 Display Unit Pt Time-lapse 21 Sensor Q Field worker 43 Information Integration Department X Position 44 Database Xd Direction 45 Time-lapse generation unit

Claims

1. A construction progress display system that shows the progress status of various construction work within a construction site, A time-lapse generation unit extracts multiple images taken from designated locations within the construction site based on images captured by on-site workers or mobile objects in motion, and generates a time-lapse representing the progress of the various construction works. A construction progress display system characterized by having the following features.

2. The time-lapse generation unit extracts the designated location image based on the captured image and the movement information associated with the captured image, which includes the history of the position and direction of movement of the field worker or the moving object. The aforementioned movement information includes the time associated with each of the aforementioned history entries, An autonomous navigation means equipped with an autonomously operating sensor, configured to be held or worn by the field worker or the mobile body, and which acquires the movement information of the field worker or the mobile body, A recording device configured to hold or attach the aforementioned on-site worker or the aforementioned mobile body, which photographs the construction site and acquires the captured images, For each of the aforementioned captured images, an information integration unit compares the time the image was captured with the time of the movement information, thereby associating the captured images and the movement information by time and storing them in a database. The construction progress display system according to claim 1, characterized by comprising the following features.

Images