Construction site construction management system, construction site construction management method, and program

Abstract

To provide a construction site construction management system, a construction site construction management method and a program capable of improving efficiency of construction site construction management by utilizing data photographed at a construction site.SOLUTION: A construction site construction management system 1 that performs construction management of a construction site using a computer (2,3,4) and a captured image of the construction site captured by a camera 2 includes a determination unit 54 that determines a construction state of the construction site based on the captured image, and an image generation unit 53 that generates a walk-through image W that is browsable from an arbitrary angle based on the captured image and a route display (13) for identifying a route captured by the camera on a design plan view of the construction site. A determination result by the determination part is displayed on the route display, and when a user operates the route display, the walk-through image photographed on the route is displayed.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a construction site construction management system, a construction site construction management method, and a program for managing construction work at a construction site. [Background technology]

[0002] Previously, management systems have been proposed for construction sites of buildings, apartment buildings, etc. For example, Patent Document 1 describes a system that uses a patrol robot to photograph objects within the facility at predetermined points and uses the images to manage progress. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-30717 Summary of the Invention [Problem to be solved by the invention]

[0004] Construction sites change daily as work progresses, but the latest information is always required to make appropriate decisions and carry out the work. In recent years, technological advances have improved the performance of cameras, making it possible to link captured video and still images with floor plans of the construction site. This technology makes it possible to visually record the construction status, but it has the following challenges:

[0005] All still images and videos taken at construction sites quickly become outdated because the site changes daily. As a result, much of the data is not used for daily management, but is simply stored as an archive, posing the challenge of how to utilize the latest data for on-site construction management. Furthermore, construction work involves a large amount of administrative work, such as creating reports for stakeholders such as the contractor and government, as well as various construction personnel, and issuing work instructions when construction defects occur. This administrative work places a heavy burden on the construction industry, and the reality is that the captured data is not being used effectively.

[0006] The present invention has been proposed in light of the above circumstances, and its purpose is to provide a construction site construction management system, construction site construction management method, and program that can utilize data photographed at construction sites to improve the efficiency of construction site construction management. [Means for solving the problem]

[0007] In order to achieve the above object, a construction site construction management system is a construction site construction management system that uses a computer and images of the construction site taken by a camera to manage construction at the construction site, and is equipped with a judgment unit that judges the construction status of the construction site based on the images, and an image generation unit that generates walk-through images that can be viewed and operated from any angle based on the images and a route display that identifies the route taken by the camera on a design floor plan of the construction site, and displays the judgment result by the judgment unit on the route display, and when a user operates the route display, the walk-through image taken along the route is displayed.

[0008] The construction site construction management system may automatically generate work instructions by automatically inserting at least the walk-through image, the judgment result, and the corresponding portion of the design plan corresponding to the judgment result. The construction site construction management system may further include a judgment unit that judges the progress rate for each type of work at the construction site based on the photographed images, automatically generate a progress chart for each type of work based on the photographed images and a schedule, and reflect the progress rate judged by the judgment unit in the progress chart. The construction site construction management system may also display a measuring indicator that allows actual dimensions to be recognized on the walk-through image and can be moved in all directions, including up and down, left and right, and diagonally, by the user. The construction site construction management system may also be configured to use learning results from machine learning to make judgments in the judgment unit. The construction site construction management system may also compare a previously photographed image with an image of the same location and display different locations or the positions of specified building components in the walk-through image.

[0009] The construction site construction management system may also display, along with the walk-through images captured along the route, a judgment button that allows the user to select and set a work type from multiple work types to evaluate the construction status of the construction site. In this case, the work types may include an undercut judgment that determines whether or not there is an excessive gap between a door and a floor installed at the construction site, and the judgment result of the undercut by the judgment unit may be displayed on the door or the floor on the walk-through image. In this case, the work types may also include a floor clearance judgment that determines whether or not there is an excessive gap between a floor and a wall installed at the construction site, and the judgment result of the floor clearance by the judgment unit may be displayed between the floor and the wall on the walk-through image. In this case, the work types may also include a board screw pitch judgment that determines whether the spacing between multiple screws securing base boards installed at the construction site is appropriate, and the judgment result of the board screw pitch by the judgment unit may be displayed on the walk-through image, along with the positions of the multiple screws and the lines connecting the screws.

[0010] In order to achieve the above object, a construction site construction management method is a construction site construction management method in which construction management of the construction site is carried out by a computer based on images of the construction site taken by a camera, and a route display that identifies the route taken by the camera is displayed on a design plan of the construction site, and a judgment result of the construction status of the construction site based on the captured images is displayed on the route display, and when a user operates the route display, a walk-through image that can be viewed and operated from any angle based on the captured images of the route is displayed. Also, a program for achieving the above object causes the computer to execute the construction site construction management method. [Effects of the Invention]

[0011] Since the construction site construction management system, construction site construction management method and program of the present invention are configured as described above, it is possible to utilize data photographed at the construction site to improve the efficiency of construction site construction management. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a system diagram of a construction site execution management system according to an embodiment of the present invention. [Figure 2] (a) is an example of a block diagram of a camera in the construction site management system, and (b) is an example of a block diagram of a user terminal in the construction site management system. [Figure 3] 1 is an example of a block diagram of a server in the construction site execution management system. [Figure 4] 10A is a flowchart showing the outline of the basic operation of the construction site execution management system, and FIG. 10B is a diagram for explaining an example of the display of a judgment button. [Figure 5] 10 is a diagram showing a schematic example of a display of a design plan of a construction site displayed on the display unit of a user terminal in the construction site execution management system. FIG. [Figure 6] (a) A diagram showing a schematic example of a walk-through image displayed on the display unit of a user terminal in the construction site construction management system, and (b) is a diagram for explaining an example of the display of the judgment button shown in Figure 6(a). [Figure 7] 10(a) and 10(b) are diagrams showing an example of a walk-through image displayed on the display unit of a user terminal in the construction site execution management system. [Figure 8] 10(a) and 10(b) are diagrams showing an example of a walk-through image displayed on the display unit of a user terminal in the construction site execution management system. [Figure 9] 10A and 10B are diagrams showing an example of a walk-through image displayed on the display unit of a user terminal in the construction site execution management system. [Figure 10]FIG. 7 is a diagram showing an example of a work instruction sheet automatically created based on a walk-through image using the instruction sheet function shown in FIG. 6(a). [Figure 11] 10A and 10B are diagrams showing an example of a production progress chart automatically created based on a photographed image. [Figure 12] FIG. 10 is a diagram illustrating an example of material management based on a walk-through image. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The construction site construction management system 1 according to this embodiment (hereinafter referred to as the construction management system) manages construction at a construction site using a computer (2, 3, 4) and photographed images of the construction site, and is equipped with a determination unit 54 that determines the construction status at the construction site based on the photographed images, and a setting unit 56 that allows the type of work for which the construction status is to be determined to be freely selected from a plurality of work types and set. These will be described in detail below.

[0014] In this embodiment, unless otherwise specified, the term "user" refers to a system user who has the authority to access the construction management system 1 in this embodiment. Potential users include not only construction companies and construction owners, but also clients, various construction-related personnel, and government agencies. Furthermore, the person taking the images at the construction site using the camera 2 is not particularly limited, and includes not only people but also robots. Furthermore, construction sites are not limited to large-scale construction sites such as buildings, apartment buildings, commercial facilities, and hospitals, but also include small-scale construction sites for private homes and small stores, and even civil engineering construction sites such as tunnels and bridges. Therefore, the content of the judgment by the judgment unit 54 is not limited to the content described below, but may be content that judges the construction condition, such as poor construction at the construction site.

[0015] <System> FIG. 1 shows an example of a construction management system 1 according to this embodiment. The construction management system 1 includes a camera 2 capable of capturing images of the construction site, a user terminal 3 such as a smartphone or personal computer, and a server 4 connected to these via a communications network 7, allowing the system to communicate freely with each other in a secure environment. Examples of the communications network 7 include telephone networks such as public switched telephone networks, mobile phone networks, next-generation telephone networks, and leased-line telephone networks, as well as packet-based networks such as the Internet. The communications standard is not particularly limited, and includes any network that provides data communication via wireless signals. An example of such a network is a wireless local area network (WLAN) that uses Wi-Fi / WiMax communications.

[0016] <Camera> As described above, camera 2 may be any camera capable of capturing images of the construction site. For example, a dedicated wide-angle camera, such as a 360-degree camera, may be used, or the camera may be a smartphone capable of capturing wide-angle images. Camera 2 is preferably capable of capturing an image over a 180-degree range. It may be a head-mounted (helmet-mounted) or handheld camera that can capture images while walking around the construction site, or it may be mounted on a tripod or fixed to a wall or floor. When capturing images handheld, a fixture may be used to hold camera 2. For example, if the construction site to be managed is a detached house, a single camera 2 equipped with a wide-angle lens may be installed in a position that allows it to capture the entire site. For large-scale construction sites such as large apartment buildings, it may be possible to capture images while walking around the construction site or remotely control a robot that can travel around the construction site. Furthermore, the installation location and capture method of camera 2 may be changed based on the construction schedule. The captured image referred to here refers to an image taken arbitrarily within the construction site, and as long as the captured image generated by the image generation unit 53 can be converted and viewed at any angle by the user's operation, there are no restrictions on the image format, shooting method, number of cameras used for shooting, pixel count of the captured image, etc. Of course, in order to make the determination result by the determination unit 54 more accurate, it is desirable to use a camera 2 that can obtain captured images with high photo resolution and video resolution.

[0017] FIG. 2(a) shows an example of a block diagram when a 360-degree camera dedicated to wide-angle image capture is used as the camera 2. The camera 2 includes a control unit 20, a transceiver 21, a memory 22, a display 23, an operation unit 24, and a lens 25. The control unit 20 is, for example, a microcomputer, and includes a CPU (Central Processing Unit) 20a that performs calculations and processing on acquired data in accordance with computer programs stored in the memory 22, thereby executing various processes. The transceiver 21 includes a communication module such as Bluetooth Low Energy (BLE) or a mobile phone communication network that performs short-range wireless communication with the user terminal 3 and the server 4, and transmits and receives data such as captured images. The memory 22 is composed of memories such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and stores various computer programs executed by the control unit 20, data on captured images, and the like. The images captured by the camera 2 may be stored in the server 4 sequentially via the communication network 7 and may be configured to be viewable in real time from the user terminal 3 (so-called cloud camera), or the captured images may be imported (uploaded) to the server 4 via an external interface. Furthermore, the images captured by the camera 2 may be imported into the user terminal 3 once, and then the user may select the images to be judged by the judgment unit 54 and import them into the server 4.

[0018] Display unit 23 is composed of a liquid crystal display, an organic EL (Electro Luminescence) display, or the like, and displays various information under the control of control unit 20. Operation unit 24 is a user interface that accepts operations such as starting shooting by the user, and includes touch operation of display unit 23, button operation, and voice operation. Lens 25 may be a full hemispherical or hemispherical type, and may be a single lens, dual lens, or multi-lens with three or more lenses. In addition to the above, camera 2 may also have an image stabilization function or a waterproof function, or may have an image generation unit with the function of adjusting the brightness of the captured image.

[0019] <User device> FIG. 2(b) shows an example block diagram of a user terminal 3, such as a smartphone or laptop computer. The user terminal 3 refers to a computer used by the user, and may be a smartphone, laptop, tablet, or desktop computer. Essentially, the user terminal 3 has a display unit 23 capable of displaying a screen for selecting the type of work for which the construction status is to be assessed and a walk-through image W via a communication network 7, and an operation unit 24 capable of operating a design floor plan 8 and viewing the walk-through image W from any angle. Therefore, for example, the user terminal 3 may require a dedicated application to access the construction management system 1, or it may be accessible from a browser. From a security perspective, the user terminal 3 may be configured to grant access to the construction management system 1 by logging in via an account, or it may be configured to be accessible via a unique URL.

[0020] The user terminal 3 includes a control unit 30, a transmission / reception unit 31, a memory unit 32, a display unit 33, an operation unit 34, and a camera 35. The control unit 30 is, for example, a microcomputer, and includes a CPU 30a that performs calculations, processing, and the like on acquired data in accordance with computer programs stored in the memory unit 32, thereby executing various processes. The transmission / reception unit 31 includes a communication module that transmits and receives data to and from the server 4, etc. The memory unit 32 is composed of memories such as RAM and ROM, and an HDD, and stores various computer programs executed by the control unit 30. The display unit 33 is composed of a liquid crystal display, an organic EL display, or the like, and displays various information and the construction status assessment results (described later) within the walk-through image W under the control of the control unit 30. The operation unit 34 is a user interface that accepts user operations, and includes, for example, a touch switch provided on a thin display constituting the display unit 33, which outputs signals corresponding to operations and is operated by voice.

[0021] <server> FIG. 3 shows an example of a block diagram of the server 4, which performs image processing, judgment processing, production progress chart generation, work type selection, instruction sheet generation, etc. The server 4 is configured with an information processing device such as a computer, and may be a single server or may be configured with multiple servers, such as a server for image generation and a database server for data storage. The server 4 may be a dedicated server computer or a cloud server. Security measures such as a firewall are provided between the server 4 and the communication network 7. The server 4 includes an image processing server 5 and may also include a learning device 6 to improve the judgment accuracy of the judgment unit 54. The image processing server 5 includes a control unit 50, a transmission / reception unit 51, a memory unit 52, an image generation unit 53, a judgment unit 54, a production progress chart generation unit 55, and a setting unit 56.

[0022] The control unit 50 includes a CPU 50a, and various processes are performed by the CPU 50a executing various programs stored in the storage unit 52. The transmission / reception unit 41 transmits and receives data, files, operation signals from the operation units 24, 34, and the like to and from the camera 2 and the user terminal 3. For example, the transmission / reception unit 41 receives images captured by the camera 2 and transmits information to be displayed on the display unit 33. The storage unit 52 stores image processing programs required for the image processing server 5 to operate, various programs and data for determining the construction status, and the like.

[0023] Based on the images captured by the camera 2, the image generation unit 53 generates a walk-through image W, which can be viewed from any angle by the user, based on a screen for selecting the type of work for which the construction status is to be assessed from multiple work types, as shown in FIG. 4(b), and the captured images. The walk-through image W may be partially a CG image, as long as it can be viewed from any angle by the user. It may also be generated by combining not only the captured image but also 2D design drawings, 3D data, and CG. For example, the captured image may be incorporated into a 3D model created using software that realizes BIM (Building Information Modeling), to generate the walk-through image W, and the system according to this embodiment may be applied. The image generation unit 53 also generates images (e.g., FIGS. 5 and 6(a)) that display the determination result display 9 on the design floor plan 8 or the walk-through image W, and images (e.g., FIG. 5) that display the determination result display 9 in color, graphics, and text on the design floor plan 8 of the construction site. The image generation unit 53 compares images taken in the past with images taken of the same location, and generates an image that displays areas that differ from the past and / or the positions of specified building components on the walk-through image W. The image generation unit 53 also generates an image that displays a measuring indicator M1 (see FIG. 8(a) and FIG. 9(a)) that allows the actual dimensions to be recognized on the walk-through image W, and a level M2 (see FIG. 8(b)) that can measure horizontal and vertical.

[0024] The determination unit 54 determines the construction status of the construction site using a determination algorithm corresponding to the selected work type based on the images of the construction site captured by the camera 2 or the walk-through images W generated from the captured images. Specific determination examples will be described later with reference to the drawings. The determination unit 54 also determines the progress rate for each work type at the construction site based on the captured images. Specifically, the determination unit 54 determines the progress rate for each work type based on the captured images, such as the percentage of walls and ceilings with light-gauge steel substrates that have been completed, or the percentage of wallpapering that has been completed, based on the captured images. When determining the progress rate, for example, if a work is determined to be "requiring confirmation," the program may not recognize it as completed, even though the construction itself is complete. This enables progress management that is more suited to the actual situation at the site. Progress management will be described further with reference to the drawings. Although not shown, the results of the determination by the determination unit 54 may be displayed by the image generation unit 53 in bar graphs or line graphs for each work type and each shooting date.

[0025] The progress report generation unit 55 generates a progress report for each type of work at the construction site based on the captured images. The specific generation of the progress report 80 will be described later with reference to FIG. 11. The setting unit 56 can freely select and set the type of work for determining the various settings and registrations in the construction management system 1 and the construction status from among a plurality of types of work. The type of work selection will be described with reference to FIG. 4, etc.

[0026] When the server 4 is equipped with a learning device 6, the learning device 6 includes a control unit 60 having a CPU, GPU, GPGPU, etc. capable of machine learning, and a memory unit 61 that stores a learning dataset. The learning device 6 works in conjunction with a judgment unit 54 that judges the construction status of a construction site, and performs AI learning to improve the judgment of the judgment unit 54. The memory unit 61 is composed of memories such as RAM and ROM, and an HDD. The control unit 60 reads and executes a program corresponding to machine learning from the memory unit 61, thereby performing machine learning using the learning dataset and generating a trained model. For example, a learning dataset is generated that includes multiple pairs of judgment results between image data of poor construction on a wall surface with uneven paint and image data of a wall surface without uneven paint, and image data to be judged as poor construction is input to a neural network as input data, and the neural network is trained to output a judgment result of poor construction for the input image data from the output side.

[0027] <Basic operation> Next, the basic operation of the construction management system 1 and examples of display (image generation examples) of the design floor plan 8 and the walk-through image W will be described with reference to Figures 4 to 6. Here, as an example of judging the construction status, a comparison of predetermined reference data with a captured image will be described to determine whether the wall and floor surfaces at a construction site, specifically, whether the fitting doors and floors, which are inspected at the construction site as part of a voluntary inspection, have been constructed without creating any unnecessary gaps, and an example of judging undercuts will be described.

[0028] First, an image of the construction site is captured by camera 2 (FIG. 4, S100). Then, the user terminal 3 selects the type of work (FIG. 4, S101). Figure 4(b) shows an example of the display of the judgment button 11a, which allows the user to select the type of work. There are various types of work for which the status of construction at a construction site needs to be assessed. In this example, the judgment button 11a allows the user to select the type of work for which the status of construction will be assessed from among multiple types of work. As shown in Figure 4(b), when the menu button 11aa next to the undercut key 11ad is pressed, the board screw pitch key 11ae and floor clearance key 11af are displayed, allowing the user to select the type of work for which the status of construction will be assessed. Therefore, if the user wants to assess the status of undercuts, the user simply selects the undercut key 11ad. The scope of the assessment can be the entire construction site being managed, or it can be performed for each walk-through image W, as shown in Figure 6(a). Selection can also be made from the design floor plan shown in Figure 5. When the type of work is selected and the setting unit 56 sets that "undercut" has been selected from among multiple types of work, the determination unit 54 determines the construction status based on the captured image (FIG. 2, S102). The determination result is then displayed on the design floor plan 8 shown in FIG. 5 and the walk-through image W shown in FIG. 6(a).

[0029] FIG. 5 shows an example of the display of a design plan 8. The design plan 8 is the actual design drawing of the construction site that has been imported into the construction management system 1 and displayed. In this embodiment, the design plan 8 is linked to the walk-through image W, and is configured so that the design plan 8 alone can be displayed enlarged based on the user's operation. For example, in the state of FIG. 6(a) in which the walk-through image W is displayed, moving the cursor over the design plan 8 displayed on the right and clicking it may switch to the screen of FIG. 5. In this case, the design plan 8 of the construction site may display the judgment result using color, icons, or text.

[0030] In Figure 5, the judgment result display 9 by the judgment unit 54 is displayed in a balloon-like figure, with the words "OK" and "Confirmation Required" (Figure 4, S103, S104). Here, the judgment result of the undercut construction status is displayed, along with a progress status display 14 that reads "100% complete." Furthermore, dotted lines 13 are also displayed in the design floor plan 8 to show the path and trajectory captured by the camera 2. This allows you to see at a glance where the site is being photographed and where it is not. Clicking on each point on the dotted lines 13 may also switch the screen to display a walk-through image W as shown in Figure 6(a).

[0031] Clicking on the dotted line of the room marked "Confirmation Required" in the display of FIG. 5 allows the user to view the walk-through image W shown in FIG. 6(a). The walk-through image W is generated by the image generation unit 53 of the image processing server 5. The format of the walk-through image W is not particularly limited, as long as it allows the user to freely view and manipulate the captured image from any angle by operating the operation unit 34 of the user terminal 3. FIG. 6(a) shows an example of the walk-through image W displayed on the display unit 33 of the user terminal 3. At first glance, it is unclear whether the image of the room displayed in FIG. 6(a) allows the user to change the viewpoint. However, by placing the cursor on the "circle W2" displayed in the walk-through image W and moving the operation unit 34, such as the mouse of the user terminal 3, up, down, left, right, or any other angle as desired, the user can view the captured image of the site from any angle as if walking around the site. In this embodiment, the image described above is referred to as a walk-through image.

[0032] Operation bars 11, 12 are provided at the upper and lower ends of the walk-through image W. The lower operation bar 11 includes a judgment button 11a that displays the judgment result by the judgment unit 54 and stores buttons for executing the judgment, an operation cursor 11b that allows viewing and operating the captured images and videos, and a date and time display unit 11c that displays the shooting date and time of the image displayed on the display unit 33. The upper operation bar 12 includes operation buttons that allow downloading the captured image to the user terminal 3 and uploading another captured image, and operation buttons that allow enlarging and reducing the walk-through image W.

[0033] A window W1 is provided at the top right corner of the walk-through image W, displaying the design floor plan 8 (see Figure 5) for easy identification. The design floor plan 8 displayed in this window W1 is linked to the walk-through image W displayed on the display unit 33 of the user terminal 3. Below that, a judgment result display 9 by the judgment unit 54 is displayed. Here, the judgment result display 9 is displayed as the text "Confirmation Required." However, this is not limited to this. It may be displayed as the English word "NG," an icon that intuitively indicates that confirmation is required, or a symbol or graphic such as a penalty mark. It may also be displayed in color. In the walk-through image W shown in Figure 6(a), the areas judged by the judgment unit 54 are indicated by dotted lines, and double circles and arrows are used to indicate areas requiring confirmation so that the judgment result can be recognized. This allows users to see at a glance what the judgment unit 54 judged, and which areas are problematic in construction and which are not. The instruction function 10 provided below the judgment result display 9 will be described later.

[0034] The operation for judging the construction status can be performed not only by operating the separate screen shown in FIG. 4(b), but also by operating the judgment button 11a on the operation bar 11 on the lower side shown on the walk-through image W. FIG. 6(b) shows an example of the display of the judgment button 11a. The judgment button 11a includes a pull-down menu button 11aa and a judgment key 11ab, and when the menu button 11aa is operated, a judgment edit key 11ac is displayed (see the right side of FIG. 6(b)). When the judgment key 11ab is operated, an automatic judgment is made by the judgment unit 54 (FIG. 4, S102), and a judgment is made by the judgment unit 54. In this case, the quality of the construction status of the currently displayed walk-through image W is judged.

[0035] The method by which the judgment unit 54 determines whether the construction condition is good or bad is not particularly limited, but the judgment may be made, for example, by comparing predetermined reference data with the data of the captured image. For example, an image data processing program (e.g., an image difference detection program) compares generated ideal image data with the actually captured image data to detect the difference. The image processing program then determines whether the construction condition is "OK" or "check required" based on the magnitude of the difference. Note that the judgment program in the judgment unit 54 is not limited to the above, and the predetermined data may be threshold data. When the predetermined data is threshold data, the gap between the door and the floor is calculated from the image data, and if it exceeds the threshold, it is displayed on the walk-through image W as "check required" or if it is below the threshold (FIG. 4, S105).

[0036] FIG. 6(b) shows an example of the display of the judgment button 11a. The judgment button 11a displayed on the walk-through image W includes a judgment edit key 11ac. Operating the menu button 11aa next to the judgment button 11a displays the judgment edit key 11ac, and operating the judgment edit key 11ac enables text editing of the judgment result display 9. That is, the user can input text regarding the judgment result from the user terminal 3. Therefore, judgment editing can be performed after directly inspecting a construction site that has been judged as "requiring inspection" by the judgment unit 54, or the user can visually judge the construction status of the undercut by viewing the walk-through image W. Note that the judgment editing can be performed by generating a separate judgment edit screen (not shown) on the walk-through image W that allows the user to input the judgment result, or by selecting a predetermined word (e.g., "OK," "Request construction from a contractor," etc.) from a pull-down menu. In this way, while relying on automatic judgment by the judgment unit 54 as the basis, if only the areas displayed as "requiring confirmation" in the judgment result of the judgment unit 54 are visually checked by the user (human), the efficiency of construction management can be improved dramatically. Furthermore, by utilizing user judgment to assist the judgment by the judgment unit 54, the reliability of the construction management system 1 can be further improved.

[0037] <Examples of display content on user devices and construction status assessment content> In the construction management system 1, it is extremely important for construction management to clearly display the construction status of the construction site on the user terminal 3. Examples of the display content and construction status judgment content on the user terminal will be further explained below with reference to the drawings.

[0038] 7(a) and 7(b) show another example of the construction status assessment. FIG. 7(a) shows an example of an assessment performed at a construction site as a self-inspection to determine whether construction has been completed without creating unnecessary gaps between the floor and the wall, and the assessment result is displayed on the walk-through image W. In this case, the assessment can be performed by operating the floor clearance key 11af (see FIG. 4(b)) during work type selection (FIG. 4, S101), or by displaying the walk-through image W of the area to be assessed and operating the assessment button 11a. When the assessment unit 54 performs a assessment based on user operation, areas on the walk-through image W that are determined to have unnecessary gaps are displayed in a different color than the other areas, and an arrow and text are displayed for those areas. The assessment result display 9 also displays the text "Confirmation Required." If the user determines that there are no problems by enlarging the areas marked as requiring confirmation, the user can operate the assessment edit key 11ac (see FIG. 6(b)) and enter "OK."

[0039] Next, FIG. 7(b) shows an example of a self-inspection performed at a construction site to determine whether the construction of base boards has been carried out without problems, and the result of the judgment is displayed on the walk-through image W. In this example, too, the judgment can be performed by operating the board screw pitch key 11ae (see FIG. 4(b)) during work type selection (FIG. 4, S101), or by displaying the walk-through image W of the area to be judged and operating the judgment button 11a. When the judgment unit 54 performs a judgment through user operation, the positions of the screws securing the base board are circled on the walk-through image W, and lines are displayed between the screws. This allows the user to determine whether there are any problems with the screw pitch, and arrows and text are displayed for areas where distortion is detected. Also, here, if the judgment is "requiring confirmation," the judgment result display 9 displays the result in text. At this time, if the user determines that there are no problems by enlarging the area indicated as requiring confirmation, the user can operate the judgment edit key 11ac (see FIG. 6(b)) and enter "OK."

[0040] As can be seen from the above, as is clear from Figure 6(a) and other figures, the walk-through image W is clear, so by enlarging the walk-through image W or freely changing the viewing angle to check the construction site, it is possible to check the construction work according to various sites, such as the amount of floor clearance, whether there are any cracks, unevenness, or distortions in the base boards, and whether the base boards are attached in a hook-shaped manner around openings.

[0041] <Other function examples> Other examples of the functions of the construction management system 1 according to this embodiment will be further described. The examples shown in FIGS. 8(a) to 9(b) show hidden areas that will later be covered by wall or ceiling materials. Plywood G is applied to areas where air conditioners, handrails, kitchen cabinets, etc. will be installed later, but the size of the plywood G is unclear from the captured image alone. It is also difficult to determine whether the plywood G is installed horizontally. Therefore, FIGS. 8(a) to 9(a) show an example equipped with a measurement function 15. Operating the measurement function 15 on the walk-through image W displays a pull-down menu (not shown) with options including "measurement function," "level function," and "cross rod function," allowing users to select and use the function. FIG. 8(a) shows an example in which a measuring indicator M1 is displayed on the walk-through image W, enabling the user to measure the height of the area where the plywood G is applied. The measuring indicator M1 is displayed so that it can be moved in all directions, including up and down, left and right, and diagonally, by the user's operation. FIG. 8(b) shows an example in which a level M2 is displayed, allowing for horizontal and vertical measurements, to confirm whether plywood G is installed horizontally. FIG. 9(a) shows an example in which a cross rod M3 is used instead of the measuring indicator M1 to recognize the dimensions of the plywood. While FIGS. 8(a) and 9(b) show an example of plywood G, the use of the measurement function is not limited to the illustrated example. For example, the measuring indicator M1 and cross rod M3 can be used as a measurement guide for any location, and the level M2 can be used to check whether pipes, towel racks, counters, and other items that must be installed horizontally are installed properly.

[0042] In these examples, the judgment unit 54 may also be used to make a judgment. In this case, the walk-through image W of the area where the judgment is desired, such as the vertical and horizontal dimensions and levelness of the plywood G, is displayed, and the judgment button 11a is operated, whereby the judgment unit 54 makes a judgment. If the judgment unit 54 judges that the desired dimensions and levelness are met, a message such as "OK" is displayed. If the desired dimensions and levelness are not met, the judgment result display 9 displays a message such as "Confirmation Required." This also makes it possible to judge the quality of the construction status without visiting the construction site, and to confirm whether the desired dimensions and levelness are met. Furthermore, in the case of the construction photographs shown in Figures 8(a) to 9(a), the dimensions and levelness can be recorded as records of the base photographs of areas hidden by wall materials, etc.

[0043] Figure 9(b) shows the same location as Figure 9(a) after interior construction work has been completed, with the plywood G hidden beneath the wall material indicated by a dotted line. The image generation unit 53 compares a previously captured image (e.g., Figure 9(a)) with an image of the same location (e.g., Figure 9(b)), and generates an image in the walk-through image W that displays differences from the previous image and / or the location of specific building components. As described above, the location of specific building components—in the example of Figure 9(b), the plywood G—is displayed, allowing for smooth installation of, for example, a kitchen wall cabinet. Furthermore, if the location of the plywood for the air conditioner base and handrail base is displayed, installation of the air conditioner, handrail, etc. can be performed smoothly and without errors, in accordance with the Quality Assurance Act. Furthermore, by saving these captured images, they can serve as evidence that the construction was carried out according to the blueprints.

[0044] FIG. 10 shows an example of a work instruction sheet 70 automatically created based on a walk-through image W. If the construction status is assessed based on the walk-through image W and a contractor or user needs to inspect the site, the work instruction sheet 70 can be automatically created by clicking the instruction sheet function 10 displayed on the photographed image or walk-through image W. The extent to which the work instruction sheet 70 shown in FIG. 10 is automatically filled out can be configured as desired, but it is convenient to automatically paste the "photograph date," the site's "walk-through image," and the "design floor plan," while allowing the user to enter information in the description, comment, and responsible person fields. Conventionally, creating instructions to point out defects and instruct contractors on work involves a lot of analog work, such as uploading photographs, scanning the corresponding design floor plan, and highlighting the relevant areas. However, the construction management system 1 of this embodiment significantly reduces the workload. Another significant advantage is that clear walk-through images W can be attached to the work instruction sheet 70, eliminating the need for explanations to contractors.

[0045] The example shown in Figure 10 is intended as a work instruction 70 for a contractor, but it can also be used as a progress report. If there are any concerns each time a work is checked using the walk-through image W, the instruction function 10 can be used to record the on-site situation with comments. It can also be used as a document for on-the-job training (OJT) at sites where difficult construction work or construction examples are rare. Reports can also be used not only for progress reports, but also for troubleshooting. Furthermore, for example, the walk-through image W can be used to check and report on the usage status of equipment that requires safety management, such as high-speed cutters, at the site. Even in this case, the ability to attach the walk-through image W allows for effective attention to be given without intimidating the site, contributing to the creation of a site where flat human relationships can be built.

[0046] Figure 11 shows an example of a progress chart 80. This progress chart 80 reflects progress on a schedule based on images of the construction site. Figure 11 shows an example of progress chart data automatically generated by the progress chart generator 55 for the private areas of a certain condominium, uploaded to the image processing server 4. For example, the 39th floor has 11 units and is managed as sections 1 and 2. The upper section lists the progress for sections 2 and 1. This allows the bold line L to show at a glance whether the construction is progressing or behind schedule compared to the schedule schedule on the confirmation date of January 29, 2024. For example, as of January 29, the preceding board construction in section 2 of the 39th floor is scheduled to be completed by January 26, but it is still not completed. It also shows that the wood subfloor construction in section 1 of the 39th floor is two days ahead of schedule. In the 38F·2 section, LGS ceiling construction is one day behind schedule, while in the 38F·1 section it is on schedule; in the 37F·2 section, wood subfloor construction is two days ahead, while in the 37·1 section it is on schedule.

[0047] As described above, the progress of construction work can be managed in real time based on the captured images. The table generated by the completed progress table generating unit 55 may also reflect the results of the assessment by the assessing unit 54. This allows progress management to be more in line with the actual conditions at the construction site.

[0048] FIG. 12 illustrates an example of material management using a two-dimensional code 90 attached to a material in a walk-through image W. Various materials, kitchen, toilet, and bathroom equipment, electrical wiring, and other items are delivered to a construction site daily as the work progresses. Therefore, managing the delivery and removal of these materials is crucial for smooth site maintenance and accident prevention. Therefore, a unique two-dimensional code 90 is attached to packaging materials for materials requiring removal management. The URL linked to this two-dimensional code 90 contains information about the material's intended use and storage period. It is a site rule that items with two-dimensional codes 90 attached must be placed so that the two-dimensional code 90 is visible. When a user finds an item with a two-dimensional code 90 attached to the walk-through image W, they enlarge the image as shown in FIG. 12 and take a photo of the two-dimensional code 90 on the display 33 of the user terminal 3 using a smartphone or other device. This takes them to the URL linked to the two-dimensional code 90, where they can access information about the material's storage period and other information. At this time, by operating the judgment edit key 11ac of the judgment button 11a to input "Deadline has passed" or the like in the judgment result display 9 and clicking the instruction function 10, a work instruction 70 can be created urging the materials to be removed promptly.

[0049] As described above, according to the construction management system 1 of this embodiment, not only the construction status of the construction site but also the judgment results of the construction status can be confirmed on the design floor plan 8 and the walk-through image W without going to the site, thereby improving the efficiency of construction management at the site.

[0050] The configuration and aspects of the construction management system 1 according to this embodiment are not limited to the above embodiment, nor are the judgment contents and the types of work selected and judged by the judgment unit 54 limited to those described above. Furthermore, the display examples of the various functions of the walk-through image W are not limited to those shown in the figures, and the display contents of the judgment result display 9 are not limited to those shown in the figures. For example, when a location where a construction status judgment has not been performed or does not need to be performed is displayed, the display may read "Unjudged," or the judgment result and progress status may be displayed together, such as "OK, construction progress 60%." The configuration of the camera 2 is also not limited to the above; it may not include the transceiver 21, and the captured data may be downloaded to a recording medium such as an SD card and used. Furthermore, when the judgment unit 54 performs judgment while checking the walk-through image W, it is also possible to perform judgment by dragging an area on the design floor plan 8 shown in Figure 5 to judge the specified area as a whole, or by specifying the entire 39th floor or a specific room on the 39th floor, and then displaying only the locations requiring inspection in the walk-through image W. [Explanation of symbols]

[0051] 1 Construction management system 2 Cameras 3. User terminal 33 Display section 4 Server 5 Image Processing Server 53 Image generation unit 54 Judgment section 55 Production progress chart generation section 56 Setting section 6 Mechanical equipment 8 Design floor plan 9 Judgment result display 10 Instruction function 14 Progress indicator 15 Measurement Functions W Walk-through Image 70 Work Instructions 80 Progress Chart

Claims

1. In a construction site construction management system that uses a computer and images of the construction site taken by a camera, a determination unit that determines the construction status of the construction site based on the photographed images; and an image generation unit that generates, based on the photographed images, a walk-through image that can be freely viewed and operated from any angle and a route display that identifies the route photographed by the camera on a design plan of the construction site; A construction site execution management system characterized in that the judgment result by the judgment unit is displayed on the route display, and when the user operates the route display, the walk-through image taken along the route is displayed.

2. In claim 1, A construction site execution management system characterized by automatically generating work instructions by automatically inserting at least the walk-through image, the judgment result, and the relevant portion of the design floor plan associated with the judgment result.

3. In the system according to claim 1 or claim 2, The determination unit further determines the rate of progress for each type of work at the construction site based on the captured images, A construction site management system characterized by automatically generating a progress chart for each type of work based on the captured images and the schedule, and reflecting the progress rate determined by the determination unit in the progress chart.

4. In claim 1 or claim 2, This construction site management system is characterized by displaying measuring indicators that allow the user to recognize actual dimensions on the walk-through image and that can be moved in all directions, including up and down, left and right, and diagonally, by the user's operation.

5. In claim 1 or claim 2, A construction site execution management system characterized in that the judgment unit makes judgments using learning results obtained through machine learning.

6. In claim 1 or claim 2, A construction site management system that compares previously taken images with images taken of the same location, and displays in the walk-through image areas that differ from the previous images or the locations of specified building components.

7. In claim 1 or claim 2, A construction site construction management system characterized by displaying, along with the walk-through images taken along the route, a judgment button that allows the user to freely select and set the type of work to be used to judge the construction status of the construction site from among multiple types of work.

8. In claim 7, The type of work includes an undercut determination for determining whether or not there is an excessive gap between a door and a floor installed at the construction site, A construction site management system characterized in that the undercut judgment result by the judgment unit is displayed on the door or floor on the walk-through image.

9. In claim 7, The type of work includes determining a floor clearance to determine whether or not there is a gap larger than necessary between the floor and the wall constructed at the construction site, A construction site management system characterized in that the judgment result of the placement clearance by the judgment unit is displayed between the placement floor and the wall on the walk-through image.

10. In claim 7, The type of work includes a board screw pitch determination that determines whether the spacing between multiple screws that fix the base board installed at the construction site is appropriate, A construction site management system characterized in that the judgment results of the board screw pitch by the judgment unit are displayed on the walk-through image, and the positions of the multiple screws and the lines connecting the screws are also displayed.

11. A construction site construction management method in which construction management of a construction site is performed by a computer based on images of the construction site taken by a camera, a route display for identifying the route photographed by the camera on a design plan of the construction site, and a determination result of the construction status of the construction site based on the photographed images is displayed on the route display; A construction site management method characterized in that when a user operates the route display, a walk-through image is displayed that can be viewed and manipulated from any angle based on the images taken along the route.

12. A program for causing the computer to execute the construction site execution management method according to claim 11.

Images