Site management system and site management method

Abstract

To provide a technique of efficiently performing management about a construction site.SOLUTION: An application 200 moves a view point in a 3D animation in conjunction with movement of a worker carrying a tablet terminal and changes the display contents of a screen following the movement (S400). When the worker selects an analysis button by adjusting the position and direction of the tablet terminal such that a work spot falls within a displayed photograph region by selecting a camera menu, an image at the time point is transmitted as a photograph to a server 100 and analyzed (S410 to S450). An analysis result of the photograph (identification result of a subject) is transmitted to the application 200 and displayed on the screen. When the worker confirms the result and selects a registration button after correction if necessary, the registration contents are transmitted to the server 100 (S460 to S490). The server 100 specifies an object corresponding to the subject, displays the object at a position in the 3D animation corresponding to the position of the work spot and updates the 3D animation (S500).SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to a site management system and method, and more particularly to a site management system and method for managing work progress and space at a construction site. [Background technology]

[0002] At construction sites (architecture, civil engineering, tunnels, bridges, roads, dams, river improvement, revetments, ports, airports, reclaimed land, parks, urban development, farmland, forest improvement, woodland improvement, electricity (elevated lines, underground high-voltage lines), etc.), work begins with preparation, then progresses through various processes, such as excavation, retaining walls, piling, foundations, underground, framework, exterior, interior, and exterior construction, before reaching inspection. Furthermore, the progress of work for each of these processes is generally managed by workers following a schedule determined by the site supervisor, etc., and then taking photographs of the site and keeping them in a photo album.

[0003] In response to this, various efforts have been made to make it easier to grasp the progress status.For example, a system is known in which a worker operates an operation unit to select information indicating the content of the work process at the work site to be photographed from displayed candidates, then photographs the scenery of the work site, adds information about the work process (number of floors, work location, work target, etc.) to the photographed image, and transmits the photographed image to a management server to register it (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-37684 Summary of the Invention [Problem to be solved by the invention]

[0005] The above-mentioned prior art is believed to make it easier to grasp the progress of work compared to management using a photo album. However, in the above-mentioned prior art, workers must manually select the work process and related information corresponding to the work site to be photographed, which makes registration time-consuming. Furthermore, when work is repeatedly photographed with a similar background, the images all look similar, making it difficult to distinguish between them unless location information is included in the images. Furthermore, if a worker accidentally selects the wrong content and registers the photographed image, incorrect progress information will be registered that does not match the information associated with the photographed image, making it difficult to properly manage the progress of work.

[0006] Space management is also important at construction sites. Because the heavy machinery and materials used at construction sites, such as construction machinery and trucks for transporting soil and sand, vary depending on the process described above, in order to ensure smooth work on site, it is necessary to properly manage when and where heavy machinery and materials are located and share information among the workers involved.

[0007] Therefore, an object of the present invention is to provide a technology for efficiently managing construction sites. [Means for solving the problem]

[0008] In order to solve the above problems, the present invention employs the following site management system and site management method. Note that the following words in parentheses are merely examples, and the present invention is not limited thereto.

[0009] In other words, the site management system of the present invention comprises an object memory unit that stores objects that can be displayed in a virtual space within a 3D animation that represents a construction site, a position management unit that manages positions in real space in association with positions within the 3D animation, an identification unit that identifies an object that corresponds to a specified target present at the construction site, and an update unit that displays the identified object at a position within the 3D animation that corresponds to the position of the specified target in real space and updates the 3D animation.

[0010] According to this aspect of the site management system and method, changes that occur at the actual construction site (for example, whether or not space is being used, the progress of work processes, etc.) are represented as objects within the 3D animation, making it easy to visually grasp the situation at the construction site through the 3D animation, and enabling efficient sharing of information regarding the situation at the construction site.

[0011] Preferably, in the above-described site management system, the 3D animation is generated based on a 3D model of the building, and the objects include those generated based on component parts of the 3D model.

[0012] According to this aspect of the site management system and method, some of the objects displayed in the 3D animation are generated based on the components of the 3D model of the building (inherited from the 3D model), thereby reducing the amount of work required to create the 3D animation compared to creating these objects from scratch.

[0013] More preferably, in the above-mentioned site management system, the position management unit manages the positions in real space of moving bodies, including construction machinery and transport vehicles brought into the construction site, in correspondence with their positions in the 3D animation, the identification unit identifies an object corresponding to the moving body, and the update unit displays the object corresponding to the identified moving body at a position in the 3D animation that corresponds to the position of the moving body in real space, thereby updating the 3D animation.

[0014] According to this aspect of the site management system and method, an object corresponding to a mobile object that has entered and parked at a construction site is displayed at a position within the 3D animation that corresponds to the parking location, making it easy to see from the 3D animation display which spaces at the construction site are in use (whether the mobile object is actually parked) and which spaces are available.

[0015] Preferably, the above-mentioned site management system further includes a photo memory unit that stores photos of subjects taken at the construction site in association with their location information, and an analysis unit that analyzes the photos to identify the subjects, wherein the identification unit identifies an object corresponding to the subject identified by the analysis unit, and the update unit updates the 3D animation by displaying the object corresponding to the identified subject at a position within the 3D animation that corresponds to the subject's position in real space.

[0016] According to this aspect of the site management system and method, objects corresponding to the subject of a photograph taken at the construction site are displayed at a position in the 3D animation that corresponds to the location of the subject, so that changes that occur at the construction site via the photograph can be easily reflected in the 3D animation, making it possible to manage the status of the construction site more efficiently.

[0017] More preferably, in the above-mentioned site management system, the photo memory unit stores a photo of the material unloaded from the transport vehicle, and the update unit updates the 3D animation by displaying an object corresponding to the material at a position within the 3D animation that corresponds to the position where the material was unloaded.Alternatively, in the above-mentioned site management system, the photo memory unit stores a photo of a work process, and the update unit updates the 3D animation by displaying an object corresponding to the work process at a position within the 3D animation that corresponds to the position where the work process was performed in a manner that makes it possible to identify the completed portion.

[0018] According to this aspect of the site management system and method, an object corresponding to unloaded materials can be displayed in a position within the 3D animation corresponding to the unloading location via a photograph of the unloaded materials, and an object corresponding to the work process can be displayed in a position within the 3D animation corresponding to the location of the work site via a photograph of the work process.This makes it easy to reflect the delivery and movement of materials and the progress of the work process in the 3D animation, making it possible to manage the situation at the construction site more efficiently.

[0019] More preferably, the above-mentioned site management system further includes a display processing unit that displays an indication that a photograph of the subject has been registered at a position within the 3D animation that corresponds to the position indicated by the above-mentioned location information.

[0020] According to this aspect of the on-site management system and method, a display is displayed indicating that a photo has been registered at a position within the 3D animation that corresponds to the subject's position, so that the registered photo can be easily confirmed via this display.

[0021] Preferably, in the above-described site management system, the photo storage unit stores photos of the subject taken at the construction site using a camera mounted on the terminal on which the 3D animation is displayed. Alternatively, in the above-described site management system, the position management unit acquires information indicating a position in real space using a sensor mounted on the terminal on which the 3D animation is displayed.

[0022] According to this aspect of the on-site management system and method, photos are taken using a camera mounted on a terminal on which the 3D animation is displayed (a dedicated application is launched), and location information is obtained using a sensor mounted on this terminal.Therefore, compared to using equipment equivalent to a camera or sensor that is attached externally to the terminal, it is easier to operate the 3D animation (application) and register photos, and photos can be registered without placing a burden on on-site workers or drivers. [Effects of the Invention]

[0023] According to the present invention, management of a construction site can be carried out efficiently. [Brief explanation of the drawings]

[0024] [Figure 1] FIG. 1 is a diagram illustrating an example of a construction site. [Figure 2] 1 is a block diagram showing the configuration of a site management system 1. FIG. [Figure 3] 10A to 10C are sequential diagrams showing an example of the display of the application 200 when guiding a material delivery vehicle. [Figure 4] FIG. 10 is a sequence diagram showing an example of the operation of the site management system 1 when guiding a material delivery vehicle. [Figure 5] 10A to 10C are sequential diagrams showing an example of the display of the application 200 when registering unloaded materials. [Figure 6] FIG. 10 is a sequence diagram showing an example of the operation of the site management system 1 when registering unloaded materials. [Figure 7] 10A to 10C are sequential diagrams showing an example of the display of the application 200 when registering a work schedule for pile driving. [Figure 8] FIG. 10 is a sequence diagram showing an example of the operation of the site management system 1 when registering a work process. [Figure 9] FIG. 10 is a diagram illustrating a screen relating to process management displayed by application 200. DETAILED DESCRIPTION OF THE INVENTION

[0025] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. In the following embodiment, a preferred example of a site management system is given, but the present invention is not limited to the illustrated example.

[0026] [Outline of the site management system] FIG. 1 shows an example of a construction site, illustrating the state of work in the pile driving process. At a construction site for buildings or civil engineering, there are various spaces such as the work area (SW), a parking lot (SM) where transport vehicles (MT) wait to remove earth and bring in materials, a storage area (SP) where excavated earth and brought in materials are temporarily stored, and part of the aisle is also used as a temporary parking space for unloading and loading. In addition to these, there are also warehouses (BW) that store construction machinery (MB) such as backhoes and pile drivers, and an administration building (BA) used by site supervisors and workers.

[0027] The site management system 1 uses 3D animations of the construction site to manage the use of various spaces and the progress of work at the construction site, enabling related parties to share information in real time while visually checking changes in the space and work over time. In the site management system 1, the work schedule for the day, including which process to carry out and to what extent, and how to use which space (for example, when and where to park material delivery vehicles and at which storage area to unload them, etc.), is determined in advance by the site supervisor or construction management center, etc. Then, information on the actual results of these daily work schedules is registered in the 3D animation by workers and drivers via tablet devices.

[0028] The 3D animation used by the site management system 1 refers to a three-dimensional animation in which a viewpoint set in the internal space moves in synchronization with the user's movements in real space, changing the display as if the user were moving through the internal space, or displaying the day's work schedule and work results over time like a stop-motion video in response to a specified operation (hereinafter, this type of display is referred to as a "time-lapse display"). When there is no user movement or operation, the display of the 3D animation stops and does not continuously change like a typical animation. Furthermore, the viewpoint set in the internal space of the 3D animation corresponds to the viewpoint of an avatar placed in the internal space as the user's avatar. The avatar is not displayed on the screen, and the internal space is generally viewed from the avatar's perspective. However, if necessary, the avatar can be displayed approximately in the center of the screen, allowing the internal space to be viewed from behind the avatar.

[0029] In this embodiment, the 3D animation is created based on a 3D model of the building (e.g., a BIM model or a CAD model). Specifically, the 3D model of the building is converted using a commercial game engine, and an initial 3D animation is created in which all objects constituting the building are hidden. The initial 3D animation corresponds to a representation of the state of the construction site before work begins. As work at the construction site progresses, actual information (progress of the work process, materials, etc.) is registered in the 3D animation, and the 3D animation is updated accordingly, with objects gradually appearing. Note that, instead of a game engine, other tools or an independently developed conversion tool may be used to convert the 3D model into 3D animation.

[0030] Furthermore, objects displayed in 3D animations are classified into two types: inherited objects and created objects. Inherited objects are objects that correspond to the components of a 3D model and are obtained by converting the 3D model (inherited from the 3D model). In contrast, created objects are objects that do not exist in the 3D model but are newly created because they need to be displayed in the 3D animation. Specifically, created objects include objects that correspond to construction machinery, transport vehicles, materials, etc.

[0031] [Configuration of the site management system] FIG. 2 is a block diagram showing the configuration of the site management system 1. The site management system 1 operates in an environment where a cloud server 100, which is responsible for managing processes and 3D animations, and a tablet terminal TB on which an application 200 is installed, which is responsible for displaying 3D animations and registering information within the 3D animations, are connected to a communication line such as the Internet.

[0032] The cloud server 100 includes, for example, a database 110, a user authentication unit 120, a process management unit 130, a data distribution unit 140, an image analysis unit 150, an object identification unit 160, an update unit 170, and the like.

[0033] The database 110 includes multiple databases (DBs) for various purposes. For example, the user DB 112 stores information about users of the site management system 1, the process management DB 114 stores information about each construction process, and the 3D animation management DB 116 stores information about 3D animations. The 3D animation management DB 116 includes an object storage unit 116A that stores information about the inherited objects and created objects described above, a photo information storage unit 116B that stores photos sent from the application 200 and related information about the photos (such as the date and time of shooting, the location information of the camera (tablet terminal TB), and the location information of the subject), and an update information storage unit 116C that stores the entity data and update data of the 3D animations, information registered in the 3D animations, and related information about the information (such as the registrant, the date and time of registration, and the location information of the registration destination (coordinates within the 3D animation)).

[0034] The user authentication unit 120 performs authentication processing for users of the site management system 1 by referring to the user DB 112, and grants access rights according to the authenticated user's classification (for example, worker, driver, manager, etc.).

[0035] The process management unit 130 stores and manages information such as the initially set schedule, number of labors, construction machinery, type and number of materials, storage location, etc. for each construction process in the process management DB 114, and also manages changes to these information.

[0036] The data distribution unit 140 distributes entity data and update data of 3D animations, as well as notifications (hereinafter referred to as "instruction notifications") to drivers instructing them on the time and location to move transport vehicles, etc.

[0037] The image analysis unit 150 analyzes a photo sent from the application 200 to identify the subject, and returns the analysis result to the application 200. For example, the image analysis unit 150 inputs the photo into a trained model that has been trained in advance using a dataset in which photographs of various work processes and various materials at a construction site are labeled, and identifies the subject based on the results of the trained model's prediction of what the subject in the photo corresponds to (which work process, which material). Furthermore, when the image analysis unit 150 identifies the subject as a material, it also identifies and quantifies the number of materials appearing in the photo.

[0038] The object identification unit 160 identifies objects associated with moving objects such as construction machinery and transport vehicles present at the construction site, and objects associated with subjects (work processes, materials, etc.) identified from photographs by the image analysis unit 150.

[0039] The update unit 170 updates the 3D animation by displaying the object identified by the object identification unit 160 at a position in the virtual space (3D animation) that corresponds to the position of the object corresponding to that object in real space (the construction site). At this time, if the object identified by the object identification unit 160 is an object corresponding to a work process, the update unit 170 displays the completed parts of the object in a manner that makes them identifiable, for example, by making the completed parts opaque and the other parts semi-transparent. The update unit 170 also stores information registered in the 3D animation via the application 200 in the 3D animation management DB 116.

[0040] The application 200 includes, for example, a location management unit 210, a display processing unit 220, a registration reception unit 230, a form processing unit 240, etc., and performs processing by appropriately using the location sensor LS, the atmospheric pressure sensor PS, and the camera CA mounted on the tablet terminal TB.

[0041] The position management unit 210 uses point P (see FIG. 1) in front of the administration building BA as a reference point, and manages the position of the tablet terminal TB (user) in real space and the position of the viewpoint in virtual space within the 3D animation in association with each other based on information from the position sensor LS and the atmospheric pressure sensor PS, and moves the viewpoint in virtual space in response to changes in the information from the position sensor LS and the atmospheric pressure sensor PS (in synchronization with the movement of the user in real space). The position management unit 210 also identifies the relative position (distance and direction) from the tablet terminal TB of the subject appearing in the center of a photograph taken by the camera CA, and identifies the absolute position of the subject based on its relationship with the position of the tablet terminal TB in real space.

[0042] The position sensor LS is, for example, a GPS, and is used to identify the position of the tablet terminal TB. When use in an environment with poor radio wave conditions is expected, a gyro sensor may be used instead of a GPS, and the relative position from a reference point may be calculated by computation. When the position management unit 210 identifies the relative position of the subject, for example, a magnetic sensor is used to detect the direction of the subject, and so-called LiDAR (light detection and ranging) that uses light to detect the distance to the target object is used to identify the distance to the subject. The atmospheric pressure sensor PS is a sensor that detects atmospheric pressure, and is used to identify the vertical position (floor number) of the tablet terminal TB.

[0043] The display processing unit 220 is responsible for all processing related to the display of 3D animations. It displays 3D animations distributed from the cloud server 100 (data distribution unit 140) on the screen of the tablet terminal TB, and changes the display position and orientation on the screen according to the movement of the viewpoint set in the 3D animation. The display processing unit 220 also displays operation menus at predetermined positions on the display screen according to the authority of the user logged in to the site management system 1. The operation menus include, for example, a camera menu used when registering information via photos, an update menu used when updating the 3D animation to the latest state, and a work confirmation menu used when displaying a time-lapse view of the work schedule before the start of work for the day or a time-lapse view of the work results after the work is completed. Furthermore, the display processing unit 220 displays tag icons at positions within the 3D animation where information is registered. When a tag icon is selected, the history of the information registered at that position (e.g., photos registered at each process) is displayed in chronological order.

[0044] The registration acceptance unit 230 provides a photo registration form that is displayed when the camera menu is selected, and receives and transmits data to and from the cloud server 100 in response to operations on the photo registration form, accepting information registration via a photo taken with the camera CA. In addition to a camera mode that accepts registration via a photo, the registration acceptance unit 230 also has a code input mode that accepts registration via a pre-prepared QR code (registered trademark) or via RFID tag attached to a material, allowing the user to change modes depending on the situation. This allows information registration to be carried out smoothly even in situations where it is difficult to take a photo. The specific processing performed via the photo registration form will be described in detail below with reference to another drawing.

[0045] The report processing unit 240 provides a management form for reports related to process management that is displayed when the report menu is selected. The report management form allows the display of information initially set for each construction process and the registration of changes to this information. Note that use of the report menu is limited to users who fall into the managerial category, such as site supervisors and personnel at the construction management center. If a user without access rights logs in to the site management system 1 using the application 200, the report menu will not be displayed on the screen.

[0046] [Operation when guiding a moving object] 3A to 3C are sequential diagrams showing examples of the display of the application 200 when guiding a moving object. To facilitate understanding of the invention, in FIG. 3A to 3C, an example will be described in which the moving object to be guided is a vehicle for delivering materials.

[0047] In FIG. 3 (A): Prior to the delivery of materials, an instruction notice is sent to the driver of the delivery vehicle by e-mail or the like. When the driver launches the application 200 in response to this, the screen of the application 200 displays large characters indicating the designated time and designated location for the movement of the delivery vehicle, and a 3D animation is displayed in a manner that makes the designated location easy to see. In the example shown, "the shoulder of the road in front of the first material storage area" is designated, and the area SP1 in the 3D animation corresponding to the first material storage area is V The shoulder area adjacent to the designated location is surrounded by a thick dashed line and indicated by a black arrow. This highlighting allows the driver to easily understand where the designated location is within the construction site. Preferably, application 200 can detect whether the engine of the delivery vehicle is on or off.

[0048] (B) in Figure 3: When the designated time arrives and the driver drives the delivery vehicle into the construction site, the viewpoint in the 3D animation moves in sync with the movement of the delivery vehicle (tablet terminal TB) around the construction site, and a display similar to that of a car navigation system appears on the screen of application 200. As the driver continues to proceed through the construction site following the display on the screen of application 200, at a certain point, large text such as "30 meters ahead, park on the right shoulder" appears, and the shoulder of the road ahead on the right is displayed surrounded by a thick dashed line.

[0049] In Figure 3 (C): When the driver parks the delivery vehicle on the right shoulder of the road surrounded by the thick dashed line, the screen of the application 200 displays large text such as "Movement completed. Please unload materials at material storage area 1." At the same time, the thick dashed line that had been displayed at the parking position in the 3D animation disappears, and an object MT corresponding to the delivery vehicle MT in the real space appears. V This type of display allows the driver to clearly instruct what to do after parking.

[0050] Transport vehicles and construction machinery other than those delivering materials are also guided to designated locations in a similar manner. Although not shown in the figure, by performing a specified operation, the driver can switch the display of the 3D animation between a bird's-eye view of the construction site, a first-person view from the avatar's point of view with the avatar hidden, or a third-person view from behind the avatar with the avatar displayed.

[0051] Figure 4 is a sequence diagram showing an example of the operation of the site management system 1 when guiding a moving object. The display of the application 200 shown in Figure 3 is performed as a result of the example of the operation of the site management system 1 shown in Figure 4. Note that ellipsis lines are added to the parts where the preceding and following processes are executed asynchronously. The following is a chronological explanation.

[0052] Step S10: The cloud server 100 transmits an instruction notice and the latest 3D animation to the driver in advance.

[0053] Steps S12 to S18: In response to this, before entering the construction site, the driver launches the application 200 on the tablet terminal TB and logs in to the site management system 1. When using the application 200 for the first time, or if login information is not saved in the application 200, the driver inputs login information (user ID and password) and sends it to the cloud server 100 (step S12), and attempts to log in to the site management system 1. The cloud server 100 performs user authentication based on the sent login information (step S14), and if there are no problems, grants authority according to the driver and notifies the application 200 that he has logged in to the site management system 1 (step S16). In response to this, the application 200 displays an operation menu according to the driver's authority (step S18).

[0054] If the login information is stored in the application 200, the above steps S12 to S18 are automatically executed based on the stored login information, and therefore the driver does not need to input the login information.

[0055] Step S20: When the driver drives the mobile object and enters the construction site, application 200 moves the viewpoint within the 3D animation in conjunction with the movement of the mobile object (more precisely, the tablet terminal TB on which application 200 is installed) within the construction site, and accordingly changes the content (position and orientation) displayed on the screen.

[0056] Step S30: When the driver moves the moving object to the specified location in accordance with the screen display of the application 200, the application 200 notifies the cloud server 100 that the movement has been completed.

[0057] Steps S40-S60: In response to this, the cloud server 100 selects an object corresponding to the moving object (step S40), displays the object selected in step S40 above at a position within the 3D animation corresponding to the destination position, updates the 3D animation (step S50), and transmits the updated data of the 3D animation to the application 200 (step S60).

[0058] Step S70: The application 200 then reflects the received update data in the display of the 3D animation, thereby displaying the moving object at a position in the 3D animation that corresponds to the destination position on the construction site.

[0059] If the driver subsequently completes the necessary work (such as unloading) and drives the mobile object again, the mobile object will leave the designated location. At this time, application 200 notifies cloud server 100 of the mobile object's exit, and in response, cloud server 100 hides the object of the mobile object displayed in the 3D animation in step S50 above, updates the 3D animation again, and transmits the updated data of the 3D animation to application 200.

[0060] [Operation when registering materials] FIG. 5 is a series of diagrams showing an example of the display of the application 200 when unloaded materials are registered. For ease of explanation, it is assumed that there was nothing placed in the specified material storage area before unloading. When the application 200 detects that the engine of the delivery vehicle has been turned off, it fixes the position of the delivery vehicle within the 3D animation. The position and orientation displayed in the 3D animation thereafter correspond to the position and orientation in the real space of the tablet terminal TB.

[0061] In Figure 5 (A): The driver transports the materials delivered by the delivery vehicle to the first material storage area SP1. R After unloading at the first material storage area SP1 RThe user looks at the screen of the application 200 while facing the direction of the camera. At this time, the screen shows the first storage area SP1 R Area SP1 in the 3D animation corresponds to V The screen shows that nothing is placed in this location. Also, in the center of the screen, a tag icon TG is displayed, indicating that information has been registered for this location (material storage area 1), and the camera menu CM is displayed in the upper left corner of the screen.

[0062] 5 (B): When the driver selects the camera menu CM, a photo registration form is displayed on the screen of the application 200. The photo registration form includes a photo area 222 that displays the image captured by the lens of the camera CA, an [Analysis] button that is selected when taking a photo of the image displayed in the photo area 222 and analyzing it, an information area 224 that displays the results of the photo analysis, a [Register] button that is selected when registering the photo and related information, a [Cancel] button that is selected when discarding the currently displayed analysis results (taking a new photo), a [Mode Selection] button that is selected when changing to an input mode other than camera mode, and a [Back] button that is selected when discarding the photo registration form and returning to the 3D animation display.

[0063] For example, if the driver places the first material storage area SP1 in the photo area 222, R Materials piled up in MA R The position and orientation of the camera CA is adjusted so that the entire object is captured, and the driver selects the [Analyze] button, which causes the image captured in the photo area 222 at that time to be photographed. The photo is then analyzed, and the analysis results are displayed in the information area 224. If the displayed analysis results are appropriate (match the type (item name) and quantity of materials actually unloaded), the driver selects the [Register] button.

[0064] In Figure 5 (C): When the [Register] button is selected, a photo and detailed information about the material based on this photo are registered at the position in the 3D animation that corresponds to the location where the material was unloaded. The coordinates of the tablet terminal TB are also registered at the same time, so it is easy to confirm that the coordinates of the unloaded location are correct. Then, the first material storage area SP1 R Materials unloaded at MA R Materials MA R The corresponding object MA V SP1 is an area in 3D animation V Also, although not shown in the figure, if you select the tag icon TG here, the information registered up to now for the first material storage area will be displayed in chronological order. This allows you to check the history of materials placed in the first material storage area.

[0065] In the above example, the appropriate analysis results are displayed in the information area 224 and the information is registered as is, but it is also possible to register the analysis results displayed in the information area 224 after modifying part of them (for example, manually modifying the number of items). Also, the [Product Name (Type of Material)] field in the information area 224 may display only the result with the highest reliability (likelihood of relevance) in the image analysis, or multiple results may be displayed as selection candidates in descending order of reliability so that they can be modified as needed before registration.

[0066] Fig. 6 is a sequence diagram showing an example of the operation of the site management system 1 when registering unloaded materials. The display of the application 200 shown in Fig. 5 is performed as a result of the example of the operation of the site management system 1 shown in Fig. 6. The following will explain this in chronological order.

[0067] Step S100: When the driver moves around the construction site carrying the tablet terminal TB, the application 200 moves the viewpoint within the 3D animation in conjunction with the driver's movements, and changes the content displayed on the screen accordingly.

[0068] Steps S110-S140: When the driver selects the camera menu (step S110), the application 200 displays a photo registration form on the screen (step S120). Then, when the driver adjusts the position and orientation of the tablet terminal TB (more precisely, the camera CA) so that the entire unloaded material fits within the photo area 222 and selects the analyze button (step S130), the application 200 takes a photo of the image that fits within the photo area 222 at that time and sends it to the cloud server 100 (step S140). It is preferable that the coordinates of the tablet terminal TB are also sent.

[0069] Steps S150, S160: In response to this, the cloud server 100 analyzes the photo to identify what the subject corresponds to, and if it corresponds to a material, identifies the type of material as well as the number of materials (step S150), and sends the photo analysis results to the application 200 (step S160).

[0070] Steps S170 to S190: The application 200 displays the analysis results in the information area 224 of the photo registration form (step S170). When the driver checks the displayed content, modifies the information as necessary, and then selects the registration button (step S180), the application 200 transmits the registration content to the cloud server 100 (step S190).

[0071] Steps S200-S220: In response to this, the cloud server 100 identifies an object corresponding to the material to be registered (step S200), updates the 3D animation by displaying the object of the material identified in step S200 at a position within the 3D animation corresponding to the position of the unloaded material (step S210), and sends the updated data of the 3D animation to the application 200 (step S220).

[0072] Step S230: The application 200 then reflects the received update data in the display of the 3D animation, thereby displaying an object according to the type and number of materials to be registered at a position in the 3D animation that corresponds to the location of the material unloading destination.

[0073] When moving materials by vehicle, a photograph of the materials stored in the material storage area is taken before the move and the information is registered, and then after the materials are loaded onto the vehicle, another photograph of the material storage area is taken and the information is registered.This causes the display of the area corresponding to the material storage area in the 3D animation to be updated to indicate that the materials have been moved (the materials in the material storage area have disappeared or increased or decreased).

[0074] In the illustrated example, the driver registers information about the unloaded materials, but if it is difficult for the driver to register the information (for example, if the tablet terminal TB used by the driver is not charged enough and the application 200 cannot be started immediately), another worker may use his or her own tablet terminal TB to register the information in place of the driver. In this case, the worker who registered the information will be recorded in the 3D animation management DB 116 as the registrant.

[0075] [Operations when registering a work process] FIG. 7 is a series of diagrams showing an example of the display of application 200 when registering a work process. In each construction process, different tasks are performed in succession at the same location until completion. For example, the process of piling (cast-in-place piles) involves installing a casing, excavating, injecting a stabilizing solution to prevent the inner wall from collapsing, further excavating to the supporting ground, removing the slime, installing a cylindrical rebar cage, pouring concrete, removing the casing, and filling it with earth and sand. This series of tasks is performed in order at the same location until completion. Therefore, as an example of registering a work process, FIG. 7 illustrates an example of registering the final work process for cast-in-place piles.

[0076] In FIG. 7 (A): It is assumed that the previous day's work was completed up to the pouring of concrete, and that the work on the current day involved pulling out the casing and backfilling with soil (the final work process for the cast-in-place pile). In this case, if the screen of the application 200 is checked at a stage before the work process carried out on the current day is registered, the screen will show an object WC corresponding to the casing for the work location where the concrete has been poured but the casing is still installed, as a result of the information registration carried out at the end of the previous day's work. V is displayed, and a tag icon TG is displayed overlaid on it to indicate that information has been registered in this location.

[0077] In FIG. 7B: When the worker selects the camera menu CM, a photo registration form is displayed on the screen of the application 200. At this time, the worker pulls out the casing and takes a photo of the work area WP where earth and sand are buried. R The position and orientation of the camera CA is adjusted so that the image fits within the photo area 222, and the worker selects the [Analyze] button, and the image that fit within the photo area 222 at that time is captured in a photo. The photo is then analyzed, and the analysis results are displayed in the information area 224. If the displayed analysis results are appropriate (match the content of the work process carried out on that day), the worker selects the [Register] button.

[0078] Figure 7 (C): When the [Register] button is selected, the work area WP R The photos and work process information are registered at the position in the 3D animation that corresponds to the position of the work area WP R The corresponding object for WP V Also, although not shown in the figure, if you select the tag icon TG here, all the information registered in the work process for the pile process will be displayed in chronological order.

[0079] With the above information registration, the registration of information for the pile process is completed, and from the next day onwards, information registration for other processes will be carried out. Figure 7 explains the final work process in the pile (cast-in-place pile) process, but for other work processes in the pile process, and not just for the pile process but also for other construction processes, information is registered via photographs at the end of each day's work and when each work process is completed, following the same flow as above.

[0080] For example, at a building construction site, progress information is registered for various work steps in each construction process, and as a result, as work progresses, the objects that make up the building are gradually assembled in the 3D animation, and as the framework (columns and beams) is constructed on site, objects corresponding to the framework are displayed, and as walls are installed on site, objects corresponding to the walls are displayed. Also, if work for the day ends while the framework is being constructed, information is registered via photographs at the end of the day, and as a result, objects corresponding to installed columns and beams are displayed opaquely, while objects corresponding to columns and beams that have not yet been installed are displayed semi-transparently, and the objects being assembled in the 3D animation are displayed in a way that makes it possible to identify the progress of the work.

[0081] In the above example, the appropriate analysis results are displayed in the information area 224 and registered as is, but it is also possible to modify and register part of the displayed analysis results. Also, the "Process" and "Work Content" columns in the information area 224 may display the result with the highest reliability (likelihood of relevance) in the image analysis, or multiple results may be displayed as selection candidates in descending order of reliability so that they can be modified as needed before registration.

[0082] In the above example, progress information on the work process is registered via photographs, but a video of the work process may be registered together with or instead of the photograph. Furthermore, a material information input form may be provided in the photo registration form, allowing the user to input information such as the amount of material used and the storage location for the work process to be registered, and the material information managed in the process management DB 114 may be updated in conjunction with the registration of information.

[0083] Fig. 8 is a sequence diagram showing an example of the operation of the site management system 1 when registering a work process. The display of the application 200 shown in Fig. 7 is performed as a result of the example of the operation of the site management system 1 shown in Fig. 8. Note that Fig. 8 omits the description of the operation related to logging in to the site management system 1 that is performed after the application 200 is started. Also, ellipsis lines are added to the parts where the preceding and following processes are executed asynchronously. The following will be explained in chronological order.

[0084] Steps S300-S330: When the worker launches application 200, update data for the 3D animation (data that differs from the downloaded 3D animation) is transmitted from cloud server 100 (step S300), and application 200 reflects the update data in the display of the 3D animation (step S310). This allows the worker to check the latest version of the 3D animation. For example, if the worker selects the work confirmation menu before starting work (step S320), the work content scheduled for that day is displayed in time lapse (step S330), allowing the worker to visually grasp the work content for that day and visualize it in their mind before starting work. Note that the 3D animation can be updated at any time by selecting the update menu, even when application 200 is not launched.

[0085] Step S400: When a worker moves around the construction site carrying a tablet terminal TB, the application 200 moves the viewpoint within the 3D animation in conjunction with the worker's movements, and changes the content displayed on the screen accordingly.

[0086] Steps S410 to S440: When the worker selects the camera menu (step S410), the application 200 displays a photo registration form on the screen (step S420). Then, when the worker adjusts the position and orientation of the tablet terminal TB (more precisely, the camera CA) so that the work location fits within the photo area 222 and selects the analyze button (step S430), the application 200 takes a photo of the image that fits within the photo area 222 at that time and sends it to the cloud server 100 (step S440).

[0087] Steps S450, S460: In response to this, the cloud server 100 analyzes the photo to identify what the subject corresponds to (step S450), and by including the coordinate information of the tablet terminal TB, transmits the analysis results indicating the progress of which work process to the application 200 (step S460).

[0088] Steps S470-S490: The application 200 displays the analysis results in the information area 224 of the photo registration form (step S470). When the worker checks the displayed content, corrects the information as necessary, and then selects the registration button (step S480), the application 200 transmits the registration content to the cloud server 100 (step S490).

[0089] Steps S500-S520: In response to this, the cloud server 100 identifies an object corresponding to the work process to be registered (step S500), updates the 3D animation by displaying the object of the work process identified in step S500 at a position within the 3D animation that corresponds to the position of the work location (step S510), and transmits the updated data of the 3D animation to the application 200 (step S520).

[0090] Step S530: The application 200 then reflects the received update data in the display of the 3D animation, thereby displaying the object of the work process at a position in the 3D animation that corresponds to the position of the work location, in a manner that allows the progress to be identified.

[0091] [Process management report screen] FIG. 9 is a diagram illustrating a form screen relating to process management displayed by the application 200. As shown in FIG.

[0092] As described above, the information initially set for each construction process is stored in advance in the process management DB 114. The initially set information includes, for example, the work cost (net of the type of work) required to complete the process, the type of construction method to be adopted, the construction machinery used in that method, the type and quantity of materials required for that method, etc., as well as the construction period and labor amount calculated after estimating the man-hours based on this information. On the report screen, it is possible to check this initially set information, estimate changes, and confirm the changes.

[0093] In Figure 9 (A): When a user who can access the report menu selects the report menu from the operation menu of application 200 and selects [Pile] from the multiple process tabs displayed, a report screen like the one shown in the example is displayed. For the pile process, detail tabs such as [Pile Work], [Area Information], [Material Information], and [Daily Schedule] are provided, and by switching between these detail tabs, various information set for the pile process can be confirmed. Note that although the names and contents of the detail tabs provided vary depending on the process, the screen structure of the report menu is common to all processes, and a specific report screen is displayed by selecting one of the process tabs from the report menu and then selecting one of the detail tabs.

[0094] When the [Pile Work] details tab is selected, the left side of the screen displays the default settings for the pile process, such as the net type of work, type, construction machinery, and pile-related information (pile tip, pile diameter, and number of piles), as well as the default construction period and labor amount based on these. The right side of the screen also displays an input form corresponding to each item on the left. In the input form, multiple options are automatically set in advance for each item except for the net type of work, construction period, and labor amount. When an option is selected for a certain item, the option for the next item is automatically reset accordingly.

[0095] Figure 9 (B): A table listing the pile types, construction machinery, and required days for cast-in-place piles. This table is referenced when automatically setting options in the input form displayed on the [Pile Work] report screen. Specifically, the [Type] field in the input form displays the names of the pile types listed in the table as options. If the user selects, for example, "Earth Drill Pile" for [Type], the options for the next item, [Construction Machine], are reset to four options corresponding to "Earth Drill Pile." If the user selects, for example, "Pile Diameter 2000φ or Less, No Serial Number" for [Construction Machine], the number of days for assembly and disassembly is automatically set to "4," the number of days for setup change is set to "1," and the required number of days is automatically set to "5." The [Construction Period] is automatically calculated based on the specified number of days. By appropriately changing the options in the input form in this way, the user can easily estimate the labor hours required when changing the initial information. Then, based on this estimate, the user manually inputs the [Work Type Net] and [Labor Quantity] and selects the [Confirm Changes] button, and the contents of the input form are stored in the process management DB 114.

[0096] In addition, on the report screen of any process tab, a camera button is provided for items such as materials and construction machinery in the input form. For items with a camera button, in addition to selecting one of the automatically set options, it is also possible to select the camera button to display a photo form, take a photo of the actual item with the camera, perform image recognition, and set the identified object as an option. In addition, for construction machinery, it is also possible to enter the control number (license plate number) and set the construction machinery associated with the control number as an option.

[0097] One issue with managing construction periods at construction sites is that it is difficult to share information across different construction sites. By using the site management system of this embodiment, the period from the start of work to the completion of work in each process can be calculated from the work history. Construction sites are often affected by factors such as weather and the number of workers. By using the data accumulated in the site management system, it is possible to perform highly accurate forecast and actual management of work progress.

[0098] According to this embodiment, the following advantages are obtained. (1) The use of various spaces on a construction site and the delivery and movement of materials can be managed in real time using 3D animations of the construction site. This allows for more immediate information sharing and more efficient information sharing among stakeholders than when managing this information using paper floor plans. Furthermore, 3D animations manage vertical information in addition to horizontal information, allowing for more appropriate space management, as space allocation can be made taking into account the height of moving objects. This prevents mistakes, such as incorrectly allocating a certain construction machine to a warehouse space that cannot accommodate it due to height restrictions, and the resulting work delays that can occur on site, thereby enabling more effective use of space.

[0099] (2) The progress of the work process is managed using a 3D animation depicting a construction site, and the progress of the work process is registered based on photographs of the work locations at positions in the 3D animation corresponding to the work locations. This makes it easier to register information and manage the registered information than when using a photo album for progress management. Furthermore, for example, at a high-rise building construction site, the same work performed on each floor looks similar, and at a large civil engineering site, the same work performed anywhere looks similar. In either case, the location cannot be distinguished simply by taking a photograph. Therefore, to properly manage progress, additional work such as sorting photographs and adding classification information is required, which is extremely time-consuming. In contrast, according to this embodiment, the horizontal position is identified using a position sensor and the vertical position (floor number) is automatically identified using a barometric pressure sensor. Based on this position information, the progress of the work process is registered at the position in the 3D animation corresponding to the actual location of the work. This makes it easy to register the progress at the correct position, allowing for proper progress management.

[0100] (3) When information about actual results (progress of work processes, delivery of materials, movement of moving objects, etc.) is registered within the 3D animation, the 3D animation is updated with an object corresponding to the content of the information displayed at the location where the information was registered, making it easy to visually grasp the situation at the construction site (progress of work, space utilization, etc.).

[0101] (4) The objects that make up the buildings displayed in the 3D animation are obtained by converting the 3D model of the building (inherited from the 3D model) when creating the 3D animation, so the amount of work required to create the 3D animation can be reduced compared to creating these objects from scratch.

[0102] (5) By selecting a tag icon displayed within the 3D animation, the information registered at that location can be displayed in chronological order, allowing users to check the history of work carried out at that location and the history of materials placed at that location. If a problem occurs, users can trace the cause of the problem by tracing the history.

[0103] (6) By using the work confirmation menu, the work schedule for the day can be displayed in 3D animation over time before work begins, allowing workers to visually grasp the work scheduled for the day and visualize it in their mind before starting work.In addition, after work is completed, the work results for that day can be displayed over time over 3D animation, allowing site supervisors and others to visually grasp and easily understand the work carried out that day (changes over time).

[0104] (7) By using the report menu, it is possible to easily estimate the man-hours required when changing materials, construction machinery, etc. while checking the information initially set for each construction process, and then input the net work type and labor amount based on this estimate, and confirm the changes on the same screen. Therefore, site supervisors can manage not only the budget and actual results of work processes, but also process change management through the same application, improving the efficiency of the work required to manage the site.

[0105] The present invention is not limited to the above-described embodiment, and can be practiced in various modified forms.

[0106] In the above-described embodiment, the application 200 is installed on the tablet terminal TB, but the installation destination of the application 200 is not limited to the tablet terminal TB, and it may be an information terminal such as a smartphone, a mobile PC, etc. Furthermore, if the information terminal does not have a location sensor, an air pressure sensor, or a camera due to its specifications, or if the user wishes to use a different device even though these sensors are installed, a separate device equivalent to these may be attached to the information terminal.

[0107] In the above-described embodiment, when guiding a moving object, the position of the moving object is determined using a position sensor installed on the tablet terminal TB used by the driver, but instead, a separate device equivalent to a position sensor such as a GPS transmitter may be placed inside the moving object, and the position may be determined using this.

[0108] In the above-described embodiment, multiple pieces of information registered for the same location (process, place) are displayed in chronological order via one tag icon, but the display format of the registered information is not limited to this. For example, a different tag icon may be assigned to each piece of registered information, and only the tag icon corresponding to the process selected by the user may be extracted and displayed.

[0109] In the above-described embodiment, the absolute position of the subject is identified by identifying the subject's relative position from the tablet terminal TB, and performance information is registered at a position within the 3D animation that corresponds to this absolute position. However, instead, the user may select a position within the 3D animation at which he or she wishes to register performance information, and the performance information may be registered for this position.

[0110] In the above-described embodiment, a driver drives the mobile body at the construction site, but in the case of a mobile body that can be remotely controlled, a person in charge may control and operate the mobile body remotely from a management building instead of the driver.

[0111] Furthermore, all of the examples shown in the drawings in the embodiments are merely preferred examples, and it goes without saying that appropriate modifications are possible when implementing the present invention. [Explanation of symbols]

[0112] 1 Site management system 100 Cloud Servers 110 databases 200 applications 222 Photography Area 224 Information area CM Camera Menu TB tablet device TG tag icon

Claims

1. A site management system for managing a construction site using 3D animation depicting the construction site, an object storage unit that stores objects that can be displayed in a virtual space within the 3D animation; a position management unit that manages positions in real space and positions in the 3D animation in association with each other; a photo storage unit that stores a photo of a subject taken by a user at a predetermined timing at the construction site in association with location information of the photo; an analysis unit that analyzes the photograph and identifies the subject; an identification unit that identifies an object corresponding to a predetermined target present at the construction site including the subject identified by the analysis unit; an update unit that updates the 3D animation by displaying the identified object at a position in the 3D animation that corresponds to the position of the predetermined target in real space; a display processing unit that visualizes the space utilization status and the progress status of the work process at the construction site by displaying the 3D animation; A site management system equipped with

2. The site management system according to claim 1, The 3D animation is The construction site is generated based on a 3D model representing a building to be constructed at the construction site, The object is Including those generated based on the components of the 3D model A site management system characterized by:

3. The site management system according to claim 1 or 2, The location management unit managing the positions in real space of moving objects, including construction machines and transport vehicles, delivered to the construction site in association with their positions in the 3D animation; The identification unit Identifying an object corresponding to the moving object; The update unit The object corresponding to the identified moving object is displayed in the 3D animation at a position in the 3D animation that corresponds to the position of the moving object in real space, and the 3D animation is updated. A site management system characterized by:

4. In the site management system according to any one of claims 1 to 3, The photo storage unit includes: storing photographs of materials unloaded from transport vehicles; The update unit updating the 3D animation to display an object corresponding to the material at a location within the 3D animation that corresponds to the location where the material was unloaded; A site management system characterized by:

5. The site management system according to any one of claims 1 to 4, The photo storage unit includes: The photos taken during the work process are stored, The update unit The 3D animation is updated by displaying an object corresponding to the work process at a position in the 3D animation corresponding to the position where the work process was performed in a manner that makes it possible to identify the portion where the work has been performed. A site management system characterized by:

6. The site management system according to any one of claims 1 to 5, The display processing unit A site management system characterized in that a display is displayed indicating that a photograph of the subject has been registered at a position within the 3D animation that corresponds to the position indicated by the position information.

7. The site management system according to any one of claims 1 to 6, The photo storage unit includes: A photograph of the subject taken at the construction site using a camera mounted on the terminal on which the 3D animation is displayed is stored. A site management system characterized by:

8. The site management system according to any one of claims 1 to 7, The location management unit Acquire information indicating the position in real space using a sensor mounted on the terminal on which the 3D animation is displayed. A site management system characterized by:

9. A site management method for managing a construction site using a 3D animation depicting the construction site, comprising: an object storage step of storing an object that can be displayed in a virtual space within the 3D animation; a position management step of managing positions in real space in association with positions within the 3D animation; a photo storage step of storing a photo of a subject taken by a user at a predetermined timing at the construction site in association with location information of the photo; an analyzing step of analyzing the photograph to identify the subject; an identification step of identifying an object corresponding to a predetermined target present at the construction site including the subject identified in the analysis step; updating the 3D animation by displaying the identified object at a position within the 3D animation that corresponds to the position of the predetermined target in real space; a display processing step of visualizing the space utilization status and the progress status of the work process at the construction site by displaying the 3D animation; Site management methods including.

Images