Construction photograph ledger creation support system and construction photograph ledger creation support program

Abstract

To clarify content required for a construction photograph ledger when creating construction blueprints, construction drawings, and process charts and to automatically generate a construction photograph ledger only by taking photographs at a construction site.SOLUTION: A construction photograph ledger creation support system 1 comprises: a construction photograph ledger plan building part 110 for building a blank ledger 400 containing embedded frames of photograph image data for a construction photograph ledger that should be created from construction drawing data and process sheet data before construction begins; a photography support part 120 for supporting photography during construction; and a construction photograph ledger creation part 140 for creating a construction photograph ledger 500 by embedding photograph image data taken at the site in the corresponding embedding frames in a blank ledger. Each embedded frame of the blank ledger 400 includes a unique frame ID, the photography support part 120 notifies of photograph ID information to be associated therewith when photographing, and the construction photograph ledger creation part 140 creates the construction photograph ledger 500 by associating them each other.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a construction photo ledger creation support system and a construction photo ledger creation support program for supporting the creation of construction photo ledger reports in construction and civil engineering works related to structures such as condominiums, office buildings, tunnels, bridges, roads, ports, and stations, and in the production of large-scale machinery and equipment such as ships and turbines. The construction work to which the construction photo ledger creation support system of the present invention can be applied is not limited to construction work, but can be widely applied to any work where the process can be planned in advance, such as the assembly and installation of large-scale machinery and equipment. [Background technology]

[0002] In construction works, civil engineering works, road construction works, assembly and installation of large-scale machinery and equipment, and the like, it is required to take photographs of the on-site construction situation at each stage during the construction, record the image data of each photograph in association with data such as date and time, and when creating a report, enter data such as the progress date and time, the location on-site where the photograph was taken, as well as an explanation of each photograph, to create a construction management ledger with photographs, and then compile these to submit a report.

[0003] In the past, at construction sites, the name of the project, the type of work, a schematic diagram of the measurement points, the progress of the project, etc. were written on a blackboard, and a photograph was taken so that the blackboard was included in the scene of the site, and the image obtained by taking the photograph was used to confirm which construction site and which photograph it was. In other words, since there are many similar scenes at construction sites and it is impossible to sort them at the construction site, if a photograph is taken at the site without any clues, it may be difficult to tell which scene was captured in the photograph later, and it may become unclear. Therefore, the date and time of the photographed image were identified by checking the contents written on the blackboard that were captured in the photograph as a clue. In this way, the date, time and content of the photographed image were identified using the contents written on the blackboard that were reflected in the photographic image as a clue, and the photographs were developed and pasted together manually to create a construction photo ledger and compile it into a report.

[0004] In this way, the creation of the construction photo ledger was a so-called post-work task, and the site supervisor or person in charge who returned to the office from the construction site would search for the relevant photos from the photos taken at the site and stored in the camera, edit the photos by adding various information to them, and create a construction photo ledger (construction photo album), and then report on the construction details based on the created construction photo ledger. In the prior art, there are systems that support the taking of photographs of the construction status at the construction site and notify the user to prevent forgetting to take photographs, but there is nothing that clearly shows how to systematically schedule the construction status to be photographed at the construction site with the intention of creating the construction photo ledger that should ultimately be created from the beginning. In particular, there was no system that systematically schedules the construction status to be photographed from the beginning, anticipating the creation of the construction photo ledger that should ultimately be created from the design stage, based on the client's wishes, the design ideas of those involved in the design, and the design drawings.

[0005] [Patent Document 1] JP 2000-165786 A [Patent Document 2] JP 2013-125535 A DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]

[0006] However, since construction sites generally have hundreds of steps and numerous construction drawings, it is difficult for site workers to take all the photographs that should be taken at each step. At construction sites, multiple steps often proceed simultaneously on the same day, such as laying new rebar, bringing in new formwork, pouring new concrete or cement materials, and installing new equipment. Therefore, if photos are taken during and after work, the image data will be disorganized and mistakes such as forgetting to take a photo or taking a duplicate photo will easily occur. In addition, considering that the process or type of work may vary from one construction site to another, it is extremely difficult for on-site workers to take images of the construction site at every process at every construction site without missing any.

[0007] In addition, the creation of the construction photo ledger is a so-called post-work by the site supervisor or person in charge who returns to the office from the construction site, and it takes time and a large burden to find the corresponding photo image from the photos taken at the site stored in the camera using the contents of the blackboard reflected in the image as a clue, and to edit the photo image by adding various information to it to create the construction photo ledger. In other words, the work of appropriately sorting the photo image data according to the construction stage requires a huge amount of human labor. Even if these tasks are entrusted to site supervisors and staff, it is difficult to secure personnel who are capable of understanding each process and construction drawings at the construction site, as well as familiar with computer and digital camera photo image data processing. If the situation is left dependent on the abilities of site supervisors and staff, it is not possible to guarantee the creation of construction photo ledgers and reports with a certain level of quality.

[0008] Currently, it is difficult to secure workers for work at construction sites, and there are fears that the labor shortage will worsen in the future. The reality is that site supervisors, construction workers, and camera operators are overworked in order to complete the work with a small number of people. Therefore, there is a demand to reduce the burden on site supervisors, construction workers, and other personnel, even if only as much as possible. It is important to reduce the burden of the subsequent task of creating a construction photo ledger.

[0009] Next, the photo image data required based on the wishes of the client, the design ideas of the people involved in the design, and the management ideas of the process manager who created each construction drawing based on the design drawings and developed the schedule for each process did not match the photo image data taken by the site supervisor and photographer in charge of the construction work at the construction site, and the reported construction photo ledger and report sometimes deviated from what the client, designer, or construction manager wanted. In other words, if the site supervisor and photographer of the construction contractor do not fully understand the purpose and intent of the photography, it may not be the construction photo ledger that the client, construction designer, or process manager wants.

[0010] Furthermore, if a photograph is forgotten at a certain location on a construction site, the construction work at the site progresses day by day, and the problem arises that it is not possible to take the necessary photograph again. Furthermore, when editing the photographed images later, the photographer may want to add any notes or instructions that he or she felt were necessary. If these notes or instructions cannot be added on the spot, it may be difficult to outsource the editing of the construction photo ledger because important information in the report may not be known unless the photographer checks with the person who actually took the photos.

[0011] In developing a technology to reduce the burden of creating a construction photo ledger, the inventor, Yoshiki Morikawa, turned his attention to the blackboard that is photographed at the same time as the photography at the site. The contents of the blackboard contain the minimum necessary information, so it is beneficial to reflect the information on the blackboard in the creation of the construction photo ledger.

[0012] However, there are some points that need to be improved when using general character recognition software. General character recognition software is equipped with a wide variety of word data and their character patterns that are generally required, but when using general character recognition software, the wide variety of word data and their character patterns are also used in the matching process, which can lead to false recognition. In other words, all the characters written on the blackboard are words used at construction sites. There are many technical terms and abbreviations, but the vocabulary is limited. Therefore, rather than using general character recognition software, we realized that it would be possible to reduce false recognition by strengthening the words, technical terms, and abbreviations used at construction sites and not loading other words that are not used in construction work, or by removing them from the correct answer candidates.

[0013] In addition, the inventor, Yoshiki Morikawa, noticed a great benefit of image recognition of construction materials and construction equipment that are delivered to the construction site at the specified date and time and appear in the photographed images in the construction photo ledger. The value of the construction photo ledger would increase if information about the construction materials and construction equipment was also recorded, but this information was entered manually on-site or as a post-work manual after the work was completed, which made it prone to input errors and placed a heavy burden on workers. He noticed the possibility of reducing the labor required to enter the construction materials and construction equipment by image recognition of the photographed images.

[0014] In addition, the inventor, Yoshiki Morikawa, noticed that when creating a construction photo ledger, there may be information that is not collected on the day of daily construction work, but is requested by the construction client later. In other words, he realized that there is value in collecting information that may be useful later, in addition to the information that is collected as essential information for creating a construction photo ledger. It is considered difficult to collect all information in advance, but he found value in the ingenuity of collecting information together using a generative AI system. For example, weather information such as rain, snow, humidity, and temperature is not essential information for the current construction ledger, but it may be requested later to analyze the drying of concrete, etc. He also considered expanding the function to collect such information in advance.

[0015] In consideration of the above problems, the present invention aims to provide a construction photo ledger creation support system and a construction photo ledger creation support program that clarify the content required for a construction photo ledger when creating design drawings and construction drawings, in order to create a construction photo ledger that contains the content required by the client, designer, and process manager, and that automatically generates a construction photo ledger by simply taking specified photos at the construction site, thereby reducing the burden on site supervisors and construction workers. [Means for solving the problem]

[0016] In order to achieve the above object, the construction photo ledger creation support system of the present invention for supporting the creation of a construction photo ledger comprises a blank ledger creation unit that creates a blank ledger in which embedded frames in which predetermined photo image data are embedded in the construction photo ledger are collected by associating frame ID data with photo ID data that is to be assigned to photo image data to be taken at a construction site, and supports the creation of a construction photo ledger, the construction photo ledger creation support system comprising a construction equipment management unit that assigns construction equipment ID data and information about the construction equipment to construction equipment that is to be brought to a predetermined location at a predetermined date and time and used at the construction site, and ... the image recognition unit acquires the construction equipment ID by image recognition of the actual construction equipment that has been delivered to a specified location at a specified date and time and is being used, and the image recognition unit acquires the construction equipment ID data by image recognition of the construction equipment that is actually being used and is captured in the photographic image data, and the construction photo ledger creation unit performs a process of attaching the photographic image data to a specified location on the frame based on the photographic ID data that corresponds to the frame ID data, and also records the construction equipment ID data acquired by the image recognition unit and information regarding the construction equipment in the frame to create the construction photo ledger. With the above configuration, in addition to the project name, type of work, measurement point outline, and progress of the project, the construction equipment being brought into the construction site can be photographed at the same time as the photo is taken, and included in the photo image. The construction equipment can then be recognized by the image recognition unit, and the results of the recognition of the construction equipment can be written into the construction photo ledger, resulting in a useful construction photo ledger in which the contents of the construction equipment are recorded in a concise manner along with the photo image data.

[0017] In addition, the image recognition unit can also perform image recognition using a construction equipment image-trained image recognition AI system that has been trained on images of a wide variety of construction equipment related to construction work. General image recognition software is equipped with a large number of various image data and image patterns that are generally required, and when general image recognition software is used, image data and image patterns of various objects unrelated to construction work are used in the matching process, which may result in erroneous recognition, but since the construction equipment used in construction work is limited to specific objects used at construction sites, it is preferable to use an image recognition AI system that has been trained with construction equipment images and patterns that have been enhanced with image data and image patterns of construction equipment used at construction sites. Misrecognition can be reduced by not loading image data and image patterns of other objects that are unlikely to be used in construction work in the image recognition AI system, or by removing them from the correct answer candidates.

[0018] Next, further, in the above-mentioned construction photo ledger creation support system, in the recording process by the construction photo ledger creation unit, the icon or link information assigned to the construction equipment can be displayed at a predetermined position of each of the frames of the construction photo ledger, or in the image area portion of the construction equipment in the photographed image data, and information regarding the construction equipment can be displayed by performing a display operation on the icon. With the above configuration, when viewing the created construction photo ledger, if the viewer wants to confirm what type of construction equipment appears in the photo, the display processing unit displays an icon or link information displayed in a specified position of the frame or in the image area portion of the construction equipment in the photo image data, and by performing a display operation on the icon or link information, information about the construction equipment is displayed, allowing the viewer to confirm the contents of the construction equipment. Here, the information on the construction equipment includes, but is not limited to, for example, the name of the construction equipment, the model number of the construction equipment, the specifications and manuals of the construction equipment, the manufacturer and supplier of the construction equipment, the lease information of the construction equipment, the qualifications to operate the construction equipment, the weight and size of the construction equipment, or a combination of these. It is also preferable that the display is organized as a pull-down menu.

[0019] Next, in the construction photo ledger creation support system configured as above, it is possible to carry out the process not only for construction equipment at the construction site, but also for materials brought to the construction site. In the above configuration, the system is equipped with a construction material management unit that assigns a material ID to materials that are scheduled to be brought to the construction site at a specified location at a specified date and time and used, and an image recognition unit that performs image recognition on the materials that are brought to the construction site at a specified location at a specified date and time and are used, and obtains the material ID, and the construction photo ledger creation unit can create the construction photo ledger by performing the pasting process of the photo image data to a specified location, the recording process of the written information on the blackboard, and the recording process of the material ID of the image recognition of the materials. With the above configuration, the construction photo ledger can be efficiently created by performing image recognition on information regarding materials that need to be recorded in the construction photo ledger, that is, construction materials and construction equipment that have been brought to the construction site at a specified location at a specified date and time and that appear in the captured images.

[0020] As in the case of construction equipment, the image recognition processing of the material ID for the materials by the image recognition unit can be performed using an image recognition AI system that has learned images of the materials related to the construction work. General image recognition software is equipped with a large number of various image data and image patterns that are generally required, and when general image recognition software is used, image data and image patterns of various objects unrelated to construction work are used in the matching process, which may result in erroneous recognition, but since the materials used in construction work are limited to specific objects used at construction sites, an image recognition AI system that has been trained on construction work images and has enhanced image data and image patterns of materials used at construction sites is used. By using an ingenious method, such as not loading image data and image patterns of other objects that are unlikely to be used in construction work with this image recognition AI system, or by removing them from the correct answer candidates, erroneous recognition can be reduced.

[0021] Next, it is also preferable to provide a voice recognition unit that receives voice input data input at the construction site through a photographing device or communication device with a voice input function and performs voice recognition on the voice input data to obtain voice input information, and the construction photo ledger creation unit creates the construction photo ledger that records the voice input information obtained by the voice recognition unit together with the written information on the blackboard obtained by the image recognition unit. With the above configuration, comments such as notes to be taken when taking photographs or matters to be handed over can be entered by text or voice at the shooting site, thereby reducing the burden of creating a construction photo ledger.

[0022] In addition, it is preferable that the voice recognition process by the voice recognition unit is performed using a construction work terminology-trained voice recognition AI system that has been trained with terms related to construction work. With general voice recognition software, there is a risk of there being too many general terms to recognize, which could result in a lot of misrecognition. However, since the terms input by voice are limited to those related to construction work, the voice recognition AI system that has been trained in construction work terminology improves the accuracy of voice recognition.

[0023] Next, in the above configuration, it is preferable to provide an information collection function expansion unit that collects various information including weather information, earthquake information, event information, logistics information, and payment information in the area around the construction site that may be required, in addition to the photo image data related to the construction that is directly required and collected for creating the constructed blank ledger, and for the construction photo ledger creation unit to create the construction photo ledger using the various information obtained from the information collection function expansion unit. With the above configuration, when creating a construction photo ledger, information that is not collected on the day of daily construction work but is requested by the construction client later can be collected and used. It is considered difficult to collect all information in advance, so it is preferable to limit information to construction work and have a generation AI system learn and collect information that was useful in the past. For example, weather information such as rain, snow, humidity, and temperature is not essential information for the current construction ledger, but may be required at a later date to analyze the drying of concrete, etc. The function can be expanded to collect such information in advance.

[0024] It is also preferable that the construction photo ledger creation unit is provided in a cloud system on a computer network, and the construction photo ledger creation unit has a communication function for receiving the photo image data by uploading it to the cloud system via the computer network.

[0025] In the construction photo ledger creation support system configured as above, as a further innovation, the following configuration can also be adopted. It is configured to include a construction data input unit that receives input of construction drawing data and schedule data related to the construction work before the start of the construction work; a photography content designation unit that receives input of the photography points and objects to be photographed at the construction site based on the construction drawing data by the person in charge of setting the contents of the construction photo ledger, and input of the photography date and time based on the schedule data; a construction photo ledger plan creation unit that is equipped with a blank ledger creation unit that creates a blank ledger with a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger according to the input from the photography content designation unit; a photography support unit that supports the photography by displaying the specified photography date and time, the specified photography point, and the photographing instructions for the object to be photographed on the display unit of a photography device or communication device with a photography function carried by the person in charge of photography during the construction work; and a construction photo ledger creation unit in which the construction photo ledger creation unit embeds the photo image data in the corresponding embedded frame in the blank ledger and creates the construction photo ledger in which information obtained from the photo image data is also recorded.

[0026] With the above configuration, a blank ledger containing a collection of embedded frames of photo image data as a construction photo ledger that should already be created before construction begins is obtained, and at the construction site, the photo image data is embedded in the corresponding embedded frames in the blank ledger simply by taking the photos specified for each day's construction, and the construction photo ledger is automatically created. This greatly reduces the burden on the site supervisor and photographer, and furthermore, the shooting points, shooting dates and times, and subjects are planned in advance, and the site supervisor and photographer take the photos while accurately checking the planned contents, so there is no risk of missing or missing photos.

[0027] Here, in the above-mentioned configuration of the blank ledger, in order to facilitate the efficient and accurate embedding of the captured photographic image data in the corresponding embedded frame in the blank ledger, a unique frame ID is provided for each embedded frame in the blank ledger created by the construction photo ledger plan creation unit, and it is preferable that the construction photo ledger plan creation unit pre-sets a photo ID that is uniquely assigned to each shooting date and time information, shooting point and photographed object, and notifies the photography support unit of this photo ID. With the above configuration, each piece of photo image data taken at the construction site with the support of the photography support unit is associated with a unique photo ID. If the construction photo ledger creation unit holds correspondence data with the photo ID corresponding to the frame ID, the construction photo ledger creation unit can receive photo image data uploaded as the construction progresses and embed the data in a buried frame with a corresponding frame ID in the blank ledger based on the photo ID. If the construction photo ledger creation unit matches the frame ID of the buried frame and the photo ID of the photo image data based on the correspondence data held by the construction photo ledger creation unit, the photo image data taken as planned can be efficiently and accurately embedded in the corresponding buried frame in the blank ledger.

[0028] Here, in the above-mentioned configuration of the construction photo ledger creation support system, it is possible for the construction photo ledger creation unit to be provided in a cloud server on a computer network, and for the photography support unit to be equipped with a communication function for uploading the photo image data relating to the photography to the cloud server on the computer network. With the above configuration, the site supervisor, the person in charge of photography, and the construction worker only need to take photos at the designated shooting points, and the photo image data will be uploaded to the cloud server on the network, and the photo image data will be automatically embedded in the corresponding embedded frame in the blank ledger one by one. In other words, there is no need for post-work. Furthermore, it is preferable that the blank ledger creation unit is equipped with a standard blank ledger database storing blank ledgers of the construction photo ledgers relating to a plurality of standardized construction works, and a standard blank ledger selection unit in which the authority or person in charge selects an appropriate standard blank ledger from the standard blank ledger database, and that the setting person performs the necessary tuning on the selected standard blank ledger in the blank ledger creation unit based on the construction drawing data and the schedule data relating to a specific construction work, and creates the blank ledger relating to the specific construction work. With the above configuration, blank ledgers can be created efficiently in the blank ledger creation unit, and a standard blank ledger that has been highly evaluated and has a proven track record in past creation can be used, and the setup staff can tune the system to efficiently create blank ledgers suitable for specific construction work.

[0029] The construction photo ledger creation support system of the present invention can be provided as a construction photo ledger creation support program that can be installed on a computer as described below. The construction photo ledger creation support program includes a blank ledger creation processing step in which a blank ledger is created by associating frame ID data assigned to each embedded frame with photo ID data assigned to photo data that is scheduled to be photographed at the construction site for a blank ledger that is a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger; a construction equipment management processing step in which construction equipment ID data is assigned to construction equipment that is scheduled to be brought into the construction site at a specified date and time and used at a specified location; and an image recognition processing step in which actual construction equipment that is captured in the photo image data taken of the construction site and that has been brought into the construction site at a specified date and time and is being used is image recognized to obtain the construction equipment ID data, and the construction photo ledger creation support program causes a computer to execute a construction photo ledger creation processing step in which the photo image data is attached to a specified location on the frame based on the photo ID data associated with the frame ID data, and the construction equipment ID data of the construction equipment acquired in the image recognition processing step is also recorded in the frame to support the creation of the construction photo ledger.

[0030] In the program of the above configuration, the blank ledger creation processing step executes the creation and processing of the blank ledger by a construction photo ledger plan construction processing step which includes a construction data input step for receiving input of construction drawing data and schedule data relating to the construction work before the start of the construction work, a setting input step for setting the shooting points and objects to be photographed at the construction site based on the construction drawing data by a person in charge of setting the contents of the construction photo ledger, a shooting content designation step for receiving setting input of the shooting date and time based on the schedule data, and a blank ledger creation step for creating a blank ledger consisting of a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger in accordance with the input in the shooting content designation step. Furthermore, in the program of the above configuration, it is preferable that the program includes a photography support processing step for supporting the photography by displaying the specified photography date and time, the specified photography point, and the photography instructions for the object to be photographed on the display unit of a photography device or a communication device with a photography function carried by a person in charge of photography during the construction work, and in the blank ledger creation processing step, unique photo ID data is assigned to the photography date and time information, the photography point, and the object to be photographed as the photo ID data, and the photo ID data is linked to each of the photo image data taken with the assistance of the photography support processing step, and in the construction photo ledger creation processing step, correspondence data with the photo ID data corresponding to the frame ID data is held, and in the construction photo ledger creation processing step, the uploaded photo image data is received and embedded in the buried frame in the blank ledger having the corresponding frame ID correspondence data based on the correspondence data. Next, in the program of the above configuration, in the recording process by the construction photo ledger creation processing step, it is preferable to execute an information display process in which the icon or link information assigned to the construction equipment is displayed at a predetermined position of each of the frames of the construction photo ledger, or is displayed in the image area portion of the construction equipment in the photographed image data, and information regarding the construction equipment is displayed by a display operation on the icon. Effect of the Invention

[0031] According to the construction photo ledger creation support system of the present invention, the construction material image included in the photograph image can be image recognized by the image recognition unit, information about the construction equipment based on the image recognition result can be entered in the construction photo ledger, and a construction photo ledger whose contents can be easily understood together with the photographic image data embedded in the buried frame can be automatically created. Also, when viewing the created construction photo ledger, if the viewer wants to confirm what kind of construction equipment is shown in the photograph, an icon or link information displayed in a predetermined position of the frame or in the image area of ​​the construction equipment in the photographic image data is displayed by the display processing unit, and by performing a display operation on the icon or link information, information about the construction equipment is displayed, and the contents of the construction equipment can be confirmed. Before the start of construction work, a blank ledger containing embedded frames of photo image data is obtained as a construction photo ledger, and at the construction site, simply taking the photos specified for each day's work will embed the photo image data in the corresponding embedded frames in the blank ledger, and the construction photo ledger will be automatically created. This greatly reduces the burden on the site supervisor and photographer, and furthermore, the shooting points, shooting dates and times, and subjects are planned in advance, and the site supervisor and photographer take the photos while accurately checking the planned contents, so there is no risk of missing or missing a photo. This reduces the burden on site supervisors, construction workers, and photographers, and ensures the creation of construction photo ledgers and reports of a consistent quality. It is possible to create construction photo ledgers and prepare reports as required by clients, designers, and process managers. [Brief description of the drawings]

[0032] [Figure 1] 1 is a diagram showing an example of the configuration of a construction photo ledger creation support system 1 according to the present invention. [Diagram 2] This is a diagram showing the general outline of the processing flow of the construction photo ledger creation support system 1. [Diagram 3]FIG. 13 is a diagram showing a very simple example of working drawing data and work schedule data for the current construction work inputted via the construction data input unit 111. [Figure 4] FIG. 4 is a diagram showing a state in which a designation process of the photographing contents is carried out via the photographing contents designation unit 113 based on the working drawing data and the process schedule data of FIG. [Diagram 5] FIG. 13 is a reference diagram of a photo list mode of a certain standard blank ledger data 300. [Figure 6] 1 is a reference diagram of a table of contents of a form image of a standard blank ledger data 300. FIG. [Figure 7] FIG. 13 is a reference diagram of a photo ledger page of a form image of a standard blank ledger data 300. [Figure 8] FIG. 13 is a reference diagram of the blank ledger data 400 in a photo list mode. [Figure 9] 13 is a reference diagram of a table of contents of a form image of the blank ledger data 400. FIG. [Figure 10] 13 is a reference diagram of a photo ledger page of a form image of blank ledger data 400. FIG. [Figure 11] 13 is a diagram showing an example of support display for image capture contents displayed on the image capture contents instruction display unit 220 of the client 200. FIG. [Figure 12] This is a simplified diagram showing how the construction photo ledger creation unit 140 is equipped with three recognition processing modules: a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143. [Figure 13] This shows only a small portion of an example of the construction photo ledger data 500 created by the construction photo ledger creation unit 140. [Figure 14] FIG. 13 is a diagram showing how information relating to construction equipment is displayed using pop-up and pull-down menus. [Figure 15] FIG. 1 is a diagram showing the processing flow 1 of the construction photo ledger creation support system 1. [Figure 16] FIG. 2 is a diagram showing the processing flow 2 of the construction photo ledger creation support system 1. [Figure 17] FIG. 3 is a diagram showing the processing flow 3 of the construction photo ledger creation support system 1. BEST MODE FOR CARRYING OUT THEINVENTION

[0033] Hereinafter, an embodiment of the construction photo ledger creation support system of the present invention will be described with reference to the drawings. However, it goes without saying that the scope of the present invention is not limited to the specific applications shown in the following embodiments. The construction work to which the construction photo ledger creation support system of the present invention can be applied is not limited to construction work, but can be widely applied to any work in which the process can be planned in advance, such as road construction and on-site assembly and installation of large-scale machinery and equipment.For ease of explanation, examples will be described mainly regarding the application to construction work, but it will be understood that the system can be similarly applied to any work in which the process can be planned in advance, such as on-site assembly and installation of large-scale machinery and equipment. Example 1

[0034] An example of the configuration of the construction photo ledger creation support system 1 of the present invention will be described below. FIG. 1 is a diagram showing an example of the configuration of a construction photo ledger creation support system 1 according to the present invention. FIG. 2 is a diagram showing an outline of the processing flow of the construction photo ledger creation support system 1. As shown in Fig. 1, the construction photo ledger creation support system 1 according to the first embodiment is constructed as a client-server system including a server 100 and a client 200 connected via a network. A cloud system may also be used. In this embodiment, a cloud server on the cloud and a smartphone brought to the site are configured as client terminals.

[0035] As shown in Figure 1, the server 100 is configured to include a construction photo ledger plan creation unit 110, a photography support unit 120, an information collection function expansion unit 130, a construction photo ledger creation unit 140, a construction photo ledger database 150, a display processing unit 160, and a communication I / F 170. In this configuration example, the construction photo ledger plan creation unit 110 is configured with a construction data input unit 111, a construction equipment management unit 112, a photography content designation unit 113, a blank ledger creation unit 114, and a standard blank ledger database 115. In this configuration example, the construction photo ledger creation unit 140 includes three recognition processing modules, namely, a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143, and a display processing unit 160. Also, although not shown, a control device, memory, input / output devices, and the like that are generally provided in the server 100 are omitted. The operator of the server 100 is not particularly limited, but here it is assumed to be the administrator of the construction photo ledger creation support system.

[0036] Next, as shown in FIG. 1, the client 200 includes a photographing section 210, a photographing content instruction display section 220, and a communication I / F 230. The hardware configuration of the client 200 may be a general-purpose personal computer, a portable communication device such as a smartphone, or a digital camera device. It may also be configured on such a device by downloading an application that provides the function of the shooting content instruction display unit 220 via a network. Since the photographing unit 210 is required, a digital camera device or a smartphone is assumed. The subject of use of the client 200 is not particularly limited, but will be described here as a site supervisor or a cameraman at a construction site. It is assumed that there are multiple clients 200 on the network, and the cloud server 100 receives photo image data from each client 200 and creates a construction photo register.

[0037] Below, each component of the server 100 will be described first, and then each component of the client 200. The outline of the process flow of the construction photo ledger creation support system 1 using FIG. 2 will be described later. First, each component of the server 100 will be described. As described above, the server 100 is configured with a construction photo ledger plan creation unit 110, a photography support unit 120, an information collection function expansion unit 130, a construction photo ledger creation unit 140, a construction photo ledger database 150, a display processing unit 160, and a communication I / F 170.

[0038] The construction photo ledger plan creation unit 110 is a part that creates blank ledger data 400, which is a collection of embedded frames of photo image data for the construction photo ledger to be created for the construction work, from input construction data related to the construction work, such as construction drawing data and schedule data, before the construction work begins.

[0039] The blank ledger data 400 is blank construction photo ledger data with no specific photo images attached in advance to match the planned completion of the construction photo ledger data 500 that will be required in the report on this specific construction work, and in this invention, this is referred to as blank ledger data 400. In the construction photo ledger creation support system 1 according to the first embodiment, the creation of this blank ledger data 400 is considered important, and if the creation of this blank ledger data 400 is incorrect or inaccurate, there is a risk that the efficiency of the construction photo ledger creation will decrease due to the need to redo photography and make changes after construction has started or at the end of construction. Therefore, the construction photo ledger plan construction unit 110 has various functions to efficiently and easily create accurate and desirable blank ledger data 400.

[0040] The construction photo ledger plan creation unit 110 comprises a construction data input unit 111 , a construction equipment management unit 112 , a photography content designation unit 113 , a blank ledger creation unit 114 , and a standard blank ledger database 115 .

[0041] The construction data input unit 111 is a part that receives input of construction drawing data and schedule data related to the current construction before the construction starts. Through the construction data input unit 111, construction drawing data and schedule data related to the construction are received from the client, design company, primary contractor, etc., for the construction company or subcontractor who is actually in charge of the construction.

[0042] "Working drawings" for construction work are created from design drawings (implementation design drawings, structural drawings, equipment drawings, etc.), and generally include detailed floor plans, structural drawings, and overall drawings (electrical drawings, air conditioning drawings, water supply and drainage sanitary drawings, gas sanitary drawings). The working drawing data referred to here is the data of such working drawings that can be processed by computer. For work other than construction work, such as on-site assembly and installation of large-scale machinery and equipment, the working drawing data is not limited to the above and can be of various types.

[0043] A "schedule" for construction work is a table that summarizes each step of the work and the time until completion (delivery date), and can be, for example, an overall schedule, a detailed schedule, a monthly schedule, a weekly schedule, etc. The schedule data referred to here is such schedule data that can be processed by computer. Since each step of the work can be specifically grasped, it becomes easier for construction managers such as site supervisors to understand the allocation of personnel and the progress of work hours. There are various types of schedule data, such as bar chart schedule data, Gantt chart schedule data, and network schedule data.

[0044] FIG. 3 is a diagram showing a very simple example of working drawing data and schedule data for this specific construction work inputted via the construction data input unit 111. FIG. 3 shows only one detailed plan view as a working drawing, and only one bar chart schedule as a schedule. In actual construction work, when it comes to large-scale construction work, the working drawings alone may amount to hundreds or thousands of sheets, and the schedule may also amount to hundreds or thousands of sheets due to a wide variety of construction sections and construction units. Here, only a very small portion is shown in order to explain the invention.

[0045] The construction facility management unit 112 assigns a material ID to materials that are to be delivered to a predetermined location on a predetermined date and time at the construction site and used. By analyzing the information collected via the construction data input unit 111 based on the construction drawing data and schedule data previously obtained before the start of construction, information regarding the construction materials to be brought into the current construction work and the construction equipment to be used can be obtained. Based on this information, the construction equipment management unit 112 manages the materials that are scheduled to be brought to the construction site at a specified date and time and to be used, and assigns material IDs to these materials.

[0046] For management, for example, a material ID may be assigned to each material individually, or a material ID may be assigned to a group of materials that are to be brought to a specific location on a specific date and time and used at the construction site. For example, if a group of materials includes 100 bolts that are brought to a specific location on a specific date and time, 100 different material IDs may be assigned to each bolt, or a single material ID may be assigned to the group of materials. By assigning this material ID, when creating the construction photo ledger described below, it is possible to include a record that the material to be used was delivered to a specified location at a specified date and time and used by matching it with the material ID.

[0047] It is also preferable that the construction equipment management unit 112 assigns, in addition to the material ID, a construction equipment ID to the construction equipment that is brought into the construction site at a predetermined place on a predetermined date and time and used. When creating a construction photo ledger, it is often necessary to record the construction equipment that was put to use. By assigning this construction equipment ID, it is possible to include a record of the construction equipment that was brought to the designated location at the designated date and time and used by matching it with the construction equipment ID when creating the construction photo ledger, which will be described later. In addition, the construction equipment management unit 112 manages the construction equipment ID in association with information about the construction equipment. In other words, if the construction equipment ID is known, various information about the construction equipment can be obtained. The information about the construction equipment is not limited to, but may include, for example, the name of the construction equipment, the model number of the construction equipment, the specifications and manual of the construction equipment, the weight and size of the construction equipment, the person in charge of the construction equipment, contact information such as a telephone number, the manufacturer or supplier of the construction equipment, lease information of the construction equipment, and qualification information for operating the construction equipment, or a combination thereof.

[0048] The photography content designation unit 113 is a construction data input unit which receives input of construction drawing data and schedule data relating to the construction work before the start of the construction work, and receives input of settings for the photography points and photographed objects at the construction site based on the construction drawing data, and the photography date and time based on the schedule data, by the person in charge of setting the contents of the construction photo register. Construction drawing data is image data showing detailed plan views, structural drawings, overall drawings, etc., but in the conventional technology, when creating the final construction photo ledger for this specific construction work, information from the viewpoint of "from what position should the photographs be taken to create an appropriate construction photo ledger" is not included. Therefore, in the construction photo ledger creation support system 1 of the present invention, the person in charge of setting the contents of the construction photo ledger at the stage before the construction work is started specifies the photographing points in advance, plans the contents of the photographs to be taken at a specified date and time and at a specified construction stage, and enables the settings via the photographing contents designation unit 113.

[0049] The designation of the photographed contents via the photographed contents designation unit 113 may be performed manually by an authority who decides the contents of the construction photo ledger while referring to the displayed construction drawing data and schedule data, or a person in charge who receives instructions from the authority. It is preferable that a convenient GUI is prepared for designation, and for example, there is a designation method that combines various input methods such as designation by mouse, selection by pull-down menu, and input of numerical values ​​via keyboard. In addition, a method in which the photographed contents designation unit 113 automatically performs initial settings through the support of artificial intelligence, which has become widespread in recent years, and is tuned by an authority or a person in charge as necessary, is also possible. In the future, it is expected that the manual settings made by the person in charge of configuration will also be generated by artificial intelligence (AI).

[0050] The shooting content designation unit 113 can designate the shooting location, shooting direction and shooting angle as the shooting point setting input, and the shooting subject, its shooting posture, and the deployed state of the lid or parts of the shooting subject as the shooting subject setting input.

[0051] FIG. 4 is a diagram showing a state where a process of designating the photographed contents is carried out via the photographed contents designation unit 113 based on the working drawing data and the process schedule data of FIG. As shown in Figure 4, for the construction drawing data, the setting input for the shooting point includes the shooting location, shooting direction, and shooting angle, and the setting input for the object to be photographed includes the object to be photographed, its shooting posture, and a specified comment on the deployed state of the cover or parts of the object to be photographed. In Figure 4, the camera shooting position and shooting direction are shown with symbols. The apex direction of the triangle is the shooting direction. In this example, the shooting angle is entered as a numerical value as the angle from the floor. Also, in this example, the object to be photographed, its shooting posture, and the deployed state of the object to be photographed are entered as specified comments at the end of the leader line. In other words, the construction drawing data that has been used conventionally and is also prepared for this construction project is provided with the photograph content data.

[0052] Regarding the specification of the shooting date and time, the shooting points and dates for each process are specified in the process schedule data, making it easy for the site supervisor or person in charge of photography to clearly plan when, where, and what to shoot to obtain photo image data. In other words, the shooting content data is added to the schedule data that has been used conventionally and is also prepared for this construction project.

[0053] The blank ledger creation unit 114 is a part that constructs a base blank ledger that serves as the construction photo ledger to be created based on the shooting content input and specified by the setting officer via the shooting content designation unit 113, in other words, a blank ledger that is a collection of embedded frames into which photo image data is embedded as the construction photo ledger to be created. In order to efficiently construct blank ledgers, the blank ledger creation unit 114 prepares a database of standard blank ledgers for each category of construction work content (standard blank ledger database 115), and has the function of creating blank ledgers for specific construction work by tuning this standard blank ledger.

[0054] The creation of the blank ledger by the blank ledger creation unit 114 may be tuned manually by an authority who decides the contents of the construction photo ledger or a person in charge who receives instructions from the authority, while referring to the shooting content designation result, construction drawing data, and schedule data created by the shooting content designation unit 113, as shown in Fig. 4. Also, a method is possible in which the shooting content designation unit 113 automatically sets the initial settings with the support of artificial intelligence (AI), which has become widespread in recent years, and the authority or person in charge tunes it as necessary.

[0055] The standard blank ledger database 115 is a database that accumulates standard data that serves as the basis for the construction photo ledger data 500, which is ultimately created by the construction photo ledger creation support system 1 and has construction photos attached and organized. Here, this base standard data is called the "standard blank ledger data 300." In other words, it is a data set that has blank areas for attaching photo images of each shooting point of the construction work proceeding according to the construction drawings and schedule, and can be said to be like a "planned photo image mount" in which the photo images at the shooting points where they are scheduled to be taken according to the construction drawings and schedule and the locations where they will be attached are planned in advance.

[0056] In actual construction work, the contents of each construction work are varied and diverse, but it is believed that they can be categorized and patterned to some extent depending on the construction object. The standard blank ledger data 300 is a "standard" construction photo ledger created according to a "standard" schedule for categorized and patterned construction objects, and "standard" data in a blank state where no photographic images have yet been attached or organized is called "standard blank ledger data 300," and the standard blank ledger database 115 collects and stores a wide variety of these. The standard blank ledger selection unit 116 selects standard blank ledger data suitable for the current specific construction work from various standard blank ledger data 300 stored in the standard blank ledger database 115. The setting staff may manually select the standard blank ledger data 300 via the standard blank ledger selection unit 116, and in the future, it is considered that the manual designation by the setting staff will also be generated by artificial intelligence (AI).

[0057] Figures 5 to 7 show only a small portion of the "standard blank ledger data 300" stored in the standard blank ledger database 115. In actual construction work, progress is recorded over a period of many days at many photographic points, so it will be understood that what is shown in Figures 5 to 7 is only a small portion of it. FIG. 5 is a reference example of a photo list mode of a certain standard blank ledger data 300. FIG. 6 is a reference example of a table of contents of a form image of a certain standard blank ledger data 300. FIG. 7 is a reference example of a photo ledger page of a form image of a certain standard blank ledger data 300. The standard blank ledger data 300 in Figures 5 to 7 only show a small portion, and it is assumed that the construction photo ledger for actual construction work will have many shooting points, many total days of photography, and many photo images. Figures 5 to 7 are in the planning stage before construction, so the photo images have not yet been pasted and organized, and are all blank.

[0058] The blank ledger creation unit 114 extracts standard blank ledger data from the standard blank ledger database 115 according to the construction category based on the construction drawings and schedule of this specific construction project, and creates a blank ledger for the specific construction project by tuning the standard blank ledger. The blank ledger creation unit 114 develops embedded frames from the extracted standard blank ledger into which the necessary number of photo image data to be created from each construction and photography point specified in Fig. 4 is embedded. Here, if a series of photography content data specified as in Fig. 4 is given, the standard blank ledger data 300 shown in Fig. 5 to Fig. 7 is developed, and photo list mode data, table of contents data of the form image, and photo ledger page data of the form image are obtained, but the photo images embedded in each are blank and only include frames.

[0059] An authority or person in charge of deciding the contents of the construction photo ledger who operates the blank ledger creation unit 114 performs tuning based on the standard blank ledger data 300 in Figures 5 to 7 in accordance with the contents of the specific construction work, and completes the blank ledger data 400. Here, if artificial intelligence technology develops in the future, the blank ledger creation unit 114 may automatically complete the blank ledger data 400 using artificial intelligence.

[0060] 8 to 10 are diagrams showing a small portion of the tuned blank ledger data 400. In an actual construction project, progress is recorded over a period of many days at a large number of photographing points, so it will be understood that what is shown in Figs. 8 to 10 is only a small portion of it. FIG. 8 is a reference example of the blank ledger data 400 in the photo list mode. FIG. 9 is a reference example of a table of contents of a form image of the blank ledger data 400. FIG. 10 is a reference example of a photo ledger page of a form image of the blank ledger data 400. Figures 8 to 10 show only a small portion of the data, and it is assumed that the actual construction work will have many shooting points, many total days of photography, and many photographs. Figures 8 to 10 show the work before construction has even begun, so the photographs have not yet been pasted or organized, and are all blank.

[0061] The photography support unit 120 supports the taking of photographs during construction by displaying the specified photography date and time, the specified photography point, and instructions for photographing the object to be photographed on the display unit of a photography device or a communication device with photography function carried by the site supervisor or person in charge of photography. In other words, it is a part that assists in taking photographs in accordance with the photographing contents (predetermined photographing points at the construction site at a specified date and time), and in this example, the client 200 is a device such as a smartphone equipped with a communication function (communication I / F 230), a display unit (photographing contents instruction display unit 220), and a camera unit (photographing unit 210, camera unit 211) described later, and the photographing assistance unit 120 assists in photographing by displaying the photographing contents on the photographing contents instruction display unit 220 of the client 200. Also, as described later, it is preferable that the photographing unit 210 of the client 200 is equipped with a photograph ID data assignment unit 213, and also has a function of notifying the photograph ID to be assigned to the photograph taken.

[0062] FIG. 11 is a diagram showing an example of a support display for the photographing contents displayed on the photographing contents instruction display section 220 of the client 200. As shown in FIG. The example in FIG. 11 is merely an example, and various examples of support display for various shooting contents are possible, and it goes without saying that the display is not limited to the example shown in FIG. 11, the display is on a display unit of a communication terminal that is assumed to be a smartphone. In other words, the server 100 is on the cloud, and data is exchanged between the server 100 and the client 200, which is a smartphone.

[0063] As shown on the left side of Figure 11, when the site supervisor or photographer enters a date in the date column, or the date is automatically entered from the smartphone's clock function, each process scheduled for that date is listed on the smartphone screen (in this example, December 15, 2022). It is displayed like a to-do list, and on this display screen, each scheduled process is displayed in the form of a button that can be selected by tapping. In this example, the site supervisor or photographer taps on the process for which they are responsible.

[0064] Next, as shown in the center diagram of FIG. 11, the planned shooting contents for the tapped process are displayed. Here, it is displayed that two shooting points (shooting point 4 and shooting point 5) are scheduled to be shot in the selected process. These shooting plans are also displayed in the form of buttons that can be specified by tapping. In this example, the site supervisor or the person in charge of photography selected and tapped shooting point 5 out of the two shooting points.

[0065] Next, as shown in the right diagram of Fig. 11, the planned shooting content at the tapped shooting point 5 is displayed. Here, the construction drawing and the location of the shooting point 5 on the construction drawing are displayed, and any specified comments are also displayed. There are various other ways to support the shooting content. For example, although not shown here, there is a button to display the most recently shot image, and when the button is tapped, the most recently shot image is displayed (here, it is possible to display a photo image taken on the previous day, December 14, 2022).

[0066] The site supervisor and the person in charge of photography take the prescribed photographs at each photography point according to the support display of the photography contents. In other words, if photography is taken according to the support of the photography support unit 120, the desired photographic data as scheduled in the planning stage can be obtained reliably, and situations such as missing a photograph can be prevented. The photographic image data taken as scheduled can be sent to the server 100 on the cloud online at the construction site, or of course it can be sent all at once later in a batch process. In addition, a blackboard on which the name of the work, the type of work, a schematic diagram of the measuring points, the progress of the work, and the like, which have been conventionally used, may be photographed together with the photograph and included in the photographic image. It is expected that such analog data will also be useful in checking the photographic image. As described below, the photography data obtained by the client 200 is linked to the photo ID information notified by the photography support unit 120 at the time of shooting, and is transmitted to the construction photo ledger creation unit 140 of the server 100 on the cloud. Furthermore, if there was a function on the worker's smartphone that displayed a reminder (memo, warning) if a photo was scheduled to be taken on a date listed on the smartphone screen but has not been taken, this would prevent forgetting to take a photo or missing out on taking a photo.

[0067] The construction photo ledger creation unit 140 receives photo image data taken by the camera of the client 200, and embeds the data in the corresponding embedded frames in the blank ledger to create the construction photo ledger data 500. Here, the construction photo ledger creation unit 140 holds correspondence data between the frame ID and the corresponding photo ID. That is, each embedded frame of the blank ledger 400 created by the construction photo ledger plan creation unit 110 is provided with a frame ID, and each piece of photo image data taken with the support of the photography support unit 120 is provided with a photo ID and uploaded. The construction photo ledger creation unit 140 receives the uploaded photo image data and embeds it into an embedded frame with a frame ID that matches the photo ID based on the frame ID-photo ID correspondence data, thereby creating the construction photo ledger data 500.

[0068] In this configuration example, the construction photo ledger creation unit 140 includes three recognition processing modules: a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143. The blackboard character recognition unit 141 receives input of photographic image data that is taken of a blackboard placed at a construction site and that contains information about the construction, and performs character recognition on the blackboard captured in the photographic image data to automatically obtain the information written on the blackboard. The construction photo ledger creation unit 140 matches the frame ID with the photo ID and pastes the photo image data input from the client 200 into a designated location in the blank ledger 400, and also records the information written on the blackboard obtained as a result of character recognition by the blackboard character recognition unit 141.

[0069] The blackboard character recognition unit 141 can be a construction terminology-trained character recognition AI system that has been made to learn terms related to construction work and the contents of past blackboard records. FIG. 12 is a simplified diagram showing how the construction photo ledger creation unit 140 is equipped with three recognition processing modules: a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143. FIG. 12(a) is a diagram showing an outline of the program module of the blackboard character recognition unit 141 that employs a construction terminology-trained character recognition AI system. As shown in FIG. 12(a), the construction terminology learned character recognition AI system of the blackboard character recognition unit 141 includes a construction terminology learning database 1412 that has learned characters that are likely to be written on a blackboard at a construction site from words and vocabulary such as construction-related terms, physical units, industry jargon used among contractors, abbreviations, and slang terms, a character recognition engine 1411 that converts character patterns into text, and a character recognition processing unit 1413.

[0070] The words and vocabulary related to construction work are limited, and rather than using general character recognition software as the blackboard character recognition unit 141, it is preferable to strengthen the words, technical terms, and abbreviations used at construction sites in the construction terminology learning database 1412, and in the recognition process of the character recognition processing unit 1413, not include other words that are unlikely to be used in construction work, or to exclude them from the correct answer candidates.

[0071] Next, the image recognition unit 142 performs image recognition on the construction materials that are brought to a predetermined place at a predetermined date and time and are used at the construction site and are captured in the photographic image data, and automatically acquires the material ID. It is also preferable that the image recognition unit 142 performs image recognition on construction equipment that is delivered to a specified location at a specified date and time and is used at a construction site and is captured in the photographic image data, and acquires a construction equipment ID. The construction photo ledger creation unit 140 matches the frame ID with the photo ID, and pastes the photo image data input from the client 200 into a designated location in the blank ledger 400, and also records the results of image recognition by the image recognition unit 142 and the obtained construction material ID and construction equipment ID.

[0072] The image recognition unit 142 can be an image recognition AI system that has been trained on construction work images and has been made to learn images of construction materials and construction equipment related to construction work. FIG. 12(b) is a diagram showing an outline of the program module of the image recognition unit 142 that employs an image recognition AI system that has been trained on construction work images. As shown in FIG. 12(b), the construction work image trained image recognition AI system of the image recognition unit 142 includes a construction material / construction equipment image database 1422 that has learned image patterns of various construction materials and construction equipment related to construction work, an image recognition engine 1421 that identifies construction material IDs and construction equipment IDs by pattern matching the image patterns of construction materials and construction equipment captured in photographic image data, and an image recognition processing unit 1423.

[0073] The construction materials and equipment related to construction work are limited, and it is preferable to not use general image recognition software as the image recognition unit 142, but to strengthen the external patterns, packaging, product names, machine types and names, supplier names, and abbreviations of various construction materials and equipment used at construction sites in the construction material / equipment image database 1422, and not include image patterns of other objects that are hardly used in construction work in the recognition processing of the image recognition processing unit 1423, or to exclude them from the correct answer candidates.

[0074] Next, the voice recognition unit 143 receives voice input data inputted at the construction site by a photographing device or a communication device with a voice input function, and performs voice recognition on the voice input data to automatically acquire voice input information. The construction photo ledger creation unit 140 matches the frame ID with the photo ID, pastes the photo image data input from the client 200 into a designated location in the blank ledger 400, and creates a construction photo ledger that also records the voice input information acquired by the voice recognition unit 143 when creating the construction photo ledger. The voice recognition unit 143 can perform voice recognition processing using a construction work terminology-trained voice recognition AI system that has been trained with terms related to construction work. FIG. 12(c) is a diagram showing an outline of the program module of the voice recognition unit 143 that employs a voice recognition AI system that has been trained with construction terminology. As shown in Figure 12 (c), the construction work terminology-trained voice recognition AI system of the voice recognition unit 143 includes a construction work terminology database 1432 that has been enhanced with various words, technical terms, abbreviations, and grammar related to construction work and has learned the voice patterns of construction work terms, a voice recognition engine 1431 that identifies construction-related voice input content by pattern matching the voice patterns related to construction work recorded in the voice data, and a voice recognition processing unit 1433.

[0075] Next, the display processing unit 160 will be described. The display processing unit 160 assigns icon or link information to construction equipment in the recording process by the construction photo ledger creation unit 140, and displays it at a predetermined position in each frame of the construction photo ledger, or displays it in the image area portion of the construction equipment in the photographed image data. When the construction photo ledger created via the display processing unit 160 is viewed, the icon or link information is displayed at a predetermined position in each frame of the construction photo ledger or in the image area portion of the construction equipment. Furthermore, when the construction photo ledger is viewed, information related to the construction equipment is displayed by the display processing unit 160 in response to a display operation on the icon or link information displayed in the frame. In this way, when viewing the created construction photo ledger, the display processing unit 160 displays an icon or link information displayed in a specified position of the frame or in the image area portion of the construction equipment in the photographed image data, and if the viewer wants to check what type of construction equipment appears in the photograph, the viewer can perform a display operation on the icon or link information to display information about the construction equipment, allowing the viewer to check the contents of the construction equipment. Information about construction equipment that may be displayed may include, but is not limited to, the name of the construction equipment, the model number of the construction equipment, specifications and manuals for the construction equipment, the weight and size of the construction equipment, the person in charge of the construction equipment, contact information such as a telephone number, the manufacturer or supplier of the construction equipment, leasing information for the construction equipment, and / or qualifications for operating the construction equipment. The display processing unit 160 can also display the information in a pull-down menu, organized by item.

[0076] Next, the information collection function extension unit 130 will be described. The information collection function expansion unit 130 collects various information that may be required, including external information such as weather information around the construction site, earthquake information, event information, logistics information, and payment information, in addition to the photo image data that is directly required for creating the construction photo ledger and is collected at the construction site. When creating a construction photo ledger, the construction photo ledger creation unit 140 can inquire of the information collection function extension unit 130 about external information that is required later, and can create the construction photo ledger by adding various information that the information collection function extension unit 130 has collected. For example, weather information such as rain, snow, humidity, and temperature is not essential information for the current construction ledger, but it may be required at a later date to analyze the drying of concrete, etc. We considered expanding the function to collect such information in advance.

[0077] Fig. 13 shows only a small part of an example of the construction photo ledger data 500 created by the construction photo ledger creation unit 140. The example in Fig. 13 is only a reference example and is not limited to this example. Various formats of the construction photo ledger data 500 are possible. In this way, by matching the frame ID of the buried frame and the photo image data according to the photo ID based on the correspondence data held by the construction photo ledger creation unit 140, the captured photo image data can be efficiently and accurately embedded in the corresponding buried frame in the blank ledger, and construction photo ledger data 500 can be created in which the details of the construction work that progresses according to schedule, day by day, are planned in advance. The construction photo ledger creation unit 140 utilizes the blackboard character recognition unit 141, the image recognition unit 142, and the voice recognition unit 143 to create a detailed, high-quality construction photo ledger by incorporating information obtained as a result of blackboard character recognition contained in the photo image data, information on construction materials and construction equipment obtained by image recognition from the images contained in the images, and information obtained as a result of voice recognition of voice data input by workers on-site. In FIG. 13, the display unit 160 displays an icon and link information for construction facility information. As shown in Figure 14, when you click on the construction equipment information icon or link information with a pointing device or tap with your finger, information related to the construction equipment recognized by the image recognition unit 142 is linked and information related to the construction equipment is displayed in a pop-up or pull-down menu. Although only one icon or link information for construction equipment information is shown in Figures 13 and 14, if multiple types of construction equipment are included in the construction photo ledger frame, multiple icons or link information may be displayed corresponding to them.

[0078] The construction photo ledger database 150 is a recording device that stores the construction photo ledger data 500 that is created day by day by the construction photo ledger creation unit 140. The intermediate data that is created day by day over time may be accumulated and stored, or may be stored in an overwritten format. The construction photo ledger database 150 stores various information related to construction work, and it is preferable that not only the details of the construction work that progresses according to schedule every day, but also a wide variety of information on construction, such as information on construction equipment, information on a wide variety of construction materials, information on construction workers, and various types of external information around the construction site (including weather information, earthquake information, event information, logistics information, payment information, etc.). It is also preferable that the database is updated daily and that the results of AI learning are reflected.

[0079] The communication I / F 170 is generally equipped in many server systems, and therefore the description thereof will be omitted here. Also, a control unit, an input / output unit, and a monitor may be equipped, and the description thereof will be omitted here. In addition, in the diagram showing the data flow described later, even if the control unit, the input / output unit, the monitor, and the communication I / F 170 are illustrated as not operating, they are assumed to be operating within the scope of common technical knowledge and executing data processing.

[0080] Next, the client 200 operated by the site supervisor or the person in charge of photography will be described. As described above, the client 200 is configured to include the photographing unit 210, the photographing content instruction display unit 220, and the communication I / F 230. In this example, a smartphone is used as a premise, and the example is configured by downloading an application to the smartphone.

[0081] In this configuration example, the photographing unit 210 includes a camera unit 211, a voice input unit 212, and a photograph ID data adding unit 213. The camera unit 211 is a photographing device for taking photographic images. In this embodiment, a camera device mounted on a smartphone is used.

[0082] The voice input unit 212 is a section where the photographer can input additional information by text or voice. If there is any notice of the progress of the construction at the construction site, it would be convenient if the details could be left as additional information or input as a matter to be referred to when taking the next photograph. Additional information is input to the photographed image data via this voice input unit 212. Here, the input itself can also be made using a text input means or voice input means installed in a smartphone. The photographing unit 210 adds the input data to the photographed image data.

[0083] The photo ID data assigning unit 213 is a unit that assigns photo ID information to the photo image data when a photo is taken at a specified shooting point. The photo ID information is uniquely assigned to the shooting date and time information, the shooting point, and the object to be photographed that were planned in advance in the construction photo ledger plan creating unit 110. The photo ID data assigning unit 213 is notified of this photo ID information via the photography support unit 120 of the server 100, and when a photo is taken, the photo ID information is linked to the photo image data and transmitted to the server 100.

[0084] The photography content instruction display unit 220 is a part that displays photography content information (information on the photography location, photography direction, photography angle, photography posture of the object to be photographed, deployment state of the lid or parts of the object to be photographed, etc.) together with the display of the construction drawing from the photography support unit 120. In other words, it obtains and displays information on the photography content to be photographed at the construction site from the photography support unit 120, and displays it to the site supervisor or person in charge of photography to support photography. In this example, a smartphone is assumed, and it is sufficient to display it on the smartphone screen.

[0085] The communication I / F 230 is generally provided in the client 200, and therefore a description thereof will be omitted here. In this embodiment, the client 200 is assumed to be a smartphone, which is a device having the communication I / F 230.

[0086] An example of the process flow of the construction photo ledger creation support system 1 of the present invention will be summarized below with reference to Figures 15 to 17. The following process flow is an example, and the order of the processes may be changed. In the following flow, it is assumed that the operator of the server 100 on the cloud, the construction photo ledger plan creation unit 110, is mainly operated by a person who plans and manages the construction work, such as a construction ordering company or a design office. The photography support unit 120 and the construction photo ledger creation unit 140 receive operation input through communication with the site supervisor or photographer at the construction site. In addition, the client 200 is assumed to be a mobile terminal such as a smartphone carried by the site supervisor or photographer at the construction site, or a digital camera device equipped with the functions of the client 200, and the operator is assumed to be the site supervisor or photographer at the construction site themselves.

[0087] [Processing flow of the Construction Photo Register Creation Support System 1: Flow before construction begins] Construction data including working drawing data and schedule data for a specific construction project is input to the construction data input unit 111 of the construction photo ledger plan creation unit 110 from a terminal (not shown) of the construction ordering company or design office (FIG. 15, step S1). Here, for example, construction data including the working drawing data and the schedule data shown in FIG. 3 is input.

[0088] Next, the construction data including the input construction drawing data and schedule data is passed to the photography content designation unit 113 (step S2 in Figure 15), and the photography content, such as the setting input of the photography point (setting input of the photography location, photography direction, and photography angle) and the setting input of the subject of photography (setting input of the subject of photography, its photography posture, and the deployed state of the cover or parts of the subject of photography), is set by staff of the construction ordering company or design office for the construction data including the construction drawing data and schedule data displayed on a terminal (not shown) of the construction ordering company or design office (step S3 in Figure 15). Here, for example, as shown in FIG. 4, the setting input of the shooting point (setting input of the shooting location, shooting direction, shooting angle), setting input of the object to be photographed (setting input of the object to be photographed, its shooting posture, and a specified comment on the deployed state of the lid or parts of the object to be photographed), etc. are performed for the construction drawing data.

[0089] Next, the shooting contents are specified via the shooting contents specification unit 113, and the construction data including the working drawing data and schedule data for which the shooting contents have been specified is passed to the blank ledger creation unit 114 (step S4 in Fig. 15), and the blank ledger creation unit 114 selects the appropriate standard blank ledger data 300 for the category of this specific construction work from the standard blank ledger database 115 (step S5 in Fig. 15). This selection may be made by a selection operation by the staff of the construction ordering company or design office operating the blank ledger creation unit 114, or may be made automatically by the blank ledger creation unit 114. Here, for example, it is assumed that the standard blank ledger data 300 is selected as shown in FIG. 5 to FIG.

[0090] Next, the standard blank ledger data 300 is tuned to suit the specific construction project by the staff of the construction ordering company or design office who operates the blank ledger creation unit 114, and any necessary information that is missing from the standard blank ledger data 300 is written in, missing pages are added for pasting photographic images to be taken, or unnecessary pages for pasting photographic images to be taken are deleted (Figure 15, step S6).

[0091] Next, the blank ledger creation unit 114 determines the standard blank ledger data 300 tuned by staff of the construction ordering company or design office as the blank ledger data 400, also determines the frame ID at the embedded location of the photo image to be pasted, and passes the determined blank ledger data 400 to the photography support unit 120 (Figure 15 step S7). Here, for example, it is assumed that the blank ledger data 400 shown in FIG. 8 to FIG. 10 has been determined. Through the process up to this point, a construction photo ledger plan is constructed mainly by the construction photo ledger plan construction unit 110, and as a result, blank ledger data 400 is obtained. It is possible that as a specific construction project progresses, parts of the plan may be revised or changed. If such partial revisions or changes occur, steps S1 to S7 of Figure 15 above can be repeated as needed to obtain blank ledger data 400 that reflects the partial revisions or changes.

[0092] [Processing flow of construction photo ledger creation support system 1 2: Flow during construction] Next, we will explain the process at the construction site after construction has begun. The photography support unit 120 of the cloud server 100 and the photography content display unit 220 of the client 200 cooperate by exchanging data via a network to support photography. For example, when a site supervisor or a person in charge of photography inquires from a smartphone what photography content is set for each process and each construction scheduled for the construction day, the photography support unit 120 transmits instruction data regarding the set photography content and displays it on the photography content display unit 220 of the client 200 (step S8 in FIG. 16). Here, the photo ID data to be assigned to the photographed photo image is passed to the photo ID data assignment unit 213 (step S9 in FIG. 16). In this example, for example, a photo shoot scheduled for December 15, 2022 is inquired about, and instructions on the content of the shoot are displayed as shown in FIG. 11. It is preferable to display the content of the photo shoot in an easy-to-understand manner so that the content of the photo shoot can be correctly conveyed. Here, the shooting point is indicated on the construction drawing, and the angle and what to shoot are displayed. Furthermore, as in the past, instructions may be given to shoot with an analog construction blackboard. It is also preferable to be able to view the photographic images that have been affixed to the most recent construction photo ledger, because this allows the user to visually check whether the photograph he or she is about to take is correct.

[0093] The site supervisor or the person in charge of taking photographs operates the smartphone which is the client 200 to operate the photography unit 210, take photographs via the camera unit 211 (step S10 in FIG. 16), and input comments and matters to be handed over via the voice input unit 212; in other words, the information that should be input at the construction site can be input by voice using the microphone function (step S11 in FIG. 16). The photo ID data assigning unit 213 links the photographic image data with the photo ID data (step S12 in FIG. 16). The photographed photograph data is transmitted together with the respective photograph ID data from the photographing unit 210 of the client 200 to the construction photograph ledger creation unit 140 of the cloud server 100 (step S13 in FIG. 16).

[0094] [Processing flow of construction photo ledger creation support system 1 3: Flow during construction] The construction photo ledger creation unit 140 embeds and pastes each received photo image data in the frame ID corresponding to each photo ID data, and creates the construction photo ledger data 500 (FIG. 17, step S14). Here, the construction photo ledger data 500 is created each time photo data is sent from the client 200. It is also possible to perform some amount of work at once by batch processing.

[0095] The construction photo ledger creation unit 140 performs character recognition processing of the blackboard that appears in each photo image data using the blackboard character recognition unit 141, performs image recognition processing of the image patterns of construction materials and construction equipment that appear in the photo image data using the image recognition unit 142, and performs voice recognition processing on the voice data received from the voice input unit 212 using the voice recognition unit 143 (step S15 in Figure 17), and the construction photo ledger creation unit 140 creates a construction photo ledger that incorporates these results (step S16 in Figure 17). The construction photo ledger creation unit 140 displays the results of embedding and pasting the photo image data on the shooting content instruction display unit 220 of the client 200, and has the site supervisor or the person in charge of photography confirm the results (FIG. 17, step S17). Note that the confirmation process may be performed by staff of the construction ordering company or the design office who have the authority to operate the cloud server 100.

[0096] The construction photo ledger creation unit 140 stores and records the construction photo ledger data 500 after the confirmation process in the construction photo ledger database 150 (FIG. 17, step S18). This storage may be performed by overwriting, or may be added to the construction photo ledger database 150 together with date data without overwriting in order to leave a chronological history. When a user or manager wishes to view the construction photo ledger data 500, a display request is issued to the display processing unit 160, which then extracts the relevant construction photo ledger data 500 from the construction photo ledger database 150 and performs display processing on the contents of the construction photo ledger data 500 on the display unit of the user's or manager's smartphone or the like, as shown in Figures 13 and 14 (Figure 17, step S19).

[0097] As described above, by using the construction photo ledger creation support system 1 of the present invention, a blank ledger containing a collection of embedded frames of photo image data as a construction photo ledger that should already be created before construction begins can be obtained, and at the construction site, simply taking the photos specified for daily construction work will embed the photo image data in the corresponding embedded frames in the blank ledger, and the construction photo ledger will be automatically created. This greatly reduces the burden on the site supervisor and photographer, and furthermore, the shooting points, shooting dates and times, and subjects are planned in advance, and the site supervisor and photographer take the photos while accurately checking the planned contents, so there is no risk of missing or missing photos.

[0098] The above illustrates and explains a preferred embodiment of the configuration example of the construction photo ledger creation support system of the present invention, but it will be understood that various modifications are possible without departing from the technical scope of the present invention. [Industrial Applicability]

[0099] The construction photo ledger creation support system of the present invention supports the creation of construction photo ledger files containing the content required by clients, construction ordering companies, construction designers, and process managers, and can be widely applied as a construction photo ledger creation support system and construction photo ledger creation support program that automatically generates a construction photo ledger by simply taking specified photos at the construction site. In addition, the construction work to which the construction photo ledger creation support system of the present invention can be applied is not limited to construction work, but can be widely applied to any work in which the process can be planned in advance, such as civil engineering work, road construction, and on-site assembly and installation of large-scale machinery and equipment. [Explanation of symbols]

[0100] 1. Construction photo ledger creation support system 100 Cloud Servers 110 Construction Photo Register Planning and Construction Department 111 Construction data entry section 112 Construction Materials Management Department 113 Shooting content specification section 114 Blank Ledger Creation Department 115 Standard Blank Ledger Database 120 Photography Support Department 130 Information Gathering Function Extension 140 Construction Photo Register Creation Department 141 Blackboard character recognition unit 142 Image Recognition Unit 143 Voice Recognition Unit 150 Construction Photo Database 160 Display processing unit 170 Communication I / F 200 clients 210 Photography Club 220 Shooting content instruction display section 230 Communication I / F

Claims

1. A construction photo ledger creation support system that supports the creation of a construction photo ledger, comprising a blank ledger creation unit that creates a blank ledger including a collection of embedded frames in which predetermined photo image data is embedded in a construction photo ledger by associating frame ID data with photo ID data that is to be assigned to photo image data to be taken at a construction site, and A construction equipment management unit that manages construction equipment ID data and information related to construction equipment that is to be delivered to a predetermined location at a predetermined date and time and used at the construction site in association with the construction equipment ID data and information related to the construction equipment; An image recognition unit that recognizes an actual construction equipment that is brought into a predetermined place at a predetermined date and time and is being used at the construction site and is captured in the photographic image data of the construction site, and acquires the construction equipment ID, The image recognition unit acquires the construction equipment ID data by image recognition of the construction equipment actually being used that appears in the photographic image data, A construction photo ledger creation support system that is equipped with a construction photo ledger creation unit that creates the construction photo ledger by recording the construction equipment ID data acquired by the image recognition unit and information regarding the construction equipment in addition to pasting the photo image data to a designated location on the frame based on the photo ID data associated with the frame ID data.

2. The construction photo ledger creation support system according to claim 1, characterized in that the image recognition unit is performed using a construction equipment image-trained image recognition AI system that has learned images of a wide variety of construction equipment related to construction work.

3. The construction photo ledger creation support system as described in claim 1, characterized in that, during the recording process by the construction photo ledger creation unit, the icon or link information assigned to the construction equipment is displayed at a predetermined position of each frame of the construction photo ledger, or in the image area portion of the construction equipment in the photographed image data, and information regarding the construction equipment is displayed by a display operation on the icon or link information.

4. An information collection function expansion unit that collects various information including weather information, earthquake information, event information, logistics information, and payment information in the vicinity of the construction site that may be required, in addition to the photo image data directly required for creating the construction photo ledger and collected at the construction site, A construction photo ledger creation support system as described in any one of claims 1 to 3, wherein the construction photo ledger creation unit creates the construction photo ledger using the various information obtained from the information collection function expansion unit when creating the construction photo ledger.

5. The construction photo ledger creation unit is provided in a cloud system on a computer network, A construction photo ledger creation support system as described in any one of claims 1 to 3, characterized in that the construction photo ledger creation unit is equipped with a communication function for receiving the photo image data by uploading it to the cloud system via the computer network.

6. a construction photo ledger plan creation unit including a construction data input unit which receives input of construction drawing data and schedule data relating to the construction work before the start of the construction work, a photography content designation unit which receives input of settings of the photography points and objects to be photographed at the construction site based on the construction drawing data by a person in charge of setting the contents of the construction photo ledger and input of settings of the photography date and time based on the schedule data, and a blank ledger creation unit which creates a blank ledger containing a collection of embedded frames in which predetermined photo image data is embedded in the construction photo ledger according to the input from the photography content designation unit; a photography support unit that displays the specified photography date and time, the specified photography point, and instructions for photographing the object to be photographed on a display unit of a photography device or a communication device with a photography function carried by a person in charge of photography during the construction work, thereby supporting the person in charge of photography; The construction photo ledger creation support system described in claim 5, characterized in that the construction photo ledger creation unit embeds the photo image data in the corresponding embedded frame in the blank ledger and creates the construction photo ledger in which information obtained from the photo image data is also recorded.

7. The blank ledger creation unit of the construction photo ledger plan construction unit creates a blank ledger in each of the embedded frames, each of which is provided with unique frame ID data; the photography support unit assigns unique photo ID data to the photography date and time information, the photography point, and the photography subject; The photo ID data is associated with each of the photo image data photographed with the assistance of the photo photography assistance unit, The construction photo ledger creation unit holds correspondence data between the frame ID data and the photo ID data corresponding to the frame ID data, The construction photo ledger creation support system described in claim 6, characterized in that the construction photo ledger creation unit receives the uploaded photo image data and embeds it in the embedded frame in the blank ledger having the corresponding frame ID data based on the photo ID data.

8. The blank ledger creation unit includes a standard blank ledger database that stores blank ledgers of the construction photo ledger related to a plurality of standardized construction works, and a standard blank ledger selection unit that allows an authorized person or the setting person to select an appropriate standard blank ledger from the standard blank ledger database; The construction photo ledger creation support system described in claim 7, characterized in that the setting officer performs the necessary tuning on the standard blank ledger selected through the blank ledger creation unit based on the construction drawing data and the schedule data for the specific construction work, and creates the blank ledger for the specific construction work.

9. On the computer, a blank ledger creation process step for creating a blank ledger in which embedded frames in which predetermined photographic image data are embedded are collected in a construction photo ledger by associating frame ID data assigned to each embedded frame with photo ID data assigned to photographic data to be taken at a construction site; A construction equipment management processing step of managing construction equipment ID data and information related to the construction equipment that is to be delivered to a predetermined location at a predetermined date and time and used at the construction site in association with the construction equipment ID data and information related to the construction equipment; An image recognition processing step of performing image recognition of actual construction equipment that is brought into a predetermined place at a predetermined date and time and is being used at the construction site and is captured in the photographic image data of the construction site, and acquiring the construction equipment ID data; A construction photo ledger creation support program that executes a construction photo ledger creation processing step in which the photo image data is attached to a predetermined location on the frame based on the photo ID data associated with the frame ID data, and the construction equipment ID data of the construction equipment obtained in the image recognition processing step is also recorded in the frame to support the creation of the construction photo ledger.

10. The construction photo ledger creation support program as described in claim 9, wherein the blank ledger creation processing step executes the creation and processing of the blank ledger by a construction photo ledger plan construction processing step including a construction data input step for receiving input of construction drawing data and schedule data relating to the construction work before the start of the construction work, a setting input step for setting the shooting points and objects to be photographed at the construction site based on the construction drawing data by a person in charge of setting the contents of the construction photo ledger, a shooting content designation step for receiving setting input of the shooting date and time based on the schedule data, and a blank ledger creation step for creating a blank ledger consisting of a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger in accordance with the input in the shooting content designation step.

11. a photographing support processing step of displaying the predetermined photographing date and time, the predetermined photographing point, and instructions for photographing the object to be photographed on a display unit of a photographing device or a communication device with a photographing function carried by a person in charge of photographing during the construction to support the photographing; In the blank ledger creation process step, unique photo ID data is assigned to the photographing date and time information, the photographing point, and the photographed object as the photo ID data, The photo ID data is associated with each of the photo image data taken with the assistance in the photo photography assistance processing step, In the construction photo ledger creation processing step, correspondence data between the frame ID data and the photo ID data corresponding to the frame ID data is stored, The construction photo ledger creation support program described in claim 10, characterized in that in the construction photo ledger creation processing step, the uploaded photo image data is received and embedded in the embedded frame having the corresponding frame ID correspondence data in the blank ledger based on the correspondence data.

12. The construction photo ledger creation support system as described in claim 9, characterized in that in the recording process by the construction photo ledger creation processing step, an icon or link information assigned to the construction equipment is displayed at a predetermined position of each of the frames of the construction photo ledger, or is displayed in the image area portion of the construction equipment in the photographed image data, and an information display process is executed in which information regarding the construction equipment is displayed by a display operation on the icon.

Images