Construction photo ledger creation support system and construction photo ledger creation support program

Abstract

To clarify content required for a construction photograph ledger when creating construction blueprints, construction drawings, and process charts and to automatically generate a construction photograph ledger only by taking photographs at a construction site.SOLUTION: A construction photograph ledger creation support system 1 comprises: a construction photograph ledger plan building part 110 for building a blank ledger 400 containing embedded frames of photograph image data for a construction photograph ledger that should be created from construction drawing data and process sheet data before construction begins; a photography support part 120 for supporting photography during construction; and a construction photograph ledger creation part 140 for creating a construction photograph ledger 500 by embedding photograph image data taken at the site in the corresponding embedding frames in a blank ledger. Each embedded frame of the blank ledger 400 includes a unique frame ID, the photography support part 120 notifies of photograph ID information to be associated therewith when photographing, and the construction photograph ledger creation part 140 creates the construction photograph ledger 500 by associating them each other.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a construction photo ledger creation support system and a construction photo ledger creation support program for supporting the creation of construction photo ledgers to be included in reports in construction and civil engineering works related to structures such as condominiums, office buildings, tunnels, bridges, roads, ports, and stations, and in the manufacture of large-scale mechanical equipment such as ships and turbines. The construction work to which the construction photo ledger creation support system of the present invention can be applied is not limited to construction work, but can be widely applied to any work for which the process can be planned in advance, such as the assembly and installation of large-scale machinery and equipment. [Background technology]

[0002] In construction work, civil engineering work, road construction, assembly and installation of large-scale machinery and equipment, and the like, photographs are taken of the on-site construction situation at each stage of the work, and the image data of each photograph is recorded in association with data such as date and time.When creating a report, data such as the progress date and time, the location on site where the photograph was taken, and an explanation of each photograph are entered to create a construction management ledger with photographs, and these are then compiled and submitted as a report.

[0003] At conventional construction sites, the name of the project, type of work, outline map of measurement points, progress of the project, etc., are written on a blackboard, and photographs are taken so that the blackboard is included in the scene of the site, and the images obtained by taking the photographs are used to confirm which construction site and which photograph it is. In other words, since there are many similar scenes at construction sites and it is not possible to sort them at construction sites, if photographs are taken at the site without any clues, it may be difficult to tell at a later date what scene appears in the photograph and when, so the date, time, and content of the photograph are identified by checking the contents written on the blackboard that is included in the photograph as a clue. In this way, the date, time and content of the photographs were identified using the information written on the blackboard that was also captured in the photographs, and the photographs were then developed and pasted together manually to create a construction photo ledger and compile it into a report.

[0004] In this way, the creation of the construction photo ledger was a so-called post-processing task, whereby the site supervisor or person in charge, upon returning to the office from the construction site, would search for the relevant photographs from among the photographs taken on site and stored in the camera, edit the photographs by adding various information to them, and create a construction photo ledger (construction photo album), and then report on the construction details based on the created construction photo ledger. In the prior art, there are systems that support the taking of photographs of the construction status at a construction site and notify users to prevent forgetting to take photographs, but there is nothing that clearly shows how to systematically schedule the construction status to be photographed at a construction site with the intention of creating the construction photo ledger that will ultimately be created from the beginning.In particular, there is nothing that systematically schedules the construction status to be photographed from the beginning, anticipating the creation of the construction photo ledger that will ultimately be created from the design stage, based on the wishes of the client, the design ideas of those involved in the design, and the design drawings.

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2000-165786 [Patent Document 2] Japanese Patent Application Laid-Open No. 2013-125535 DISCLOSURE OF THE INVENTION [Problem to be solved by the invention]

[0006] However, because construction sites generally involve hundreds of steps and numerous construction drawings, it is difficult for on-site workers to take all the necessary photographs at each step. Multiple processes often proceed simultaneously on the same day at construction sites, including laying new rebar, bringing in new formwork, pouring new concrete or cement materials, and installing new equipment. Simply taking photos during and after work can lead to cluttered image data, making it easy for mistakes such as forgetting to take a photo or taking multiple photos. Furthermore, considering that the process or type of work may vary from one construction site to another, it is extremely difficult for on-site workers to take images of the construction site at every process at every construction site without missing any.

[0007] In addition, the creation of the construction photo ledger is a so-called post-processing task performed by the site supervisor or person in charge after returning from the construction site to the office, and it takes time and a heavy workload to search for the corresponding photo image from the photos taken at the site stored in the camera using the contents of the blackboard reflected in the image as a clue, and then edit the photo image by adding various information to create the construction photo ledger. In other words, the task of appropriately sorting the photo image data according to the construction stage requires a huge amount of manual labor. Furthermore, even if these tasks are left to the site supervisor or person in charge, it is difficult to secure personnel who are capable of understanding each process and construction drawings at the construction site, as well as familiar with the processing of computer and digital camera photo image data. If the situation is left dependent on the abilities of the site supervisor or person in charge, it is not possible to guarantee the creation of construction photo ledgers and reports that maintain a certain level of quality.

[0008] Currently, it is difficult to secure workers for work at construction sites, and there are concerns that the labor shortage will worsen in the future. In reality, site supervisors, construction workers, and camera operators are overworked in order to complete the work with a small number of people. Therefore, there is a need to reduce the burden on site supervisors, construction workers, and other personnel, even if only slightly. It is also important to reduce the burden of the subsequent task of creating a construction photo ledger.

[0009] Next, the photo image data required based on the client's wishes, the design philosophy of those involved in the design, and the management philosophy of the process manager who created each construction drawing based on the design drawings and developed the process chart for each process did not match the photo image data taken by the site supervisor and photographer in charge of the construction work at the construction site, and the submitted construction photo ledger and report sometimes deviated from what the client, designer, or construction manager wanted.In other words, if the site supervisor and photographer of the construction contractor do not fully understand the purpose and intent of the photography, it may not be the construction photo ledger that the client, construction designer, or process manager wants.

[0010] Furthermore, if a photograph is forgotten at a certain location on a construction site, the construction work at the site progresses day by day, and the problem arises that the necessary photograph cannot be retaken. Furthermore, when editing the photographic images after they have been taken, the photographer may want to add any notes or instructions that he or she felt were necessary at the time.If these notes or instructions cannot be added on the spot, important information in the report may not be known during post-editing unless the photographer actually takes the photographs.This may make it difficult to outsource the editing of the construction photo ledger.

[0011] While developing technology to reduce the burden of creating construction photo ledgers, inventor Yoshiki Morikawa noticed the hassle of inputting text at the photo shoot site. Even when using devices such as smartphones, inputting text is a hassle, and many people find it burdensome to create the documents. It would be convenient if voice input was possible. Here, the inventor, Yoshiki Morikawa, realized that general speech recognition software is equipped with a large number of commonly required diverse word data and their speech patterns, and that when general speech recognition software is used, the diverse word data and their speech patterns are also used in the matching process, which can actually lead to incorrect recognition, and this is an issue that needs to be improved.

[0012] Furthermore, while developing technology to reduce the burden of creating a construction photo ledger, the inventor, Yoshiki Morikawa, noticed the blackboards that are photographed at the same time as the photography at the site. Because the contents written on the blackboard contain the minimum necessary information, it is beneficial to reflect the information on the blackboard in the creation of the construction photo ledger. However, there are areas that need improvement when using general character recognition software. While general character recognition software is equipped with a wide variety of commonly required word data and their character patterns, we realized that using general character recognition software can lead to misrecognition because the software also uses the wide variety of word data and their character patterns in the matching process. In other words, the characters written on the blackboard are all words used at construction sites. While there are many technical terms and abbreviations, the vocabulary is limited. Therefore, rather than using general character recognition software, we realized that misrecognition could be reduced by strengthening the words, technical terms, and abbreviations used at construction sites, and not incorporating other words that are not often used in construction work, or by excluding them from the correct answer candidates.

[0013] Furthermore, inventor Yoshiki Morikawa realized that there is a great benefit to using image recognition on construction materials and equipment that are delivered to a construction site at a designated date and time and appear in photographed images in a construction photo ledger. The value of a construction photo ledger would increase if it also included information about these construction materials and equipment, but this information is entered manually on-site or as a follow-up manual after work is completed, which is prone to input errors and places a heavy burden on workers. He realized that image recognition of photographed images could potentially reduce the labor required to enter information about construction materials and equipment.

[0014] Furthermore, inventor Yoshiki Morikawa realized that when creating a construction photo ledger, there may be information that is not collected on the day of daily construction work but that the construction client requests later. In other words, he realized that in addition to the information collected as essential for creating a construction photo ledger, there is value in also collecting information that may be useful later. While it is considered difficult to proactively collect all information, he found value in using a generative AI system to collect additional information. For example, while weather information such as rain, snow, humidity, and temperature is not essential information for the current construction ledger, it may be required later to analyze the drying of concrete. He also considered expanding the system's functionality to proactively collect this information.

[0015] In view of the above problems, the present invention aims to provide a construction photo ledger creation support system and a construction photo ledger creation support program that clarify the content required for a construction photo ledger when creating design drawings and construction drawings, in order to create a construction photo ledger that contains the content required by the client, designer, and process manager, and that automatically generates a construction photo ledger by simply inputting comments and handover information by voice at the construction site, without the need for correct and simple text input, thereby reducing the burden on site supervisors and construction workers. [Means for solving the problem]

[0016] In order to achieve the above-mentioned object, the construction photo ledger creation support system of the present invention, which supports the creation of a construction photo ledger, comprises a blank ledger creation unit that creates a blank ledger consisting of a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger by associating frame ID data with photo ID data taken at the construction site, and is a construction photo ledger creation support system that supports the creation of a construction photo ledger, and comprises a voice recognition unit that receives voice input data input at the construction site using a photographing device or communication device with a voice input function together with the photo ID data, and performs voice recognition on the voice input data to acquire the voice input information and the photo ID data together, wherein the voice recognition unit acquires the voice input data input at the construction site using the voice recognition, and the construction photo ledger creation unit, when creating the construction photo ledger, creates the construction photo ledger in which the voice input data acquired by the voice recognition unit is also recorded together with the photo ID data. With the above configuration, the name of the construction project, type of work, outline of the measurement points, progress of the construction project, etc. can be input orally using a voice input device when taking photographs on-site, and by having the voice recognized by the voice recognition unit, the information can be recorded in the construction photo ledger by voice, and a useful construction photo ledger can be obtained in which the contents are written in a concise manner along with the photographic image data. The "voice comments / handover items" that can be input using voice recognition are not limited, but could include, for example, any of the following: matters of concern to the person in charge, any discomfort, the condition of construction materials and equipment, the quality of the work, various information about the construction workers, and any improvements to construction materials and equipment, or a combination of these. This information can be input by voice using a smartphone microphone instead of by text input, and the recognition results can be input as "voice comments / handover items." Text input can be cumbersome at construction sites, so being able to input by voice is convenient.

[0017] In addition, as the voice recognition processing by the voice recognition unit, it is also possible to perform the voice recognition processing using a construction work terminology-trained voice recognition AI system that has been trained with terms related to construction work. While general speech recognition software is equipped with a wide variety of commonly required word data and a large number of its speech patterns, and using general speech recognition software can lead to misrecognition because the wide variety of word data and its speech patterns are also used in the matching process, the terminology used at construction sites is all the same, and there are many technical terms and abbreviations, so a speech recognition AI system pre-trained in construction terminology that has been strengthened to include the words, technical terms, and abbreviations used at construction sites is used. By not loading other words that are not used in construction work into the speech recognition AI system, or by excluding them from the correct answer candidates, it is possible to reduce misrecognition and improve the accuracy rate of speech recognition.

[0018] Next, the construction photo ledger creation support system of the above configuration further includes a construction material management unit that assigns material IDs to materials that are scheduled to be delivered to the construction site at a specified location on a specified date and time and used, and an image recognition unit that performs image recognition on materials that are captured in the photo image data and are scheduled to be delivered to the construction site at a specified location on a specified date and time and used, and acquires the material ID, and the construction photo ledger creation unit can create the construction photo ledger by pasting the photo image data in a specified location, recording the written information on the blackboard, and recording the material ID of the image recognition of the materials.

[0019] With the above configuration, information regarding materials that need to be recorded in the construction photo ledger, that is, construction materials and construction equipment that have been delivered to the construction site at a specified location on a specified date and time and that appear in the photographed images, can be recognized by image recognition, and by voice input of points that the person in charge at the site notices, making it possible to efficiently create a construction photo ledger.

[0020] In addition, the image recognition processing of the material ID for the material by the image recognition unit can be performed using an image recognition AI system that has learned images of the materials related to the construction work and is trained on construction material and construction equipment images. While general image recognition software is equipped with a large number of diverse image data and image patterns that are generally required, and using general image recognition software can result in misrecognition because it uses image data and image patterns of various objects unrelated to construction work in the matching process, the materials used in construction work are limited to specific objects used at construction sites, and an image recognition AI system trained on construction work images is used that has enhanced image data and image patterns of materials used at construction sites. Misrecognition can be reduced by not loading image data and image patterns of other objects that are unlikely to be used in construction work into this image recognition AI system trained on construction material and construction equipment images, or by excluding them from the correct answer candidates.

[0021] Furthermore, it is possible to improve not only the materials used in construction but also the construction equipment. In the above configuration, it is preferable that the construction material management unit assigns, in addition to the material ID, a construction equipment ID to the construction equipment that is delivered to the construction site at a specified date and time and used at a specified location, the image recognition unit acquires the material ID and the construction equipment ID by image recognition of the construction material and the construction equipment captured in the photographic image data, and the construction photo ledger creation unit creates the construction photo ledger that also records information about the construction equipment based on the construction equipment ID acquired by the image recognition unit when creating the construction photo ledger.

[0022] It is preferable that the image recognition processing of the construction equipment ID for the construction equipment by the image recognition unit is performed using a construction material / construction equipment image-trained image recognition AI system that has learned images of the construction equipment related to the construction work. The construction equipment used in construction work is limited to specific equipment used at construction sites, so it is sufficient to use an image recognition AI system that has been trained on construction work images and has enhanced image data and image patterns of equipment used at construction sites. Misrecognition can be reduced by not loading the image data and image patterns of other equipment and objects that are not likely to be used in construction work into the image recognition AI system, or by excluding them from the correct answer candidates.

[0023] Next, since the above-mentioned image recognition unit is equipped with a voice recognition unit, the construction photo ledger creation unit can create the construction photo ledger that records the voice input information acquired by the voice recognition unit along with the information acquired by the image recognition unit, and further, it is possible to view, together with the photo image data, the situation at which the voice input was made using the voice input device at the site and in which scene. With the above configuration, comments such as notes to be added when taking photographs or matters to be handed over can be entered by text or voice at the shooting site, thereby reducing the burden of creating a construction photo ledger.

[0024] Next, in the above configuration, it is preferable to provide an information collection function expansion unit that collects various information including weather information, earthquake information, event information, logistics information, and payment information around the construction site that may be required, in addition to the photo image data related to the construction work that is directly required and collected for creating the constructed blank ledger, and for the construction photo ledger creation unit to create the construction photo ledger using the various information obtained from the information collection function expansion unit. With the above configuration, when creating a construction photo ledger, it is possible to collect and use information that is not collected on the day of daily construction work but is later requested by the construction client. While it is considered difficult to proactively collect all information, it is preferable to limit the information to construction work and use a generation AI system to learn and collect information that has been useful in the past. For example, while weather information such as rain, snow, humidity, and temperature is not essential information for the current construction ledger, it may be required at a later date to analyze the drying of concrete, etc. The function can be expanded to proactively collect this information as well. It is also preferable that the construction photo ledger creation unit is provided in a cloud system on a computer network, and that the construction photo ledger creation unit has a communication function for receiving the photo image data and the voice input data by uploading them to the cloud system via the computer network.

[0025] In the construction photo ledger creation support system configured as above, the following configuration can also be adopted as a further innovation. It is configured to include a construction data input unit that receives input of construction drawing data and schedule data related to the construction work before the start of the construction work; a photography content designation unit that receives input of settings for photography points and objects to be photographed at the construction site based on the construction drawing data by the person in charge of setting the contents of the construction photo ledger, and input of settings for the photography date and time based on the schedule data; a construction photo ledger plan creation unit that is equipped with a blank ledger creation unit that creates a blank ledger with a collection of embedded frames in which specified photo image data will be embedded in the construction photo ledger according to the input from the photography content designation unit; a photography support unit that supports the photography by displaying the specified photography date and time, the specified photography point, and instructions for photographing the object to be photographed on the display unit of a photography device or communication device with a photography function carried by the person in charge of photography during the construction; and a construction photo ledger creation unit that embeds the photo image data in the corresponding embedded frame in the blank ledger and creates the construction photo ledger that also records information obtained from the photo image data.

[0026] With the above configuration, a blank ledger containing embedded frames of photographic image data is obtained as a construction photo ledger that should be created before construction begins, and at the construction site, simply by taking the photos specified for daily construction work, the photographic image data is embedded in the corresponding embedded frames in the blank ledger, and voice input data is also embedded, automatically creating a construction photo ledger. This greatly reduces the burden on the site supervisor and photographer, and furthermore, since the photography points, photography dates and times, and subjects are planned in advance and the site supervisor and photographer accurately confirm the planned contents while photographing, there is no risk of forgetting or missing a photo.

[0027] Here, in the above-mentioned configuration of the invention using the blank ledger, in order to contribute to the process of efficiently and accurately embedding the captured photographic image data in the corresponding embedded frame in the blank ledger, each embedded frame in the blank ledger created by the construction photo ledger plan creation unit is provided with a unique frame ID, and further, it is preferable that the construction photo ledger plan creation unit pre-sets a photo ID that is uniquely assigned to each shooting date and time information, shooting point and photographed object, and notifies this photo ID to the photography support unit. With the above configuration, each piece of photo image data taken at a construction site with the assistance of the photography support unit is associated with a unique photo ID. If the construction photo ledger creation unit holds correspondence data between frame IDs and corresponding photo IDs, the construction photo ledger creation unit can receive photo image data and voice input data uploaded as the construction progresses and embed the data in embedded frames with corresponding frame IDs in the blank ledger based on the photo ID. By matching the frame ID of the embedded frame, the photo ID of the photo image data, and the voice input ID of the voice input data based on the correspondence data held by the construction photo ledger creation unit, the photo image data taken as planned can be efficiently and accurately embedded in the corresponding embedded frames in the blank ledger.

[0028] Here, in the above configuration of the construction photo ledger creation support system, it is possible for the construction photo ledger creation unit to be provided on a cloud server on a computer network, and for the photography support unit to be equipped with a communication function for uploading the photo image data related to the photography to the cloud server on the computer network. With the above configuration, the site supervisor, photographer, and construction worker simply need to take photos at the designated shooting points, and the photo image data will be uploaded to the cloud server on the network, and the photo image data will be automatically embedded in the corresponding embedded frame in the blank ledger one by one. In other words, there is no need for post-processing. Furthermore, it is preferable that the blank ledger creation unit is equipped with a standard blank ledger database that stores blank ledgers of the construction photo ledgers related to multiple standardized construction projects, and a standard blank ledger selection unit that allows the authorized person or the person in charge to select an appropriate standard blank ledger from the standard blank ledger database, and that the setting person performs the necessary tuning on the selected standard blank ledger in the blank ledger creation unit based on the construction drawing data and the schedule data related to a specific construction project, and creates the blank ledger related to the specific construction project. With the above configuration, blank ledgers can be created efficiently in the blank ledger creation unit, and a standard blank ledger that has been highly evaluated and proven in past creations can be used, allowing the setup staff to tune the system to efficiently create blank ledgers suitable for specific construction work.

[0029] The construction photo ledger creation support system according to the present invention can be provided as a construction photo ledger creation support program. The construction photo ledger creation support program includes a blank ledger creation processing step in which a blank ledger is created by associating frame ID data assigned to each embedded frame with photo ID data assigned to photo data to be photographed at the construction site for a blank ledger that is a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger, and a voice recognition processing step in which voice input data input at the construction site using a photography device or communication device with a voice input function is received together with the photo ID data, and the voice input data is voice recognized to obtain the voice input information and the photo ID data together, and the construction photo ledger creation support program causes a computer to execute a construction photo ledger creation processing step in which the photo image data is pasted to a specified location on the frame based on the photo ID data associated with the frame ID data, and the voice input data acquired in the voice recognition processing step is also recorded on the frame to support the creation of the construction photo ledger.

[0030] In the program of the above configuration, the blank ledger creation processing step executes the creation and processing of the blank ledger through a construction photo ledger plan construction processing step which includes a construction data input step for receiving input of construction drawing data and schedule data related to the construction work before the start of the construction work, an input step for setting the shooting points and objects to be photographed at the construction site based on the construction drawing data by a person in charge of setting the contents of the construction photo ledger, a shooting content designation step for receiving input of the shooting date and time based on the schedule data, and a blank ledger creation step for creating a blank ledger consisting of a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger in accordance with the input in the shooting content designation step. Furthermore, in the program of the above configuration, it is preferable that the program includes a photography support processing step that supports the photography by displaying the specified photography date and time, the specified photography point, and instructions for taking photos of the object to be photographed on the display unit of a photography device or communication device with a photography function carried by the person in charge of photography during the construction work, and in the blank ledger creation processing step, unique photo ID data is assigned to the photography date and time information, the photography point, and the object to be photographed as the photo ID data, and the photo ID data is linked to each of the photo image data taken with assistance in the photography support processing step, and in the construction photo ledger creation processing step, correspondence data with the voice input ID data corresponding to the frame ID data is stored, and in the construction photo ledger creation processing step, the uploaded voice input data is received, and the voice input data is embedded in the embedded frame in the blank ledger that has the corresponding frame ID correspondence data based on the correspondence data. [Effects of the Invention]

[0031] According to the construction photo ledger creation support system of the present invention, comments and handover matters can be entered by voice input using a device held by the photographer on-site, such as a smartphone, thereby reducing the workload of on-site site supervisors and staff. Furthermore, blackboard images included in photo images can be character-recognized by a blackboard character recognition unit, construction material images can be image-recognized by an image recognition unit, and construction equipment images can be image-recognized by an image recognition unit. The character recognition results and the names of construction materials and construction equipment based on the image recognition results can be entered in the construction photo ledger, and a construction photo ledger whose contents can be easily understood along with the photo image data embedded in the buried frame can be automatically created. Before construction begins, a blank ledger containing embedded frames of photo image data is obtained as a construction photo ledger that should already be created, and anything that is noticed on the construction site can be input by voice. Furthermore, simply by taking the designated photos during daily construction, the photo image data is embedded in the corresponding embedded frames in the blank ledger, and the construction photo ledger is automatically created. This significantly reduces the burden on the on-site site supervisor and photographer, and furthermore, since the shooting points, shooting dates and times, and subjects are planned in advance, and the on-site site supervisor and photographer accurately confirm the planned contents while taking photos, there is no risk of missing or forgetting to take a photo. This reduces the burden on site supervisors, construction workers, and photographers, and ensures that construction photo ledgers and reports are created with a consistent level of quality. It is possible to create a construction photo ledger and prepare reports as required by the client, designer, and project manager. [Brief explanation of the drawings]

[0032] [Figure 1] 1 is a diagram showing an example of the configuration of a construction photo ledger creation support system 1 according to the present invention. [Figure 2] FIG. 1 is a diagram showing the outline of the processing flow of the construction photo ledger creation support system 1. [Figure 3] FIG. 10 is a diagram showing a very simple example of working drawing data and schedule data for the current construction work input via the construction data input unit 111. [Figure 4] FIG. 4 is a diagram showing a state in which a process of specifying the photographing contents is carried out via a photographing contents specifying unit 113 based on the working drawing data and the process chart data of FIG. [Figure 5] FIG. 10 is a reference diagram of a photo list mode of standard blank ledger data 300. [Figure 6] This is a reference diagram of the table of contents of a form image of standard blank ledger data 300. [Figure 7] FIG. 10 is a reference diagram of a photo ledger page of a form image of standard blank ledger data 300. [Figure 8] FIG. 10 is a reference diagram of the blank ledger data 400 in a photo list mode. [Figure 9] This is a reference diagram of the table of contents of the form image of the blank ledger data 400. [Figure 10] FIG. 10 is a reference diagram of a photo ledger page of a form image of blank ledger data 400. [Figure 11] 10A and 10B are diagrams showing examples of support displays for photography content displayed on a photography content instruction display unit 220 of a client 200. FIG. [Figure 12] This is a simplified diagram showing how the construction photo ledger creation unit 140 is equipped with three recognition processing modules: a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143. [Figure 13] This shows only a small portion of an example of the construction photo ledger data 500 created by the construction photo ledger creation unit 140. [Figure 14] 10A and 10B are diagrams showing how information input by voice is displayed as a pop-up or pull-down menu. [Figure 15] FIG. 1 is a diagram showing a processing flow 1 of the construction photo ledger creation support system 1. [Figure 16] FIG. 2 is a diagram showing the processing flow 2 of the construction photo ledger creation support system 1. [Figure 17] FIG. 3 is a diagram showing the processing flow 3 of the construction photo ledger creation support system 1. BEST MODE FOR CARRYING OUT THE INVENTION

[0033] Hereinafter, an embodiment of the construction photo ledger creation support system of the present invention will be described with reference to the drawings. However, it goes without saying that the scope of the present invention is not limited to the specific applications shown in the following embodiments. The construction work to which the construction photo ledger creation support system of the present invention is applicable is not limited to construction work, but can be widely applied to any work for which the process can be planned in advance, such as road construction work and on-site assembly and installation of large-scale machinery and equipment.For the sake of convenience, examples will be described that mainly focus on application to construction work, but it will be understood that the system can be similarly applied to any work for which the process can be planned in advance, such as on-site assembly and installation of large-scale machinery and equipment. Example 1

[0034] An example of the configuration of the construction photo ledger creation support system 1 of the present invention will be described below. FIG. 1 is a diagram showing an example of the configuration of a construction photo ledger creation support system 1 according to the present invention. FIG. 2 is a diagram showing the outline of the processing flow of the construction photo ledger creation support system 1. As shown in Fig. 1, the construction photo ledger creation support system 1 according to the first embodiment is constructed as a client-server system including a server 100 and a client 200 connected via a network. A cloud system may also be used. In this example, a cloud server on the cloud and a smartphone brought to the site are used as client terminals.

[0035] As shown in Figure 1, the server 100 is configured to include a construction photo ledger plan creation unit 110, a photography support unit 120, an information collection function expansion unit 130, a construction photo ledger creation unit 140, a construction photo ledger database 150, and a communication I / F 160. In this configuration example, the construction photo ledger plan creation unit 110 is configured to include a construction data input unit 111, a construction material management unit 112, a photography content designation unit 113, a blank ledger creation unit 114, and a standard blank ledger database 115. In this configuration example, the construction photo ledger creation unit 140 includes three recognition processing modules: a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143. Although not shown, the control device, memory, input / output device, and the like that are generally provided in the server 100 are omitted. The operator of the server 100 is not particularly limited, but here it is assumed to be the administrator of the construction photo ledger creation support system.

[0036] Next, as shown in FIG. 1, the client 200 is configured to include a photographing unit 210, a photographing content instruction display unit 220, and a communication I / F 230. The hardware configuration of the client 200 may be a general-purpose PC, a portable communication device such as a smartphone, or a digital camera. It may also be configured on such a device by downloading an application that provides the function of the shooting content instruction display unit 220 via a network. Since the photography unit 210 is required, a digital camera or a smartphone is assumed. The user of the client 200 is not particularly limited, but in this example, the client 200 is described as a site supervisor or a person in charge of photography at a construction site. It is assumed that there are multiple clients 200 on the network, and the cloud server 100 receives photo image data from each client 200 and creates a construction photo ledger.

[0037] Below, the components of the server 100 will be described first, followed by the components of the client 200. The outline of the processing flow of the construction photo ledger creation support system 1 using FIG. 2 will be described later. First, each component of the server 100 will be described. As described above, the server 100 is configured with a construction photo ledger plan creation unit 110, a photography support unit 120, an information collection function expansion unit 130, a construction photo ledger creation unit 140, a construction photo ledger database 150, and a communication I / F 160.

[0038] The construction photo ledger plan creation unit 110 is the part that creates blank ledger data 400, which is a collection of embedded frames of photo image data for the construction photo ledger to be created for the construction work, from the construction data entered for the construction work, such as construction drawing data and schedule data, before the construction work begins.

[0039] The blank ledger data 400 is blank construction photo ledger data with no specific photographic images attached in advance to match the planned completion of the construction photo ledger data 500 that will be required in the report on this specific construction work, and in this invention this is referred to as blank ledger data 400. In the construction photo ledger creation support system 1 according to the first embodiment, it is considered important to create this blank ledger data 400, and if the creation of this blank ledger data 400 is incorrect or inaccurate, there is a risk that the efficiency of creating the construction photo ledger will be reduced due to the need to redo photography and make changes after construction has begun or at the end of construction. Therefore, the construction photo ledger plan creation unit 110 has various functions to efficiently and easily create accurate and desirable blank ledger data 400.

[0040] The construction photo ledger plan creation unit 110 includes a construction data input unit 111 , a construction material management unit 112 , a photography content designation unit 113 , a blank ledger creation unit 114 , and a standard blank ledger database 115 .

[0041] The construction data input unit 111 is a part that receives input of construction drawing data and schedule data related to the construction work before the construction work starts. Through the construction data input unit 111, the construction company or subcontractor that will actually be in charge of the construction work receives construction drawing data and schedule data related to the construction work from the client, design company, primary contractor, etc.

[0042] "Work drawings" for construction work are created from design drawings (final design drawings, structural drawings, equipment drawings, etc.), and generally include detailed floor plans, structural drawings, and overall drawings (electrical drawings, air conditioning drawings, water supply and drainage sanitary drawings, gas sanitary drawings). Work drawing data here refers to these work drawings that have been made computer-processable. For work other than construction work, such as on-site assembly and installation of large-scale machinery and equipment, the work drawing data is not limited to the above and can be of various types.

[0043] A "schedule" for construction work is a table that summarizes each step of the work and the time until completion (delivery date), and can be, for example, an overall schedule, a detailed schedule, a monthly schedule, or a weekly schedule. The schedule data referred to here is such schedule data that can be processed by computer. Because each step of the work can be grasped in detail, it becomes easier for construction managers such as site supervisors to understand the allocation of personnel and the progress of work hours. There are various types of schedule data, such as bar chart schedule data, Gantt chart schedule data, and network schedule data.

[0044] FIG. 3 is a diagram showing a very simple example of working drawing data and schedule data for this specific construction work input via the construction data input unit 111. FIG. 3 shows only one detailed plan view as a working drawing and one bar chart schedule as a schedule. In actual construction work, when the work is large-scale, the working drawings alone may number in the hundreds or even thousands, and the schedule may also number in the hundreds or even thousands due to the wide variety of construction sections and construction units. Here, only a small portion is shown for the purpose of explaining the invention.

[0045] The construction material management unit 112 assigns a material ID to materials that are to be delivered to a predetermined location on a predetermined date and time at a construction site and used. By analyzing the information collected through the construction data input unit 111 based on the construction drawing data and schedule data previously obtained before the start of construction, information regarding the construction materials to be delivered to the construction project and the construction equipment to be used can be obtained.The construction material management unit 112 uses this information to manage the materials that are to be delivered to the construction site at a specified date and time and to be used at a specified location, and assigns material IDs to these materials.

[0046] For management purposes, for example, a material ID may be assigned to each material individually, or a material ID may be assigned to a group of materials that are to be delivered to a predetermined location on a predetermined date and time at the construction site and used. For example, if a group of materials consists of 100 bolts that are delivered to a predetermined location on a predetermined date and time, 100 different material IDs may be assigned to each bolt, or a single material ID may be assigned to the group of materials. By assigning this material ID, when creating the construction photo ledger described below, it is possible to include a record that the materials to be used were delivered to a specified location on a specified date and time and used by matching them with the material ID.

[0047] It is also preferable that the construction material management unit 112 assigns, in addition to the material ID, a construction equipment ID to construction equipment that is delivered to a predetermined location on a predetermined date and time at the construction site and used. When creating a construction photo ledger, it is often necessary to record the construction equipment that has been put into use. By assigning this construction equipment ID, when creating the construction photo ledger (described later), it is possible to include a record that the construction equipment that is scheduled to be used has been delivered to a specified location at a specified date and time and used, by matching it with the construction equipment ID.

[0048] The photography content designation unit 113 is a construction data input unit that receives input of construction drawing data and schedule data related to the construction work before the start of the construction work, and receives input of settings for the photography points and photographed objects at the construction site based on the construction drawing data, and settings for the photography date and time based on the schedule data, by the person in charge of setting the contents of the construction photo ledger. Construction drawing data is image data showing detailed floor plans, structural drawings, and overall drawings, but in the prior art, when creating the final construction photo ledger for this specific construction project, it does not include information on "from what position photographs should be taken to create an appropriate construction photo ledger." Therefore, in the construction photo ledger creation support system 1 of the present invention, the person in charge of setting the contents of the construction photo ledger designates the photography points in advance at the stage before construction begins, plans the content of the photographs to be taken at a specified date and time and at a specified construction stage, and makes it possible to set the content via the photography content designation unit 113.

[0049] The designation of the photographing contents via the photographing contents designation unit 113 may be performed manually by an authority who decides the contents of the construction photo ledger while referring to the displayed construction drawing data and schedule data, or by a person in charge who receives instructions from the authority. It is preferable that a convenient GUI be provided for designation, and one designation method may combine various input methods, such as designation with a mouse, selection from a pull-down menu, or input of numerical values ​​via a keyboard. In addition, a method is also possible in which the photographing contents designation unit 113 automatically performs initial settings with the support of artificial intelligence, which has become popular in recent years, and the authority or person in charge tunes the settings as needed. In the future, it is expected that the manual settings made by the person in charge of setting up the system will also be generated by artificial intelligence (AI).

[0050] The shooting content designation unit 113 can specify the shooting location, shooting direction, and shooting angle as the shooting point setting input, and the shooting object setting input, such as the shooting object, its shooting posture, and the deployed state of the lid or parts of the shooting object as the shooting object setting input.

[0051] FIG. 4 is a diagram showing a state in which the photographing content designation process is performed via the photographing content designation unit 113 based on the working drawing data and the process chart data of FIG. As shown in Figure 4, the shooting location, shooting direction, and shooting angle are set as the setting input for the shooting point, and the object to be photographed, its shooting posture, and designated comments on the deployed state of the cover or parts of the object to be photographed are set as the setting input for the construction drawing data. In Figure 4, the camera shooting position and shooting direction are indicated by symbols. The direction of the vertex of the triangle is the shooting direction. In this example, the shooting angle is entered as a numerical value as the angle from the floor. In addition, the object to be photographed, its shooting posture, and the deployed state of the object to be photographed are entered as designated comments at the end of the leader line. In other words, the construction drawing data that has been used conventionally and is also prepared for this construction project is provided with data on the content of the photography.

[0052] In addition, the shooting dates and times are specified for each process in the schedule data, allowing the site supervisor and photography staff to clearly and easily plan when, where, and what to photograph to obtain photo image data. In other words, the photograph content data is added to the schedule data that has been used conventionally and is also prepared for this construction project.

[0053] The blank ledger creation unit 114 is the part that creates a base blank ledger that will serve as the construction photo ledger to be created based on the photographic content input and specified by the setting person via the photographic content designation unit 113, that is, a blank ledger that is a collection of embedded frames into which photographic image data will be embedded as the construction photo ledger to be created. In order to efficiently construct blank ledgers, the blank ledger creation unit 114 has a function of preparing a database of standard blank ledgers for each category of construction work (standard blank ledger database 115), and by tuning this standard blank ledger, creating a blank ledger for a specific construction work.

[0054] The creation of the blank ledger by the blank ledger creation unit 114 may be manually tuned by an authority who decides the contents of the construction photo ledger or a person in charge who receives instructions from the authority, while referring to the shooting content designation results, construction drawing data, and schedule data created by the shooting content designation unit 113, as shown in Fig. 4. Also, a method is possible in which the shooting content designation unit 113 automatically performs initial settings with the support of artificial intelligence (AI), which has become widespread in recent years, and the authority or person in charge tunes the settings as needed.

[0055] The standard blank ledger database 115 is a database that stores standard data that serves as the basis for the construction photo ledger data 500, which is ultimately created by the construction photo ledger creation support system 1 and has construction photos pasted and organized. Here, this base standard data is called the "standard blank ledger data 300." In other words, it is a database in which the locations where photographic images of each shooting point in the construction work that progresses according to the construction drawings and schedule are pasted are left blank, and it can be thought of as a kind of "planned photo image mount" in which the photographic images of the shooting points where photography is scheduled to be taken according to the construction drawings and schedule and the locations where they will be pasted are planned in advance.

[0056] In actual construction work, there are variations in the content of each individual work, and they are diverse in nature, but it is believed that they can be categorized and patterned to some extent depending on the construction object. The standard blank ledger data 300 is a "standard" construction photo ledger created according to a "standard" schedule for categorized and patterned construction objects, and "standard" data in a blank state where photographic images have not yet been pasted and organized is called "standard blank ledger data 300," and the standard blank ledger database 115 collects and stores a wide variety of these. The standard blank ledger selection unit 116 selects standard blank ledger data suitable for the current specific construction work from the various standard blank ledger data 300 stored in the standard blank ledger database 115. The setting person may manually select the standard blank ledger data 300 via the standard blank ledger selection unit 116, and in the future, it is expected that this manual selection by the setting person will also be generated by artificial intelligence (AI).

[0057] Figures 5 to 7 show only a small portion of the "standard blank ledger data 300" stored in the standard blank ledger database 115. In actual construction work, progress is recorded over a period of many days at numerous photographic points, so it should be understood that what is shown in Figures 5 to 7 is only a small portion of it. FIG. 5 is a reference example of a photo list mode of a certain standard blank ledger data 300. FIG. 6 is a reference example of a table of contents of a form image of a certain standard blank ledger data 300. FIG. 7 is a reference example of a photo ledger page of a form image of a certain standard blank ledger data 300. The standard blank ledger data 300 in Figures 5 to 7 only show a small portion, and it is assumed that the construction photo ledger for actual construction will have many photo shooting points, many total days of photography, and many photographic images. Figures 5 to 7 are from the planning stage before construction, so the photographic images have not yet been pasted and organized, and are all blank.

[0058] The blank ledger creation unit 114 extracts standard blank ledger data from the standard blank ledger database 115 according to the construction category from the construction drawings and schedule of the specific construction work, and creates a blank ledger for the specific construction work by tuning the standard blank ledger. The blank ledger creation unit 114 develops embedded frames from the extracted standard blank ledger into which the necessary number of photo image data to be created from each construction project and photography point specified in Fig. 4 is embedded. Here, when a series of photography content data specified as in Fig. 4 is given, the standard blank ledger data 300 shown in Fig. 5 to Fig. 7 is developed, and photo list mode data, table of contents data for the form image, and photo ledger page data for the form image are obtained, but the photo images embedded in each are only frames and are blank.

[0059] The person with authority or responsibility for deciding the contents of the construction photo ledger who operates the blank ledger creation unit 114 will tune the standard blank ledger data 300 shown in Figures 5 to 7 in accordance with the contents of the specific construction work, and complete the blank ledger data 400. Here, if artificial intelligence technology continues to develop in the future, the blank ledger creation unit 114 may use artificial intelligence to automatically complete the blank ledger data 400.

[0060] 8 to 10 show only a small portion of the tuned blank ledger data 400. It will be understood that in actual construction work, progress is recorded over a period of many days at many photographic points, and that what is shown in Figs. 8 to 10 is only a small portion of it. FIG. 8 is a reference example of the blank ledger data 400 in the photo list mode. FIG. 9 is a reference example of a table of contents of a form image of the blank ledger data 400. FIG. 10 is a reference example of a photo ledger page of a form image of the blank ledger data 400. Figures 8 to 10 only show a small portion of the data, and it is assumed that the construction photo ledger for actual construction work will have many more photo points, many more days of photography, and many more photographs. Figures 8 to 10 show the work before construction has even begun, so the photographs have not yet been pasted and organized, and are all blank.

[0061] The photography support unit 120 supports the taking of photographs during construction by displaying the specified photography date and time, the specified photography point, and instructions for taking photographs of the object to be photographed on the display unit of the photography device or communication device with photography function carried by the site supervisor or photography officer. In other words, it is a part that assists in taking photographs in accordance with the photographing content (predetermined photographing points at the construction site at a predetermined date and time), and in this example, the client 200 is a device such as a smartphone that has a communication function (communication I / F 230), a display unit (photographing content instruction display unit 220), and a camera unit (photographing unit 210, camera unit 211), which will be described later, and the photographing assistance unit 120 assists in taking photographs by displaying the photographing content on the photographing content instruction display unit 220 of the client 200. Also, as will be described later, it is preferable that the photographing unit 210 of the client 200 has a photograph ID data assignment unit 213, and also has a function of notifying the photograph ID to be assigned to the photograph taken.

[0062] FIG. 11 is a diagram showing an example of a support display for the photography content displayed on the photography content instruction display unit 220 of the client 200. In FIG. The example in FIG. 11 is merely an example, and various examples of support displays for various shooting contents are possible, and it goes without saying that the example is not limited to the display example shown in FIG. 11, the display is on the display unit of a communication terminal that is assumed to be a smartphone. In other words, the server 100 is located on the cloud, and data is exchanged between the server 100 and the client 200, which is a smartphone.

[0063] As shown on the left side of Figure 11, when the site supervisor or photographer enters a date in the date column, or the date is automatically entered using the smartphone's clock function, each process scheduled for that date is listed on the smartphone screen (in this example, December 15, 2022). It is displayed like a to-do list, and on this display screen, each scheduled process is displayed in the form of a button that can be selected by tapping. In this example, the site supervisor or photographer taps on the process for which they are responsible.

[0064] Next, as shown in the center of Figure 11, the planned shooting content for the tapped process is displayed. Here, it is displayed that two shooting points (shooting point 4 and shooting point 5) are scheduled to be shot in the selected process. These shooting plans are also displayed in the form of buttons that can be specified by tapping. In this example, the site supervisor or photographer selected and tapped shooting point 5 out of the two shooting points.

[0065] Next, as shown in the right diagram of Figure 11, the planned shooting content at the tapped shooting point 5 is displayed. Here, the construction drawing and the location of shooting point 5 on the construction drawing are displayed, and any specified comments are also displayed. There are various other ways to support the content of photos. For example, although not shown here, there is a button to display the most recently taken image, and when you tap the button, the most recently taken image is displayed (in this case, it is possible to display a photo image taken on the previous day, December 14, 2022).

[0066] The site supervisor and the person in charge of photography take the prescribed photographs at each photography point according to the support display of the photography content. In other words, by taking photographs according to the support of the photography support unit 120, the desired photographic data can be reliably obtained as scheduled in the planning stage, and situations such as missing photographs can be prevented. The photographic image data taken as scheduled can be sent to the cloud server 100 online at the construction site, or of course, can be sent all at once later in a batch process. It is also possible to take a photograph of a blackboard, which has been commonly used in the past and has written on it the name of the construction, type of work, a rough outline of the measurement points, the progress of the construction, etc., and include this in the photographic image. It is also expected that such analog data will be useful in checking the photographic image. As described below, the photographic data obtained by the client 200 is linked to the photo ID information notified by the photographic support unit 120 at the time of photographing, and is sent to the construction photo ledger creation unit 140 of the server 100 on the cloud. Furthermore, if there is a function on the smartphone screen that displays a reminder (a reminder or warning) on ​​the worker's smartphone if a photo scheduled for that date listed on the smartphone screen has not been taken, this can prevent forgetting or missing out on taking a photo.

[0067] The construction photo ledger creation unit 140 receives photo image data taken by the camera of the client 200 and embeds it in the corresponding embedded frame in the blank ledger to create the construction photo ledger data 500. Here, the construction photo ledger creation unit 140 holds correspondence data between the photo ID corresponding to the frame ID. That is, each embedded frame of the blank ledger 400 created by the construction photo ledger plan creation unit 110 is provided with a frame ID, and each piece of photo image data taken with the support of the photography support unit 120 is provided with a photo ID and uploaded. The construction photo ledger creation unit 140 receives the uploaded photo image data and, based on the frame ID-photo ID correspondence data, embeds it into an embedded frame with a frame ID that matches the photo ID, thereby creating the construction photo ledger data 500.

[0068] In this configuration example, the construction photo ledger creation unit 140 includes three recognition processing modules: a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143. The blackboard character recognition unit 141 receives input of photographic image data of a blackboard placed at a construction site and photographed so as to include information relating to the construction, and automatically acquires information written on the blackboard by character recognition of the blackboard reflected in the photographic image data. The construction photo ledger creation unit 140 matches the frame ID with the photo ID and pastes the photo image data input from the client 200 into a designated location in the blank ledger 400, and also records the information written on the blackboard obtained as a result of character recognition by the blackboard character recognition unit 141.

[0069] The blackboard character recognition unit 141 can be a construction terminology-trained character recognition AI system that has been trained to learn terms related to construction work and past blackboard records. FIG. 12 is a diagram simply showing how the construction photo ledger creation unit 140 is equipped with three recognition processing modules: a blackboard character recognition unit 141, an image recognition unit 142, and a voice recognition unit 143. FIG. 12(a) is a diagram showing an outline of the program module of the blackboard character recognition unit 141 that employs a construction terminology-trained character recognition AI system. As shown in Figure 12(a), the construction terminology-trained character recognition AI system of the blackboard character recognition unit 141 includes a construction terminology training database 1412 that has learned characters that are likely to be written on blackboards at construction sites from words and vocabulary such as construction-related terms, physical units, industry jargon used among contractors, abbreviations, and colloquialisms; a character recognition engine 1411 that converts character patterns into text; and a character recognition processing unit 1413.

[0070] The words and vocabulary related to construction work are limited, and rather than using general character recognition software as the blackboard character recognition unit 141, it is preferable to strengthen the words, technical terms, and abbreviations used at construction work sites in the construction terminology learning database 1412, and in the recognition processing of the character recognition processing unit 1413, not include other words that are not likely to be used in construction work, or to exclude them from the correct answer candidates.

[0071] Next, the image recognition unit 142 performs image recognition on the construction materials that are captured in the photographic image data and that are delivered to a predetermined location at a predetermined date and time and used at the construction site, and automatically acquires the material ID. It is also preferable that the image recognition unit 142 performs image recognition on the construction equipment that is brought into a specified location at a specified date and time and is used at the construction site and that is captured in the photographic image data, and acquires the construction equipment ID. The construction photo ledger creation unit 140 matches the frame ID with the photo ID, pastes the photo image data input from the client 200 into a designated location in the blank ledger 400, and also records the results of image recognition by the image recognition unit 142 and the construction material ID and construction equipment ID obtained.

[0072] The image recognition unit 142 can be a construction work image-trained image recognition AI system that has been trained to learn images of construction materials and construction equipment related to construction work. FIG. 12(b) is a diagram showing an outline of the program modules of the image recognition unit 142 that employs an image recognition AI system that has learned construction work images. As shown in Figure 12(b), the construction work image-trained image recognition AI system of the image recognition unit 142 includes a construction material image database 1422 that has learned image patterns of various construction materials and construction equipment related to construction work, an image recognition engine 1421 that identifies construction material IDs and construction equipment IDs by pattern matching the image patterns of construction materials and construction equipment captured in photographic image data, and an image recognition processing unit 1423.

[0073] The construction materials and construction equipment related to construction work are limited, and rather than using general image recognition software as the image recognition unit 142, it is preferable to strengthen the construction material image database 1422 with external patterns, packaging, product names, types and names of machines, supplier names, and abbreviations of various construction materials and construction equipment used at construction sites, and to devise a way to not include image patterns of other objects that are unlikely to be used in construction work in the recognition processing of the image recognition processing unit 1423, or to exclude them from the correct answer candidates.

[0074] Next, the voice recognition unit 143 receives voice input data inputted at the construction site by a photographing device or a communication device with a voice input function, and performs voice recognition on the voice input data to automatically acquire voice input information. The construction photo ledger creation unit 140 matches the frame ID with the photo ID, pastes the photo image data input from the client 200 into a designated location in the blank ledger 400, and creates a construction photo ledger that also records the voice input information acquired by the voice recognition unit 143 when creating the construction photo ledger.

[0075] The voice recognition unit 143 can perform voice recognition processing using a construction work terminology-trained voice recognition AI system that has been trained with terms related to construction work. FIG. 12(c) is a diagram showing an outline of the program module of the voice recognition unit 143 that employs a voice recognition AI system that has learned construction terminology. As shown in Figure 12(c), the construction terminology-trained voice recognition AI system of the voice recognition unit 143 includes a construction terminology database 1432 that has strengthened various words, technical terms, abbreviations, and grammar related to construction work and has learned the voice patterns of construction work terms, a voice recognition engine 1431 that pattern-matches the voice patterns related to construction work recorded in the voice data to identify the construction-related voice input content, and a voice recognition processing unit 1433.

[0076] Next, the information collection function expansion unit 130 will be described. The information collection function expansion unit 130 collects various information that may be required, including weather information around the construction site, earthquake information, event information, logistics information, payment information, etc., in addition to the photographic image data that is directly required for creating the construction photo ledger and is collected at the construction site. When creating a construction photo ledger, the construction photo ledger creation unit 140 can inquire about external information that is required later from the information collection function extension unit 130 and create the construction photo ledger by adding the various information that the information collection function extension unit 130 has collected. For example, while weather information such as rain, snow, humidity, and temperature is not essential information for the current construction ledger, it may be required at a later date to analyze the drying of concrete, etc. We considered expanding the functionality to collect this information in advance.

[0077] Figure 13 shows only a small portion of an example of construction photo ledger data 500 created by the construction photo ledger creation unit 140. The example in Figure 13 is only a reference example and is not limited to this example. Various formats of construction photo ledger data 500 are possible. In this way, by matching the frame ID of the buried frame and the photo ID of the photo image data based on the correspondence data held by the construction photo ledger creation unit 140, voice-input comments, the contents of the matters to be handed over, and the photographed photo image data can be efficiently and accurately embedded in the corresponding buried frame in the blank ledger, and construction photo ledger data 500 can be created that shows the construction details that are progressing according to schedule, day by day, in advance. The construction photo ledger creation unit 140 utilizes the blackboard character recognition unit 141, the image recognition unit 142, and the voice recognition unit 143 to create a detailed, high-quality construction photo ledger by incorporating information obtained as a result of character recognition on a blackboard contained in the photo image data, information on construction materials and construction equipment obtained by image recognition from the images contained in the images, and information obtained as a result of voice recognition of voice data input by workers on site. As shown in Figure 14, the information entered by voice is recorded as voice-recognized text in the "Voice Comments / Information to be handed over" section, and the voice file is also displayed as an icon or link information, and the voice file can be played by clicking with a pointing device or tapping with a finger. In Figures 13 and 14, only one icon and link information for an audio file are shown, but if multiple types of audio files are included in the construction photo ledger frame, icons and link information corresponding to each of them may be displayed.

[0078] The construction photo ledger database 150 is a recording device that stores the construction photo ledger data 500 that is created every day by the construction photo ledger creation unit 140. The interim data that is created every day over time may also be accumulated and stored, or may be stored in a format that allows it to be overwritten.

[0079] The communication I / F 160 is generally provided in many server systems, and therefore its description will be omitted here. A control unit, an input / output unit, and a monitor may also be provided, and their description will be omitted here. In the diagrams showing the data flow described below, even if the control unit, input / output unit, monitor, and communication I / F 160 are shown as not operating, they are still operating within the scope of common technical knowledge and executing data processing.

[0080] Next, the client 200 operated by the site supervisor or the person in charge of photography will be described. As described above, the client 200 is configured to include the photography unit 210, the photography content instruction display unit 220, and the communication I / F 230. In this example, a smartphone is used, and the client 200 is configured by downloading an application to the smartphone.

[0081] In this configuration example, the photographing unit 210 includes a camera unit 211, a voice input unit 212, and a photograph ID data assigning unit 213. The camera unit 211 is a photographing device for taking photographic images. In this example, a camera device mounted on a smartphone is used.

[0082] The voice input unit 212 is a section where the photographer can input additional information by text or voice. If there is any notice of progress at the construction site, it would be convenient if the details could be recorded as additional information or input as a handover item to be referred to the next time a photograph is taken. Additional information is input to the photographic image data taken via this voice input unit 212. Here, the input itself can also be made using a text input means or voice input means installed in a smartphone. The photographing unit 210 adds this input data to the photographic image data taken.

[0083] The photo ID data assigning unit 213 is a unit that assigns photo ID information to the photo image data when a photo is taken at a predetermined photography point. The photo ID information is uniquely assigned to the photography date and time information, photography point, and photographed object that were planned in advance in the construction photo ledger plan creating unit 110. The photo ID data assigning unit 213 is notified of this photo ID information via the photography support unit 120 of the server 100, and when a photo is taken, it links this photo ID information to the photo image data and transmits it to the server 100.

[0084] The photography content instruction display unit 220 is a part that displays the photography content information (information about the photography location, photography direction, photography angle, photography posture of the object being photographed, and the deployed state of the cover or parts of the object being photographed, etc.) along with the display of the construction drawings from the photography support unit 120. In other words, it obtains and displays information about the photography content that should be photographed at the construction site from the photography support unit 120, and displays it to the site supervisor or person in charge of photography to support photography. In this example, a smartphone is assumed, and it is sufficient to display it on the smartphone screen.

[0085] The communication I / F 230 is generally provided in the client 200, and therefore a description thereof will be omitted here. In this example, the client 200 is assumed to be a smartphone, and therefore is a device having the communication I / F 230.

[0086] An example of the processing flow of the construction photo ledger creation support system 1 of the present invention will be summarized below with reference to Figures 15 to 17. The following processing flow is an example, and the order of the processing may be reversed. In the following flow, it is assumed that the operator of the cloud-based server 100, the construction photo ledger plan creation unit 110, will be primarily operated by a construction ordering company, design office, or other person who plans and manages the construction work. The photography support unit 120 and the construction photo ledger creation unit 140 receive operational input through interactions with the site supervisor, photographer, or other person at the construction site. The client 200 is assumed to be a mobile device such as a smartphone carried by the site supervisor, photographer, or other person at the construction site, or a digital camera device equipped with the functions of the client 200, and the operator is assumed to be the site supervisor or photographer themselves at the construction site.

[0087] [Processing flow of Construction Photo Ledger Creation Support System 1 1: Flow before construction begins] Construction data including construction drawing data and schedule data for a specific construction project is input into the construction data input unit 111 of the construction photo ledger plan creation unit 110 from a terminal (not shown) of the construction ordering company or design office (step S1 in Figure 15). Here, for example, construction data including the working drawing data and schedule data shown in FIG. 3 is input.

[0088] Next, the construction data including the input construction drawing data and schedule data is passed to the photography content designation unit 113 (step S2 in Figure 15), and the photography content, such as setting input of the photography point (setting input of photography location, photography direction, photography angle) and setting input of the object to be photographed (setting input of the object to be photographed, its photography posture, and the expanded state of the cover or parts of the object to be photographed), is set by staff of the construction ordering company or design office for the construction data including the construction drawing data and schedule data displayed on a terminal (not shown) of the construction ordering company or design office (step S3 in Figure 15). Here, for example, as shown in Figure 4, the setting input of the shooting point (setting input of the shooting location, shooting direction, shooting angle), setting input of the object to be photographed (setting input of the object to be photographed, its shooting posture, and specified comments on the unfolded state of the cover or parts of the object to be photographed), etc. are performed for the construction drawing data.

[0089] Next, the shooting content is specified via the shooting content specification unit 113, and the construction data including the working drawing data and schedule data for which the shooting content has been specified is passed to the blank ledger creation unit 114 (step S4 in Figure 15), and the blank ledger creation unit 114 selects appropriate standard blank ledger data 300 for the category of this specific construction work from the standard blank ledger database 115 (step S5 in Figure 15). Note that this selection may be made by a selection operation by the construction ordering company or design office staff operating the blank ledger creation unit 114, or may be made automatically by the blank ledger creation unit 114. Here, it is assumed that the standard blank ledger data 300 is selected, for example, as shown in FIGS.

[0090] Next, the standard blank ledger data 300 is tuned to suit the specific construction project by the staff of the construction ordering company or design office who operate the blank ledger creation unit 114, and necessary information that is missing from the standard blank ledger data 300 is written in, missing pages for pasting photographic images to be taken are added, or unnecessary pages for pasting photographic images to be taken are deleted (step S6 in Figure 15).

[0091] Next, the blank ledger creation unit 114 determines the standard blank ledger data 300 tuned by the staff of the construction ordering company or design office as the blank ledger data 400, also determines the frame ID at the embedded location of the photographic image to be pasted, and passes the determined blank ledger data 400 to the photography support unit 120 (step S7 in Figure 15). Here, it is assumed that the blank ledger data 400 shown in FIGS. 8 to 10 has been determined. In the process up to this point, a construction photo ledger plan is constructed mainly by the construction photo ledger plan construction unit 110, and as a result, blank ledger data 400 is obtained. It is possible that as specific construction work progresses, parts of the plan may be revised or changed. If such partial revisions or changes occur, steps S1 to S7 of Figure 15 above can be repeated as needed to obtain blank ledger data 400 that reflects the partial revisions and changes.

[0092] [Processing flow of construction photo ledger creation support system 1 2: Flow during construction] Next, we will explain the process at the construction site after construction has begun. The photography support unit 120 of the cloud server 100 and the photography content display unit 220 of the client 200 exchange data via a network to cooperate and support photography. For example, when a site supervisor or a photographer inquires from their smartphone about the photography content set for each process and construction scheduled for the construction day, the photography support unit 120 transmits instruction data regarding the photography content set and displays it on the photography content display unit 220 of the client 200 (step S8 in FIG. 16). Note that here, photo ID data to be assigned to the captured photographic image is passed to the photo ID data assignment unit 213 (step S9 in FIG. 16). In this example, for example, an inquiry is made about photography scheduled for December 15, 2022, and instructions on the photography content are displayed as shown in Figure 11. It is preferable to display the content of the photography in an easy-to-understand manner so that the content of the photography can be correctly conveyed. Here, the photography point is indicated on the construction drawing, and the angle and what to photograph are displayed. Furthermore, as in the past, instructions to take photos can be given along with an analog construction blackboard. It is also preferable to be able to view the photographs recorded in the most recent construction photo ledger, as this allows the user to visually check whether the photographs they are about to take are correct.

[0093] The site supervisor or person in charge of photography operates the smartphone that is the client 200, operates the photography unit 210, takes photos via the camera unit 211 (step S10 in Figure 16), and inputs comments and matters to be handed over via the voice input unit 212; in other words, the microphone function can be used to input by voice the information that needs to be input at the construction site (step S11 in Figure 16). The photo ID data assigning unit 213 links the photographic image data with the photo ID data (step S12 in FIG. 16). The photographed photograph data is sent together with the respective photograph ID data from the photographing unit 210 of the client 200 to the construction photograph ledger creating unit 140 of the cloud server 100 (step S13 in FIG. 16).

[0094] [Processing flow of Construction Photo Ledger Creation Support System 1 3: Flow during construction] The construction photo ledger creation unit 140 embeds and pastes the received photo image data into the frame ID corresponding to the respective photo ID data, thereby creating the construction photo ledger data 500 (FIG. 17, step S14). Here, the construction photo ledger data 500 is created each time photo data is sent from the client 200. It is also possible to perform batch processing to some extent.

[0095] The construction photo ledger creation unit 140 performs character recognition processing of the blackboard that appears in each photo image data using the blackboard character recognition unit 141, performs image recognition of the image patterns of construction materials and construction equipment that appear in the photo image data using the image recognition unit 142, and performs voice recognition processing of the voice data received from the voice input unit 212 using the voice recognition unit 143 (step S15 in Figure 17), and the construction photo ledger creation unit 140 creates a construction photo ledger that incorporates these results (step S16 in Figure 17). The construction photo ledger creation unit 140 displays the results of embedding and pasting the photo image data on the photography content instruction display unit 220 of the client 200, and has the site supervisor or the person in charge of photography confirm the results (FIG. 17, step S17). Note that the confirmation process may be performed by staff of the construction ordering company or design office who have the authority to operate the cloud server 100.

[0096] The construction photo ledger creation unit 140 stores and records the construction photo ledger data 500 after confirmation processing in the construction photo ledger database 150 (step S18 in FIG. 17). This storage may be performed by overwriting, or may be added to the construction photo ledger database 150 together with date data without overwriting in order to leave a chronological history.

[0097] As described above, by using the construction photo ledger creation support system 1 of the present invention, a blank ledger containing embedded frames of photographic image data is obtained as a construction photo ledger that should be created before construction begins, and at the construction site, simply by taking the photos specified for daily construction work, the photographic image data is embedded in the corresponding embedded frames in the blank ledger, and the construction photo ledger is automatically created. This greatly reduces the burden on the site supervisor and photographer, and further, since the photography points, photography dates and times, and subjects are planned in advance and the site supervisor and photographer accurately confirm the planned contents while taking photos, there is no risk of forgetting to take or missing a photo.

[0098] The above has illustrated and explained a preferred embodiment of the configuration example of the construction photo ledger creation support system of the present invention, but it will be understood that various modifications are possible without departing from the technical scope of the present invention. [Industrial Applicability]

[0099] The construction photo ledger creation support system of the present invention supports the creation of construction photo ledger with the content required by the client, construction ordering company, construction designer, and process manager, and can be widely applied as a construction photo ledger creation support system and construction photo ledger creation support program that automatically generates a construction photo ledger simply by taking specified photos at the construction site. In addition, the construction work to which the construction photo ledger creation support system of the present invention can be applied is not limited to construction work, but can be widely applied to any work in which the process can be planned in advance, such as civil engineering work, road construction, and on-site assembly and installation of large-scale machinery and equipment. [Explanation of symbols]

[0100] 1 Construction photo ledger creation support system 100 Cloud Servers 110 Construction Photo Register Planning and Construction Department 111 Construction data input section 112 Construction Materials Management Department 113 Shooting content specification section 114 Blank Ledger Creation Department 115 Standard Blank Ledger Database 120 Photography Support Department 130 Information Gathering Function Extension Unit 140 Construction Photo Ledger Creation Department 141 Blackboard character recognition unit 142 Image Recognition Unit 143 Voice Recognition Unit 150 Construction Photo Register Database 160 Display processing unit 170 Communication I / F 200 clients 210 Photography Club 220 Shooting content instruction display section 230 Communication I / F

Claims

1. A construction photo ledger creation support system that supports the creation of a construction photo ledger, comprising a blank ledger creation unit that creates a blank ledger in which embedded frames in which predetermined photo image data are embedded are collected in a construction photo ledger by associating frame ID data with photo ID data taken at a construction site, a voice recognition unit that receives voice input data input by a photographing device or a communication device with a voice input function at the construction site and performs voice recognition on the voice input data to acquire voice input information; the voice recognition unit acquires the voice input data input at the construction site, A construction photo ledger creation support system characterized in that, when creating the construction photo ledger, the construction photo ledger creation unit matches the frame ID with the photo ID, pastes the photo image data input from the client terminal into a designated location on the blank ledger, and creates the construction photo ledger that also records the voice input information acquired by the voice recognition unit.

2. The client terminal is provided with a photographing unit having a camera unit, a voice input unit, and a photograph ID data assigning unit, At the construction site, additional information for the photographic image data of the construction site photographed by the camera unit is input by voice via the voice input unit of the client terminal; The construction photo ledger creation support system according to claim 1, characterized in that the photography unit adds the voice-input data to the photographic image data obtained by the photography.

3. The construction photo ledger creation support system described in claim 1 or 2, characterized in that the voice recognition unit performs voice recognition processing using a construction work terminology-trained voice recognition AI system that has been trained to learn terms related to construction work.

4. a construction data input unit that receives input of construction drawing data and schedule data related to the construction work before the start of the construction work; a photography content designation unit that receives input of settings for photography points and objects to be photographed at the construction site based on the construction drawing data by a person in charge of setting the contents of the construction photo ledger, and input of settings for photography dates and times based on the schedule data; and a blank ledger creation unit that creates a blank ledger containing a collection of embedded frames in which predetermined photo image data is embedded in the construction photo ledger according to the input from the photography content designation unit, by associating frame ID data with photo ID data taken at the construction site; The construction photo ledger creation support system described in claim 1 or 2, characterized in that it is equipped with a photography support unit that displays the specified photography date and time, the specified photography point, and instructions for photographing the object to be photographed on the display unit of the photography device or communication device with photography function carried by the person in charge of photography during the construction work, thereby supporting the photography.

5. An information collection function expansion unit is provided for collecting various information including weather information, earthquake information, event information, logistics information, and payment information around the construction site that may be required, in addition to the photo image data that is directly required for creating the construction photo ledger and collected at the construction site, A construction photo ledger creation support system as described in claim 1 or 2, wherein the construction photo ledger creation unit creates the construction photo ledger using the various information obtained from the information collection function expansion unit when creating the construction photo ledger.

6. The construction photo ledger creation unit is provided in a cloud system on a computer network, The construction photo ledger creation support system described in claim 1 or 2, characterized in that the construction photo ledger creation unit is equipped with a communication function for receiving the photo image data and the voice input data by uploading them to the cloud system via the computer network.

7. a construction data input unit that receives input of construction drawing data and schedule data related to the construction work before the start of the construction work; a photography content designation unit that receives input of setting of photography points and photographed objects at the construction site based on the construction drawing data by a person in charge of setting the contents of the construction photo ledger, and input of setting of photography date and time based on the schedule data; and a construction photo ledger plan creation unit that includes a blank ledger creation unit that creates a blank ledger containing a collection of embedded frames in which predetermined photo image data is embedded in the construction photo ledger according to the input from the photography content designation unit. a photography support unit that displays the predetermined photography date and time, the predetermined photography point, and instructions for taking a photograph of the object to be photographed on a display unit of a photography device or a communication device with a photography function carried by a person in charge of photography during the construction work, thereby supporting the person in charge of photography; The construction photo ledger creation support system described in claim 6, characterized in that the construction photo ledger creation unit embeds the photo image data in the corresponding embedded frame in the blank ledger and creates the construction photo ledger that also records information obtained from the photo image data.

8. Each embedded frame of the blank ledger created by the blank ledger creation unit of the construction photo ledger plan creation unit is provided with unique frame ID data, the photography support unit assigns unique photo ID data to the photography date and time information, the photography point, and the photography subject; The photo ID data is linked to each of the photo image data taken with the support of the photo taking support unit, The construction photo ledger creation unit holds correspondence data between the frame ID data and the photo ID data corresponding to the frame ID data, The construction photo ledger creation support system described in claim 7, characterized in that the construction photo ledger creation unit receives the uploaded photo image data and embeds it in the embedded frame in the blank ledger that has the corresponding frame ID data based on the photo ID data.

9. The blank ledger creation unit includes a standard blank ledger database that stores blank ledgers of the construction photo ledger related to a plurality of standardized construction works, and a standard blank ledger selection unit that allows an authorized person or the setting person to select an appropriate standard blank ledger from the standard blank ledger database, The construction photo ledger creation support system described in claim 8, characterized in that the setting officer performs the necessary tuning on the standard blank ledger related to the selection through the blank ledger creation unit based on the construction drawing data and the schedule data related to the specific construction work, and creates the blank ledger related to the specific construction work.

10. On the computer, a blank ledger creation processing step for creating a blank ledger in which embedded frames in which predetermined photographic image data are embedded are collected in a construction photo ledger by associating frame ID data assigned to each embedded frame with photo ID data assigned to photographic data to be taken at the construction site; a voice recognition processing step of receiving voice input data inputted at the construction site by a photographing device or a communication device with a voice input function, and performing voice recognition on the voice input data to acquire voice input information; In the voice recognition processing step, the voice input data input at the construction site is acquired, A construction photo ledger creation support program characterized by including a construction photo ledger creation processing step that, when creating the construction photo ledger, matches the frame ID with the photo ID, pastes the input photo image data into a designated location on the blank ledger, and creates the construction photo ledger that also records the voice input information acquired by a voice recognition unit.

11. The construction photo ledger creation support program of claim 10, wherein the blank ledger creation processing step executes the creation and processing of the blank ledger through a construction photo ledger plan construction processing step, which includes a construction data input step for receiving input of construction drawing data and schedule data related to the construction work before the start of the construction work, a setting input step for setting the shooting points and objects to be photographed at the construction site based on the construction drawing data by a person in charge of setting the contents of the construction photo ledger, a shooting content designation step for receiving input of the shooting date and time based on the schedule data, and a blank ledger creation step for creating a blank ledger consisting of a collection of embedded frames in which specified photo image data is embedded in the construction photo ledger in accordance with the input in the shooting content designation step.

12. a photography support processing step of displaying the predetermined photography date and time, the predetermined photography point, and instructions for taking a photograph of the object to be photographed on a display unit of a photography device or a communication device with a photography function carried by a person in charge of photography during the construction work, thereby supporting the person in charge of photography; In the blank ledger creation processing step, unique photo ID data is assigned to the photographing date and time information, the photographing point, and the photographed object as the photo ID data, The photo ID data is linked to each of the photo image data taken with assistance in the photo photography assistance processing step, In the construction photo ledger creation processing step, correspondence data between the frame ID data and the voice input ID data corresponding to the frame ID data is stored, The construction photo ledger creation support program described in claim 11, characterized in that in the construction photo ledger creation processing step, the uploaded voice input data is received and the voice input data is embedded in the embedded frame in the blank ledger that has the corresponding frame ID correspondence data based on the correspondence data.

Images