Construction recording photograph management device

Abstract

To provide a construction recording photograph management device capable of accurately determining the dimension of a measurement location from a construction recording photograph.SOLUTION: A construction recording photograph management device comprises: image acquisition means for acquiring a construction recording image photographed including a leveling rod, a location to be measured indicative of a finished shape of construction, and a reading position instruction which instructs a dimension for identifying the finished shape by applying the leveling rod to the location to be measured; leveling rod identification means for identifying a leveling rod included in the construction recording image; dimension information extraction means for extracting dimension display information from characters constituting a dimension display indicated in the identified leveling rod or a graphic; reading position extraction means for extracting a reading position instruction included in the construction recording image; dimension determination means for determining dimension display information corresponding to a dimension position and outputting the dimension information on the basis of the information extracted by the dimension information extraction means and the dimension information extraction means; and image output means for outputting the dimension information, superimposing it on the construction recording image as image information.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a construction record photo management device. [Background technology]

[0002] As one of the construction management items for construction work, it is common to read and record the dimensions of the completed work from images of the construction site and images of the construction method. In particular, "construction record photos" for inspecting whether the completed work is as designed are obtained as images including measurements of the width, length, depth, etc. of the construction site, as evidence that the work was carried out as designed.

[0003] When taking photographs for construction records, a staff is often used. It is a long, plate-like member that generally has numbers or figures indicating the length on its surface.

[0004] When taking a construction recorder's photograph including a staff, a sliding marker is attached to the staff to make it easier to read the dimensions that indicate the completed state of the construction. For the purpose of improving the accuracy of reading dimensions from a construction record image in which a staff with a marker is photographed, a technique is also known in which an image including a staff with a marker, photographed from an oblique angle, is corrected to improve the accuracy of reading dimensions (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2022-135715 A Summary of the Invention [Problem to be solved by the invention]

[0006] Generally, construction record photographs are not taken using a staff with a marker, such as the one disclosed in Patent Document 1. Instead, construction record photographs are often taken using a staff without a marker, with lines superimposed that are perpendicular to the longitudinal direction of the staff.

[0007] That is, in general construction record photography, for example, when recording the excavation width and excavation depth in civil engineering work, a rope is stretched over the measurement target location, and a staff is placed against the rope to serve as a marker for reading the dimensions of the measurement target location, which is then read manually. However, due to the resolution of the photo, the brightness at the time of shooting, the contrast with the surroundings, the angle of view, etc., it is difficult to accurately read the length of the part where the rope overlaps the staff.

[0008] The present invention has been made in consideration of the above problems, and has an object to provide a construction record photo management device that can accurately determine the dimensions of measurement points from construction record photos. [Means for solving the problem]

[0009] In order to solve the above problems, the present invention relates to a construction record photo management device, and is characterized by comprising: an image acquisition means for acquiring a construction record image including a staff which is a long, plate-like member having a dimensional indication on its surface indicating the longitudinal dimension, a measurement target location capable of indicating the completed state of the construction, and a reading position indication indicating the reading position of dimensional information indicating the dimensions related to the completed state by applying the staff to the measurement target location; a staff identification means for identifying the staff included in the construction record image; a dimensional information extraction means for extracting dimensional indication information from characters or figures constituting the dimensional indication shown on the identified staff; a reading position extraction means for extracting the reading position indication included in the construction record image; a dimensional value determination means for determining a value related to the dimensional information based on the dimensional information extraction means and the reading position indication; and an image output means for superimposing the value related to the dimensional information on the construction record image as image information and outputting it. Effect of the Invention

[0010] According to the present invention, the dimensions of measurement points can be determined with high accuracy from construction record photographs. [Brief description of the drawings]

[0011] [Figure 1] 1 is a system configuration diagram of a construction record photo management device according to the present invention. [Diagram 2] 1 is a hardware configuration diagram showing an embodiment of a construction record photo management device according to the present invention; [Diagram 3] 1 is a hardware configuration diagram of an image processing device and an information processing device used in an embodiment of a construction record photo management device according to the present invention; [Figure 4] 4A and 4B are diagrams showing examples of scales included in construction images to be processed in the construction record photo management device. [Diagram 5] FIG. 4 is a diagram showing an example of a construction image according to the embodiment. [Figure 6] 5A to 5C are diagrams showing examples of output images according to the embodiment. [Figure 7] 1 is a diagram showing an example of functional blocks included in a construction record photo management device according to an embodiment of the present invention; [Figure 8] 4 is a flowchart illustrating the flow of an image analysis process executed by the construction record photo management device according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [Summary of the embodiment of the present invention] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of a construction record photo management device according to the present invention will be described with reference to the drawings. Fig. 1 is a system configuration diagram showing an example of a construction record photo management device that utilizes cloud computing.

[0013] The image generation output device 10 as a construction record photo management device is composed of a group of devices that realize a predetermined function by software technology executed using the hardware resources of a computer located on the Internet, for example. The image generation output device 10, which will be described in detail later, is a device that acquires an image of the completed state of a construction site input from the image processing device 20, analyzes the image, generates an additional image to which various information as the analysis result of the image is added, and outputs the image. The additional image output by the image generation output device 10 is transmitted to the image processing device 20 via the communication network 40, for example, and is stored in the storage device 102 described later, so that it can be safely used as a construction record image.

[0014] In the following description, an image processing device 20 serving as a multi-function portable information terminal, such as a smartphone, is exemplified as hardware for realizing the image input function to the image generation and output device 10. Also exemplified is a configuration in which an imaging device 31 is combined with an information processing device 30, such as a personal computer. However, the hardware resources responsible for inputting and outputting information to and from the image generation and output device 10 according to this embodiment are not limited to these. Any form is acceptable as long as it is capable of realizing the information processing functions described below.

[0015] [Example of hardware configuration of image generation / output device 10] 2 is a diagram showing an example of the hardware configuration of an information processing device that constitutes the image generation and output device 10 that utilizes cloud computing technology. For example, the image generation and output device 10 has the following hardware resources.

[0016] 2, the image generation and output device 10 includes a calculation device 101 including a central processing unit (CPU), and a storage device 102 including a random access memory (RAM), a read only memory (ROM), and a solid state drive (SSD).

[0017] The image generation and output device 10 also has an input device 103 that has the function of inputting image data received via the communication network 40 to the arithmetic device 101, and an output device 104 that has the function of outputting an additional image based on the image data resulting from processing in the arithmetic device 101.

[0018] Furthermore, the image generation and output device 10 has an interface (hereinafter, referred to as "I / F 105") and the like. The I / F 105 is connected to a communication module 11. The communication module 11 has a function of connecting the communication network 40 to the image generation and output device 10 so that they can communicate with each other.

[0019] 2, the image generation and output device 10 is depicted as a hardware resource contained in a single housing, but the present invention is not limited to this. For example, the image generation and output device 10 according to the present embodiment may be configured to realize the same hardware resource as described above by combining a plurality of information processing devices.

[0020] Furthermore, the image generation / output device 10 may further include an auxiliary device in addition to the arithmetic device 101, the storage device 102, the input device 103, and the output device 104. Specifically, the image generation / output device 10 may include an external or internal auxiliary device such as a GPU (Graphics Processing Unit).

[0021] [Example of hardware configuration of image processing device 20] FIG. 3(a) is a diagram showing an example of the hardware configuration of an image processing device 20 for inputting a construction image to the image generation and output device 10. As shown in FIG.

[0022] 3(a), the image processing device 20 has the same hardware resources as the image generation and output device 10. That is, the image processing device 20 has a CPU 201 as a calculation processing unit, a ROM 202 as a non-volatile storage unit, a RAM 203 as a volatile storage unit, an SSD 204 for storing and saving input information, etc. Also, the image processing device 20 has an I / F 205 as an external interface, and the I / F 205 has a camera 21, a monitor 22, and a communication module 23.

[0023] The image processing device 20 may be, for example, a device equipped with a photographing function for photographing construction images, a communication function for transmitting the construction images to the image generation and output device 10 via the communication network 40 and receiving dimensional images output from the image generation and output device 10, and a display function for displaying the construction images and dimensional images. For example, the image processing device 20 is realized by a multi-function mobile terminal (so-called a smartphone) or the like.

[0024] [Hardware configuration example of information processing device 30] FIG. 3(b) is a diagram showing an example of the hardware configuration of an information processing device 30 for inputting, viewing, checking, etc., construction images in the image generation and output device 10. As shown in FIG.

[0025] The information processing device 30 is a device that reads construction images captured using an imaging device 31 such as a digital camera, transmits the construction images to the image generation and output device 10 via a communication network 40, and also receives dimensional images output from the image generation and output device 10, and has the function of displaying the construction images and dimensional images.

[0026] As shown in FIG. 3B, the hardware configuration example of the information processing device 30 has much in common with the hardware resources already described, so only those unique to the information processing device 30 will be described.

[0027] The I / F 305 has an image reading module 32 that reads the construction image from the imaging device 31, and a communication module 33 that transmits the construction image to the image generation and output device 10.

[0028] [Form for generating construction record image for use with image generation output device 10] Before explaining the analysis processing by the image generation and output device 10, an example of a scale 51 is shown in Figure 4 as an object included in an image (hereinafter simply referred to as a "construction image 50") that is used to photograph the completed state of a construction site and to utilize it as a construction record image, which corresponds to the input data input from the image processing device 20.

[0029] As shown in Fig. 4, the staff 51 is a long plate-like member, and dimensional markings 501 showing dimensions are displayed by figures and letters on the longitudinal surface. The staff 51 is a scale used to indicate the length of the completed work at a construction site where a construction record image is required. The staff 51 is also a member that, when placed at the construction site, makes it possible to visually confirm the dimensional values ​​corresponding to the points to be measured in order to check the completed work.

[0030] [Construction image 50] Next, an example of a construction image 50 corresponding to the input data will be described with reference to Fig. 5. Fig. 5 shows an example of a construction site of a building construction work, in which a staff 51 and a rope 52 are used to measure the depth in an excavation work. Conventionally, such a construction image 50 is acquired, and an inspector visually checks the completed state of the part to be measured while referring to the staff 51.

[0031] The construction image 50 shown in FIG. 5 includes a staff 51, a state of the construction site to show the completed state of the construction, and a state of applying the staff 51 to a measurement target location at the construction site. The construction image 50 also includes a rope 52 as an example of a read position instruction indicating a read position for reading dimensional information indicating the dimensions related to the completed state with respect to the staff 51. Note that, as in the example of FIG. 5, if the dimensions related to the completed state of the construction site are the depth of the construction site, the read position instruction corresponds to a line segment extending in the horizontal direction since the longitudinal direction of the staff 51 is vertical. The intersection of this read position instruction (rope 52) and the staff 51, i.e., the position where the rope 52 crosses the staff 51, corresponds to a measurement position required to inspect whether the construction at the site has been carried out as designed.

[0032] Therefore, the rope 52 as the reading position indication is a line segment element extending in a direction perpendicular to the longitudinal direction of the staff 51, and is included in the construction image 50 in a form that crosses a specific position of the dimension display 501 of the staff 51. The reading position indication is not limited to a form such as the rope 52, but may be anything that can exert an effect similar to that of the rope 52 when included in the construction image 50. For example, it may be a rod-shaped member or the finger of a worker on-site.

[0033] As described above, the construction image 50 includes a scale 51 and a reading position indication (e.g., rope 52), and serves as input data for analyzing dimensional information as the completed state by applying the scale 51 and rope 52 to measurement target locations that indicate the completed state of the construction work.

[0034] [Additional image] Next, an example of an output image 60 as an additional image that is output by analyzing a construction image 50 using the image generating and outputting device 10 will be described with reference to FIG. 6(a) is an example of an output image 60 that is output by analyzing a construction image 50 that illustrates an example of measuring the depth of a construction site with the longitudinal direction of a staff 51 being vertical. FIG. 6(b) is an example of an output image 60 that is output by analyzing a construction image 50 that illustrates an example of measuring the width (length) of a construction site with the longitudinal direction of a staff 51 being horizontal. FIG. 6(b) is an example in which a rod 521 made of a rod-shaped member is used as a reading position indication, instead of a rope 52. Note that FIG. 6(b) omits the illustration of some information included in the output image 60. Therefore, details of the output image 60 will be described with reference to FIG. 6(a).

[0035] In FIG. 6( a ), the output image 60 includes the staff 51 and rope 52 that were included in the construction image 50 , and further includes a staff position display 63 that indicates the position where the staff 51 exists in the construction image 50 .

[0036] The staff position display 63 corresponds to a rectangular image that displays the analysis results so as to show the staff 51 included in the construction image 50 in a tilted state due to the angle of view in a straight-on state.

[0037] The output image 60 also includes dimensional display information 61 obtained by analyzing the dimensional display (characters, figures, or both) displayed on the surface of the staff 51 included in the construction image 50. The dimensional display information 61 is information generated as a result of performing character recognition processing and figure recognition processing using OCR (Optical Character Recognition) on the dimensional display by image analysis processing executed in the image generation and output device 10. In other words, the dimensional display information 61 corresponds to information for indicating the dimensions of the completed form of the construction site along the longitudinal and vertical directions of the staff 51.

[0038] In addition, when the scale 51 is positioned horizontally as shown in Figure 6 (b), although not shown, in the output image 60, the dimension display information 61 is included as information for indicating the dimensions of the finished shape of the construction site, aligned in the longitudinal and horizontal directions of the scale 51.

[0039] The output image 60 also includes dimensional information 62 for analyzing the position of the rope 52 included in the construction image 50 in the dimensioned staff image including the dimension display information 61, and displaying, as the analysis result, a specific numerical value of the dimension display information 61 which corresponds to the dimensional position as the position where the rope 52 crosses the staff 51.

[0040] In the case of the output image 60 illustrated in Fig. 6(a), it is shown that the dimension (depth) of the excavation to be measured as the completed form is 650 mm. That is, the value related to the dimension information 62 is "650 mm" in the example of Fig. 6(a). Therefore, the dimension information 62 included in the output image 60 is also displayed in a manner in which the excavation dimension can be identified as a specific numerical value.

[0041] The output image 60 is output with the dimension display information 61, dimension information 62, and staff position display 63 superimposed as images on the construction image 50. The output image 60 can also include an "electronic small blackboard image 64" for displaying the construction project name and the like required for the construction record image. When the electronic small blackboard image 64 is included, information equivalent to the dimension information 62 can also be superimposed inside the electronic small blackboard image 64.

[0042] The output image 60 is output from the image generating / outputting device 10 in a predetermined image format, and is recorded and transmitted. Therefore, it is difficult to falsify the dimensional information 62 included in the output image 60. As a result, it is possible to accurately extract dimensions from the completed form using photographed images of the construction site, which are also important as evidence showing the completed form in construction completion documents, and to automatically record the dimensional information in a state that makes it difficult to falsify.

[0043] [Functional blocks of image generation and output device 10] Next, functional blocks of the image generation and output device 10 capable of executing image analysis processing with the construction image 50 as input data and the output image 60 as output data as described above will be described with reference to Fig. 7. The image generation and output module 100 shown in Fig. 7 is realized by executing a predetermined image analysis program, an image generation program, and an image output program using the hardware resources (see Fig. 2) of the image generation and output device 10.

[0044] The image generation and output module 100 includes, for example, an image acquisition unit 110, a staff identification unit 120, a dimensional information extraction unit 130, a reading position extraction unit 140, a dimensional value determination unit 150, and an image output unit 160.

[0045] The image acquisition unit 110, which serves as an image acquisition means, is a module that receives the construction image 50 captured by the image processing device 20 as input data and makes the image analysis process described below executable. For example, the image acquisition unit 110 may determine whether the construction image 50 is an image from which dimensional information 62 can be derived, and when the image is not valid, may output a display to notify the user via the monitor 22. Note that the determination of whether the construction image 50 is valid as an analysis target may be made using a machine learning model.

[0046] The staff identification unit 120, which serves as a staff identification means, executes a process of identifying the staff 51 included in the construction image 50 acquired by the image acquisition unit 110. The staff identification unit 120 identifies the staff position indication 63 included in the output image 60. Note that the analysis target for identifying the staff 51 in the construction image 50 may be performed using a trained model that has been trained in advance using a machine learning process using a plurality of construction images 50.

[0047] The dimension information extraction unit 130, which serves as a dimension information extraction means, converts characters and figures constituting the display of the dimensions shown on the identified staff 51 into digital data by OCR, and generates dimension display information 61 to be included in the output image 60. The dimension display information 61 is generated in a state in which the inclination of the staff 51 identified by the staff identification unit 120 is corrected, and the distance from the origin for measuring the dimensions of the completed form is accurately indicated. The process of correcting the inclination of the staff 51 and correcting the dimension display information 61 in accordance with the amount of correction may be performed by using a learned model that has been trained in advance using a machine learning process using a plurality of construction images 50.

[0048] The reading position extraction unit 140, which serves as a reading position extraction means, executes a process of identifying the rope 52 included in the construction image 50. The rope 52 is identified as a line segment in a direction transverse to the longitudinal direction of the staff 51 (a direction perpendicular to the staff 51). The analysis process for identifying the reading position may be performed using a trained model that has been trained in advance using a machine learning process using a plurality of construction images 50.

[0049] The dimension value determination unit 150, which serves as a dimension value determination means, executes a process of determining a specific number in the dimension display information 61 generated by the dimension information extraction unit 130, which is the position of the rope 52 in the construction image 50, identified by the reading position extraction unit 140. The numerical value identified here corresponds to the dimension of the measurement target portion of the completed construction form to be recorded using the output image 60. The analysis process for determining the dimension corresponding to the measurement target portion may be performed using a trained model that has been trained in advance using a machine learning process using multiple construction images 50.

[0050] The image output unit 160 as an image output means outputs an output image 60 as image information including dimension display information 61, dimension information 62, and staff position display 63 for the construction image 50.

[0051] [Embodiment of image generation and output processing] Next, the flow of the image generation and output process executed in the image generation and output device 10 will be described with reference to the flowchart in Fig. 8. First, a construction image 50 is input from the image processing device 20, and the image acquisition unit 110 judges whether or not the image is capable of deriving dimensional information 62. If the image is not valid, a display is output via the monitor 22 to inform the user (S801).

[0052] Next, the staff identification unit 120 identifies the staff 51 included in the input construction image 50 (S802). In step S802, a staff position display 63 to be superimposed on the output image 60 is generated.

[0053] Next, the dimension information extraction unit 130 performs OCR processing on the characters and figures constituting the display of the dimensions shown on the identified staff 51. The OCR processing generates dimension display information 61 attached to the staff 51 (S803). The dimension information extraction unit 130 also corrects the inclination of the staff 51 identified in step 802, and generates the dimension display information 61 in a state in which the distance from the origin for measuring the dimensions of the finished form is accurately accounted for.

[0054] Next, a dimensional support extraction process is executed to identify the rope 52 included in the construction image 50 (S804). When the rope 52 is identified in step S804, the position where the rope 52 crosses the staff 51 is also identified. The position where the rope 52 crosses the staff 51 is identified by extracting the position of overlap (position where they are superimposed) between the identified rope and staff 51. That is, in step S804, a process is executed to identify a "portion equivalent to a line segment" represented by the rope 52 included in the construction image 50, and to identify the position where this line segment crosses the staff 51.

[0055] The order of the processes S802 and S804 may be interchanged. That is, the process of identifying the rope 52 may be executed first (S804), and then the process of identifying the staff 51 may be executed (S802). The process of generating the dimension display information 61 by OCR processing (S803) may be executed after the process of identifying the staff 51 (S802), and the process of S804 may be executed between S802 and S803.

[0056] Next, the dimension display information 61 generated in S803, which corresponds to the position where the rope 52 as a line segment crosses the staff 51 (overlaps with the staff 51), is determined, and the dimension information 62 at the position where the rope 52 overlaps is output (S805). The numerical value output as the dimension information 62 is information corresponding to the dimension of the measurement target point of the completed form of the construction to be recorded using the output image 60.

[0057] Next, the image output unit 160 generates and outputs an output image 60 including the dimension display information 61, the dimension information 62, and the staff position display 63 for the construction image 50 (S806). The output image 60 output in step S806 is as shown in FIG.

[0058] As described above, according to the image generation and output device 10 of this embodiment, the output image 60 can be generated from the construction image 50. The generated output image 60 can also be recorded separately for each construction in the storage device 102 provided in the image generation and output device 10. In this case, the construction record photographs can be managed as information for creating documents to be used in completion documents for each corresponding construction.

[0059] Furthermore, the output image 60 output by the image generation output device 10 can accurately show the information required to record the completed state. Therefore, even when an inspector visually checks the construction content, the information shown in the output image 60 can be referred to, thereby reducing the amount of work required to achieve accurate construction management.

[0060] The present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the technical gist of the present invention. The present invention covers all technical matters included in the technical ideas described in the claims. The above-described embodiments are preferred examples, but a person skilled in the art can realize various modifications from the disclosed contents. Such modifications are also included in the technical scope described in the claims. [Explanation of symbols]

[0061] 10: Image generation and output device 20: Image processing device 50: Construction images 51: Leveling rod 52: Rope 60: Output image 61: Dimension display information 62:Dimension information 63: Leveling rod position display 64: Electronic small blackboard image 100: Image generation output module 110: Image acquisition unit 120: Leveling rod identification section 130: Dimension information extraction section 140: Reading position extraction unit 150: Dimension value judgment section 160: Image output unit

Claims

1. an image acquisition means for acquiring a construction record image including a long plate-like member having a staff having a dimension indication on its surface indicating a longitudinal dimension, a measurement target portion capable of indicating a completed construction state, and a reading position indication indicating a position for reading dimensional information indicating a dimension related to the completed state by applying the staff to the measurement target portion; A staff identification means for identifying a staff included in the construction record image; A dimension information extraction means for extracting dimension display information from characters or figures constituting the dimension display shown on the identified staff; A reading position extraction means for extracting the reading position instruction included in the construction record image; a dimension value determining means for determining a value related to the dimension information based on the dimension information extracting means and the reading position instruction; an image output means for outputting a value related to the dimensional information as image information superimposed on the construction record image; A construction record photo management device comprising:

2. the reading position instruction corresponds to a line segment extending in a direction perpendicular to a longitudinal direction of the staff, The dimension value determination means determines a position where the line segments overlap, the position corresponding to the dimension indication.

2. A construction record photo management device according to claim 1.

3. The image output means outputs a staff image with dimensions in which the dimensional display information extracted by the dimensional information extraction means is arranged along the staff, and a value related to the dimensional information, superimposed on the construction record image.

3. A construction record photo management device according to claim 1 or 2.

4. The image output means includes: An image in which the value related to the dimensional information is superimposed on the electronic small blackboard image corresponding to the measurement target portion is also output.

2. A construction record photo management device according to claim 1.

Images