Image measurement device, image measurement method, and image measurement program
The image measurement device integrates data from multiple sides of column reinforcement by matching corner reinforcing bars, addressing alignment challenges and enhancing measurement accuracy by preventing double counting and ensuring complete data integration.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-02-28
- Publication Date
- 2026-03-11
AI Technical Summary
Existing image measurement systems for column reinforcement face challenges in accurately associating and correlating measurements from multiple sides, leading to potential double counting and missed measurements due to the complexity of aligning and integrating data from different angles.
An image measurement device that integrates data from multiple sides of column reinforcement by identifying and matching corner reinforcing bars across images, allowing for accurate correlation and output of combined measurement results.
The device effectively identifies the surface on which column reinforcement is arranged, preventing double counting and ensuring complete data integration, thereby reducing human error and improving measurement accuracy.
Smart Images

Figure 0007828193000001 
Figure 0007828193000002 
Figure 0007828193000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an image measurement device, an image measurement method, and an image measurement program for measuring column reinforcement by image processing. [Background technology]
[0002] Currently, technology is being developed to measure rebar diameter, spacing, etc. by analyzing photographed images of rebar arrangement. In addition, development is also underway on user support technology for photographing and measuring rebar arrangement, and technology to improve measurement accuracy.
[0003] For example, the notification device in Patent Document 1 acquires stereo images of reinforcing bars, generates three-dimensional point cloud coordinates based on the acquired stereo images, and identifies a plane formed by the reinforcing bars that make up the reinforcing bars based on the generated three-dimensional point cloud coordinates. Next, if the notification device determines that reinforcing bars cannot be measured when generating the three-dimensional point cloud coordinates or when identifying the plane, it notifies the device of this fact. If the notification device cannot generate three-dimensional point cloud coordinates or if the inclination angle of the identified plane or the distance to the plane does not satisfy a predetermined condition, it determines that reinforcing bars cannot be measured. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-173275 Summary of the Invention [Problem to be solved by the invention]
[0005] However, when measuring column reinforcement, images are taken of at least four sides, not just one. After measuring the column reinforcement, it is necessary to check not only whether the measurement results for each side are properly associated, but also to correlate the measurement results with each other, ensure that no rebars are counted twice, and that no measurements have been missed. Therefore, simply measuring each image appropriately places a heavy workload on the person taking the measurements, which can lead to human error. For example, there is the problem that even when looking at an image of column reinforcement, it is not possible to tell which rebar plane was photographed.
[0006] In view of the above-mentioned problems, one aspect of the present invention aims to prevent double counting of rebars and missed measurements by making it possible to identify the surface on which the photographed column reinforcement is placed. [Means for solving the problem]
[0007] In order to solve the above problems, an image measuring device according to one embodiment of the present invention is an image measuring device that measures column reinforcement using an image of the column reinforcement, and includes: an acquisition unit that acquires a first image that is an image of a first side of the column reinforcement and a second image that is an image of a second side of the column reinforcement adjacent to the first side; a selection unit that selects a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first side from the first image and selects a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second side and corresponds to the first corner reinforcing bar from the second image; an integration unit that uses the first corner reinforcing bar and the second corner reinforcing bar to integrate data regarding each reinforcing bar on the first side, including first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data regarding each reinforcing bar on the second side, including the location of the second corner reinforcing bar; and an output unit that outputs data obtained by integrating the first reinforcing bar data and the second reinforcing bar data.
[0008] In addition, in order to solve the above-mentioned problems, an image measuring device according to one embodiment of the present invention is an image measuring device that measures column reinforcement using an image of the column reinforcement, and is equipped with an acquisition unit that acquires a first image that is an image of a first side of the column reinforcement and a second image that is an image of a second side of the column reinforcement adjacent to the first side, a selection unit that selects a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first side from the first image and selects a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second side from the second image and corresponds to the first corner reinforcing bar, and an output unit that outputs data regarding each reinforcing bar on the first side, first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data that is data regarding each reinforcing bar on the second side, indicating the location of the second corner reinforcing bar.
[0009] In addition, in order to solve the above-mentioned problems, an image measurement method according to one embodiment of the present invention is an image measurement method for measuring column reinforcement using an image of the column reinforcement, and includes: an acquisition step of acquiring a first image which is an image of a first side of the column reinforcement and a second image which is an image of a second side of the column reinforcement adjacent to the first side; a selection step of selecting a first corner reinforcing bar which is a corner reinforcing bar to be placed on the first side from the first image and selecting a second corner reinforcing bar which is a corner reinforcing bar to be placed on the second side and corresponds to the first corner reinforcing bar from the second image; an integration step of integrating, using the first corner reinforcing bar and the second corner reinforcing bar, data regarding each reinforcing bar on the first side, first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data regarding each reinforcing bar on the second side, which indicates the location of the second corner reinforcing bar; and an output step of outputting data obtained by integrating the first reinforcing bar data and the second reinforcing bar data. [Effects of the Invention]
[0010] According to one aspect of the present invention, it is possible to identify the surface on which the photographed column reinforcement is arranged. [Brief explanation of the drawings]
[0011] [Figure 1]1 is a block diagram showing a configuration of an image measurement device according to a first embodiment of the present invention. [Figure 2] FIG. 1 is a perspective view showing a column reinforcement structure according to a first embodiment of the present invention. [Figure 3] FIG. 2 is a diagram showing an image of a first surface of the column reinforcement according to the first embodiment of the present invention. [Figure 4] FIG. 10 is a diagram showing an image summarizing the measurement results of the first surface of the column reinforcement according to the first embodiment of the present invention. [Figure 5] FIG. 2 is a diagram showing an image of the second surface of the column reinforcement according to the first embodiment of the present invention. [Figure 6] FIG. 10 is a diagram showing an image summarizing the measurement results of the second surface of the column reinforcement according to the first embodiment of the present invention. [Figure 7] FIG. 1 is a diagram showing an example of a screen for setting corner reinforcing bars according to the first embodiment of the present invention. [Figure 8] FIG. 10 is a diagram showing an example of output of measurement results that integrate the judgment results of reinforcing bar standards according to the first embodiment of the present invention. [Figure 9] FIG. 10 is a diagram showing an example of output of measurement results that integrate the judgment results of reinforcing bar standards according to the first embodiment of the present invention. [Figure 10] FIG. 10 is a diagram showing an example of an output result obtained by integrating images of measurement results according to the first embodiment of the present invention. [Figure 11] 10 is a flowchart showing a process for integrating and outputting the measurement results of the first surface and the measurement results of the second surface according to the first embodiment of the present invention. [Figure 12] FIG. 10 is a diagram showing an example of a screen for setting the number of photographed surfaces and the photographing order of column reinforcement according to the second embodiment of the present invention. [Figure 13] FIG. 10 is a diagram showing an example of a screen prompting the user to photograph the next side according to the second embodiment of the present invention. [Figure 14] FIG. 10 is a diagram showing an example of a screen for setting corner reinforcing bars according to the second embodiment of the present invention. [Figure 15] FIG. 10 is a diagram showing an example of a screen for setting corner reinforcing bars according to the second embodiment of the present invention. [Figure 16] 10 is an example of a top view of column reinforcement according to a second embodiment of the present invention. [Figure 17] 10 is an example of a top view of column reinforcement according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described in detail with reference to the drawings.
[0013] [Embodiment 1] Fig. 1 is a block diagram showing the configuration of an image measurement device 100 according to a first embodiment of the present invention. The image measurement device 100 measures column reinforcement using an image of the column reinforcement. As shown in Fig. 1, the image measurement device 100 includes, as hardware, an imaging unit 101, an imaging unit 102, an image processing unit 103, a display unit 104, an input unit 105, and a storage unit 106.
[0014] The imaging units 101 and 102 are configured with solid-state imaging elements such as CCD (Charge Coupled Device) and CMOS (Complementary Metal Oxide Semiconductor) sensors, lenses, etc., and capture images under set shooting conditions such as exposure and focus position.
[0015] The image processing unit 103 performs image processing to measure the distance between a point and a plane, etc. The image processing unit 103 can be realized by software processing using a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or by hardware processing using an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0016] The display unit 104 is a display for displaying images acquired by the imaging units 101 and 102, measurement results of the distance between a point and a plane, etc. The display unit 104 is configured by a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display.
[0017] The input unit 105 is configured with a mouse, the touch panel of the display unit 104, etc. The storage unit 106 includes a storage medium such as a flash memory or a magnetic disk, and stores captured images, measurement results, etc.
[0018] The image processing unit 103 calculates the parallax from the images captured by the imaging units 101 and 102, and calculates three-dimensional information of the object in the image. The parallax is the amount of displacement of the object between two images, and is calculated using block matching or the like. In block matching, a reference window is set at a pixel of interest in a reference image, and reference windows are sequentially set in the reference image, and the similarity or difference between the pixels in the reference window and the reference window is evaluated. For the evaluation, SAD (Sum of Absolute Difference), SSD (Sum of Squared Difference), or the like is used.
[0019] The relationship between the distance Z to the photographed subject and the parallax D is expressed by D = f × B / Z, where f is the focal length of the image capturing units 101 and 102, and B is the distance between the two image capturing units. Furthermore, the three-dimensional coordinates (X, Y, Z) of the subject at the distance Z at the coordinates (x, y) on the image can be calculated by X = x × Z / f and Y = y × Z / f.
[0020] Here, with regard to the image measurement device 100 according to this embodiment, a method for calculating parallax from images acquired by the two imaging units 101 and 102 when acquiring three-dimensional information (depth information) will be described. Note that other methods may also be used; for example, parallax may be calculated from three or more imaging units, or depth information may be acquired by TOF (Time Of Flight).
[0021] The column reinforcement in this embodiment refers to reinforcement arranged in the shape of a square column. Measurements of column reinforcement include the number of rebars, their diameter, and spacing. Regarding the number of rebars, the number of main rebars, the number of tie bars, and the total number that make up the column reinforcement are measured. Main rebars are rebars that extend vertically and refer to thick rebars found in concrete such as columns. Tie bars are rebars that extend horizontally and refer to thin rebars used in columns and surround the main rebars.
[0022] Regarding the rebar diameter, there are cases where only the rebar diameter is output, and cases where the rebar standard of the measured rebar is determined by comparing the measured rebar diameter with the nominal diameter, node height, etc., and the name of the rebar standard is output. Regarding the rebar spacing, there are cases where the distance between the rebar position lines indicating the center positions of the rebars is measured, and cases where the distance between the surfaces of opposing rebars is measured as the space between the rebars.
[0023] FIG. 2 is a perspective view showing the structure of the column reinforcement 200 according to this embodiment. FIG. 2 also shows the state in which the first face F1 of the column reinforcement 200 is being photographed using the image measurement device 100. As shown in FIG. 2, the column reinforcement 200 is composed of four faces: the first face F1, the second face F2, the third face F3, and the fourth face F4. Here, the term "face" refers not to the physical surface of the rebar itself, but to the faces of the rebars arranged on the same plane. For example, the second face F2 is adjacent to the right of the first face F1. The fourth face F4 is adjacent to the left of the first face F1. The image measurement device 100 acquires images of each face of the column reinforcement 200, determines the rebar standard of the column reinforcement 200 from the images, and outputs the determination result. Here, "adjacent" does not necessarily mean that the two faces are in contact; it means that two faces that share a common corner rebar in the column reinforcement are adjacent to each other without contacting each other.
[0024] FIG. 3 is a diagram showing an image of the first surface F1 of the column reinforcement 200 captured using the image measurement device 100 according to this embodiment. FIG. 3 further shows the state after the first surface F1 has been measured. As shown in FIG. 3, dashed lines and numbers indicating the center positions of the reinforcing bars are added to the main reinforcements and ties arranged on the measured first surface F1. Furthermore, the corner reinforcing bar C11 of the column reinforcement 200 is photographed as main reinforcement 1, and the corner reinforcing bar C12 is photographed as main reinforcement 6. While the image shown in FIG. 3 does not display the measurement results, including the reinforcing bar standard determination results, the measurement results may be output to a text file or an image summarizing the measurement results may be displayed. A display area for the measurement results may be provided adjacent to the image shown in FIG. 3, and the measurement results may be displayed in that area.
[0025] Fig. 4 is a diagram showing an image summarizing the measurement results of the first face F1 of the column reinforcement 200 according to this embodiment. As shown in Fig. 4, the main reinforcements are assigned numbers from 1 to 6, and the standard determination result for each main reinforcement is marked with D29. The ties are assigned numbers from 1 to 3, and the standard determination result for each ties is marked with D13. As a result of the above, by saving the measurement results in an area separate from the image or displaying them on a screen separate from the image, it is possible to avoid reducing the visibility of the reinforcing bars in the captured image.
[0026] FIG. 5 is a diagram showing an image of the second surface F2 of the column reinforcement 200 captured using the image measurement device 100 according to this embodiment. FIG. 5 further shows the state after the second surface F2 has been measured. As shown in FIG. 5, dashed lines and numbers indicating the center positions of the rebars are added to the main reinforcements and ties placed on the measured second surface F2. Furthermore, the corner rebar C21 of the column reinforcement 200 is photographed as main reinforcement 1, and the corner rebar C22 is photographed as main reinforcement 4. The image shown in FIG. 5 does not display the rebar standard determination results, which are the measurement results. However, the measurement results can be output to a text file, or an image summarizing the measurement results can be displayed. A region for displaying the measurement results may be provided adjacent to the image shown in FIG. 5, and the measurement results may be displayed in that region.
[0027] Fig. 6 is a diagram showing an image summarizing the measurement results of the second surface F2 of the column reinforcement 200 according to this embodiment. As shown in Fig. 6, the main reinforcements are assigned numbers from 1 to 4, and the standard determination result for each main reinforcement is marked with D29. The ties are assigned numbers from 1 to 3, and the standard determination result for each ties is marked with D13. As a result of the above, by saving the measurement results in an area separate from the image or displaying them on a screen separate from the image, it is possible to avoid reducing the visibility of the reinforcing bars in the captured image.
[0028] In the case of conventional image measurement devices, the data of Figures 3 and 4 (measurement results of the first plane F1) and the data of Figures 5 and 6 (measurement results of the second plane F2) are stored separately. On the other hand, the image measurement device 100 according to this embodiment integrates the measurement result data (first rebar data) obtained from the captured image of the first plane F1 and the measurement result data (second rebar data) obtained from the captured image of the second plane F2, and stores the integrated data in the memory unit 106 or displays (outputs) it on the display unit 104.
[0029] Of the rebars included in the column reinforcement 200, the square rebar (first square rebar) C12 arranged on the first face F1 shown in Fig. 3 and the square rebar (second square rebar) C21 arranged on the second face F2 shown in Fig. 5 are the same rebar. Therefore, in order to integrate the respective measurement results, the image measurement device 100 sets (selects) the square rebar C12 and the square rebar C21 corresponding to the square rebar C12 as common square rebars arranged on both the first face F1 and the second face F2.
[0030] FIG. 7 is a diagram showing an example of a screen for setting square reinforcing bars according to this embodiment. The setting of square reinforcing bars is performed by the user specifying a captured image of the first face F1 and a captured image of the second face F2 displayed on the display unit 104 of the image measurement device 100. The setting of square reinforcing bars can also be performed by displaying the images shown in FIGS. 3 and 5 separately. However, as shown in FIG. 7, the images of the two faces to be integrated are displayed side by side, which is preferable because it makes it easier to understand the correspondence between them. In this case, the display unit 104 displays the captured image of the first face F1 on the left side of the screen and the captured image of the second face F2 on the right side of the screen, in accordance with the positional relationship between the first face F1 and the second face F2 when the column reinforcement 200 is viewed from the outside.
[0031] Furthermore, when a user specifies a corner rebar on each image, the color of the line indicating the center position of that corner rebar on the image may be made different from the color of the lines indicating the center positions of the other rebars, or a number indicating the specified rebar may be displayed in a separate frame, allowing the user to easily understand the status of the corner rebar specification.
[0032] When the corner reinforcing bars are set, the image measurement device 100 uses the corner reinforcing bars to integrate multiple measurement results (reinforcing bar data indicating the location of the corner reinforcing bars). The measurement results integrated by the image measurement device 100 include, for example, the reinforcing bar standard determination results and images.
[0033] Figure 8 shows an example of measurement results that combine the rebar standard judgment results. The six main rebars on the first surface F1 and the four on the second surface F2 are combined, resulting in a judgment result of nine rebars, taking into account overlapping corner rebars. Furthermore, since three tie bars are common between the first surface F1 and the second surface F2, all results are combined to result in three.
[0034] Here, three ties have been described for the column reinforcement 200 according to this embodiment, but there may be two or fewer ties, or four or more ties, and the number and position of ties may differ depending on the measurement range. In such cases, the user can specify ties that are common to the first face F1 and the second face F2, in the same way as specifying corner reinforcing bars, and the measurement results of the ties can be integrated.
[0035] FIG. 9 is a diagram showing an example of measurement results output that integrates the rebar standard assessment results according to this embodiment. As shown in FIG. 9, the image measurement device 100 may assign attributes to each rebar according to the rebar standard assessment results. In FIG. 9, the attribute of each rebar is assigned as one of the following: first surface, second surface, and square rebar. Furthermore, the number 6 of main rebar 6, which is a square rebar, is underlined to distinguish it from other rebars, which is preferable because it clearly identifies it as a square rebar. In FIG. 9, the main rebar number is underlined, but the same effect as underlining can be achieved by changing the font, color, thickness, etc. of the number, encircling the number, or adding a mark near the number to distinguish it from others.
[0036] Fig. 10 is a diagram showing an example of the output result of integrating images of measurement results according to this embodiment. The image measurement device 100 generates the image shown in Fig. 10 by integrating the image shown in Fig. 3 and the image shown in Fig. 5 based on the position of the square reinforcing bar C12 shown in Fig. 3 and the position of the square reinforcing bar C21 shown in Fig. 5. The image measurement device 100 integrates the images so that, for example, the square reinforcing bar C12 shown in Fig. 3 and the square reinforcing bar C21 shown in Fig. 5 overlap as the main reinforcement bars 6 shown in Fig. 10.
[0037] When merging the two images, the centers of the corner rebars are made to overlap. A natural-looking image can be generated by weighting the images according to the distance from the corner rebar, so that the image of the first face F1 is given a higher weight on the first face F1 side of the corner rebar, and the image of the second face F2 is given a higher weight on the second face F2 side of the corner rebar. Furthermore, the main rebar 6, which is the corner rebar, can be distinguished from other rebars by changing the color, thickness, etc. of the line indicating the center position of the rebar and the number.
[0038] Furthermore, by calculating the rebar plane on each side where the rebar to be measured exists and converting and integrating the images so that the rebar planes on each side overlap, an image that appears as if the rebars are arranged on the same plane can be generated, which is advantageous. For example, the image measurement device 100 generates an image by integrating an image of the first plane F1 and an image of the second plane F2 based on the first plane F1, which is the plane on which multiple rebars are arranged, and the second plane F2, which is the plane on which multiple rebars are arranged. In this case, by aligning the image with the plane's normal vector, the plane that can be photographed most directly from each side can be photographed, thereby reducing processing time and generating an integrated image that is closer to being viewed directly, without converting the image of that plane.
[0039] FIG. 11 is a flowchart showing a process in which the image measurement device 100 according to this embodiment integrates and outputs the measurement results of the first surface F1 and the measurement results of the second surface F2.
[0040] (Step S1: Acquisition step) In the image measurement device 100, the image processing unit (acquisition unit) 103 acquires an image of a first surface F1 and an image of a second surface F2, in which the column reinforcement 200, which is the measurement target, is photographed by the imaging unit 101 and the imaging unit 102.
[0041] (Step S2) The image processing unit 103 performs measurement processing on the rebar to be measured from the acquired images of each surface. For example, if the measurement processing is to determine the rebar standard, the image processing unit 103 calculates the three-dimensional coordinates of the feature points, calculates a least-squares plane from the calculated point cloud while removing noise components, and calculates the rebar position by calculating straight-line components from the point cloud on the least-squares plane. The image processing unit 103 then calculates the rebar edge from the point cloud around the calculated rebar position, calculates the rebar diameter from the rebar edge, and determines the rebar standard by comparing the calculated rebar diameter with a pre-registered rebar standard.
[0042] (Step S3: Selection step) The image processing unit 103 sets a common square reinforcing bar to be placed on both the first surface F1 and the second surface F2. When the user specifies a square reinforcing bar, the display unit 104 displays an image of the first surface F1 and an image of the second surface F2. The input unit 105 accepts the specification of the position of the square reinforcing bar. The image processing unit (selection unit) 103 selects the reinforcing bar at the specified position as the square reinforcing bar.
[0043] (Step S4: Integration step) The image processing unit (integration unit) 103 integrates the measurement results based on the set square reinforcing bars.
[0044] (Step S5: Output step) The image processing unit (output unit) 103 outputs the integrated measurement results. For example, the image processing unit 103 displays the measurement results on the display unit 104 or stores them in the memory unit 106. The measurement results include the rebar standard determination, rebar diameter, rebar spacing, rebar position, number of rebars, images, etc.
[0045] According to the above configuration, by integrating the measurement results indicating the location of the selected corner reinforcing bars C, it becomes clear whether a given main reinforcement is arranged on the first face F1 or the second face F2, so it is possible to identify the face on which the photographed column reinforcement 200 is arranged. In other words, it is possible to know which reinforcing bar plane the photographed image of the column reinforcement 200 was taken of.
[0046] Here, in the flowchart of Figure 11, the image measurement device 100 has been described as performing measurement processing after photographing the first face F1 and the second face F2 of the column reinforcement 200, but the second face F2 may be photographed after completing the measurement processing of the first face F1, or the measurement processing of the first face F1 and the photographing and measurement processing of the second face F2 may be processed in parallel.
[0047] Next, in this embodiment, a method has been described in which images captured by the imaging units 101 and 102 are directly input to the image processing unit 103 in the image measurement device 100, but the same effect can be obtained if the image processing unit 103 acquires images previously stored in the storage unit 106. Also, the same effect can be obtained if the image processing unit 103 acquires the measurement results of each surface stored in the storage unit 106 and integrates the measurement results.
[0048] Furthermore, in this embodiment, a method for integrating the first face F1 and the second face F2 of the column reinforcement 200 has been described, but other faces can be integrated using a similar process. For example, by integrating the measurement results of the first face F1 and the second face F2 with the measurement results of the third face F3, and further integrating the measurement results of the first face F1, the second face F2, and the third face F3 with the measurement results of the fourth face F4, it is possible to integrate the measurement results of the four faces that make up the column reinforcement 200. The above method makes it possible to associate and store the measurement results of the column reinforcement 200, prevent omissions in photography, and make it easier to check the condition of each face.
[0049] Furthermore, in the above description, a method has been described in which the measurement results are integrated by specifying the corner reinforcing bars between two adjacent faces each time two adjacent faces are photographed. However, a method may also be used in which the corner reinforcing bars between two adjacent faces are specified after photographing three or four faces, and the measurement results are integrated all at once. For example, if the column reinforcement arrangement 200 has four faces to photograph, the image measurement device 100 photographs each of the first face F1, second face F2, third face F3, and fourth face F4 and measures the reinforcing bars on each face. Next, the image measurement device 100 selects the corner reinforcing bars between the first face F1 and the second face F2, the corner reinforcing bars between the second face F2 and the third face F3, and the corner reinforcing bars between the third face F3 and the fourth face F4. The image measurement device 100 then integrates the first face F1, the second face F2, the third face F3, and the fourth face F4 using the selected three sets of corner reinforcing bars.
[0050] The image measurement device 100 may output each measurement result (rebar data) of each surface of the column reinforcement 200 without integrating the measurement results.
[0051] [Embodiment 2] A second embodiment of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the first embodiment, and the description thereof will not be repeated.
[0052] In the second embodiment of the present invention, when each face of the column reinforcement 200 is photographed using the image measurement device 100, the number of faces of the column reinforcement 200 to be photographed, the order in which each face is photographed, etc. are set in advance.
[0053] At an actual construction site, it may not be possible to photograph all faces of the column reinforcement 200 due to the presence of other objects or the influence of scaffolding. Therefore, by setting in advance the number of faces of the column reinforcement 200 to be photographed in the image measurement device 100, it becomes possible to properly guide the user during photography. Furthermore, by setting in advance the direction of photography in the image measurement device 100, it becomes possible to provide an image measurement device 100 that is easy for the user to use during photography.
[0054] FIG. 12 is a diagram showing an example of a screen G1 for setting the number of photographed surfaces and the photographing order of the column reinforcement 200 according to this embodiment. The screen G1 is displayed on the display unit 104 of the image measurement device 100. Then, using the buttons displayed on the right side of the screen G1, it is possible to select one of the number of photographed surfaces and one of the photographing orders. The number of photographed surfaces indicates the number of surfaces of the column reinforcement 200 that can actually be photographed. As shown in FIG. 12, two, three, or four surfaces can be selected as the number of photographed surfaces. The photographing order indicates the order in which each surface is photographed when the column reinforcement 200 is viewed from directly above. As shown in FIG. 12, it is possible to select either clockwise (i.e., (3) -> (2) -> (1)) or counterclockwise (i.e., (1) -> (2) -> (3)) as the photographing order.
[0055] A "Back" button and a "Decide" button are located on the lower right side of screen G1. After selecting the imaging conditions to be implemented, the user can click the "Decide" button to properly photograph the column reinforcement 200. By clicking the "Back" button, the user can return to the previous screen. In addition, a top view of the column reinforcement 200 indicating the number of imaging planes and the imaging order is displayed on the left side of screen G1. This is preferable because it makes it easier for the user to check the imaging conditions.
[0056] The following describes the procedure for photographing the column reinforcement 200 when the number of photographing planes is set to three and the photographing order is set to counterclockwise as shown in FIG.
[0057] FIG. 13 is a diagram showing an example of a screen G2 that guides the user to photograph the next surface according to this embodiment. After photographing the first surface F1 using the image measurement device 100, the user moves on to photographing the second surface F2. At this time, the image measurement device 100 displays (outputs) on the screen G2 the presence of the surface of the column reinforcement 200 that should be photographed next and a message guiding the user to photograph that surface (indicating that the second surface F2 should be photographed) based on the number of photographed surfaces and the photographing order set on the screen G1 of FIG. 12. For example, since the photographing order is set counterclockwise on the screen G1 of FIG. 12, the next surface to be photographed is on the right side for the user, and therefore the message "Please photograph the surface to the right" is displayed on the screen G2 of FIG. 13.
[0058] Furthermore, a "Back" button and a "Photograph" button are located on the lower right side of screen G1. The user can smoothly measure the column reinforcement 200 by clicking the "Photograph" button in accordance with the message on screen G2. By clicking the "Back" button, the user can return to the previous screen. The image measurement device 100 may also display the set number of photographed planes and the number of images that have been photographed on the screen of the display unit 104 to notify the user of the remaining number of photographs.
[0059] When the user photographs the second surface F2 according to the message on screen G2 and then photographs the third surface F3, the number of photographed surfaces set on screen G1, which is three, is reached. Therefore, the image measurement device 100 does not guide the user to photograph the next surface, but notifies the user that the set photographing is complete, or transitions to a screen for setting the square rebar. This allows the user to avoid unnecessary photographing and move on to the next task quickly.
[0060] Fig. 14 is a diagram showing an example of a screen G3 for setting corner reinforcing bars according to this embodiment. On the screen G3, images of each face of the column reinforcement 200 are arranged based on the photographing order set on the screen G1 of Fig. 12. Since the photographing order is set counterclockwise on the screen G1, as shown in Fig. 14, the first face F1 is arranged on the left side and the second face F2 is arranged on the right side.
[0061] The corner reinforcing bars on the first face F1 are main reinforcing bars 6, and the corner reinforcing bars on the second face F2 are main reinforcing bars 1. Therefore, by arranging the first face F1 and the second face F2 as described above on screen G3, the corner reinforcing bars on each face to be selected are displayed close to each other. This allows the user to easily select and check the corner reinforcing bars.
[0062] The bottom right of screen G3 has a "Back" button and a "Decide" button. After selecting a square rebar, the user can click the "Decide" button to display an image in which the first surface F1 and the second surface F2 are integrated. The user can return to the previous screen by clicking the "Back" button.
[0063] Fig. 15 is a diagram showing an example of screen G4 for setting square reinforcing bars according to this embodiment. When the shooting order is set clockwise on screen G1, the square reinforcing bar on the first surface F1 is main reinforcing bar 1, and the square reinforcing bar on the fourth surface F4 is main reinforcing bar 4, as shown in Fig. 15. Therefore, on screen G4, the first surface F1 is located on the right side, and the fourth surface F4 is located on the left side.
[0064] Furthermore, if the shooting order is set, the positional relationship of each surface to be integrated can be determined, and it is known that the rebars at the ends of the multiple main reinforcements will become square rebars. Therefore, it is possible to automatically set the outermost rebars that integrate each surface as square rebars, or to simplify the work of specifying the positions of the square rebars by initializing them.
[0065] The bottom right of screen G4 has a "Back" button and a "Decide" button. After selecting a square rebar, the user can click the "Decide" button to display an image in which the first surface F1 and the second surface F2 are integrated. The user can return to the previous screen by clicking the "Back" button.
[0066] 14 and 15, examples have been described in which corner rebars are set on a screen displaying images of two faces, i.e., the first face F1 and the second face F2, and the first face F1 and the fourth face F4, but the same effect can be achieved by setting corner rebars on a screen displaying each image. For example, corner rebars may be set on a screen displaying three consecutive faces, or corner rebars may be set simultaneously on a screen displaying all faces.
[0067] 14 and 15, the images of each face are arranged so that the same corner reinforcing bars on each face are displayed close to each other. For example, the image measuring device 100 arranges the image of the first face F1 and the image of the second face F2 side by side so that the corner reinforcing bars on the first face F1 and the corner reinforcing bars on the second face F2 are close to each other, and displays a screen that allows the user to select the corner reinforcing bars from the image of the first face F1 and the image of the second face F2. This allows the user to easily set the corner reinforcing bars on each face.
[0068] In the above, an example was described in which both the number of photographed surfaces and the photographing order of the column reinforcement 200 were set in advance on the screen G1. However, the respective effects can be obtained by setting either the number of photographed surfaces or the photographing order. When the number of photographed surfaces is set, it is possible to determine whether there are any remaining surfaces to be photographed. In this case, the image measurement device 100 may display a screen prompting the user to photograph the next surface when fewer surfaces than the set number of photographed surfaces have been photographed, or may display a screen prompting the user to proceed to the next process (e.g., to select a corner reinforcing bar) when the same number of surfaces as the set number of photographed surfaces have been photographed. When the photographing order is set, it is possible to determine the direction in which each photographed image should be joined. Therefore, by arranging the images side by side so that the corner reinforcing bars in each of the two images are close to each other, it is possible to easily set and check the corner reinforcing bars.
[0069] Fig. 16 is an example of a top view of the column reinforcement 200 according to this embodiment. As shown in Fig. 16, it is preferable to generate a top view of the column reinforcement 200 as an output that integrates the measurement results of each face of the column reinforcement 200, as this makes the positions of the main reinforcements easier to understand. In Fig. 16, the measurement results of the four faces of the column reinforcement 200 are integrated, and then the positions of the main reinforcements are arranged and drawn on each face. The positions at which the main reinforcements are drawn may be equally spaced, but if the spacing between the main reinforcements has been measured, it is preferable to draw the positions of the main reinforcements at the ratio of that spacing, as this allows the actual column reinforcement 200 to be expressed.
[0070] Fig. 17 is an example of a top view of the column reinforcement 200 according to this embodiment. When there are surfaces of the column reinforcement 200 that have not been measured (i.e., surfaces that have not been integrated), as shown in Fig. 17, the positions of the main reinforcements that have not actually been measured but are estimated from the facing reinforcement may be drawn with dotted lines or the like. This makes it possible to distinguish them from the measured main reinforcements. Then, to make it easier to distinguish the position of each main reinforcement, drawing auxiliary lines or assigning numbers to the reinforcing bars that correspond to the measurement results makes it easier to understand the measurement results.
[0071] Here, in the above embodiment, the case of measuring column reinforcement 200 has been described, but it can also be applied to rectangular reinforcement, and the same effect can be obtained, for example, with beam reinforcement.
[0072] As described above, with the image measurement device 100 according to this embodiment, by setting the number of photographed surfaces, the completion of photographing can be notified and the next task can be quickly started. Also, by setting the photographing order, the photographing order can be notified and the images can be arranged so that the corner reinforcing bars on each surface are close to each other, and the corner reinforcing bars can be specified or automatically determined.
[0073] In particular, when the two images are displayed side by side, it is easy to see that the rebars on the inside of the two images (i.e., the right rebar in the left image and the left rebar in the right image) are common corner rebars.
[0074] [Software implementation example] The functions of the image measurement device 100 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly, the image processing unit 103).
[0075] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.
[0076] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.
[0077] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.
[0078] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may run on the control device or on another device (for example, an edge computer or a cloud server).
[0079] 〔summary〕 The image measuring device according to aspect 1 of the present invention is an image measuring device that measures column reinforcement using an image of the column reinforcement, and includes: an acquisition unit that acquires a first image that is an image of a first side of the column reinforcement and a second image that is an image of a second side of the column reinforcement adjacent to the first side; a selection unit that selects a first corner reinforcing bar from the first image, which is a corner reinforcing bar that will be placed on the first side, and selects a second corner reinforcing bar from the second image, which is a corner reinforcing bar that will be placed on the second side and corresponds to the first corner reinforcing bar; an integration unit that uses the first corner reinforcing bar and the second corner reinforcing bar to integrate data regarding each reinforcing bar on the first side, including first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data regarding each reinforcing bar on the second side, including the location of the second corner reinforcing bar; and an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data.
[0080] In the image measuring device of aspect 2 of the present invention, in the above-mentioned aspect 1, the integration unit may generate an image by integrating the first image and the second image based on the position of the first corner reinforcing bar and the position of the second corner reinforcing bar.
[0081] In the image measuring device of aspect 3 of the present invention, in the above aspect 2, the integration unit may generate an image integrating the first image and the second image based on a first plane which is a plane on which the multiple reinforcing bars of the first surface are arranged and a second plane which is a plane on which the multiple reinforcing bars of the second surface are arranged.
[0082] In the image measuring device of aspect 4 of the present invention, in aspect 1 above, the output unit may set the order in which to photograph each side of the column reinforcement, arrange the first image and the second image side by side so that the first corner reinforcing bar and the second corner reinforcing bar are close to each other, and display a screen that allows the user to select the first corner reinforcing bar from the first image and the second corner reinforcing bar from the second image.
[0083] In the image measuring device according to aspect 5 of the present invention, in the above-mentioned aspect 1, the output unit may output a message indicating that the second surface should be photographed after the first surface has been photographed.
[0084] In the image measuring device according to aspect 6 of the present invention, in the above aspect 1, the output unit may allow the user to set the number of faces to be photographed of the column reinforcement, and when the photographing of the set number of faces has been completed, may display a screen that allows the user to select the corner reinforcement.
[0085] The image measuring device of aspect 7 of the present invention is an image measuring device that measures column reinforcement using an image of the column reinforcement, and is equipped with an acquisition unit that acquires a first image that is an image of a first side of the column reinforcement and a second image that is an image of a second side of the column reinforcement adjacent to the first side, a selection unit that selects a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first side from the first image and selects a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second side from the second image and corresponds to the first corner reinforcing bar, and an output unit that outputs data regarding each reinforcing bar on the first side, first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data that is data regarding each reinforcing bar on the second side, indicating the location of the second corner reinforcing bar.
[0086] The image measurement method according to aspect 8 of the present invention is an image measurement method for measuring column reinforcement using an image of the column reinforcement, and includes the steps of: acquiring a first image, which is an image of a first side of the column reinforcement, and a second image, which is an image of a second side of the column reinforcement adjacent to the first side; selecting a first corner reinforcing bar, which is a corner reinforcing bar to be placed on the first side, from the first image; and selecting a second corner reinforcing bar, which is a corner reinforcing bar to be placed on the second side and corresponds to the first corner reinforcing bar, from the second image; using the first corner reinforcing bar and the second corner reinforcing bar, integrating data regarding each reinforcing bar on the first side, which is first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data, which is data regarding each reinforcing bar on the second side, which is second reinforcing bar data indicating the location of the second corner reinforcing bar; and outputting data integrating the first reinforcing bar data and the second reinforcing bar data.
[0087] The image measuring device according to each aspect of the present invention may be realized by a computer. In this case, the control program for the image measuring device, which causes the computer to operate as each part (software element) of the image measuring device, thereby realizing the image measuring device on the computer, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention.
[0088] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, new technical features can be created by combining the technical means disclosed in each embodiment. For example, column reinforcement includes concepts such as beams and bridges. [Explanation of symbols]
[0089] 100 Image measurement device 101 Imaging unit 102 Imaging unit 103 Image processing unit (acquisition unit, selection unit, integration unit, output unit) 104 Display section 105 Input section 106 Storage section 200 Column reinforcement C12 Corner Reinforcement Bar (First Corner Reinforcement Bar) C21 Corner Reinforcement Bar (Second Corner Reinforcement Bar) F1 front page F2 2nd side
Claims
1. An image measurement device that measures column reinforcement using an image of the column reinforcement, an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface; A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; an integration unit that integrates, using the first corner reinforcing bar and the second corner reinforcing bar, first reinforcing bar data that indicates the location of the first corner reinforcing bar, which is data that individually indicates the measurement results of each reinforcing bar on the first side, and second reinforcing bar data that indicates the location of the second corner reinforcing bar, which is data that individually indicates the measurement results of each reinforcing bar on the second side; an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data; An image measurement device comprising:
2. An image measurement device that measures column reinforcement using an image of the column reinforcement, an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface; A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars; an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data, The integration unit An image is generated by integrating the first image and the second image based on the positions of the first corner reinforcing bars and the second corner reinforcing bars. An image measurement device characterized by:
3. The integration unit An image is generated by integrating the first image and the second image based on a first plane on which the plurality of reinforcing bars of the first surface are arranged and a second plane on which the plurality of reinforcing bars of the second surface are arranged.
3. The image measuring device according to claim 2.
4. An image measurement device that measures column reinforcement using an image of the column reinforcement, an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface; A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars; an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data, The output unit The order in which each face of the column reinforcement is photographed is set, the first image and the second image are arranged side by side so that the first corner reinforcing bar and the second corner reinforcing bar are close to each other, and a screen is displayed in which the first corner reinforcing bar is selected from the first image and the second corner reinforcing bar is selected from the second image. An image measurement device characterized by:
5. An image measurement device that measures column reinforcement using an image of the column reinforcement, an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface; A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars; an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data, The output unit After photographing the first side, a message is output indicating that the second side should be photographed. An image measurement device characterized by:
6. An image measurement device that measures column reinforcement using an image of the column reinforcement, an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface; A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars; an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data, The output unit The number of faces to be photographed for the column reinforcement is set, and when the photographing of the set number of faces is completed, a screen for selecting the corner reinforcement is displayed. An image measurement device characterized by:
7. An image measurement method for measuring column reinforcement using an image of the column reinforcement, an acquisition step of acquiring a first image which is an image of a first surface of the column reinforcement and a second image which is an image of a second surface of the column reinforcement adjacent to the first surface; A selection step of selecting, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selecting, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; an integration step of integrating, using the first corner reinforcing bar and the second corner reinforcing bar, first reinforcing bar data, which is data individually showing the measurement results of each reinforcing bar on the first side and indicates the location of the first corner reinforcing bar, and second reinforcing bar data, which is data individually showing the measurement results of each reinforcing bar on the second side and indicates the location of the second corner reinforcing bar; an output step of outputting data obtained by integrating the first reinforcing bar data and the second reinforcing bar data; An image measurement method comprising:
8. 2. An image measurement program for causing a computer to function as the image measurement device according to claim 1, the image measurement program causing a computer to function as the acquisition unit, the selection unit, the integration unit, and the output unit.
Citation Information
Patent Citations
Image processing apparatus for photogrammetry, on-site recording system using the same, baggage recording system, and laser beam machining system
JP2010266202A
Imaging apparatus, image processing apparatus, control method of imaging apparatus, and image processing program
JP2017003364A
Notification device, notification processing program and notification processing method
JP2018173275A
Image processing apparatus, image processing system and control program
JP2019008717A
Information acquisition device
JP2021016169A