Reinforcing bar inspection device, reinforcing bar inspection method, and program
The reinforcement inspection device generates a three-dimensional image from stereo data to accurately measure reinforcing bars, enhancing visibility and precision in reinforcement inspections without altering the original image data.
Patent Information
- Application Number
- JP2023091286
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-02
- Publication Date
- 2024-12-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing reinforcement inspection systems require conversion of current image data into three-dimensional data, which can lead to tampering and inaccuracies in measuring reinforcement arrangements.
A reinforcement inspection device that uses a stereo camera to generate a three-dimensional image of reinforcement arrangements, identifying planes and detecting reinforcing bar positions, and superimposing this image onto a stereo image to provide accurate measurement without altering the original data.
Enables accurate measurement of reinforcing bars in subsequent processes by restoring the reinforcement arrangement three-dimensionally, improving visibility and allowing precise measurement without tampering with the current image data.
Smart Images

Figure 2024173117000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a reinforcement inspection device, a reinforcement inspection method, and a program. [Background technology]
[0002] In the construction of reinforced concrete structures, a rebar arrangement inspection is conducted to check whether the rebar arrangement, which is made up of multiple rebars, is constructed as designed. In the rebar arrangement inspection, workers may carry out the inspection while referring to the position of the rebars, the type of rebars, the actual and design values of the rebar arrangement spacing, and the number of each rebar, all of which are displayed on a screen.
[0003] For example, Patent Document 1 describes a conventional reinforcing bar measurement system that displays an image of the reinforcing bar to be inspected. This reinforcing bar measurement system includes a display unit that displays reinforcing bar measurement information superimposed on a stereo image of the reinforcing bar, an input unit that can receive an input of an editing signal that edits at least one of a plurality of reinforcing bar detection virtual lines, a plurality of reinforcing bar numbers, and identification information, and edits the measurement information based on the editing signal received by the input unit. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2020-166660 A Summary of the Invention [Problem to be solved by the invention]
[0005] The reinforcing bar measurement system described in Patent Document 1 saves image data of the reinforcing bars as data for measuring reinforcing bars. However, there is a problem that the reinforcing bars cannot be measured in a later process unless the image data is converted into data that represents the three-dimensional structure of the reinforcing bars, i.e., the reinforcing bar is falsified.
[0006] The present disclosure is intended to solve the above-mentioned problems, and aims to provide a reinforcing bar inspection device that can measure reinforcing bars in a later process without tampering with current image data. [Means for solving the problem]
[0007] The reinforcement bar inspection device according to the present disclosure is a reinforcement bar inspection device that inspects reinforcement bars having multiple layers of planes made of rebars arranged in a lattice pattern, and includes a three-dimensional information acquisition unit that generates a three-dimensional image of the reinforcement bar from a stereo image of the reinforcement bar captured by a stereo camera, a plane identification unit that identifies the plane of the reinforcement bar using the three-dimensional image, a rebar detection unit that detects rebar detection information indicating the position of the rebar in the identified plane and angle of view information for each pixel of the stereo image, and an image information generation unit that generates image information based on the rebar detection information and the angle of view information, in which the three-dimensional image is associated with the stereo image on a pixel-by-pixel basis, and the three-dimensional image is displayed superimposed on the stereo image. Effect of the Invention
[0008] According to the present disclosure, a three-dimensional image is associated with a stereo image on a pixel-by-pixel basis based on rebar detection information indicating the position of rebars arranged in a lattice pattern by rebar arrangement and information on the angle of view of each pixel of the stereo image, and image information is generated in which the three-dimensional image is superimposed on the stereo image. By three-dimensionally restoring the rebar arrangement from the current image data of the stereo image based on the three-dimensional image associated with the stereo image and the information on the angle of view of each pixel, it is possible to perform rebar measurement of the rebar arrangement in a later process without tampering with the current image data. [Brief description of the drawings]
[0009] [Figure 1] 1 is a block diagram showing a configuration example of a bar arrangement inspection device according to a first embodiment. FIG. [Diagram 2] FIG. 2 is a schematic diagram showing each layer constituting the reinforcement inspection display screen. [Diagram 3] FIG. 13 is a screen diagram showing an example (1) of a reinforcement inspection display screen. [Figure 4] FIG. 13 is a screen diagram showing an example (2) of a reinforcement inspection display screen. [Diagram 5] FIG. 13 is a screen diagram showing an example (3) of a reinforcement inspection display screen. [Figure 6] FIG. 13 is a screen diagram showing an example (4) of a reinforcement inspection display screen. [Figure 7] FIG. 13 is a screen diagram showing an example (5) of a reinforcement inspection display screen. [Figure 8] 4 is a flowchart showing a bar arrangement inspection method according to the first embodiment. [Figure 9] 9A and 9B are block diagrams showing a hardware configuration for realizing the functions of the bar arrangement inspection device according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Embodiment 1 FIG. 1 is a block diagram showing a configuration example of a reinforcing bar inspection device 1 according to a first embodiment. In FIG. 1, the reinforcing bar inspection device 1 is a device that inspects at least one of the number of reinforcing bars, the spacing between adjacent reinforcing bars, the diameter of the reinforcing bars, and the spacing between nodes of the reinforcing bars in a reinforcing bar arrangement having a multi-layer plane made of reinforcing bars arranged in a lattice pattern. The reinforcing bar inspection device 1 is a tablet terminal, a smartphone, or a notebook-type personal computer (PC). As shown in FIG. 1, a stereo camera 2 is connected to the reinforcing bar inspection device 1 by wire or wirelessly. The reinforcing bar inspection device 1 is not limited to a device with an external stereo camera 2, and may have the stereo camera 2 built-in.
[0011] In a reinforcement inspection, an inspector carries a reinforcement inspection device 1 and moves around the reinforcement to be inspected, photographing the reinforcement with a stereo camera 2 connected to the reinforcement inspection device 1. The stereo camera 2, which moves with the inspector, can photograph the reinforcement from multiple angles. In addition, the moving object moving around the reinforcement is not limited to an inspector, but may be a vehicle, an unmanned aerial vehicle, etc.
[0012] The bar arrangement inspection device 1 may be a component included in a server capable of communicating with a terminal device equipped with the stereo camera 2. For example, the terminal device can perform bar arrangement inspection provided in the form of SaaS (Software as a Service). When performing bar arrangement inspection in the form of SaaS, an information processing application for bar arrangement inspection does not need to be installed on the terminal device. The information processing application for bar arrangement inspection is executed on the server, and the terminal device is provided with measurement result information on a general-purpose web browser. The bar arrangement inspection application is stored in a storage unit included in the server. Furthermore, an information processing application for bar arrangement inspection may be installed in the terminal device. In the terminal device in which the information processing application for bar arrangement inspection is installed, the application is executed to enable the bar arrangement inspection.
[0013] The stereo camera 2 is an imaging device having a left imaging section and a right imaging section. The left imaging section captures a left viewpoint image seen from the left side. The right imaging section captures a right viewpoint image seen from the right side. The stereo camera 2 outputs a captured image composed of the left viewpoint image and the right viewpoint image. The camera angle of view information (H, V) for each pixel in the shooting range of the stereo camera 2 is included in the stereo image and output to the bar arrangement inspection device 1. This camera angle of view information (H, V) is information indicating the position of each pixel constituting the stereo image in the camera's angle of view, and is information expressed as the horizontal (H) and vertical (V) angles corresponding to the xy coordinates of the pixel.
[0014] The reinforcing bar inspection device 1 is a device equipped with at least a calculation unit and a storage unit. The calculation unit controls the overall operation of the reinforcing bar inspection device 1. The calculation unit includes a three-dimensional information acquisition unit 11, a plane identification unit 12, a reinforcing bar detection unit 13, an image information generation unit 14, and a measurement unit 15. The calculation unit executes an information processing application for reinforcing bar inspection, thereby realizing various functions of the three-dimensional information acquisition unit 11, the plane identification unit 12, the reinforcing bar detection unit 13, the image information generation unit 14, and the measurement unit 15.
[0015] The storage unit stores an information processing application for the bar arrangement inspection and information used for the calculation processing of the calculation unit. The storage unit is a storage device provided in a computer functioning as the bar arrangement inspection apparatus 1, and includes a storage such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), or a memory 104 in Fig. 9B described later. Note that the storage unit may be provided outside the bar arrangement inspection apparatus 1 as long as it is accessible by the bar arrangement inspection apparatus 1.
[0016] The three-dimensional information acquisition unit 11 generates a three-dimensional image of the reinforcement from the stereo images of the reinforcement captured by the stereo camera 2. For example, an inspector carrying the reinforcement inspection device 1 moves around the reinforcement to be inspected, and the stereo camera 2 continuously captures the reinforcement from multiple shooting angles at a predetermined frame rate (e.g., 30 fps). The three-dimensional information acquisition unit 11 sequentially inputs the captured images, which are time-series data of the left viewpoint image of the reinforcement and the right viewpoint image (frame image) of the same reinforcement, from the stereo camera 2. Then, the three-dimensional information acquisition unit 11 performs stereo matching between the left viewpoint image and the right viewpoint image to acquire three-dimensional information, which is a three-dimensional image of the inspection area, for each captured image (for each frame image).
[0017] The three-dimensional information acquisition unit 11 reconstructs three-dimensional information of the reinforcement using the three-dimensional information acquired for each captured image. For example, the three-dimensional image acquired for each captured image is captured from different shooting angles by moving the stereo camera 2. The three-dimensional information acquisition unit 11 may input three-dimensional images corresponding to each of the multiple captured images acquired for each predetermined inspection period, extract three-dimensional points that are characteristic points (edges, etc.) of the reinforcing bars that constitute the reinforcement from each three-dimensional image acquired during the inspection period, and specify where the same three-dimensional points are located in each of these three-dimensional images. In this way, the three-dimensional information acquisition unit 11 reconstructs three-dimensional images in which the three-dimensional point group of the reinforcement is specified for each inspection period.
[0018] For example, even if occlusion occurs in a 3D image of reinforcement taken at a shooting point at a certain time, where a reinforcing bar in an upper layer hides a reinforcing bar in a lower layer, some 3D images of reinforcement taken at a shooting point at a different time include images in which occlusion by the same reinforcing bar in the upper layer does not occur. Therefore, the 3D information acquisition unit 11 reconstructs the 3D information of the reinforcement using the 3D information for each captured image, thereby generating 3D information in which 3D points corresponding to the reinforcing bars arranged in the plane of each layer of reinforcement are specified.
[0019] The plane identifying unit 12 identifies a plane that the reinforcement has by using the three-dimensional image. For example, the plane identifying unit 12 sets a plurality of plane candidates including a plurality of three-dimensional points in the reconstructed three-dimensional image, and calculates the number of three-dimensional points whose distance from the plane candidates is equal to or less than a threshold value. The plane identifying unit 12 identifies the plane candidate having the largest number of calculated three-dimensional points among the plurality of plane candidates as the plane of the topmost floor. Similarly, the plane identifying unit 12 identifies the plane of each floor by using a threshold value set for each plane.
[0020] The reinforcing bar detection unit 13 detects reinforcing bar detection information indicating the position of reinforcing bars in the plane identified by the plane identification unit 12, and field of view information (H, V) for each pixel of the stereo image. For example, the reinforcing bar detection unit 13 converts stereo images and three-dimensional images (depth images) of reinforcing bars into frontal images in which reinforcing bars arranged in a lattice pattern are perpendicular to each other. For example, the reinforcing bar detection unit 13 specifies the four corner points of an arbitrary lattice rectangle of reinforcing bars arranged in a lattice pattern on the plane of each floor, and estimates a facing transformation matrix using the position coordinates of the specified four points. The reinforcing bar detection unit 13 converts the stereo image and the three-dimensional image into a facing image based on the estimated facing transformation matrix.
[0021] Then, the reinforcing bar detection unit 13 detects the position information of the reinforcing bar on each of the planes of the multiple layers by using the front-facing image of the 3D image. For example, the reinforcing bar detection unit 13 detects the position of the reinforcing bar installed on the plane of each layer in the front-facing image by binarizing the front-facing image, generating a masked image in which the image portion of the reinforcing bar is masked, and counting the pixels of the image portion of the reinforcing bar, and generates reinforcing bar detection information indicating the position of the reinforcing bar. In addition, the reinforcing bar detection unit 13 extracts camera angle of view information (H, V) for each pixel from the stereo images. The extracted camera angle of view information (H, V) and reinforcing bar detection information are output to the image information generation unit 14, and the reinforcing bar detection information is output to the measurement unit 15.
[0022] The image information generating unit 14 generates image information in which a three-dimensional image is associated with a stereo image in pixel units based on the rebar detection information and the camera angle of view information (H, V) and the three-dimensional image is displayed superimposed on the stereo image. For example, the stereo image is stored in the storage unit 4 as an SVG (Scalable Vector Graphic) file. The image information generating unit 14 converts the three-dimensional image into a layer image to generate image information linked to the SVG file of the stereo image, and stores the generated image information in the storage unit 4.
[0023] For example, a stereo image includes the camera angle of view information (H, V) of the image capturing range in pixel units. The image information generating unit 14 uses the camera angle of view information (H, V) of the target point in the stereo image to calculate the two-dimensional coordinates (X, Y) of the target point on the display screen of the display unit 3, and combines the calculated two-dimensional coordinates with the depth information corresponding to the target point in the three-dimensional image (depth image). This series of processes is the layering (superimposition) of the three-dimensional image. This allows the bar arrangement inspection device 1 to display an image with improved visibility of the actual distance of the reinforcing bars in the bar arrangement on the stereo image. Moreover, the image information generated by the image information generating unit 14 is essentially a three-dimensional reconstruction of the reinforcing bars. Therefore, the image information also makes it possible to measure the distance between any two points, and it is possible to provide image information that allows the measurement of reinforcing bars without falsifying the stereo image.
[0024] In addition, in a depth image, which is a three-dimensional image, the brightness information for each pixel in the stereo image becomes distance information to the subject. For this reason, the image information generating unit 14 stores the distance information in the depth image in millimeters, for example, as 16-bit gradation, in association with the stereo image in the storage unit 4.
[0025] The measuring unit 15 measures the planar reinforcing bars of the reinforcing bars using the image information generated by the image information generating unit 14. In the image information, distance information of a three-dimensional image is associated with the stereo image on a pixel-by-pixel basis. Therefore, it is possible to measure the distance between any two points in the image information using the distance information for each pixel. For example, the measuring unit 15 may use the image information to measure inspection information such as the diameter of the reinforcing bars.
[0026] In addition, the measurement unit 15 may measure the reinforcing bars on each plane of the reinforcement using a three-dimensional image including the reinforcing bars on the plane of each layer of the reinforcement and reinforcing bar detection information indicating the position of the detected reinforcing bars. For example, the measurement unit 15 may specify the plane of the inspection target from the reinforcing bars using a three-dimensional image, extract images of the reinforcing bars arranged on the plane of the inspection target from the captured image converted into a frontal image, and divide the extracted images of the reinforcing bars into a plurality of partial images. Then, when these partial images are input, the measurement unit 15 may infer the inspection information of the reinforcing bars using a learning model that infers the diameter of the reinforcing bars, etc., as the inspection information of the reinforcing bars.
[0027] The image information generating unit 14 may generate image information that further superimposes electronic whiteboard information showing the results of measuring the rebar by the measuring unit 15. For example, when the image information generating unit 14 acquires the measurement information of the rebar by the measuring unit 15, it generates electronic whiteboard information that displays the acquired measurement information in text or graphs. The electronic whiteboard information is added to the SVG file of the stereo image. This makes it possible for the bar arrangement inspection device 1 to display an image on which electronic whiteboard information is superimposed.
[0028] FIG. 2 is a schematic diagram showing each layer constituting the bar arrangement inspection display screen, and shows images of each layer constituting the image information. In FIG. 2, a stereo image 141 is a current image of a bar arrangement having a plane of multiple layers made of reinforcing bars 6 arranged in a lattice pattern. A three-dimensional image (depth image) 142 is an image made of three-dimensional point cloud data of the reinforcing bars, and each three-dimensional point includes its three-dimensional coordinates and distance information from the shooting point (the position of the stereo camera 2). An image 143 is an image showing reinforcing bar detection information, and includes, for example, a marker 151A showing the position of a horizontal reinforcing bar 6 arranged at the forefront of the reinforcing bars, and a marker 151B showing the position of a vertical reinforcing bar 6. An image 144 is an image including electronic whiteboard information 151C showing measurement information of the reinforcing bars 6.
[0029] FIG. 3 is a screen diagram showing an example (1) of the reinforcing bar inspection display screen. The image information generating unit 14 associates the three-dimensional image 142 with the stereo image 141 shown in FIG. 2 in pixel units, superimposes the three-dimensional image 142 on the stereo image 141, and generates image information 145 by superimposing the image 143 and the image 144 in order. The image information 145 displayed on the display unit 3 is shown in FIG. 3. In the image information 145, a three-dimensional point cloud, which is distance information, is superimposed on the reinforcing bar 6 shown in the stereo image. By visually checking the shading (which can also be said to be dense or coarse) of the three-dimensional point cloud in the image information 145, the actual distance of the reinforcing bar on the stereo image can be recognized. In this way, the image information 145 provided by the reinforcing bar inspection device 1 has improved visibility of the actual distance of the reinforcing bar in the reinforcing bar arrangement on the stereo image.
[0030] Furthermore, the image information generating unit 14 may generate a three-dimensional image that distinguishes and displays the reinforcing bars for each plane, and generate image information in which the generated three-dimensional image is superimposed on a stereo image. This allows the bar arrangement inspection device 1 to display an image with improved visibility of which layer's plane the reinforcing bars are arranged in on the stereo image. Possible modes for distinguishing and displaying reinforcing bars include, for example, changing the color assigned to the three-dimensional point cloud representing the reinforcing bars, or changing the type of line superimposed on the image of the reinforcing bars.
[0031] For example, the image information generating unit 14 may generate a three-dimensional image in which the color of the reinforcing bar is changed for each plane. This allows the reinforcing bar arrangement inspection device 1 to display an image with improved visibility of which plane the reinforcing bar is arranged on, based on the difference in color of the reinforcing bar for each plane. Fig. 4 is a screen diagram showing an example (2) of the reinforcement inspection display screen. An image 146 shown in Fig. 4 is a three-dimensional image in which different color information is added to the plane of each story, superimposed on a stereo image of the same reinforcement, and the stereo image and the three-dimensional image are associated with each other on a pixel-by-pixel basis.
[0032] The image information generating unit 14 identifies, from among the 3D points of the 3D image, those that belong to the plane identified by the plane identifying unit 12, and assigns different color information for each plane to the 3D point cloud corresponding to the reinforcing bars in the plane identified using the reinforcing bar detection information. This generates a pseudo-color 3D image in which different color information is assigned to each 3D point of the reinforcing bars for each plane. The image information generating unit 14 displays an image 146 on the display unit 3, in which a pseudo-color three-dimensional image is superimposed on a stereo image. In the image 146, the three-dimensional point cloud 111A corresponding to the reinforcing bars 6 placed on the plane of the upper layer is displayed in blue, and the three-dimensional point cloud 111A corresponding to the reinforcing bars 6 placed on the plane of the lower layer is displayed in red. By referring to this image 146, it is possible to recognize on which plane of the layer the reinforcing bars 6 are placed, based on the difference in the color of the reinforcing bars for each plane.
[0033] The image information generating unit 14 may generate a three-dimensional image in which the type of line superimposed on the rebar is changed for each plane. This allows the reinforcing bar inspection device 1 to display an image with improved visibility of which rebar is installed on which plane of each layer, due to the difference in the type of line superimposed on the rebar for each plane. FIG. 5 is a screen diagram showing an example (3) of a reinforcing bar inspection display screen. An image 147 shown in FIG. 5 is a three-dimensional image in which different types of line information are added to the planes of each layer, superimposed on a stereo image of the same reinforcing bar, and the stereo image and the three-dimensional image are associated with each other on a pixel-by-pixel basis.
[0034] The image information generating unit 14 identifies, from among the 3D points of the 3D image, those belonging to the plane identified by the plane identifying unit 12, and assigns different types of line information for each plane to the 3D point cloud corresponding to the reinforcing bars in the plane identified using the reinforcing bar detection information. This generates a line-added 3D image in which different types of line information are assigned to the reinforcing bars for each plane. The image information generating unit 14 displays an image 147, in which a line-added three-dimensional image is superimposed on a stereo image, on the display unit 3. In image 147, an image of a solid line is superimposed on a three-dimensional point cloud 111C corresponding to the reinforcing bars 6 assembled on the plane of an upper layer, and an image of a dashed line is superimposed on a three-dimensional point cloud 111A corresponding to the reinforcing bars 6 assembled on the plane of a lower layer. By referring to this image 147, it is possible to recognize on which plane of a layer the reinforcing bars 6 are assembled, based on the difference in the type of lines for each plane.
[0035] The image information generating unit 14 may generate a three-dimensional image that displays the reinforcing bars in the plane specified by the operation in a manner that distinguishes them from the reinforcing bars in other planes in the reinforcing bar arrangement, and generate image information in which the three-dimensional image is superimposed on the stereo image. This enables the reinforcing bar arrangement inspection device 1 to display an image with improved visibility of the reinforcing bars arranged in the specified plane. Possible modes for distinguishing and displaying reinforcing bars include, for example, changing the color assigned to the three-dimensional point cloud representing the reinforcing bars, or changing the type of line superimposed on the image of the reinforcing bars.
[0036] For example, the image information generating unit 14 may generate a three-dimensional image that displays reinforcing bars in a plane specified by an operation in a color different from reinforcing bars in other planes in the reinforcement arrangement. This allows the reinforcement arrangement inspection device 1 to display an image in which the visibility of the reinforcing bars arranged in the specified plane is improved by the color given to the reinforcing bars. For example, the image information generating unit 14 provides a user interface that allows the user to specify any plane of the reinforcement arrangement using the operation unit 5 while the image information 145 shown in FIG. 3 is displayed on the display unit 3. When a plane is specified using the operation unit 5, the operation information is output from the operation unit 5 to the image information generating unit 14. The image information generating unit 14 identifies the specified plane based on the operation information.
[0037] 6 is a screen diagram showing an example (4) of the reinforcing bar inspection display screen. The image information generating unit 14 identifies, from among the three-dimensional points of the three-dimensional image, those belonging to the plane specified by the operation information, and assigns color information unique to this plane to the three-dimensional point cloud corresponding to the reinforcing bars in the plane specified using the reinforcing bar detection information. This generates a pseudo-color three-dimensional image in which color information is assigned to each three-dimensional point of the reinforcing bars in the specified plane. The image information generating unit 14 displays an image 148 on the display unit 3, in which a pseudo-color three-dimensional image is superimposed on a stereo image. In the image 148, a plane of the upper layer is specified, and the three-dimensional point cloud 111A corresponding to the reinforcing bars 6 placed on this plane is displayed in blue. By referring to this image 148, it is possible to recognize the reinforcing bars 6 placed on the specified plane by the color of the reinforcing bars.
[0038] The image information generating unit 14 may generate a three-dimensional image that displays the reinforcing bars in a plane specified by the operation by superimposing a different type of line from the reinforcing bars in other planes in the arrangement. This allows the reinforcing bar inspection device 1 to display an image in which the visibility of the reinforcing bars assembled in the specified plane is improved by the type of line superimposed on the reinforcing bars. For example, the image information generating unit 14 provides a user interface that allows the user to specify any plane of the reinforcing bars using the operation unit 5 while the image information 145 shown in FIG. 3 is displayed on the display unit 3. When a plane is specified using the operation unit 5, the operation information is output from the operation unit 5 to the image information generating unit 14. The image information generating unit 14 identifies the specified plane based on the operation information.
[0039] Fig. 7 is a screen diagram showing an example (5) of the reinforcing bar inspection display screen. The image information generating unit 14 identifies three-dimensional points in the three-dimensional image that belong to the plane specified by the operation information, and assigns line information of a type unique to this plane to the three-dimensional point cloud corresponding to the reinforcing bars in the plane specified using the reinforcing bar detection information. This generates a line-added three-dimensional image in which lines are superimposed on the reinforcing bars in the specified plane. The image information generating unit 14 displays an image 149 on the display unit 3, in which a line-added three-dimensional image is superimposed on a stereo image. In image 149, a plane of the upper layer is specified, and an image of a solid line is superimposed on an image of the reinforcing bars 6 assembled on this plane. By referring to this image 149, it is possible to recognize the reinforcing bars 6 assembled on the specified plane from the type of line superimposed on the reinforcing bars.
[0040] As a mode for distinguishing and displaying reinforcing bars, the above description has been given by changing the color given to the three-dimensional point cloud representing the reinforcing bars or by changing the type of line superimposed on the image of the reinforcing bars, but the present invention is not limited to this. In this case, it is sufficient to distinguish and display the reinforcing bars, and for example, the color given to the three-dimensional point cloud representing the reinforcing bars may be illuminated or the illumination may be blinked.
[0041] FIG. 8 is a flowchart showing the bar arrangement inspection method according to the first embodiment. The three-dimensional information acquisition unit 11 generates a three-dimensional image of the reinforcement from the stereo images of the reinforcement captured by the stereo camera 2 (step ST1). The plane identification unit 12 uses the three-dimensional images to identify the plane of the reinforcement (step ST2). The reinforcing bar detection unit 13 detects reinforcing bar detection information and camera angle of view information (H, V) (step ST3). The image information generation unit 14 generates image information in which the three-dimensional image is associated with the stereo images on a pixel-by-pixel basis based on the reinforcing bar detection information and the angle of view information, and the three-dimensional image is superimposed on the stereo images (step ST4). By performing this method, the reinforcement inspection device 1 can display an image with improved visibility of the actual distance of the reinforcing bars in the reinforcement on the stereo images.
[0042] Next, a hardware configuration for realizing the functions of the bar arrangement inspection device 1 will be described. The functions of the three-dimensional information acquisition unit 11, plane identification unit 12, reinforcing bar detection unit 13, image information generation unit 14 and measurement unit 15 included in the reinforcing bar inspection device 1 are realized by a processing circuit. That is, the bar arrangement inspection device 1 includes a processing circuit for executing each process from step ST1 to step ST4 shown in Fig. 8. The processing circuit may be dedicated hardware, or may be a CPU (Central Processing Unit) that executes a program stored in a memory.
[0043] Fig. 9A is a block diagram showing a hardware configuration for realizing the functions of the bar arrangement inspection device 1. Fig. 9B is a block diagram showing a hardware configuration for executing software for realizing the functions of the bar arrangement inspection device 1. In Figs. 9A and 9B, an input interface 100 is an interface that relays image information output from the stereo camera 2 to the bar arrangement inspection device 1. An output interface 101 is an interface that relays bar arrangement inspection results output from the bar arrangement inspection device 1 to a downstream device.
[0044] When the processing circuit is the dedicated hardware processing circuit 102 shown in FIG. 9A, the processing circuit 102 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof. The functions of the three-dimensional information acquisition unit 11, plane identification unit 12, reinforcing bar detection unit 13, image information generation unit 14 and measurement unit 15 provided in the reinforcement inspection device 1 may be realized by separate processing circuits, or these functions may be combined and realized by a single processing circuit.
[0045] 9B, the functions of the three-dimensional information acquisition unit 11, plane identification unit 12, reinforcing bar detection unit 13, image information generation unit 14, and measurement unit 15 included in the reinforcing bar inspection device 1 are realized by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and stored in the memory 104.
[0046] The processor 103 reads out and executes the programs stored in the memory 104, thereby realizing the functions of the three-dimensional information acquisition unit 11, plane identification unit 12, reinforcing bar detection unit 13, image information generation unit 14 and measurement unit 15 that are provided in the reinforcement inspection device 1. For example, the reinforcement inspection device 1 includes a memory 104 for storing a program that, when executed by the processor 103, results in the processing of steps ST1 to ST4 shown in Fig. 8 being executed. These programs cause a computer to execute procedures or methods of processing performed by the three-dimensional information acquisition unit 11, the plane identification unit 12, the reinforcing bar detection unit 13, the image information generation unit 14, and the measurement unit 15. The memory 104 may be a computer-readable storage medium in which programs for causing a computer to function as the three-dimensional information acquisition unit 11, the plane identification unit 12, the reinforcing bar detection unit 13, the image information generation unit 14, and the measurement unit 15 are stored.
[0047] Memory 104 may be, for example, a non-volatile or volatile semiconductor memory such as a Random Access Memory (RAM), a Read Only Memory (ROM), a flash memory, an Erasable Programmable Read Only Memory (EPROM), an Electrically-EPROM (EEPROM), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD, etc.
[0048] Some of the functions of the three-dimensional information acquisition unit 11, plane identification unit 12, reinforcing bar detection unit 13, image information generation unit 14, and measurement unit 15 included in the reinforcement inspection device 1 may be realized by dedicated hardware, and the remaining functions may be realized by software or firmware. For example, the functions of the three-dimensional information acquisition unit 11 are realized by a processing circuit 102, which is dedicated hardware, and the functions of the plane identification unit 12, the reinforcing bar detection unit 13, the image information generation unit 14 and the measurement unit 15 are realized by a processor 103 reading and executing a program stored in a memory 104. Thus, the processing circuitry may implement the above-described functions through hardware, software, firmware or a combination of these.
[0049] As described above, the reinforcing bar inspection device 1 according to the first embodiment includes a three-dimensional information acquisition unit 11 that generates a three-dimensional image of the reinforcing bar from the stereo images of the reinforcing bar captured by the stereo camera 2, a plane identification unit 12 that identifies a plane of the reinforcing bar using the three-dimensional image, a reinforcing bar detection unit 13 that detects reinforcing bar detection information indicating the position of the reinforcing bar in the identified plane and information on the angle of view of each pixel of the stereo image, and an image information generation unit 14 that generates image information in which a three-dimensional image is associated with the stereo image on a pixel-by-pixel basis based on the reinforcing bar detection information and the angle of view information, and the three-dimensional image is displayed superimposed on the stereo image. The reinforcing bar inspection device 1 three-dimensionally restores the reinforcing bar from the current image data of the stereo image based on the three-dimensional image associated with the stereo image and the information on the angle of view in pixel units, thereby making it possible to perform reinforcing bar measurement of the reinforcing bar in a later process without tampering with the current image data.
[0050] The bar arrangement inspection device 1 according to the first embodiment includes a measurement unit 15 that measures the rebars on each plane of the rebar arrangement using three-dimensional images and rebar detection information. The image information generation unit 14 generates image information on which electronic whiteboard information showing the results of measuring the rebars is further superimposed. This enables the bar arrangement inspection device 1 to display an image on which the electronic whiteboard information is superimposed.
[0051] In the bar arrangement inspection device 1 according to the first embodiment, the image information generating unit 14 generates a three-dimensional image that distinguishes between rebars on each plane, and generates image information in which the generated three-dimensional image is superimposed on a stereo image. This enables the bar arrangement inspection device 1 to display an image with improved visibility of which plane of the layer in which the rebars are arranged in the bar arrangement on the stereo image.
[0052] In the bar arrangement inspection device 1 according to the first embodiment, the image information generating unit 14 generates a three-dimensional image in which the color of the reinforcing bars is changed for each plane. This enables the bar arrangement inspection device 1 to display an image with improved visibility of which plane of the layer in which the reinforcing bars are arranged in the bar arrangement on the stereo image.
[0053] In the bar arrangement inspection device 1 according to the first embodiment, the image information generating unit 14 generates a three-dimensional image in which the type of line superimposed on the rebar is changed for each plane. This enables the bar arrangement inspection device 1 to display an image with improved visibility of which plane of the layer in which the rebar is arranged in the bar arrangement on the stereo image.
[0054] In the bar arrangement inspection device 1 according to the first embodiment, the image information generating unit 14 generates a three-dimensional image that displays rebars in a plane specified by operation in a manner that distinguishes them from rebars in other planes in the bar arrangement, and generates image information in which the three-dimensional image is superimposed on a stereo image. This enables the bar arrangement inspection device 1 to display an image with improved visibility of whether the rebars are arranged in the plane specified by operation.
[0055] In the bar arrangement inspection device 1 according to the first embodiment, the image information generating unit 14 generates a three-dimensional image that displays reinforcing bars in a plane specified by operation in a color different from reinforcing bars in other planes in the bar arrangement. This enables the bar arrangement inspection device 1 to display an image with improved visibility of whether the reinforcing bars are arranged in the plane specified by operation.
[0056] In the bar arrangement inspection device 1 according to the first embodiment, the image information generating unit 14 generates a three-dimensional image that displays reinforcing bars in a plane specified by operation by superimposing a different type of line from reinforcing bars in other planes in the bar arrangement. This enables the bar arrangement inspection device 1 to display an image with improved visibility of whether the reinforcing bars are arranged in the plane specified by operation.
[0057] The reinforcing bar inspection method according to the first embodiment includes a step ST1 in which the three-dimensional information acquisition unit 11 generates a three-dimensional image of the reinforcing bar from the stereo image of the reinforcing bar captured by the stereo camera 2, a step ST2 in which the plane identification unit 12 identifies a plane of the reinforcing bar using the three-dimensional image, a step ST3 in which the reinforcing bar detection unit 13 detects reinforcing bar detection information indicating the position of the reinforcing bar in the identified plane and information on the angle of view of each pixel of the stereo image, and a step ST4 in which the image information generation unit 14 generates image information in which the three-dimensional image is associated with the stereo image in pixel units based on the reinforcing bar detection information and the angle of view information, and the three-dimensional image is displayed superimposed on the stereo image. By executing this method, the reinforcing bar inspection device 1 can perform reinforcing bar measurement of the reinforcing bar in a later process without falsifying the current image data by three-dimensionally restoring the reinforcing bar from the current image data of the stereo image based on the three-dimensional image associated with the stereo image and the information on the angle of view in pixel units.
[0058] The bar arrangement inspection method according to the first embodiment includes step ST6 in which the measurement unit 15 measures the planar reinforcing bars of the reinforcing bars using a three-dimensional image, and the image information generation unit 14 generates image information on which electronic whiteboard information showing the results of measuring the reinforcing bars is further superimposed. By performing this method, the bar arrangement inspection device 1 can display an image on which electronic whiteboard information is superimposed.
[0059] The computer executing the program of embodiment 1 functions as a reinforcement inspection device 1 equipped with a three-dimensional information acquisition unit 11 that generates a three-dimensional image of the reinforcement from the stereo images of the reinforcement captured by the stereo camera 2, a plane identification unit 12 that identifies the plane that the reinforcement has using the three-dimensional image, a reinforcing bar detection unit 13 that detects reinforcing bar detection information indicating the position of the reinforcing bar in the identified plane and angle of view information for each pixel of the stereo image, and an image information generation unit 14 that generates image information that corresponds the three-dimensional image to the stereo image on a pixel-by-pixel basis based on the reinforcing bar detection information and the angle of view information, and displays the three-dimensional image superimposed on the stereo image. This makes it possible to provide a reinforcing bar inspection device 1 that can perform rebar measurement of reinforcing bars in a later process without falsifying the current image data by three-dimensionally restoring the reinforcing bars from the current image data of the stereo images based on the three-dimensional image associated with the stereo images and the angle of view information in pixel units.
[0060] The computer that executes the program according to the first embodiment includes a measuring unit 15 that uses three-dimensional images to measure the planar reinforcing bars of the reinforcing bars, and the image information generating unit 14 functions as a reinforcing bar inspection device 1 that generates image information on which electronic whiteboard information showing the results of measuring the reinforcing bars is further superimposed. This makes it possible to provide a reinforcing bar inspection device 1 that displays an image on which electronic whiteboard information is superimposed.
[0061] Any of the components of the embodiments may be modified or omitted. [Explanation of symbols]
[0062] 1 Reinforcement inspection device, 2 stereo camera, 3 display unit, 4 memory unit, 5 operation unit, 6 reinforcing bar, 11 three-dimensional information acquisition unit, 12 plane identification unit, 13 reinforcing bar detection unit, 14 image information generation unit, 15 measurement unit, 100 input interface, 101 output interface, 102 processing circuit, 103 processor, 104 memory, 111A, 111C three-dimensional point cloud, 141 stereo image, 142 three-dimensional image, 143, 144, 146, 147, 148, 149 image, 145 image information, 151A, 151B marker, 151C electronic whiteboard information.
Claims
1. A reinforcing bar inspection device for inspecting reinforcing bars having a multi-layered plane made of reinforcing bars arranged in a lattice pattern, a three-dimensional information acquisition unit that generates a three-dimensional image of the reinforcement from the stereo images of the reinforcement captured by a stereo camera; A plane identification unit that identifies a plane of the reinforcement using the three-dimensional image; a reinforcing bar detection unit that detects reinforcing bar detection information indicating the position of a reinforcing bar in a specified plane and information on an angle of view for each pixel of the stereo image; an image information generating unit that generates image information in which the three-dimensional image is associated with the stereo image in pixel units based on the reinforcing bar detection information and the angle of view information, and the three-dimensional image is superimposed on the stereo image and displayed. A reinforcing bar inspection device characterized by the above.
2. A measuring unit that measures the planar reinforcing bars of the reinforcing bars using the image information, The image information generating unit generates the image information on which electronic whiteboard information showing the results of measuring the reinforcing bars is further superimposed.
2. The reinforcing bar inspection device according to claim 1 .
3. The image information generating unit generates the three-dimensional image that distinguishes the reinforcing bars for each plane, and generates the image information by superimposing the generated three-dimensional image on the stereo image.
3. The reinforcing bar inspection device according to claim 1 or 2.
4. The image information generating unit generates the three-dimensional image in which the color of the reinforcing bar is changed for each plane.
4. The reinforcing bar inspection device according to claim 3.
5. The image information generating unit generates the three-dimensional image in which the type of line superimposed on the reinforcing bar is changed for each plane.
4. The reinforcing bar inspection device according to claim 3.
6. The image information generating unit generates the three-dimensional image that displays the reinforcing bars in a plane specified by the operation in a manner that distinguishes them from the reinforcing bars in other planes in the reinforcing bar arrangement, and generates the image information in which the generated three-dimensional image is superimposed on the stereo image.
4. The reinforcing bar inspection device according to claim 3.
7. The image information generating unit generates the three-dimensional image in which the reinforcing bars in the plane specified by the operation are displayed in a color different from the reinforcing bars in other planes in the reinforcing bar arrangement.
7. The bar arrangement inspection device according to claim 6.
8. The image information generating unit generates the three-dimensional image in which the reinforcing bars in the plane specified by the operation are superimposed with lines of a type different from the reinforcing bars in other planes in the reinforcing bars arrangement.
7. The bar arrangement inspection device according to claim 6.
9. A reinforcing bar inspection method using a reinforcing bar inspection device for inspecting reinforcing bars having a multi-layered plane made of reinforcing bars arranged in a lattice pattern, comprising: A three-dimensional information acquisition unit generates a three-dimensional image of the reinforcement from the stereo images of the reinforcement captured by a stereo camera; A step in which a plane identifying unit identifies a plane of the reinforcement using the three-dimensional image; A step in which a reinforcing bar detection unit detects reinforcing bar detection information indicating a position of a reinforcing bar in the identified plane and field of view information for each pixel of the stereo image; and generating image information in which the three-dimensional image is associated with the stereo image in pixel units based on the reinforcing bar detection information and the angle of view information, and the three-dimensional image is superimposed on the stereo image and displayed. A reinforcement inspection method comprising:
10. A step in which a measuring unit measures a planar reinforcing bar of the reinforcing bar arrangement using the image information, The image information generating unit generates the image information on which electronic whiteboard information showing the results of measuring the reinforcing bars is further superimposed. The method for inspecting bar arrangement according to claim 9 .
11. Computer, A reinforcing bar inspection device for inspecting reinforcing bars having a multi-layered plane made of reinforcing bars arranged in a lattice pattern, a three-dimensional information acquisition unit that generates a three-dimensional image of the reinforcement from the stereo images of the reinforcement captured by a stereo camera; A plane identification unit that identifies a plane of the reinforcement using the three-dimensional image; a reinforcing bar detection unit that detects reinforcing bar detection information indicating the position of a reinforcing bar in a specified plane and information on an angle of view for each pixel of the stereo image; and an image information generating unit that generates image information in which the three-dimensional image is associated with the stereo image in pixel units based on the reinforcing bar detection information and the angle of view information, and the three-dimensional image is displayed superimposed on the stereo image. A program characterized by:
12. Computer, A measuring unit that measures the planar reinforcing bars of the reinforcing bars using the image information, The image information generating unit functions as a reinforcing bar arrangement inspection device that generates the image information on which electronic whiteboard information showing the results of measuring the reinforcing bars is further superimposed.
12. The program according to claim 11 .
Citation Information
Patent Citations
Bar arrangement measurement system, bar arrangement measurement method, and program
JP2020166660A
Cited By
Multi-mode AI-driven three-dimensional steel bar beam intelligent acceptance method
CN120525411A
Reinforcement Inspection Support Method
JP7933999B1
