Test support system, test support method, and program

Abstract

We provide an inspection support system that can assist in capturing images showing reinforced concrete structures. [Solution] The inspection support system 10 is an inspection support system 10 that assists in taking images used for inspecting reinforced concrete structures, and comprises an imaging unit 26, a display control unit 23d that displays a video showing the reinforced concrete structure being captured by the imaging unit 26 on a display unit 22, an acquisition unit 23a that acquires image information of the image showing the reinforced concrete structure and acquires posture information of the imaging unit 26 when the video is being displayed, and a detection unit 23c that detects the reinforcing bars included in the reinforced concrete structure shown in the image based on the acquired image information, and the display control unit 23d superimposes and displays a first object indicating the detected reinforcing bars on the video based on the acquired posture information.

Description

Technical Field

[0001] The present invention relates to an inspection support system for assisting in the inspection of a reinforcing bar structure.

Background Art

[0002] In the construction of a building with a reinforced concrete structure, before placing concrete, reinforcement inspection (inspection of the arrangement of reinforcing bars) is carried out according to the design information. As a technology related to reinforcement inspection, Patent Document 1 discloses a reinforcement measuring device that is excellent in workability and can measure the three-dimensional arrangement of reinforcing bars.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present invention provides an inspection support system or the like that can assist in photographing an image in which a reinforcing bar structure is reflected.

Means for Solving the Problems

[0005] An inspection support system according to an aspect of the present invention is an inspection support system for assisting in photographing an image used for inspecting a reinforcing bar structure, including an imaging unit, a display unit, a display control unit that displays a moving image in which the reinforcing bar structure being photographed by the imaging unit is reflected on the display unit, an acquisition unit that acquires image information of an image in which the reinforcing bar structure is reflected and attitude information of the imaging unit when the moving image is being displayed, and a detection unit that detects reinforcing bars included in the reinforcing bar structure reflected in the image based on the acquired image information, and the display control unit superimposes and displays a first object indicating the detected reinforcing bars on the moving image based on the acquired attitude information.

[0006] An inspection support method according to one aspect of the present invention is an inspection support method performed by a computer to support the capture of images used for inspecting a reinforcing bar structure, comprising: a first display step in which an imaging unit displays a video showing the reinforcing bar structure being captured on a display unit; an acquisition step in which, while the video is being displayed, image information of the image showing the reinforcing bar structure is acquired and orientation information of the imaging unit is acquired; a detection step in which, based on the acquired image information, reinforcing bars included in the reinforcing bar structure shown in the image are detected; and a second display step in which, based on the acquired orientation information, a first object indicating the detected reinforcing bars is superimposed on the video.

[0007] A program according to one aspect of the present invention is a program for causing the computer to execute the inspection support method. [Effects of the Invention]

[0008] The inspection support system of the present invention can assist in capturing images showing reinforced concrete structures. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a block diagram showing the configuration of the inspection support system according to the embodiment. [Figure 2] Figure 2 shows a worker performing a rebar inspection using the inspection support system according to the embodiment. [Figure 3] Figure 3 is a flowchart showing an example of the operation of the inspection support device according to the embodiment. [Figure 4] Figure 4 shows an example of design information. [Figure 5] Figure 5 shows an example of a selection screen used by a worker to select the reinforcing bars to be inspected. [Figure 6] Figure 6 shows an example of the selection screen when one reinforcing bar is displayed as active. [Figure 7] Figure 7 is a flowchart of Example 1 of the image capture support process. [Figure 8]Figure 8 shows an example of an image capture screen. [Figure 9] Figure 9 shows an example of the display of the first object. [Figure 10] Figure 10 is a flowchart of Example 2 of the image acquisition support process. [Figure 11] Figure 11 shows an example of the display of the second object. [Figure 12] Figure 12 is a flowchart of Example 3 of the image acquisition support process. [Figure 13] Figure 13 shows an example of an object displaying the direction of movement. [Modes for carrying out the invention]

[0010] The embodiments will be described in detail below with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement positions and connection configurations of components, steps, and the order of steps shown in the following embodiments are examples only and are not intended to limit the present invention. Furthermore, components in the following embodiments that are not described in an independent claim will be described as optional components.

[0011] Please note that each figure is a schematic diagram and not necessarily a strictly accurate representation. Furthermore, in each figure, substantially identical components are denoted by the same reference numerals, and redundant explanations may be omitted or simplified.

[0012] (Embodiment) [composition] First, the configuration of the inspection support system according to the embodiment will be described. Figure 1 is a block diagram showing the configuration of the inspection support system according to the embodiment.

[0013] The inspection support system 10 is a system that can support the reinforcement inspection by workers at the construction site. The reinforcement inspection is an inspection to confirm whether the arrangement of steel bars, the thickness of steel bars (bar diameter), the number of steel bars, etc. in a building under construction match the design information (design drawings). FIG. 2 is a diagram showing a worker who performs reinforcement inspection using the inspection support system 10. The worker can perform the reinforcement inspection relatively easily by taking an image of the steel bar structure to be inspected using the portable inspection support device 20.

[0014] As shown in FIG. 1, the inspection support system 10 includes an inspection support device 20 and a server device 30.

[0015] The inspection support device 20 is a portable information terminal used by workers to perform reinforcement inspection. The inspection support device 20 is realized, for example, by attaching a dedicated adapter to a general-purpose information terminal such as a smartphone or a tablet terminal, but it may also be a dedicated information terminal. Specifically, the inspection support device 20 includes an operation reception unit 21, a display unit 22, an information processing unit 23, a storage unit 24, a communication unit 25, an imaging unit 26, and an acceleration sensor 27.

[0016] The operation reception unit 21 receives the input (manual operation) of the worker. The operation reception unit 21 is realized, for example, by a touch panel.

[0017] The display unit 22 displays an image. The display unit 22 is realized, for example, by a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel.

[0018] The information processing unit 23 performs information processing to support the reinforcement bar inspection by the worker. The information processing unit 23 is implemented by, for example, a microcomputer, but may also be implemented by a processor. The information processing unit 23 includes, as functional components, an acquisition unit 23a, a generation unit 23b, a grouping unit 23c, a display control unit 23d, and an inspection unit 23e. The functions of the acquisition unit 23a, the generation unit 23b, the grouping unit 23c, the display control unit 23d, and the inspection unit 23e are realized, for example, by the microcomputer or processor constituting the information processing unit 23 executing a computer program stored in the storage unit 24. The detailed functions of the acquisition unit 23a, the generation unit 23b, the grouping unit 23c, the display control unit 23d, and the inspection unit 23e will be described later.

[0019] The memory unit 24 is a storage device that stores computer programs executed by the information processing unit 23, as well as various information necessary for the information processing unit 23 to perform the above processing. The memory unit 24 is implemented, for example, by semiconductor memory.

[0020] The communication unit 25 is a communication module (communication circuit) that enables the inspection support device 20 to communicate with the server device 30 via a wide-area communication network 90 such as the Internet. The communication performed by the communication unit 25 is, for example, wireless communication. The communication standard used for communication is not particularly limited.

[0021] The imaging unit 26 captures an image. The imaging unit 26 is a stereo camera capable of measuring, for example, the distance from the position of the inspection support device 20 when capturing an image to the subject appearing in the image.

[0022] The acceleration sensor 27 detects the acceleration applied to the inspection support device 20. The acceleration sensor 27 is used to detect the position (displacement), orientation, and vertical direction of the inspection support device 20 when an operator takes an image using the inspection support device 20.

[0023] The server device 30 communicates with the inspection support device 20 (communication unit 25) to receive login information entered by the worker into the inspection support device 20, and performs authentication of the received login information (in other words, user authentication). If user authentication is successful, the server device 30 sends a usage permission notification to the inspection support device 20. Upon receiving the usage permission notification, the inspection support device 20 becomes ready to perform rebar inspection. The following example of operation is assumed to occur after successful user authentication.

[0024] [Example of operation] Next, we will describe an example of the operation of the inspection support device 20, which assists workers in inspecting the reinforcement bar placement. Figure 3 is a flowchart of the operation example of the inspection support device 20.

[0025] When a predetermined input screen (not shown) is displayed on the display unit 22 of the inspection support device 20, the operator performs a selection operation to select design information corresponding to the reinforced concrete structure to be inspected from among multiple design information stored in the storage unit 24. The operation reception unit 21 receives the design information selection operation (S11), and the acquisition unit 23a acquires the selected design information from the storage unit 24 (S12). Figure 4 is a diagram showing an example of design information. The design information shown in Figure 4 is information that shows the design reinforcement arrangement of a column in a building, and specifically, it shows the types of reinforcement bars (main reinforcement and stirrups) included in the column and the arrangement of each type of reinforcement bar. Specifically, the design information shown in Figure 4 shows the arrangement of multiple main reinforcement bars that are long in the vertical direction and multiple stirrups that are processed into a rectangle to surround the main reinforcement bars. In step S12, design information showing the reinforcement arrangement of a column as shown in Figure 4 is acquired. Examples of parts other than columns include beams, walls, or slabs.

[0026] Next, the worker performs a shooting operation to photograph the reinforcing steel structure to be inspected, and the operation reception unit 21 receives the shooting operation (S13). Based on the received shooting operation, the acquisition unit 23a uses the imaging unit 26 to capture an image (still image) of the reinforcing steel structure and acquires the image information of the captured image (S14). As described above, the imaging unit 26 is a stereo camera, and in step S14, image information of two images taken from different shooting positions is acquired in a single shooting operation. In other words, the image information includes the actual image data of the two images (stereo images) and viewpoint information (information indicating the distance between the shooting positions). Here, it is assumed that the reinforcing steel structure of a column, as shown in Figure 2, is to be photographed. Image capture may be performed multiple times, for example, by changing the shooting position, but it is sufficient to perform it at least once.

[0027] Next, the generation unit 23b generates a three-dimensional model of the reinforcing bar structure shown in the image based on the image information acquired in step S14 (S15). Specifically, the generation unit 23b can determine the distance from the inspection support device 20 to each part of the reinforcing bar structure based on the two actual image data and viewpoint information included in the image information, and can generate a three-dimensional model of the reinforcing bar structure based on the determined distance. A detailed explanation of the method for generating the three-dimensional model is omitted.

[0028] In step S15, the 3D model generated may contain reinforcing bars that are not intended for inspection. For example, when taking images at a construction site, unintended reinforcing bars may be captured in the images, resulting in the 3D model containing actual reinforcing bars that are not intended for inspection. In addition, the 3D model may contain non-existent reinforcing bars that are not intended for inspection due to false detection.

[0029] In order to exclude reinforcing bars that have been incorrectly detected by the inspection support device 20 from the inspection, the following steps S16 to S18 are performed, and the worker selects the reinforcing bar to be inspected from among the multiple reinforcing bars included in the 3D model.

[0030] The grouping unit 23c detects multiple reinforcing bars (more specifically, 3D models of multiple reinforcing bars) from the 3D model generated in step S15, and groups the detected multiple reinforcing bars (S16).

[0031] For example, if column design information is selected in step S12, the grouping unit 23c detects vertically long reinforcing bars from the 3D model, assigns individual identification information to each detected reinforcing bar, and also assigns common group identification information to the detected reinforcing bars. In other words, the grouping unit 23c detects main reinforcing bars from the 3D model and manages the detected main reinforcing bars as a single group. The vertical direction can be detected using the acceleration sensor 27.

[0032] Furthermore, the grouping unit 23c detects reinforcing bars that intersect perpendicularly with the main reinforcement (reinforcing bars that are long horizontally), assigns individual identification information to each detected reinforcing bar, and also assigns common group identification information to the detected reinforcing bars. In other words, the grouping unit 23c detects stirrups from the 3D model and manages the detected stirrups as a single group.

[0033] Next, the display control unit 23d displays a selection screen on the display unit 22 for the worker to select the reinforcing bars to be inspected (S17). Figure 5 shows an example of the selection screen. The selection screen in Figure 5 includes a first area 22a where the image taken in step S14 is displayed, a second area 22b where second objects (buttons) for selecting reinforcing bars are arranged, and a third area 22c where a cross-sectional view of the 3D model is displayed.

[0034] The image displayed in the first region 22a is superimposed with a first object 22d for selecting reinforcing bars. The first object 22d is assigned individual identification information (numbers 0 to 11 in Figure 5) that was assigned in step S16. The display control unit 23d can assign identification information of reinforcing bars detected in the 3D model to the corresponding reinforcing bars in the image, based on the correspondence between the reinforcing bar structure shown in the image and the 3D model of the reinforcing bar structure.

[0035] In the second area 22b, multiple second objects corresponding to the individual identification information assigned in step S16 are displayed.

[0036] The third area 22c displays a cross-sectional view of the 3D model. The cross-section displayed is automatically determined according to the design information (parts such as columns) acquired in step S12. In other words, different design information will result in different displayed cross-sections. If the design information for a column (Figure 4) is acquired in step S12, the third area 22c displays a cross-section cut in a horizontal plane (i.e., a cross-section of the main reinforcement). The main reinforcement displayed in the cross-sectional view of the third area 22c is also assigned the individual identification information assigned in step S16.

[0037] The display control unit 23d can switch the display and hiding of the first object 22d and the second object 22e on a group basis. When the first toggle switch 22f at the top of the second area 22b is turned on and off, the display of the first object 22d and the second object 22e of the main reinforcement detected in step S16 is turned on and off, and when the second toggle switch 22g is turned on and off, the display of the first object 22d and the second object 22e of the stirrups detected in step S16 is turned on and off.

[0038] In Figure 5, the first toggle switch 22f is ON and the second toggle switch 22g is OFF, so only the first object 22d and second object 22e of the main reinforcement are displayed, and the first object 22d and second object 22e of the stirrups are not displayed. If the second toggle switch 22g is turned ON in addition to the first toggle switch 22f, the selection screen will display the first object 22d and second object 22e of the main reinforcement, as well as the first object 22d and second object 22e of the stirrups. In other words, more objects will be displayed on the selection screen than shown in Figure 5, making it difficult for the worker to quickly select the desired object.

[0039] When the selection screen described above is displayed, the operator performs a selection operation to select the reinforcing bar to be inspected, and the operation reception unit 21 accepts the selection operation for the reinforcing bar (S18). The selection operation here includes both the selection operation for the first object 22d and the selection operation for the second object 22e. For example, when the operator selects the first object 22d to which individual identification information "0" has been assigned, the first object 22d to which individual identification information "0" has been assigned, the reinforcing bar corresponding to individual identification information "0" shown in the image in the first region 22a, the second object 22e to which individual identification information "0" has been assigned, and the reinforcing bar in the third region 22c (cross-sectional view) to which individual identification information "0" has been assigned become active (indicated as selected). Figure 6 shows an example of the selection screen when one reinforcing bar is actively displayed. Active display means that the selected object is displayed in a different manner from the unselected object, and specifically means that the selected object is displayed in a different color from the unselected object.

[0040] Furthermore, if the operator selects the second object 22e to which individual identification information "0" has been assigned, the first object 22d to which individual identification information "0" has been assigned, the reinforcing bar corresponding to individual identification information "0" shown in the image within the first region 22a, the second object 22e to which individual identification information "0" has been assigned, and the reinforcing bar in the cross-sectional view to which individual identification information "0" has been assigned will all be displayed as active. In other words, the operator is allowed to both select the reinforcing bar by manipulating the first object 22d and to perform the reinforcing bar operation by manipulating the second object 22e.

[0041] In step S18, if the worker wants to select the main reinforcement for inspection, they simply turn on the first toggle switch 22f and turn off the second toggle switch 22g. This displays only the first object 22d and second object 22e of the main reinforcement, while the first object 22d and second object 22e of the stirrups are not displayed, allowing the worker to quickly select the main reinforcement and reducing the likelihood of incorrect selection.

[0042] Next, the inspection unit 23e inspects the reinforcement structure by comparing a 3D model containing only the reinforcement bars selected in step S18 with the design information acquired in step S12 (S19). If main reinforcement bars were selected in step S18, the inspection unit 23e compares the 3D model containing only the main reinforcement bars with the design information to check whether the arrangement of the main reinforcement bars, the thickness of the main reinforcement bars, and the number of main reinforcement bars match the design information (design drawings). The inspection unit 23e then displays the inspection results on the display unit 22 and stores them in the storage unit 24.

[0043] As described above, the inspection support device 20 can assist workers in inspecting reinforcement bars. The inspection support device 20 groups multiple reinforcing bars included in the 3D model of the reinforced concrete structure and has a function to switch the display and hiding of multiple objects (multiple first objects 22d or multiple second objects 22e) on the display unit 22 for selecting the reinforcing bars to be inspected, on a group-by-group basis. With such an inspection support device 20, workers can quickly select the reinforcing bars to be inspected by hiding the objects corresponding to the reinforcing bars that are not to be inspected.

[0044] [Example 1 of image capture support processing] In step S14 described above, the current rebar structure being captured by the imaging unit 26 is displayed as a video in real time on the display unit 22. The acquisition unit 23a acquires image information of the image at that point in time multiple times at predetermined time intervals while the video is being displayed, and stores it in the storage unit 24. The generation of the 3D model in step S15 is performed using the image information of the image stored in this way.

[0045] Here, the reinforcing bars located further back from the inspection support device 20 are hidden by the reinforcing bars located closer to the viewer and are difficult to capture in the image. In order to generate a 3D model of the reinforcing bar structure, all the reinforcing bars included in the structure must be visible in at least one of the multiple images taken. In other words, in step S14, it is necessary to take multiple images by having the worker move or by changing the posture of the inspection support device 20.

[0046] Therefore, in step S14, image capture support processing is performed so that all reinforcing bars included in the reinforced concrete structure are visible in at least one of the multiple images taken. Below, an example 1 of such image capture support processing is described. Figure 7 is a flowchart of example 1 of image capture support processing.

[0047] The display control unit 23d displays a video of the reinforcing steel structure being captured by the imaging unit 26 on the display unit 22 in real time (S14a). Figure 8 is a diagram showing an example of the display unit (image capture screen) with the video displayed. The acquisition unit 23a acquires the posture information of the inspection support device 20 (imaging unit 26) while the video is being displayed (S14b). The posture information is the output information of the acceleration sensor 27 (specifically, acceleration information in the x, y, and z axes). The processing in step S14b is repeated while the video is being displayed. The posture information is acquired continuously while the video is being displayed in order to determine the position and posture of the inspection support device 20 in a predetermined reference coordinate system (three-dimensional coordinate space).

[0048] The acquisition unit 23a acquires image information of the image showing the reinforced concrete structure while the video is being displayed (S14c). In other words, the acquisition unit 23a acquires image information of the image (image) for generating a 3D model of the reinforced concrete structure. To put it another way, the acquisition unit 23a takes an image.

[0049] Next, the detection unit 23c detects the reinforcing bars included in the reinforcing bar structure shown in the image based on the image information acquired in step S14c (S14d). The detection unit 23c stores in the storage unit 24, for example, the estimated position of the detected reinforcing bar in the reference coordinate system, based on the position and orientation of the inspection support device 20 when the image information was acquired, which is determined by the orientation information, and the position of the detected reinforcing bar in the image.

[0050] Next, the display control unit 23d superimposes the first object, which represents the detected reinforcing bar, onto the video (S14e). Figure 9 shows an example of the display of the first object.

[0051] As shown in Figure 9, the first object is, for example, a linear object along the detected reinforcing bar. The first object is assigned identification information (numbers 0 to 6 in Figure 9). The first object is not limited to a linear object; it may also be an arrow pointing to the detected reinforcing bar. Note that in Figure 9, to avoid making the drawing complex and difficult to read, the first object is only displayed for vertically long reinforcing bars that have been successfully detected. However, the first object will also be displayed for horizontally long reinforcing bars if they are successfully detected.

[0052] If the position of the inspection support device 20 (the operator's position) moves while the video is being displayed, the display position of the first object in the video is corrected based on the current position and orientation of the inspection support device 20 in the reference coordinates, which are determined based on the orientation information, and the estimated position of the reinforcing bar in the reference coordinates, which is stored in the memory unit 24 in step S14d. In other words, if the position of the inspection support device 20 (the operator's position) changes while the video is being displayed, the display position of the first object is updated accordingly, and if the display position of the reinforcing bar in the video changes, it follows that change.

[0053] The processing in steps S14c to S14e is repeated after a predetermined time of several seconds to about 10 seconds has elapsed. From the second time onward, if a new rebar is detected, a new first object is superimposed on the video.

[0054] As described above, the inspection support device 20 (display control unit 23d) overlays the first object indicating the detected reinforcing bar onto the video based on the posture information acquired in step S14b. This allows the worker to easily distinguish between detected and undetected reinforcing bars, and to change their standing position (shooting position) so that undetected reinforcing bars are detected.

[0055] [Example 2 of image capture support processing] In Example 1 of the image capture support process, a first object indicating detected reinforcing bars was displayed. However, in addition to the first object, a second object indicating undetected reinforcing bars may also be displayed. Below, Example 2 of such image capture support process will be described. Figure 10 is a flowchart of Example 2 of the image capture support process.

[0056] The processing in steps S14a to S14e is the same as in Example 1 of the image capture support processing, so a detailed explanation is omitted. After step S14e, the display control unit 23d compares the design information (design reinforcement arrangement) acquired in step S12 with the detection result in step S14d (reinforcement arrangement detected in step S14d) to estimate the position of the undetected reinforcement (S14f). For example, if the design number of main reinforcement bars is 8 and the number of main reinforcement bars detected is 7, the display control unit 23d can estimate the position of the remaining 1 main reinforcement bar. The display control unit 23d stores the estimated position of the undetected reinforcement bar in the reference coordinates in the storage unit 24.

[0057] Next, the display control unit 23d superimposes a second object indicating undetected reinforcing bars onto the video (S14g). Figure 11 shows an example of the display of the second object. Figure 11 is a diagram that assumes the worker has changed (moved) the shooting position after reinforcing bars have been detected as shown in Figure 9.

[0058] In Figure 11, a dashed line object is displayed as a second object at the design location of the reinforcing bars that could not be detected in the state shown in Figure 9. The second object is not limited to a dashed line object; it could also be an arrow or the like that points to the design location of the undetected reinforcing bars. The second object can be an object of a different nature from the first object; for example, it could be a straight line with a different color from the first object.

[0059] If the position of the inspection support device 20 (the operator's position) moves while the video is being displayed, the display position of the second object in the video is corrected based on the current position and orientation of the inspection support device 20 in the reference coordinates, which are determined based on the orientation information, and the estimated position of the undetected reinforcing bars in the reference coordinates, which is stored in the memory unit 24 in step S14f. In other words, if the position of the inspection support device 20 (the operator's position) changes while the video is being displayed, the display position of the second object is updated accordingly, and if the display position of the reinforcing bars in the video changes, it follows that change.

[0060] The processing in steps S14c to S14g is repeated after a predetermined time of several seconds to about 10 seconds has elapsed. From the second time onward, if a new rebar is detected, a new first object is superimposed on the video in place of the second object.

[0061] As described above, the inspection support device 20 (display control unit 23d) overlays a second object indicating undetected reinforcing bars included in the reinforcing bar structure onto the video, based on the detection result by the detection unit 23c in step S14d and the design information acquired in step S12. This allows the worker to easily understand which reinforcing bars have been detected and which have not, and to change their standing position (shooting position) so that undetected reinforcing bars are detected.

[0062] [Example 3 of image capture support processing] In Example 1 of the image capture support process, a first object indicating detected reinforcing bars was displayed. However, in addition to the first object, a second object indicating the direction of movement of the inspection support device 20 (imaging unit 26) for detecting undetected reinforcing bars may also be displayed. Below, Example 2 of such a still image capture support process will be described. Figure 12 is a flowchart of Example 3 of the image capture support process.

[0063] The processing in steps S14a to S14f is the same as in Example 2 of the image acquisition support processing, so a detailed explanation is omitted. After step S14f, the display control unit 23d superimposes an object indicating the direction of movement for detecting undetected reinforcing bars onto the display unit 22 (S14h). Figure 13 shows an example of the display of an object indicating the direction of movement.

[0064] Objects indicating the direction of movement can be described as objects that encourage (recommend) movement, or objects that guide the shooting position. In Figure 13, an arrow is displayed on the right side of the video as an example of an object indicating the direction of movement. The location of undetected reinforcing bars and the direction of the arrow to be displayed are determined, for example, by table information stored in the memory unit 24 beforehand. Note that objects indicating the direction of movement may be displayed outside or inside the video.

[0065] The processing in steps S14c to S14h is repeated after a predetermined time of several seconds to about 10 seconds has elapsed. Once there are no more undetected reinforcing bars, the object indicating the direction of movement will no longer be displayed.

[0066] As described above, the inspection support device 20 (display control unit 23d) displays on the display unit 22 the direction of movement of the inspection support device 20 (imaging unit 26) for detecting undetected reinforcing bars included in the reinforcing bar structure, based on the detection result by the detection unit 23c in step S14d and the design information acquired in step S12. This allows the worker to change their standing position (shooting position) so that undetected reinforcing bars are detected.

[0067] [Differentiation] In the image capture support process of the above embodiment, an example was described in which the first object is superimposed on the video, but it is not essential that the first object is superimposed on the video. It is sufficient that at least one of the first object, the second object, and the object indicating the direction of movement is displayed on the display unit 22, and it is also possible that only the second object is displayed, or only the object indicating the direction of movement is displayed.

[0068] In the above embodiment, image information from images captured by a stereo camera was used to generate a three-dimensional model of the reinforced concrete structure. However, the inspection support device 20 may be equipped with a ToF (Time of Flight) camera as the imaging unit 26, and the generation unit 23b may generate a three-dimensional model of the reinforced concrete structure based on image information from images (distance images) captured by the ToF camera.

[0069] Furthermore, the inspection support device 20 may be equipped with a 3D scanner such as LiDAR (Light Detection And Ranging), and may generate a 3D model of the reinforced concrete structure based on point cloud data showing the unevenness of the reinforced concrete structure acquired by the 3D scanner.

[0070] In the above embodiment, some of the processes described as being performed by the inspection support device 20 may be performed by the server device 30. For example, the 3D model generation process may be performed by the server device 30.

[0071] [Effects, etc.] Invention 1 is an inspection support system 10 that assists in taking images used for inspecting reinforced concrete structures, comprising: an imaging unit 26; a display unit 22; a display control unit 23d that displays a video of the reinforced concrete structure being captured by the imaging unit 26 on the display unit 22; an acquisition unit 23a that acquires image information of the image of the reinforced concrete structure and also acquires posture information of the imaging unit 26 when the video is being displayed; and a detection unit 23c that detects reinforcing bars included in the reinforced concrete structure shown in the image based on the acquired image information, wherein the display control unit 23d overlays a first object indicating the detected reinforcing bars onto the video based on the acquired posture information.

[0072] Such an inspection support system 10 can assist workers in taking images by displaying a first object that indicates the detected rebar. The worker can then recognize if there is any undetected rebar and change the shooting position.

[0073] Invention 2 is an inspection support system 10 of Invention 1, wherein the acquisition unit 23a further acquires design information of the reinforcing bar structure, and the display control unit 23d displays on the display unit 22 the direction of movement of the imaging unit 26 for detecting undetected reinforcing bars included in the reinforcing bar structure, based on the detection result by the detection unit 23c and the acquired design information.

[0074] Such an inspection support system 10 can assist workers in taking images by displaying the direction of movement for detecting undetected reinforcing bars. Workers can easily change their shooting position according to the displayed direction of movement.

[0075] Invention 3 is an inspection support system 10 according to Invention 1 or 2, wherein the acquisition unit 23a further acquires design information of the reinforcement structure, and the display control unit 23d superimposes a second object indicating undetected reinforcement bars included in the reinforcement structure onto the video based on the detection result by the detection unit 23c and the acquired design information.

[0076] Such an inspection support system 10 can assist workers in taking images by displaying a second object indicating undetected rebar. The worker can then recognize the presence of undetected rebar and change the shooting position.

[0077] Invention 4 is an inspection support method performed by a computer to assist in capturing images used for inspecting reinforced concrete structures, comprising: a first display step in which an imaging unit 26 displays a video showing the reinforced concrete structure being captured on a display unit 22; an acquisition step in which, while the video is being displayed, image information of the image showing the reinforced concrete structure is acquired and orientation information of the imaging unit 26 is acquired; a detection step in which, based on the acquired image information, reinforcing bars included in the reinforced concrete structure shown in the image are detected; and a second display step in which, based on the acquired orientation information, a first object indicating the detected reinforcing bars is superimposed on the video.

[0078] This inspection support method can assist workers in taking images by displaying a first object that indicates the detected reinforcing bar.

[0079] Invention 5 is a program for causing a computer to execute the inspection support method of Invention 4.

[0080] According to such a program, the computer can assist workers in taking images by displaying a first object that indicates the detected reinforcing bars.

[0081] (Other embodiments) Although embodiments have been described above, the present invention is not limited to the embodiments described above.

[0082] For example, in the above embodiment, the inspection support system was implemented by multiple devices, but it may also be implemented as a single device. For example, the inspection support system may be implemented as a single device corresponding to an inspection support device. When the inspection support system is implemented by multiple devices, the components of the inspection support system may be distributed among the multiple devices in any way.

[0083] Furthermore, the method of communication between devices in the above embodiment is not particularly limited. In addition, a relay device (not shown) may be interposed in the communication between devices.

[0084] Furthermore, in the above embodiment, a process performed by a specific processing unit may be performed by another processing unit. For example, in the above embodiment, some or all of the processes described as being performed by the information processing server may be performed by an information terminal. Also, the order of multiple processes may be changed, or multiple processes may be executed in parallel.

[0085] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0086] Furthermore, each component may be implemented by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0087] Furthermore, general or specific embodiments of the present invention may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. Alternatively, they may be implemented as any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

[0088] For example, the present invention may be implemented as an inspection support system or inspection support device as described above. The present invention may be implemented as a method executed by a computer such as an inspection support system or inspection support device, or as a program (computer program product) for causing a computer to execute such a method. The present invention may be implemented as a computer-readable non-temporary recording medium on which these programs are recorded.

[0089] Furthermore, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of the present invention. [Explanation of Symbols]

[0090] 10. Inspection support system 20 Inspection support device 21 Operation Reception Section 22 Display section 22a 1st area 22b 2nd area 22c 3rd area 22d Objects in the image 22e Button-type object 22f 1st toggle switch 22g Second toggle switch 23 Information Processing Department 23a Acquisition Department 23b Generator 23c Detection unit 23d Display Control Unit 23e Inspection Department 24 Memory section 25 Communications Department 26 Imaging Department 27. Accelerometer 30 Server Devices 90 Wide-area telecommunications network

Claims

1. An inspection support system that assists in capturing images used for inspecting reinforced concrete structures, Imaging unit, Display unit and The imaging unit displays a video showing the reinforcing structure being filmed on the display unit, and the display control unit displays a video showing the reinforcing structure being filmed on the display unit. An acquisition unit that, while the aforementioned video is displayed, acquires image information of the image showing the reinforced concrete structure and acquires the orientation information of the imaging unit, The system includes a detection unit that detects reinforcing bars included in the reinforcing bar structure shown in the image based on the acquired image information, The display control unit overlays the detected first object representing the reinforcing bar onto the video based on the acquired posture information. Inspection support system.

2. The acquisition unit further acquires the design information of the reinforced concrete structure, Based on the detection results from the detection unit and the acquired design information, the display control unit displays on the display unit the direction of movement of the imaging unit for detecting undetected reinforcing bars included in the reinforcing bar structure. The inspection support system according to claim 1.

3. The acquisition unit further acquires the design information of the reinforced concrete structure, The display control unit superimposes a second object representing undetected reinforcing bars included in the reinforcing bar structure onto the video, based on the detection results from the detection unit and the acquired design information. The inspection support system according to claim 1 or 2.

4. An inspection support method, which is performed by a computer to assist in capturing images used for inspecting reinforced concrete structures, A first display step in which the imaging unit displays a video showing the reinforced concrete structure being filmed on the display unit, The acquisition step involves acquiring image information of the image showing the reinforcing steel structure while the aforementioned video is being displayed, and acquiring the orientation information of the imaging unit. A detection step of detecting reinforcing bars included in the reinforcing bar structure shown in the image based on the acquired image information, The process includes a second display step of superimposing a first object representing the detected reinforcing bar onto the video based on the acquired posture information. Testing support methods.

5. A program for causing the computer to execute the inspection support method described in claim 4.

Images