Display device, bar arrangement inspection system, display method, and bar arrangement inspection method

Abstract

To provide a display device that allows a user to easily identify a falsely detected line image of reinforcing bars.SOLUTION: A display device includes a line image display part that displays a plurality of line images corresponding to respective reinforcing bars in a photographed picture of erected reinforcing bars, a display setting part that selectively displays a part of the line images in a specified range, a deletion part that receives selection of the line images to be deleted from the selectively displayed line images and deletes the selected line images, and a comparator that displays comparison results between measurement data of the reinforcing bars obtained from the image and the design data of the reinforcing bars obtained in advance.SELECTED DRAWING: Figure 12

Description

[Technical field]

[0001] The present disclosure relates to a display device, a bar arrangement inspection system, a display method, and a bar arrangement inspection method. [Background technology]

[0002] In recent years, there have been many studies on improving the efficiency of work in the construction industry. For example, there are studies on improving the efficiency of rebar inspection, which checks whether the rebar diameter and spacing in the floors, walls, columns, beams, etc. of buildings are aligned according to the design drawings.

[0003] As an example of reinforcing bar inspection, Patent Document 1 proposes a reinforcing bar inspection system that generates center lines of reinforcing bar areas in an image of the reinforcing bar and determines whether the number of center lines matches the design data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Publication 2020-166660 Summary of the Invention [Problem to be solved by the invention]

[0005] When detecting reinforcing bars using image recognition technology from images of erected reinforcing bars, reinforcing bars may be erroneously detected. In such cases, reinforcing bar inspection may not be performed properly.

[0006] For example, image recognition technology may erroneously detect rebars in areas where they do not actually exist. In such cases, the rebars recognized by image recognition technology may not correspond to the rebars in the design data, and the rebar arrangement inspection may not be performed properly.

[0007] Therefore, one possible solution is to superimpose rebar line images recognized using image recognition technology onto the captured reinforcement bar image, allowing the user to select the rebar line images that have been erroneously detected, and delete the data of the rebars that have been erroneously detected.

[0008] However, depending on the way in which the reinforcing bars are photographed, the density of the reinforcing bars, etc., the image-recognized reinforcing bar line images may be displayed densely. In this case, even if the image-recognized reinforcing bar line images include erroneously detected reinforcing bar line images, it is difficult for the user to recognize which reinforcing bar line images are erroneously detected reinforcing bar line images.

[0009] Non-limiting examples of the present disclosure contribute to providing a display device, a reinforcing bar inspection system, a display method, and a reinforcing bar inspection method that allow a user to easily recognize erroneously detected reinforcing bar line images. [Means for solving the problem]

[0010] A display device according to one embodiment of the present disclosure includes a line image display unit that displays a plurality of line images corresponding to each of the reinforcing bars in an image taken of an erected reinforcing bar, a display setting unit that selectively displays a portion of the plurality of line images within a specified range, a deletion unit that accepts a selection of a line image to be deleted from the selectively displayed line images and deletes the line image, and a comparison unit that displays a comparison result between measurement data of the reinforcing bar obtained from the image and design data of the reinforcing bar obtained in advance.

[0011] A reinforcement bar inspection system according to one embodiment of the present disclosure is a reinforcement bar inspection system comprising a display device and an information processing device, wherein the display device comprises a line image display unit that displays a plurality of line images corresponding to each of the rebars in an image photographed of an erected rebar, a display setting unit that selectively displays a portion of the plurality of line images within a specified range, a deletion unit that accepts a selection of a line image to be deleted from the selectively displayed line images and deletes the line image, and a comparison unit that displays a comparison result between measurement data of the rebar acquired from the image and design data of the rebar acquired in advance, and the information processing device comprises a reception unit that accepts registration of the design data from a user terminal, a provision unit that provides the design data to the display device, an acquisition unit that acquires the comparison result from the display device, and a transmission unit that transmits the acquired comparison result to the user terminal.

[0012] A display method according to one embodiment of the present disclosure is a display method for a display device used for reinforcement inspection, which displays a plurality of line images corresponding to each of the rebars in an image taken of an erected rebar, selectively displays some of the plurality of line images within a specified range, accepts a selection of line images to be deleted from among the selectively displayed line images, deletes the line images, and displays a comparison result between measurement data of the rebar obtained from the image and design data of the rebar obtained in advance.

[0013] A reinforcement bar inspection method according to one embodiment of the present disclosure is a reinforcement bar inspection method of a reinforcement bar inspection system equipped with a display device and an information processing device, in which the display device displays a plurality of line images corresponding to each of the rebars in an image photographed of an erected rebar, selectively displays a portion of the plurality of line images within a specified range, accepts a selection of a line image to be deleted from the selectively displayed line images, deletes the line images, displays a comparison result between the measurement data of the rebar obtained from the image and previously acquired design data of the rebar, and the information processing device accepts registration of the design data from a user terminal, provides the design data to the display device, obtains the comparison result from the display device, and transmits the obtained comparison result to the user terminal.

[0014] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0015] According to an embodiment of the present disclosure, a user can easily recognize line images of reinforcing bars that have been erroneously detected.

[0016] Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings, in which such advantages and / or benefits are provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of which are provided to obtain one or more identical features. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a diagram showing a configuration example of a bar arrangement inspection system according to an embodiment of the present disclosure. [Diagram 2] A diagram explaining an example of the flow of the reinforcing bar inspection service provided by the reinforcing bar inspection system in Figure 1. [Diagram 3] Diagram showing the reinforcement to be inspected [Figure 4] A diagram showing an example of the screen displayed on the device [Diagram 5] FIG. 1 is a diagram showing an example of a block configuration of an information processing device; [Figure 6] A diagram showing an example of the block configuration of a terminal [Figure 7] A diagram showing an example of the block configuration of a terminal [Figure 8] A diagram showing an example of the screen displayed on the device [Figure 9] A diagram showing an example of the screen displayed on the device [Figure 10] A diagram explaining an example 1 of screen display operation using a slider [Figure 11] The image of the reinforcement shown in Figure 10 viewed from above [Figure 12] A diagram explaining the second example of screen display operation using a slider [Figure 13] Top view of the reinforcement image shown in Figure 12 [Figure 14] A diagram explaining example 3 of the screen display operation using a slider [Figure 15] The image of the reinforcement shown in Figure 14 viewed from above [Figure 16] A diagram explaining example 4 of the screen display using a slider [Figure 17] The image of the reinforcement shown in Figure 16 viewed from above [Figure 18] A diagram explaining an example of how the screen display works with a slider [Figure 19] A diagram explaining an example of how the screen display works with a slider [Figure 20] A diagram explaining an example of how the screen display works with a slider [Figure 21] A diagram explaining an example of how the screen display works with a slider [Figure 22] Flowchart showing an example of terminal operation [Figure 23] A diagram showing an example of a slider image DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

[0019] It should be noted that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0020] <System configuration> 1 is a diagram showing an example of the configuration of a bar arrangement inspection system 1 according to an embodiment of the present disclosure. As shown in FIG. 1, the bar arrangement inspection system 1 has an information processing device 11 and terminals 12 and 13.

[0021] The information processing device 11 communicates with the terminals 12 and 13 via a network N1, such as a wireless network and the Internet. The information processing device 11 may be, for example, a server.

[0022] The terminal 12 is used, for example, in a construction company A1a. The terminal 12 may be, for example, a terminal such as a personal computer.

[0023] The terminal 13 is used, for example, at the construction site A1b. The terminal 13 may be a mobile terminal equipped with an image sensor for acquiring three-dimensional images, such as a stereo camera. The terminal 13 may also be a stereo camera equipped with an information processing function and a display.

[0024] <Reinforcement Inspection Service Flow> FIG. 2 is a diagram for explaining an example of the flow of a bar arrangement inspection service provided by the bar arrangement inspection system 1 of FIG.

[0025] A user of the construction company A1a creates a design drawing using the terminal 12, and uploads (registers) design data of the created design drawing to the information processing device 11 (S1).

[0026] A user at the construction site A1b accesses the information processing device 11 using the terminal 13, and downloads design data for the construction site A1b to the terminal 13 (S2).

[0027] The user at the construction site A1b selects a point (inspection point) where the reinforcement inspection will be performed using the terminal 13 (S3). For example, the user at the construction site A1b selects an inspection point such as a floor, a wall, or a ceiling of a room where the reinforcement inspection will be performed.

[0028] The user at the construction site A1b uses the terminal 13 to carry out a reinforcing bar inspection of the inspection point selected in S3 (S4). For example, the user at the construction site A1b uses the terminal 13 to photograph the reinforcing bar at the inspection point and carry out the reinforcing bar inspection.

[0029] When the user at the construction site A1b finishes the bar arrangement inspection in S4, he or she uploads the bar arrangement inspection results (data) to the information processing device 11 using the terminal 13 (S5).

[0030] The information processing device 11 generates an inspection form (data) based on the data of the bar arrangement inspection result uploaded in S5 (S6).

[0031] A user at the construction company A1a accesses the information processing device 11 using the terminal 12 and downloads the inspection form to the terminal 12 (S7). A user at the construction site A1b accesses the information processing device 11 using the terminal 13 and downloads the inspection form to the terminal 13 (S7).

[0032] <Analysis> Figure 3 shows the reinforcement (reinforcing bar) to be inspected. In the following, the reinforcement is illustrated in a simplified form for ease of understanding.

[0033] A user at a construction site takes multiple images of the reinforcing bars A3a from different angles using a terminal equipped with an image sensor. The terminal uses image recognition technology to recognize the reinforcing bars from the captured images and displays the recognized reinforcing bars as line images on the display.

[0034] Fig. 4 is a diagram showing an example of a screen displayed on the display of a terminal. For example, as shown in Fig. 4, the terminal displays one of a plurality of captured reinforcing bar images (reinforcing bar images) on the display. The terminal recognizes the reinforcing bar using image recognition technology, and displays a line image A4a of the recognized reinforcing bar superimposed on the reinforcing bar image. For ease of understanding, Fig. 4 shows a line image A4a of reinforcing bar extending in the vertical direction, and does not show line images of frame-shaped reinforcing bars (horizontal reinforcing bars).

[0035] Depending on how the reinforcing bars are photographed and their density, the reinforcing bars may not be properly recognized in the image. For example, as shown in line image A4b in Fig. 4, reinforcing bars may be erroneously detected as being present in areas where they do not actually exist. In this case, the reinforcing bars recognized by the image recognition technology do not match the corresponding relationship between the reinforcing bars in the design data, and therefore the reinforcing bar inspection may not be performed properly.

[0036] To ensure that the reinforcement bar inspection is performed properly, it is possible to have the user delete (erase) the erroneously detected rebars. For example, it is possible to have the user select the line image A4b on the terminal display and delete the erroneously detected rebars.

[0037] However, depending on the way in which the reinforcing bars are photographed, the density of the reinforcing bars, etc., the image-recognized reinforcing bar line images may be displayed densely. In this case, even if the image-recognized reinforcing bar line images include erroneously detected reinforcing bar line images, it is difficult for the user to recognize which reinforcing bar line images are erroneously detected reinforcing bar line images.

[0038] The present disclosure enables a user to easily recognize line images of reinforcing bars that have been erroneously detected.

[0039] <Block configuration> Block configuration of information processing device 11 Fig. 5 is a diagram showing an example of a block configuration of the information processing device 11. As shown in Fig. 5, the information processing device 11 includes a control unit 11a, a storage unit 11b, and a communication unit 11c.

[0040] The control unit 11a controls the entire information processing device 11. The control unit 11a may be configured by a processor such as a CPU (central processing unit).

[0041] The control unit 11a includes a registration unit 11aa, a provision unit 11ab, an acquisition unit 11ac, and a generation unit 11ad. The control unit 11a may realize the functions of each of the above-mentioned units according to a program (application) stored in the storage unit 11b.

[0042] The registration unit 11aa registers the design data uploaded from the terminal 12 of the construction company A1a (stores it in the storage unit 11b).

[0043] The providing unit 11ab provides the design data in response to a request from the terminal 13 of the construction site A1b. The providing unit 11ab provides the design data to, for example, the terminal 13 of the construction site A1b associated with the construction company A1a.

[0044] The acquisition unit 11ac acquires (receives) the reinforcement bar inspection results uploaded from the terminal 13.

[0045] The generation unit 11ad generates a form based on the reinforcement inspection results uploaded from the terminal 13. The generation unit 11ad transmits the generated form to the terminals 12 and 13 in response to requests from the terminals 12 and 13.

[0046] The storage unit 11b stores an operating system (OS) program and application programs to be executed by the control unit 11a. For example, the storage unit 11b stores an application program for a rebar inspection service. The storage unit 11b also stores various data required for processing by the control unit 11a. The storage unit 11b may be, for example, a solid state drive (SSD), a random access memory (RAM), a flash memory, a read only memory (ROM), and / or a hard disk drive (HDD).

[0047] The communication unit 11c communicates with the terminals 12 and 13 via the network N1.

[0048] Terminal 12 block configuration Fig. 6 is a diagram showing an example of a block configuration of the terminal 12. As shown in Fig. 6, the terminal 12 has a control unit 12a, a storage unit 12b, a communication unit 12c, and a graphics unit 12d.

[0049] The control unit 12a controls the entire terminal 12. The control unit 12a may be configured by a processor such as a CPU.

[0050] The control unit 12a includes an upload unit 12aa and a download unit 12ab. The control unit 12a may realize the functions of the above-mentioned units according to a program stored in the storage unit 12b.

[0051] The upload unit 12aa uploads the design data to the information processing device 11.

[0052] The download unit 12ab downloads the bar arrangement inspection report (data) from the information processing device 11.

[0053] The storage unit 12b stores an OS program and application programs to be executed by the control unit 12a. For example, the storage unit 12b stores an application program for a bar arrangement inspection service. The storage unit 12b also stores various data required for processing by the control unit 12a. The storage unit 12b may be, for example, an SSD, a RAM, a flash memory, a ROM, and / or a HDD.

[0054] The communication unit 12c communicates with the information processing device 11 and the terminal 13 via the network N1.

[0055] The graphics unit 12d displays an image on a display (a display included in the terminal 12) based on the digital image data output from the control unit 11a. The display may be, for example, a liquid crystal display or an organic EL (electro luminescence) display.

[0056] Terminal 13 block configuration Fig. 7 is a diagram showing an example of a block configuration of the terminal 13. As shown in Fig. 7, the terminal 13 has a control unit 13a, a storage unit 13b, a communication unit 13c, a graphics unit 13d, and an image sensor 13e.

[0057] The control unit 13a controls the entire terminal 13. The control unit 13a may be configured by a processor such as a CPU.

[0058] The control unit 13a includes a download unit 13aa, an image capturing unit 13ab, a line image display unit 13ac, a display setting unit 13ad, a deletion unit 13ae, a comparison unit 13af, and an upload unit 13ag. The control unit 13a may realize the functions of the above-mentioned units according to a program stored in the storage unit 13b.

[0059] The download unit 13aa downloads design data from the information processing device 11. The design data is, for example, design data related to the construction site A1b. The download unit 13aa also downloads a bar arrangement inspection form (form data) from the information processing device 11.

[0060] The photographing unit 13ab photographs an object to be photographed using the image sensor 13e. For example, the photographing unit 13ab photographs an erected reinforcing bar (reinforcing bar).

[0061] The line image display unit 13ac displays on a display a plurality of line images corresponding to the respective reinforcing bars in an image obtained by photographing the erected reinforcing bars.

[0062] The line image display unit 13ac may recognize the photographed rebars using existing image recognition technology. The line image display unit 13ac may recognize the photographed rebars using artificial intelligence (AI) such as deep learning. The AI ​​may be one that has learned rebar images.

[0063] The display setting unit 13ad selectively displays a line image of a specified range specified by the user. For example, the display setting unit 13ad slices the line image by a width (area) specified by the user and displays it.

[0064] The deletion unit 13ae accepts a selection of a line image to be deleted from among the selected and displayed line images, and deletes the line image. The deletion unit 13ae, for example, deletes or edits each line image individually.

[0065] The comparison unit 13af compares the measurement data of the reinforcing bars obtained by image recognition with the design data downloaded in advance, and displays the comparison result on a display. The measurement data may be, for example, dimensional data such as the diameter of the reinforcing bars or the spacing between the reinforcing bars.

[0066] The comparison unit 13af may acquire measurement data of the reinforcing bar that has been image-recognized using AI. The AI ​​may be one that has learned the relationship between the reinforcing bar image and the dimensional data.

[0067] The upload unit 13ag uploads the comparison result (inspection result) of the comparison unit 13af to the information processing device 11.

[0068] The storage unit 13b stores an OS program and application programs to be executed by the control unit 13a. For example, the storage unit 13b stores an application program for a bar arrangement inspection service. The storage unit 13b also stores various data required for processing by the control unit 13a. The storage unit 13b may be, for example, an SSD, a RAM, a flash memory, a ROM, and / or a HDD.

[0069] The communication unit 13c communicates with the information processing device 11 and the terminal 12 via the network N1.

[0070] The graphics unit 13d displays an image on a display (a display included in the terminal 13) based on the digital image data output from the control unit 13a. The display may be, for example, a liquid crystal display or an organic EL display.

[0071] The image sensor 13e is, for example, a three-dimensional image sensor such as a stereo camera that captures a three-dimensional image. The image sensor 13e may be a passive image sensor or an active image sensor.

[0072] <Device screen> In the following, for ease of understanding, the screen example is illustrated in a simplified form. FIG 8 is a diagram showing an example of a screen displayed on the display of terminal 13.

[0073] A user of the terminal 13 (a user at the construction site A1b) launches an application for the bar arrangement inspection service on the terminal 13. The application may be downloaded from an application store, or may be downloaded from a server of a business providing the bar arrangement inspection service.

[0074] For example, the user inputs a password according to an application of the bar arrangement inspection service to log in. Note that the login is not limited to password input, and biometric authentication such as voiceprint authentication or face authentication may be used.

[0075] After logging in to the bar arrangement inspection service, the user downloads, for example, design data related to the construction site A1b from the information processing device 11 to the terminal 13. After downloading the design data to the terminal 13, the user selects an inspection point in the construction site A1b where the user wants to perform a bar arrangement inspection according to the application of the bar arrangement inspection service.

[0076] After selecting an inspection point, the user photographs the reinforcing bars (rebars) at the selected inspection point. The user photographs the reinforcing bars at the inspection point from different directions using the image sensor 13e of the terminal 13 (hereinafter, sometimes simply referred to as the terminal 13) (for example, see FIG. 3).

[0077] A screen A8a shown in FIG. 8 is displayed on the display of the terminal 13 based on the application of the bar arrangement inspection service, for example, after the user takes multiple images of the bar arrangement at the inspection point.

[0078] Information about the design drawing of the design data downloaded by the terminal 13 and information about the inspection point selected by the user are displayed within the dotted frame A8b in Fig. 8. Note that the dotted frame with the numbers shown in Fig. 8 is shown for the purpose of explanation and is not displayed on the screen A8a.

[0079] The design data downloaded by the terminal 13 is displayed in the dotted frame A8c in Fig. 8. For example, the dotted frame A8c in Fig. 8 displays information such as the name, diameter, and spacing of each reinforcing bar of the reinforcing bar arrangement based on the design data.

[0080] In the dotted frame A8d in Fig. 8, one of a plurality of reinforcement images photographed by the user is displayed. One reinforcement image may be automatically selected by the terminal 13 or may be selected by the user. The image data of the image sensor 13e may be displayed as a two-dimensional image or a three-dimensional image on the display of the terminal 13. For example, the image data may be stored in the storage unit 13b of the terminal 13 as three-dimensional data such as point cloud data.

[0081] The dotted frame A8e in Fig. 8 displays information about reinforcing bars recognized by an AI (reinforcing bar inspection service application) implemented in the terminal 13. For example, the dotted frame A8e in Fig. 8 displays information about the diameter of each reinforcing bar and the spacing between the reinforcing bars recognized by the AI ​​implemented in the terminal 13.

[0082] The screen A8a includes images of buttons A8f and A8g. The button A8f is a button for transitioning to a screen (FIG. 9) for the user to delete rebars that have been erroneously recognized by the AI. The button A8g is a button for starting a rebar arrangement inspection.

[0083] The results of the reinforcement inspection are displayed in the dotted frame A8h in Fig. 8. For example, when the button A8g is pressed, the terminal 13 compares the measurement data of the rebars (rebars image-recognized by the AI) acquired from the line image with the downloaded design data, and displays the comparison results (rebar inspection results) in the dotted frame A8h. If the measurement data differs from the design data by a predetermined value or more, the terminal 13 displays an image indicating the difference, such as "NG". As shown in the dotted frames A8c, A8e, and A8h, the terminal 13 displays the design data downloaded from the information processing device 11, the measurement data of each rebar of the reinforcement recognized by the AI, and the reinforcement inspection results adjacent to each other.

[0084] Fig. 9 is a diagram showing an example of a screen displayed on the display of the terminal 13. When the button A8f shown in Fig. 8 is pressed, the terminal 13 displays a screen A9a shown in Fig. 9 on the display.

[0085] For example, as shown at the top of the screen A9a, a guide such as "Please select and delete unnecessary reinforcement" is displayed on the screen A9a. Also, one of multiple reinforcement images taken by the user is displayed on the screen A9a. When the button A9b is pressed, the terminal 13 switches the reinforcement image displayed on the screen A9a.

[0086] The Z axis displayed on the screen A9a indicates the shooting direction of the image sensor 13e (optical axis direction, depth direction of the image). The X axis displayed on the screen A9a indicates the horizontal direction (horizontal direction of the image) relative to the shooting direction of the image sensor 13e. The Y axis displayed on the screen A9a indicates the vertical direction (vertical direction of the image) relative to the shooting direction of the image sensor 13e.

[0087] The line image A9c is an image of a rebar that has been image-recognized by AI. Note that the line image A9c does not have to be an image of a dotted line as long as the user can recognize that it is an image of a rebar that has been image-recognized by AI.

[0088] The reinforcing bar image A9d is an image of reinforcing bars photographed by the user. The terminal 13 displays the reinforcing bar line image A9c, which has been image-recognized by the AI, superimposed on the reinforcing bar image A9d.

[0089] The screen A9a includes an image of a slider A9e. As described in detail below in <Display operation by slider>, the terminal 13 selectively displays a part of the reinforcement image photographed by the user in response to the user's operation of the slider A9e. In other words, the terminal 13 slices and displays the reinforcement image photographed by the user in response to the user's operation of the slider A9e.

[0090] The terminal 13 switches the direction in which the reinforcement image is sliced ​​in response to pressing of the images of the "X axis", "Y axis", and "Z axis" indicated by the arrow A9h in Fig. 9. For example, when the "Z axis" image is pressed, the terminal 13 slices the reinforcement image parallel to the XY plane. When the "Y axis" image is pressed, the terminal 13 slices the reinforcement image parallel to the XZ plane. When the "X axis" image is pressed, the terminal 13 slices the reinforcement image parallel to the YZ plane. Note that the direction in which the reinforcement image is sliced ​​may be switched by pressing of another button image instead of pressing of the images of the "X axis", "Y axis", and "Z axis" indicated by the arrow A9h in Fig. 9.

[0091] Furthermore, the terminal 13 switches the line image A9c to be displayed superimposed on the reinforcement image A9d in response to pressing of, for example, the images of "X axis", "Y axis", and "Z axis" shown by the arrow A9h in Fig. 9. For example, when "Z axis" or "X axis" is pressed, the terminal 13 displays a line image extending in the Y axis direction as shown in the line image A9c. For example, when "Y axis" is pressed, the terminal 13 displays a line image extending in the X axis direction (for example, see the thick lines shown in Figs. 18, 19, and 20).

[0092] The screen A9a includes an image of a button A9f. The button A9f is a button for deleting a line image selected by the user. For example, when the line image A9g described below is selected by the user and the button A9f is pressed, the terminal 13 deletes the line image A9g and the rebar data recognized by the AI ​​corresponding to the line image A9g.

[0093] Line image A9g shows a line image in which the AI ​​misidentified rebar. As shown in line image A9g, the AI ​​may misidentify rebar as being present in an area where no rebar actually exists (see <Analysis> above).

[0094] <Slider display operation> The following describes a display operation when the image of the "Z axis" indicated by the arrow A9h in Fig. 9 is pressed. In other words, the following describes a display operation when the terminal 13 slices the reinforcement bar image A9d shown in Fig. 9 in parallel with the XY plane.

[0095] Screen movement in the Z-axis direction 1 Fig. 10 is a diagram for explaining a screen operation example 1 using a slider. Fig. 10 shows a reinforcement image A10a, a line image A10b, and a slider A10c displayed on the display of the terminal 13. The reinforcement image A10a shown in Fig. 10 corresponds to the reinforcement image A9d shown in Fig. 9. The line image A10b shown in Fig. 10 corresponds to the line image displayed at the forefront among the line images A9c shown in Fig. 9. The slider A10c shown in Fig. 10 corresponds to the slider A9e shown in Fig. 9.

[0096] The terminal 13 selectively displays a line image of a rebar (an image of a rebar recognized by the AI) in response to the user's operation of the slider A10c. For example, the terminal 13 selectively displays a line image A10b from among a plurality of line images recognized by the AI, as shown in FIG.

[0097] The terminal 13 may also selectively display the reinforcement image in response to the user's operation of the slider A10c. For example, the terminal 13 may selectively display the reinforcement image according to the brightness of the image as shown in Fig. 10 (in the example of Fig. 10, the foremost reinforcing bar is displayed brighter than the other reinforcing bars).

[0098] Fig. 11 is a view of the reinforcement bar image A10a shown in Fig. 10 viewed from above. In Fig. 11, the same components as those in Fig. 10 are given the same reference numerals. Note that the six white circles and the rectangular frame passing through the six white circles shown in Fig. 11 indicate reinforcing bars. Although not shown in Fig. 9, the configuration (figure) shown in Fig. 11 may also be displayed as an image on the display of the terminal 13.

[0099] The slider A10c specifies a range in the Z-axis direction (see FIG. 9) for selectively displaying the line image of the reinforcing bar. For example, as shown in the specified range A11a (hatched portion) in FIG. 11, the slider A10c specifies a range in the Z-axis direction for selectively displaying the line image of the reinforcing bar.

[0100] In the example of Fig. 11, the line image A10b is included in the specified range A11a. Therefore, in the reinforcement bar arrangement image A10a shown in Fig. 10, the line image A10b is displayed on the display of the terminal 13, and the line images corresponding to the other rebars are not displayed on the display of the terminal 13.

[0101] The width of the designated range A11a corresponds to the length of the slider A10c. For example, the width of the designated range A11a corresponds to two points on both ends of the slider A10c, as shown by the dotted lines in FIG.

[0102] As described below, the length of the slider A10c is changed in response to a user operation, and the width of the designated range A11a in which the rebar line image is displayed is changed in response to the change in the length of the slider A10c.

[0103] Screen movement in the Z-axis direction 2 12 is a diagram for explaining a second example of screen operation using a slider. In FIG. 12, the same components as in FIG. 10 are denoted by the same reference numerals.

[0104] The length (width) of the slider A10c is changed in response to a user operation. In Fig. 12, the length of the slider A10c is changed to be longer than the slider A10c shown in Fig. 10.

[0105] The terminal 13 increases the range of the rebar line image displayed on the display in accordance with the length of the slider A10c. As a result, the display of the terminal 13 displays the rebar line images A10b, A12b, and A12c, as well as the line image A12d erroneously recognized by the AI, as shown in Fig. 12. The line image A12d in Fig. 12 corresponds to the line image A9g shown in Fig. 9.

[0106] Fig. 13 is a view of the reinforcement bar image A10a shown in Fig. 12 viewed from above. In Fig. 13, the same components as those in Fig. 12 are given the same reference numerals. Note that the six white circles and the rectangular frame passing through the six white circles shown in Fig. 13 indicate reinforcing bars. Although not shown in Fig. 9, the configuration (figure) shown in Fig. 13 may also be displayed as an image on the display of the terminal 13.

[0107] In Fig. 13, the length of the slider A10c is changed to be longer than the slider A10c shown in Fig. 11. The terminal 13 changes the designated range A13a (hatched portion) in which the line image is selectively displayed, according to the length of the slider A10c. In other words, the terminal 13 changes the width of the reinforcement image sliced ​​vertically in the Z-axis direction (see the Z-axis in Fig. 9), according to the length of the slider A10c. The terminal 13 displays the line image included in the sliced ​​reinforcement image.

[0108] In the example of Fig. 13, the line images A10b, A12b, A12c, and A12d are included in the specified range A13a. Therefore, in the reinforcement bar arrangement image A10a shown in Fig. 12, the line images A10b, A12b, A12c, and A12d are displayed on the display of the terminal 13, and the line images corresponding to the other rebars are not displayed on the display of the terminal 13.

[0109] Screen movement in the Z-axis direction 3 Fig. 14 is a diagram for explaining a screen operation example 3 using a slider. In Fig. 14, the same components as in Fig. 12 are given the same reference numerals.

[0110] The length of the slider A10c is changed in response to a user's operation. In Fig. 14, the length of the slider A10c is changed to be longer than the slider A10c shown in Fig. 12.

[0111] The terminal 13 increases the range of the rebar line image displayed on the display in accordance with the length of the slider A10c. As a result, the display of the terminal 13 displays rebar line images A10b, A12b, A12c, A12d, A14b, A14c, and A14d, as shown in FIG.

[0112] Fig. 15 is a view of the reinforcement bar image A10a shown in Fig. 14 viewed from above. In Fig. 15, the same components as in Fig. 14 are given the same reference numerals. Note that the six white circles and the rectangular frame passing through the six white circles shown in Fig. 15 indicate reinforcing bars. Although not shown in Fig. 9, the configuration (figure) shown in Fig. 15 may also be displayed as an image on the display of the terminal 13.

[0113] In Fig. 15, the length of the slider A10c is changed to be longer than the slider A10c shown in Fig. 13. The terminal 13 changes the designated range A15a (hatched portion) in which the line image is selectively displayed, according to the length of the slider A10c. In other words, the terminal 13 designates the width for vertically slicing the reinforcement image in the Z-axis direction (see the Z-axis in Fig. 9) according to the length of the slider A10c. The terminal 13 displays the line image included in the sliced ​​reinforcement image.

[0114] In the example of Fig. 15, the line images A10b, A12b, A12c, A12d, A14b, A14c, and A14d are included in the specified range A15a. Therefore, in the reinforcement arrangement image A10a shown in Fig. 14, the line images A10b, A12b, A12c, A12d, A14b, A14c, and A14d are displayed on the display of the terminal 13.

[0115] FIG. 9 shows an example of the reinforcement bar image A9d and the line images A9c and A9g when the length of the slider A9e is set to the maximum, and corresponds to the screen display example shown in FIG.

[0116] Screen movement in the Z-axis direction 4 16 is a diagram for explaining a fourth example of screen operation using a slider. In FIG. 16, the length of the slider A10c is set to the same length as the slider A10c shown in FIG.

[0117] The slider A10c moves in response to a user operation. In Fig. 16, the position of the slider A10c is set further in the +Z axis direction (toward the back of the screen) than the slider A10c shown in Fig. 10.

[0118] When the slider A10c in Fig. 16 is set to the length shown in Fig. 16 and moved from the position shown in Fig. 10 to the position shown in Fig. 16, a rebar line image A16b and a line image A12d erroneously recognized by the AI ​​are displayed on the display of the terminal 13. Note that in Fig. 10, only the line image A10b on the frontmost side of the screen is displayed.

[0119] Fig. 17 is a view of the reinforcement bar image A10a shown in Fig. 16 viewed from above. In Fig. 17, the same components as those in Fig. 16 are given the same reference numerals. Note that the six white circles and the rectangular frame passing through the six white circles shown in Fig. 17 indicate reinforcing bars. Although not shown in Fig. 9, the configuration (figure) shown in Fig. 17 may also be displayed as an image on the display of the terminal 13.

[0120] In Fig. 17, the position of the designated range A17a (hatched portion) for selectively displaying a line image is moved toward the +Z axis direction with respect to the designated range A11a shown in Fig. 11. The terminal 13 changes the position and width of the designated range A17a (hatched portion) for selectively displaying a line image according to the position and length of the slider A10c. In other words, the terminal 13 changes the position and width for vertically slicing the reinforcement image in the Z axis direction (see the Z axis in Fig. 9) according to the position and length of the slider A10c. The terminal 13 displays the line image included in the sliced ​​reinforcement image.

[0121] 17, the line images A16b and A12d are included in the specified range A17a. Therefore, in the reinforcement bar arrangement image A10a shown in FIG.

[0122] In addition, in screen operation 4, in order to explain the movement of the designated range (explaining the operation in which the designated range A11a in FIG. 11 moves to the designated range A17a in FIG. 17), the length of the slider A10c shown in FIG. 16 is described as being the same as the length of the slider A10c shown in FIG. 10, but this is not limited to this. In FIG. 16 and FIG. 17, the width (size) of the designated range A17a can be changed by changing the length of the slider A10c.

[0123] - Screen movement in the Y-axis direction The following describes a display operation when the image of the "Y axis" indicated by the arrow A9h in Fig. 9 is pressed. In other words, the following describes a display operation when the terminal 13 slices the reinforcement bar image A9d shown in Fig. 9 in parallel with the XZ plane.

[0124] 18 to 20 are diagrams for explaining examples of screen operations using a slider. As shown in FIG. 18 to FIG. 20, the length of the slider A18a is changed in response to a user operation. The terminal 13 changes a designated range A18b (hatched portion) in which a line image is selectively displayed in response to the length of the slider A18a. In other words, the terminal 13 changes the width of the reinforcement bar image sliced ​​vertically in the Y-axis direction (see the Y-axis in FIG. 9) in response to the length of the slider A18a. The terminal 13 displays a line image included in the sliced ​​reinforcement bar image. For example, the terminal 13 displays a line image of a reinforcing bar recognized by an AI, as shown by the thick lines in FIG. 18 to FIG. 20.

[0125] Fig. 21 is a diagram for explaining an example of screen operation by a slider. As shown in Fig. 21, the position of the slider A18a is changed according to a user's operation. The terminal 13 changes the position and width of a designated range A18b (hatched portion) for selectively displaying a line image according to the position and length of the slider A18a. In other words, the terminal 13 changes the position and width for vertically slicing the reinforcement image in the Y-axis direction (see the Y-axis in Fig. 9) according to the position and length of the slider A18a. The terminal 13 displays the line image included in the sliced ​​reinforcement image.

[0126] -Screen movement in the X-axis direction The terminal 13 slices the reinforcement image in the X-axis direction as well, in the same manner as the display operations in the Z-axis direction and Y-axis direction described above, and displays line images included in the sliced ​​reinforcement image.

[0127] For example, the terminal 13 slices the reinforcement image parallel to the YZ plane and displays it on the display. The terminal 13 controls the width and position of the slice in response to the user's operation of a slider.

[0128] <Delete line images> The terminal 13 slices and displays the reinforcement image A9d and the line image A9c in response to the operation of the slider A9e shown in Fig. 9. For example, the terminal 13 slices and displays the reinforcement image and the line image as described in Figs. 10 to 21.

[0129] By operating the slider A9e, the user can, for example, display a portion of the densely displayed line images on the display. Therefore, if the line images displayed on the display include a line image that has been erroneously recognized by the AI, the user can easily find it by operating the slider A9e.

[0130] When the user finds a line image that has been erroneously recognized by the AI, the user selects the line image. For example, the user presses the line image A9g shown in Fig. 9. Then, the user presses the button A9f shown in Fig. 9. When the button A9f is pressed, the terminal 13 deletes the line image selected by the user from the display, and deletes the measurement data of the rebar corresponding to the deleted line image.

[0131] <Device operation flow> 22 is a flowchart showing an example of the operation of the terminal 13. The terminal 13 starts up an application for a bar arrangement inspection service in response to an operation by a user of the construction site A1b.

[0132] The terminal 13 performs login authentication of the user (S10). For example, the terminal 13 performs login authentication by password input or biometric authentication.

[0133] If the login authentication is successful, the terminal 13 displays, for example, a screen A8a in FIG. 8 on the display.

[0134] The terminal 13 (the application of the bar arrangement inspection service) receives design data related to the construction site A1b from the information processing device 11 in response to a user operation (S11).

[0135] The terminal 13 selects an inspection point for carrying out a bar arrangement inspection in the construction site A1b in response to an operation by the user (S12).

[0136] The terminal 13 starts the image sensor 13e in response to the user's operation, and captures multiple images of the reinforcement bars at the inspection points (S13).

[0137] The terminal 13 starts the reinforcing bar measurement process in response to the user's operation (S14).

[0138] The terminal 13 displays the measurement results on the display (S15).

[0139] The measurement results obtained by image recognition by AI may include unnecessary rebars. The terminal 13 deletes the line images of the unnecessary rebars in response to a user operation (S16).

[0140] For example, the terminal 13 deletes the line image selected by the user (for example, the line image A9g in FIG. 9) from among the line images displayed on the display (for example, the line images A9c and A9g in FIG. 9). As described in FIG. 10 to FIG. 21, the terminal 13 slides the line images in response to the operation of the slider, and can display the line images of the rebars that have been erroneously recognized by the AI ​​so that the user can easily recognize them.

[0141] The terminal 13 starts the bar arrangement inspection (S17). For example, when the button A8g shown in Fig. 8 is pressed, the terminal 13 starts the bar arrangement inspection.

[0142] The terminal 13 displays the bar arrangement inspection result on the display (S18). For example, the terminal 13 displays the bar arrangement inspection result on the display as shown in the dotted frame A8h in FIG.

[0143] The terminal 13 uploads the bar arrangement inspection results to the information processing device 11 in response to a user operation (S19).

[0144] The terminal 13 downloads the bar arrangement inspection result report from the information processing device 11 in response to a user operation (S20).

[0145] The order of the flow shown above is an example and is not limited to the above order.

[0146] <Summary of the embodiment> As described above, the terminal 13 displays a plurality of line images corresponding to each reinforcing bar in an image of an erected reinforcing bar, and selectively displays a specified range of line images. The terminal 13 displays a comparison result between the measurement data of the reinforcing bar acquired from the line images and the design data of the reinforcing bar arrangement acquired in advance. This allows the user to easily recognize the line images of the reinforcing bars erroneously detected by the terminal 13. For example, the terminal 13 selectively displays the line images of the reinforcing bars in a specified range specified by the user. This allows the user to display on the display the line image that the user desires from among the multiple line images of the reinforcing bars detected by the terminal 13, and allows the user to easily recognize the line images of the reinforcing bars erroneously detected by the terminal 13.

[0147] Furthermore, the terminal 13 displays a plurality of line images corresponding to each reinforcing bar in an image of the erected reinforcing bar, and slices the line images by a specified width before displaying them. The terminal 13 accepts a selection of a line image to be deleted from the sliced ​​line images displayed, and deletes the accepted line image. The terminal 13 displays a comparison result between the measurement data of the reinforcing bar acquired from the line images that were not deleted among the plurality of line images, and the design data of the reinforcing bar that was acquired in advance. This allows the user to easily recognize the line images of the reinforcing bars that are erroneously detected by the terminal 13. For example, the terminal 13 slices the line images by a width specified by the user before displaying them. This allows the user to display on the display the line image that the user desires from the plurality of line images of the reinforcing bars detected by the terminal 13, and allows the user to easily recognize the line images of the reinforcing bars that are erroneously detected by the terminal 13.

[0148] <Modification> Variation 1 23 is a diagram showing an example of a slider image. The terminal 13 may superimpose an image A23b showing the position of the line image on the image of the slider A23a. This allows the user to recognize the location where the line images are dense, and to easily grasp the position to which the slider A23a should be moved and the length of the slider A23a to be set.

[0149] Variation 2 The AI ​​may erroneously recognize that no rebar exists in a portion where a rebar actually exists. In this case, the terminal 13 may accept data of the rebar that the AI ​​could not recognize from the user. For example, the terminal 13 displays a button for adding rebar data on the screen A8a shown in FIG. 8. When the button for adding rebar data is pressed, the terminal 13 accepts the rebar data from the user.

[0150] Variation 3 The functions of the terminal 13 described above (for example, the functions of the control unit 13a shown in FIG. 7) may be included in the information processing device 11. The terminal 13 may display the results of the processing performed by the information processing device 11 on a display.

[0151] For example, the terminal 13 uploads an image of reinforcing bars captured by an image sensor to the information processing device 11. The information processing device 11 performs image recognition of reinforcing bars based on the uploaded image of reinforcing bars and transmits line image data to the terminal 13. The information processing device 11 also displays slide images on the display of the terminal 13 and selectively displays line images on the display in response to a user's operation on the slide image.

[0152] The terminal 13 transmits information on the line image selected by the user to the information processing device 11. The information processing device 11 deletes the reinforcing bar data based on the received information. The information processing device 11 compares the reinforcing bar measurement data with the design data and transmits the comparison result to the terminal 13.

[0153] Variation 4 The viewpoint of the reinforcement image displayed on the display of the terminal 13 may be changed. For example, the viewpoint of the reinforcement image displayed on the display of the terminal 13 may be changed by pressing and rotating the X, Y, and Z coordinate axes shown in the lower left of Fig. 9. Also, the viewpoint of the reinforcement image displayed on the display of the terminal 13 may be changed by pressing and rotating a part of the reinforcement image displayed in the center of Fig. 9.

[0154] Variation 5 In the above, when a user finds a line image that has been erroneously recognized by the AI, the user selects the line image itself (for example, the user selects line image A9g in FIG. 9) and deletes it, but this is not limited to the above. For example, terminal 13 may display information related to the line image recognized by the AI ​​on terminal 13. For example, terminal 13 may display information such as the number of the line image recognized by the AI ​​and the name and diameter of the rebar in the "****" portion on the right side of FIG. 9. When information related to the line image ("****" on the right side of FIG. 9) is selected and button A9f is pressed, terminal 13 may delete the information of the selected rebar.

[0155] The number of the line image may also be displayed near the line image superimposed on the reinforcement image displayed in the center of Fig. 9. Due to the correspondence between the number of the line image displayed near the line image and the number of the line image displayed in the rightmost part of Fig. 9, the user can recognize which line image of the line images superimposed on the reinforcement image is indicated by the number displayed in the rightmost part of Fig. 9.

[0156] Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modified or amended examples within the scope of the claims. It is understood that such modified or amended examples also belong to the technical scope of the present disclosure. Furthermore, the components in the embodiments may be arbitrarily combined within the scope of the present disclosure. In the above, the terminal 13 may be referred to as a display device. Construction may be read as architecture. Data may be read as information. A construction company may be read as a design office or a design company.

[0157] In the above-described embodiments, the notation "... part" used for each component may be replaced with other notations such as "... circuit", "... assembly", "... device", "... unit", or "... module".

[0158] The present disclosure can be realized by software, hardware, or software in cooperation with hardware. Each functional block used in the description of the above embodiment may be realized partially or entirely as an LSI, which is an integrated circuit, and each process described in the above embodiment may be controlled partially or entirely by one LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of one chip that includes some or all of the functional blocks. The LSI may have input and output of data. Depending on the degree of integration, the LSI may be called an IC, a system LSI, a super LSI, or an ultra LSI.

[0159] The method of integration is not limited to LSI, but may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Also, after LSI manufacturing, a programmable FPGA (Field Programmable Gate Array) or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI may be used. The present disclosure may be realized as digital processing or analog processing.

[0160] Furthermore, if a new integrated circuit technology that can replace LSI appears due to the progress of semiconductor technology or a derivative technology, it is possible to integrate the functional blocks using that technology. The application of biotechnology is also a possibility. [Industrial Applicability]

[0161] The present disclosure is useful, for example, for inspecting reinforcement of floors, walls, columns, beams, and the like of buildings. [Explanation of symbols]

[0162] Reinforcement Inspection System 11 Information processing equipment 12,13 Terminal A1a Construction company A1b Construction site

Claims

1. a line image display unit that displays a plurality of line images corresponding to each of the reinforcing bars in an image of the reinforcing bars; a display setting unit that selectively displays a part of the plurality of line images within a specified range; a deletion unit that accepts a selection of a line image to be deleted from among the selectively displayed line images, and deletes the line image; A comparison unit that displays a comparison result between the measurement data of the reinforcing bar acquired from the image and the design data of the reinforcing bar acquired in advance; A display device comprising:

2. the display setting unit displays a slider image for moving the range or for specifying the size of the range. The display device according to claim 1.

3. The display setting unit displays an image representing the range that moves or changes in size in response to an operation of a slider image, superimposed on the image of the reinforcing bar and the line image. The display device according to claim 1.

4. the display setting unit displays an image indicating the position of the line image superimposed on the slider image. The display device according to claim 3.

5. The display setting unit specifies two points in the optical axis direction, horizontal direction, or vertical direction of the image sensor that captures the reinforcing bar, and displays a line image between the two points. The display device according to claim 1.

6. The display setting unit sets the range in an optical axis direction, a horizontal direction, or a vertical direction of an image sensor that captures the reinforcing bar. The display device according to claim 1.

7. The display setting unit deletes the designated line images individually. The display device according to claim 1.

8. The display setting unit does not display the line image outside the range. The display device according to claim 1.

9. the comparison unit displays the design data, the measurement data, and the comparison result in adjacent arrangement. The display device according to claim 1.

10. the comparison unit displays an image representing the difference when the measurement data differs from the design data by a predetermined value or more. The display device according to claim 1.

11. A reinforcing bar inspection system including a display device and an information processing device, The display device includes: a line image display unit that displays a plurality of line images corresponding to each of the reinforcing bars in an image of the reinforcing bars that have been erected; a display setting unit that selectively displays a part of the plurality of line images within a specified range; a deletion unit that accepts a selection of a line image to be deleted from among the selectively displayed line images, and deletes the line image; A comparison unit that displays a comparison result between the measurement data of the reinforcing bar acquired from the image and the design data of the reinforcing bar acquired in advance; Equipped with The information processing device includes: a reception unit that receives registration of the design data from a user terminal; a providing unit for providing the design data to the display device; an acquisition unit that acquires the comparison result from the display device; A transmission unit that transmits the obtained comparison result to the user terminal; A reinforcement inspection system equipped with

12. A display method of a display device used in a reinforcement inspection, comprising: A plurality of line images corresponding to each of the reinforcing bars in the image of the erected reinforcing bars are displayed; Selectively displaying a portion of the plurality of line images within a specified range; Accepting a selection of a line image to be deleted from among the selectively displayed line images, and deleting the line image; displaying a comparison result between the measurement data of the reinforcing bar acquired from the image and previously acquired design data of the reinforcing bar; Display method.

13. A method for inspecting a bar arrangement by a bar arrangement inspection system including a display device and an information processing device, comprising: The display device, A plurality of line images corresponding to each reinforcing bar in an image of the erected reinforcing bar are displayed; Selectively displaying a portion of the plurality of line images within a specified range; Accepting a selection of a line image to be deleted from among the selectively displayed line images, and deleting the line image; Displaying a comparison result between the measurement data of the reinforcing bar acquired from the image and the design data of the reinforcing bar acquired in advance; The information processing device, Accepting registration of the design data from a user terminal; providing the design data to the display device; obtaining the comparison result from the display device; Transmitting the obtained comparison result to the user terminal; Reinforcement inspection method.

Images