Information processing system, information processing method, and program
The information processing system automates rock bolt interval measurement using composite imaging, ensuring safety and efficiency in tunnel construction by displaying measurement results and design compliance.
Patent Information
- Application Number
- JP2023081844
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-17
- Publication Date
- 2024-11-28
AI Technical Summary
The manual measurement of rock bolt placement intervals in tunnels is time-consuming and poses safety risks due to the need for aerial work vehicles or scaffolding, which can lead to accidents.
An information processing system that uses a communication terminal with RGB and distance image acquisition units to generate composite images, allowing for the automatic measurement of rock bolt placement intervals without manual scaling or aerial work, displaying the results alongside design values and warnings for deviations.
Enables safe and efficient measurement of rock bolt placement intervals, reducing human error and time consumption while providing real-time feedback on compliance with design standards.
Smart Images

Figure 2024165562000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]
[0002] Rock bolts have been widely used as supports in tunnel construction, cut earth reinforcement construction, etc. Rock bolts are rod-shaped bolts used to suppress deformation of the ground and landslides, and can be integrated with the ground and stabilized by inserting a steel plate between drilled holes in the ground. For example, Patent Document 1 discloses a rock bolt that is driven into the ground. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2021-75903 Summary of the Invention [Problem to be solved by the invention]
[0004] The Ministry of Land, Infrastructure, Transport and Tourism and local governments have established standards and specifications for the placement intervals of rock bolts. Rock bolts must be managed in accordance with these standards. Workers use a scale to measure the placement intervals of rock bolts installed in tunnels, which takes a considerable amount of time. In addition, when workers measure the placement intervals of rock bolts installed in places that are difficult to reach by hand, such as on the tunnel walls, they must use aerial work vehicles and scaffolding, which raises safety concerns such as falls and being pinched when moving the basket of an aerial work vehicle.
[0005] The disclosed technology has been developed in consideration of these circumstances, and aims to provide a technology that can safely and quickly measure the positioning status of rod-shaped support members that are cast into multiple locations. [Means for solving the problem]
[0006] An information processing system that is one aspect of the disclosed technology is an information processing system that manages the arrangement of multiple rod-shaped support members whose ends are embedded in a building with visible ends, and includes a first acquisition unit that acquires a first image of the ends of the multiple support members that are visible, a second acquisition unit that acquires a second image that is different from the first image and includes a distance image of the multiple ends, a generation unit that generates a composite image based on the first image and the second image, and a measurement unit that measures the arrangement spacing of the multiple ends based on the composite image.
[0007] According to this aspect, the information processing system acquires a first image of the ends of a plurality of support members that are visible, and acquires a second image different from the first image and including a distance image of the plurality of ends. The management system generates a composite image based on the first image and the second image, and measures the arrangement interval of the plurality of ends based on the composite image. Thus, the user does not need to perform manual measurement using a scale or measurement using an aerial work vehicle or scaffolding. Therefore, the user can safely and quickly measure the arrangement of rod-shaped support members, such as rock bolts, that are driven into multiple locations during the same construction work.
[0008] In the above information processing system, a display unit may be further provided that displays the composite image and the arrangement interval on a screen, and the display unit may display on the screen the arrangement interval of at least two ends selected from a plurality of ends included in the displayed composite image.
[0009] According to this aspect, the information processing system displays the arrangement interval of the support members on the screen, so that the user does not need to visually read the graduations on the scale to check the arrangement interval, and therefore the user can easily check the measurement result of the arrangement interval on the screen.
[0010] The information processing system may further include a storage unit in which a design value relating to the arrangement interval is stored, and the display unit may display the arrangement interval and the design value in association with each other.
[0011] According to this aspect, the information processing system displays the placement interval and the design value in association with each other on the screen, so that the user can easily compare the placement interval and the design value on the screen, and therefore the user can check whether the support members are embedded in the structure at the placement interval according to the design value.
[0012] The information processing system may further include a difference calculation unit that calculates a difference between the arrangement interval and a design value for the arrangement interval, and the display unit may display a warning message when the difference is not within a predetermined range.
[0013] According to this aspect, when the difference between the placement interval and the design value for the placement interval is not within a predetermined range, the information processing system displays a warning message on the screen, allowing the user to recognize anomalies such as human placement errors or abnormalities in the natural ground. Therefore, the user can easily understand that the support members are embedded with a placement interval that is outside the allowable range.
[0014] In the above information processing system, a memory unit may be further provided which stores previously measured spacing between multiple end portions as history information, and when a spacing between multiple end portions that is the same as the previously measured spacing between multiple end portions is measured, the display unit may display the spacing between the multiple end portions and the history information on the screen in association with each other.
[0015] According to this aspect, the information processing system displays the arrangement interval and the history information on the screen in association with each other, so that the user can compare the measurement results of the arrangement interval measured in the past with the current measurement results, and thus the user can easily check the change in the arrangement interval over time.
[0016] The information processing system may further include a document creation unit that creates a document in which the arrangement interval and a design value related to the arrangement interval are associated with each other.
[0017] According to this aspect, the information processing system creates a report in which the layout intervals and the design values are associated with each other, and thus the user does not need to manually perform tasks such as calculating the difference between the layout intervals and the design values related to the layout intervals, or checking the consistency with the standard values, etc. Therefore, the user can easily and quickly create the report.
[0018] In the above information processing system, the documentation creation unit may create a documentation in which the arrangement intervals, the design values, and the differences corresponding to the arrangement intervals and the design values are associated with each other.
[0019] According to this aspect, the information processing system creates a report in which the arrangement interval, the design value, and the difference corresponding to the arrangement interval and the design value are associated with each other. Therefore, the user does not need to manually input the difference into the report. Furthermore, the user can obtain a report in which the difference between the arrangement interval and the design value created by the report creation unit is input. Therefore, the user can quickly create a report in which the difference between the arrangement interval and the design value is input. Furthermore, the user can easily check the difference between the arrangement interval and the design value in the report created by the information processing system.
[0020] In the above information processing system, the structure may be a structure extending in one direction, and the report creation unit may create a report in which at least one of the spacing between the ends of multiple support members that are visible and arranged in the extension direction of the structure and the spacing between the ends of multiple support members that are visible and arranged in a direction different from the extension direction of the structure is associated with a design value.
[0021] According to this aspect, the information processing system creates a report in which at least one of the arrangement intervals of the ends of the support members embedded in the extension direction of the structure and the arrangement intervals of the ends of the support members embedded in a direction different from the extension direction of the structure is associated with a design value. Therefore, the user can use the created report to check the three-dimensional arrangement of the support members in the structure.
[0022] A program according to another aspect of the present disclosure causes a computer that manages the arrangement of multiple rod-shaped support members whose ends are embedded in a building with visible ends to execute a first acquisition step of acquiring a first image of the ends of the multiple support members that are visible, a second acquisition step of acquiring a second image different from the first image, the second image including a distance image of the multiple ends, a generation step of generating a composite image based on the first image and the second image, and a measurement step of measuring the arrangement spacing of the multiple ends based on the composite image.
[0023] An information processing method according to another aspect of the present disclosure is an information processing method executed by a computer that manages the arrangement of multiple rod-shaped support members whose ends are embedded in a building with visible ends, and includes a first acquisition step of acquiring a first image of the ends of the multiple support members that are visible, a second acquisition step of acquiring a second image different from the first image and including a distance image of the multiple ends, a generation step of generating a composite image based on the first image and the second image, and a measurement step of measuring the arrangement spacing of the multiple ends based on the composite image. Effect of the Invention
[0024] According to the present invention, the arrangement of a plurality of rod-shaped support members can be measured safely and in a short period of time. [Brief description of the drawings]
[0025] [Figure 1] FIG. 1 is a diagram for explaining an overview of a management system according to a first embodiment of the present disclosure. [Diagram 2] FIG. 1 shows an example of a tunnel with embedded rock bolts. [Diagram 3] 2 is a block diagram showing an example of a configuration of a communication terminal according to a first embodiment of the present disclosure. FIG. [Figure 4] FIG. 2 is a diagram showing an example of RGB image information according to the first embodiment of the present disclosure. [Diagram 5] 4 is a diagram showing an example of distance image information according to the first embodiment of the present disclosure. FIG. [Figure 6] 11 is a diagram showing an example in which a display unit according to the first embodiment of the present disclosure displays measurement result information of an arrangement interval. FIG. [Figure 7] 6 is a diagram showing an example in which the display unit according to the first embodiment of the present disclosure displays measurement result information and design value information in association with each other. FIG. [Figure 8] 13 is a diagram showing an example in which a display unit according to the first embodiment of the present disclosure displays measurement result information in association with history information of the same end portion as the measurement result information. FIG. [Figure 9] FIG. 2 is a diagram showing an example of a record according to the first embodiment of the present disclosure. [Figure 10] 5 is a flowchart illustrating an example of a process of a management system according to the first embodiment of the present disclosure. [Figure 11] 4 is a flowchart relating to processing of an arrangement interval measurement unit according to the first embodiment of the present disclosure. [Figure 12] FIG. 11 is a diagram for explaining an overview of a management system according to a second embodiment of the present disclosure. [Figure 13] FIG. 11 is a block diagram showing an example of a configuration of a communication terminal according to a second embodiment of the present disclosure. [Figure 14] FIG. 2 is a diagram illustrating an example of a hardware configuration of a management system according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0026] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The following embodiment is an example for explaining the present invention, and is not intended to limit the present invention to the embodiment. Furthermore, the present invention can be modified in various ways without departing from the gist of the invention. Furthermore, the same components in each drawing are denoted by the same reference numerals as much as possible, and duplicated explanations are omitted.
[0027] First Embodiment A first embodiment of the present invention will be described with reference to the accompanying drawings, in which the same reference numerals denote the same or similar configurations. <System Overview> 1 is a diagram for explaining an overview of a management system 100 (information processing system) according to the first embodiment. In the example shown in FIG. 1, the management system 100 illustratively includes an information processing device 10 and a communication terminal M.
[0028] In FIG. 1, a worker U uses a communication terminal M (e.g., a tablet terminal) to investigate the arrangement of support members embedded in a tunnel T constructed by excavating natural ground or rock masses. The support members include, for example, rock bolts, which are rod-shaped bolts used to suppress deformation of natural ground and landslides. The rock bolts can be integrated with the natural ground and stabilized by inserting a steel plate between the rock masses that have been drilled and then inserting the plate into the natural ground. In the following, a rock bolt will be used as an example of a support member, but is not limited to this. In the construction process of the tunnel T, the rock bolts are arranged so that their ends E1 and E2 protrude from the inner wall surface of the tunnel T and are visible. The worker U is also referred to as a "user." As a non-limiting example, the user may be the worker U, a construction company of the tunnel T, a company commissioned to investigate the arrangement of the support members, or an employee of the national or local government.
[0029] A worker U captures an image of the wall surface of the tunnel T using a camera equipped in a communication terminal M, and measures the placement intervals of a plurality of lock bolts (for example, the interval between end E1 and end E2). Data on the measured placement intervals is transmitted to an information processing device 10 via a network N. The information processing device 10 is, for example, a personal computer that creates a report on the measurement results of the placement status of the rock bolts. Note that the network N may be, for example, but is not limited to, the Internet, a LAN, a dedicated line, a telephone line, Bluetooth (registered trademark), WiFi (Wireless Fidelity) (registered trademark), any other communication line, or a combination thereof, and may be either wired or wireless.
[0030] The supports S shown in Figure 1 are arch-shaped structures placed at regular intervals in the direction of extension of the tunnel T to prevent the collapse of the tunnel T. Also, the supports S are marked with numbers SN to identify them.
[0031] FIG. 2 is a diagram showing an example of a tunnel T in which rock bolts are embedded. In the example shown in FIG. 2, a plurality of rock bolts RB including rock bolts RB1 and RB2 are embedded in an arch shape between two supports S in accordance with the shape of the tunnel T. For example, 16 rock bolts RB are embedded in an arch shape between supports S1 and S2 in accordance with the shape of the tunnel T. Note that when describing a plurality of rock bolts including "rock bolt RB1" and "rock bolt RB2" without distinction, some of the reference numerals are omitted and they are simply referred to as "rock bolts RB."
[0032] <Functional configuration> Next, a configuration of the communication terminal M according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the communication terminal M according to the first embodiment.
[0033] The communication terminal M includes an information processing unit 11 and a storage unit 21, for example.
[0034] The information processing unit 11 includes, for example, an RGB image acquisition unit 12 (first acquisition unit), a distance image acquisition unit 13 (second acquisition unit), a composite image generation unit 14 (generation unit), an arrangement interval measurement unit 15 (measurement unit), a display unit 16, and a difference calculation unit 17.
[0035] The above-mentioned units included in the information processing unit 11 may be realized by, for example, the communication interface 4 shown in FIG. 14 (hardware configuration), or may be realized by the CPU 2 executing a program stored in the memory 3 in addition to the communication interface 4. When the CPU 2 executes a program, the program may be stored in a storage medium. The storage medium storing the program may be a non-transitory computer readable medium. The non-transitory storage medium is not particularly limited, and may be, for example, a storage medium such as a Universal Serial Bus (USB) memory or a Compact Disc ROM (CD-ROM).
[0036] The RGB image acquisition unit 12 acquires RGB image information 22. The RGB image information 22 is image information relating to the ends E of multiple rock bolts RB in the tunnel T, as shown in Fig. 2. When multiple ends including "end E1" and "end E2" are described without distinction, some of the reference numerals will be omitted and they will simply be referred to as "end E".
[0037] The RGB image acquisition unit 12 is realized, for example, by an RGB image camera included in a depth camera mounted on the communication terminal M. The depth camera is configured to include, for example, an RGB image camera that distinguishes colors, and a twin-lens camera (stereo camera). The depth camera may acquire distance images by a stereo method. Note that the depth camera may be configured to include, for example, an RGB image camera that distinguishes colors, a device that irradiates an invisible infrared pattern, and a twin-lens camera that can receive the infrared pattern. When a worker U captures an image of the wall surface of the tunnel T with the depth camera provided in the communication terminal M, the worker U can acquire RGB image information 22 and distance image information 23 described later.
[0038] More specifically, the RGB image acquisition unit 12 captures images of multiple visible ends E of multiple rock bolts embedded in the wall surface of the tunnel T shown in FIG. 4 using an RGB image camera to acquire RGB image information 22, which is a color still image. The RGB image information 22 may or may not include a number SN for distinguishing the support structure S. The RGB image information 22 may be other visible images, such as a black and white still image or a monochrome still image. The area surrounded by a dashed line A in the RGB image information 22 shown in FIG. 4 corresponds to the wall surface of the tunnel T. The area surrounded by a dashed line B in the RGB image information 22 shown in FIG. 4 corresponds to the ground surface in the tunnel T. The RGB image acquisition unit 12 stores the acquired RGB image information 22 in the storage unit 21.
[0039] The distance image acquisition unit 13 acquires distance image information 23. The distance image information 23 is image information related to the size of a predetermined area in the tunnel T in which multiple lock bolts RB are embedded. The distance image acquisition unit 13 is realized by, for example, a distance image camera included in a depth camera mounted on the communication terminal M.
[0040] FIG. 5 is a diagram showing an example of distance image information 23. In the example shown in FIG. 5, distance image acquisition unit 13 measures the distance between the distance image camera and the imaged object, and thereby can acquire distance image information 23, which is three-dimensional spatial coordinate information with the distance image camera as the starting point. That is, it is possible to determine not only the distance between the distance image camera and the wall surface of tunnel T including ends E of multiple rock bolts, which are the imaged object, but also the size of the imaged object. Distance image information 23 has information such as "the vertical and horizontal lengths of the imaged object per pixel are 5 mm." Distance image acquisition unit 13 stores the acquired distance image information 23 in storage unit 21.
[0041] 5 corresponds to the area surrounded by dashed line A in the RGB image information 22 shown in FIG. 4. Also, the area surrounded by dashed line B in the distance image information 23 shown in FIG. 5 (shown in a lighter color than the area surrounded by dashed line B in FIG. 5) corresponds to the area surrounded by dashed line B in the RGB image information 22 shown in FIG. 4. Here, in the distance image information 23 shown in FIG. 5, darkness and light correspond to the distance between the distance image camera and the image capture target. More specifically, in the distance image information 23, when the distance between the distance image camera and the image capture target is smaller, the image is displayed darker, and when the distance between the distance image camera and the image capture target is larger, the image is displayed brighter. In other words, it can be seen that the ground portion corresponding to the area surrounded by dashed line B in Figure 4 (the area surrounded by dashed line B in Figure 5) is closer to the distance image camera than the wall portion of tunnel T corresponding to the area surrounded by dashed line A in Figure 4 (the area surrounded by dashed line A in Figure 5).
[0042] The composite image generating unit 14 generates composite image information 24 based on the RGB image information 22 and the distance image information 23. For example, the composite image generating unit 14 generates the composite image information 24 by superimposing the distance image information 23 on the RGB image information 22.
[0043] The arrangement interval measurement unit 15 measures the arrangement interval of the multiple end parts E based on the composite image information 24. The arrangement interval measurement unit 15 measures the arrangement interval of the multiple adjacent end parts E included in the composite image information 24 generated by the composite image generation unit 14, for example. The arrangement interval measurement unit 15 calculates the length of a line segment connecting predetermined adjacent end parts E. The arrangement interval measurement unit 15 finds the three-dimensional distance of the line segment, for example, from the three-dimensional coordinates corresponding to the pixels of the two end points of the line segment to be measured. In addition, the arrangement interval measurement unit 15 stores the measured arrangement interval in the storage unit 21 as measurement result information 26.
[0044] The arrangement interval measurement unit 15 may measure the arrangement interval of the selected multiple end portions E included in the composite image information 24. For example, the user may select at least two adjacent end portions E included in the composite image information 24, and the arrangement interval measurement unit 15 may measure the arrangement interval of the selected end portions E. More specifically, if the screen of the communication terminal M is a touch panel, the user may tap the end portion E included in the composite image information 24 displayed on the screen to select it. Also, if the communication terminal M has a microphone, the user may specify and select the end portion E by voice input. Also, if the communication terminal M has an in-camera, the user may select the end portion E by having the in-camera read the movement of the user's line of sight. Also, the arrangement interval measurement unit 15 may automatically select at least two adjacent end portions E included in the composite image information 24. More specifically, the arrangement interval measurement unit 15 may perform image analysis of the composite image information 24 to automatically recognize and select the end portion E included in the composite image information 24.
[0045] As described above, the management system 100 acquires RGB image information 22 relating to the ends E of multiple rock bolts RB that are visible, and acquires distance image information 23 relating to the multiple ends E. The management system 100 generates composite image information 24 based on the RGB image information 22 and the distance image information 23. The management system 100 measures the arrangement intervals of the multiple ends E based on the composite image information 24, and acquires measurement result information 26 as the measurement result. This eliminates the need for the user to perform manual measurements using a scale or measurements using an aerial work vehicle or scaffolding. This allows the user to safely and quickly measure the arrangement of rock bolts RB that are driven into multiple locations during the same construction work.
[0046] The communication terminal M may include a display unit 16. The display unit 16 displays the composite image information 24 and the measurement result information 26 on a screen. The display unit 16 is realized by the input / output interface 5 shown in FIG.
[0047] The display unit 16 may display on the screen the arrangement interval of at least two end portions E selected from the multiple end portions E included in the displayed composite image information 24.
[0048] Fig. 6 is a diagram showing an example in which the display unit 16 shown in Fig. 3 displays measurement result information 26 of the arrangement interval. In the example shown in Fig. 6, a user selects at least two adjacent end portions E from among a plurality of end portions E included in the composite image information 24 displayed on the screen of the communication terminal M. The display unit 16 displays the arrangement interval between the selected two end portions E on the screen. For example, when the end portions E3 and E4 shown in Fig. 6 are selected by the user, the display unit 16 displays a line segment connecting the end portions E3 and E4 on the screen, and further displays "measurement value: 1145 mm" as the measurement result information 26 of the arrangement interval.
[0049] Next, when the user selects the end E5 shown in FIG. 6, the display unit 16 displays a line segment connecting the end E3 and the end E5, and further displays "measurement value: 972 mm" as the measurement result information 26 of the arrangement interval between the end E3 and the end E5. Next, when the user selects the end E6 shown in FIG. 6, the display unit 16 displays a line segment connecting the end E4 and the end E6, and displays "measurement value: 983 mm" on the screen as the measurement result information 26 of the arrangement interval between the end E4 and the end E6. Furthermore, the display unit 16 displays a line segment connecting the end E5 and the end E6, and displays "measurement value: 1122 mm" as the measurement result information 26 of the arrangement interval between the end E5 and the end E6. The position where the measurement result information 26 of the two adjacent end parts E is displayed is, for example, between the two end parts E or on the line segment connecting the end parts E. Furthermore, the display unit 16 does not necessarily have to display the line segment connecting the end parts E.
[0050] As described above, the method for the user to select the end portion E displayed on the screen includes a method of selecting the end portion E displayed on the screen by tapping it, a method of selecting it by voice input, and a method of selecting the end portion E by reading the line of sight using the in-camera of the communication terminal M. In addition, the communication terminal M may automatically recognize and select the end portion E included in the composite image information 24.
[0051] As described above, by the management system 100 displaying the placement interval of the lock bolts RB on the screen, the user does not need to visually read the graduations on the scale to check the placement interval. Therefore, the user can easily check the measurement result of the placement interval on the screen.
[0052] The display unit 16 may display the arrangement interval and a design value related to the arrangement interval in association with each other. The display unit 16, for example, acquires design value information 25 from the storage unit 21, and displays the measurement result information 26 and the design value information 25 in association with each other. The design value information 25 is a predetermined design value related to the arrangement interval of the end portions E. The design value may be determined in any manner, and for example, the design value may be set based on a standard determined by the government or each local government, or the design value may be determined by the construction company of the tunnel T.
[0053] 7 is a diagram showing an example in which the display unit 16 displays the measurement result information 26 in association with the design value information 25. For example, the display unit 16 displays "design value: 1140 mm" which is the design value information 25 in association with "measurement value: 1145 mm" which is the measurement result information 26 of the arrangement interval between the end portion E3 and the end portion E4. Similarly, for the end portions E3 and E5, the end portion E5 and E6, and the end portions E4 and E6, the display unit 16 displays "design value: 970 mm", "design value: 1120 mm", and "design value: 983 mm" which are the design value information 25 in association with the measurement result information 26.
[0054] 7, the measurement result information 26 and the design value information 25 are associated by being vertically adjacent to each other, but this is not limited thereto. For example, the display unit 16 may associate the measurement result information 26 and the design value information 25 by displaying them in horizontally adjacent positions. Furthermore, the display unit 16 may display one piece of measurement result information 26 and one piece of design value information 25 in characters of one color, and display another piece of measurement result information 26 and another piece of design value information 25 in characters of a different color, thereby associating the respective pieces of information.
[0055] As described above, the management system 100 associates the measurement result information 26 with the design value information 25 and displays them on the screen, allowing the user to easily compare the measurement result information 26 with the design value information 25 on the screen. Therefore, the user can check whether the rock bolts RB are embedded in the tunnel T at the designed intervals.
[0056] The communication terminal M may further include a difference calculation unit 17 that calculates the difference between the measurement result information 26 and the design value. For example, the difference calculation unit 17 calculates the difference between the arrangement interval of the end E3 and the end E4 shown in Fig. 6 and Fig. 7 and the design value. More specifically, the difference (5 mm) between the measurement result (e.g., 1145 mm) of the arrangement interval of the end E3 and the end E4 and the design value (e.g., 1140 mm) is calculated.
[0057] Display unit 16 displays a warning message when the difference calculated by difference calculation unit 17 is not within a predetermined range (e.g., 50 mm). For example, when the measured arrangement interval is 1200 mm, the difference between the arrangement interval and the design value (1140 mm) is 60 mm, which exceeds the predetermined range (e.g., 50 mm), display unit 16 displays a warning message on the screen of communication terminal M.
[0058] As described above, when the difference between the arrangement interval and the design value for the arrangement interval is not within a predetermined range, the management system 100 displays a warning message on the screen, allowing the user to recognize abnormalities such as human placement errors or changes in the natural ground. Therefore, the user can easily understand that the rock bolts RB are embedded with an arrangement interval that is outside the allowable range.
[0059] When the display unit 16 measures the same arrangement interval of multiple end parts E as multiple end parts E measured in the past, the display unit 16 may display the measurement result information 26 of the arrangement interval of the multiple end parts E and the history information 27 on the screen in association with each other. For example, the history information 27 is information on the arrangement interval of the multiple end parts E measured in the past. The display unit 16 acquires the history information 27 from the storage unit 21, for example, and displays the measurement result information 26 and the history information 27 of the same end parts E as the measurement result information 26 in association with each other.
[0060] FIG. 8 is a diagram showing an example in which the display unit 16 displays the measurement result information 26 and the history information 27 of the same end E as the measurement result information 26 in association with each other. For example, the display unit 16 displays "PAST: 1135 mm" which is the history information 27 of the arrangement interval between the end E3 and the end E4 measured in the past in association with "measurement value: 1145 mm" which is the measurement result information 26 of the arrangement interval between the end E3 and the end E4. Similarly, for the end E3 and the end E5, the end E5 and the end E6, and the end E4 and the end E6, the display unit 16 displays "PAST: 975 mm", "PAST: 1120 mm", and "PAST: 983 mm" which are the history information 27 in association with the measurement result information 26. The display unit 16 may also display the measurement result information 26, the design value information 25 related to the measurement result information 26, and the history information 27 in association with each other.
[0061] It is arbitrary how far back the history information 27 the display unit 16 displays. For example, the display unit 16 may display the arrangement interval measured over a predetermined period (for example, several days or several weeks) as the history information 27. Furthermore, the display unit 16 may display a plurality of pieces of history information 27 in association with the measurement result information 26. For example, the display unit 16 may display history information 27 from one year ago and two years ago in association with the measurement result information 26. This allows the user to easily check the tendency of changes in the arrangement interval over time.
[0062] As described above, the management system 100 associates the measurement result information 26 with the history information 27 and displays them on the screen, allowing the user to compare the measurement results of the arrangement intervals measured in the past with the current measurement results. Therefore, the user can easily check the change in the arrangement intervals over time.
[0063] The management system 100 includes a record creation unit 18. The management system 100 includes the record creation unit 18 that creates a record in which, for example, the arrangement intervals of a plurality of end portions E are associated with design values. In this embodiment, as shown in Fig. 1, the information processing device 10 includes the record creation unit 18. Note that, in a second embodiment, as described later, the communication terminal M includes the record creation unit 18 instead of the information processing device 10.
[0064] The information processing device 10 obtains the measurement result information 26 and the design value information 25 from the communication terminal M to create a report. The information processing device 10 may also hold the design value information 25 in advance, in which case there is no need to obtain the design value information 25 from the communication terminal M. For example, when the information processing device 10 is a computer of a construction company of a tunnel T, a worker U shown in FIG. 1 transmits the measurement result information 26 to the computer from the communication terminal M that he operates. The computer may receive the measurement result information 26 and create a report by associating it with the design value information 25 that is held in advance. The information processing device 10 may also obtain the difference between the arrangement interval calculated by the difference calculation unit 17 and the design value related to the arrangement interval from the communication terminal M.
[0065] FIG. 9 is a diagram showing an example of a report prepared by the report preparation unit 18. In the example shown in FIG. 9, the report preparation unit 18 prepares an electronic report Re for 16 rock bolts RB (see FIG. 2) embedded in an arch shape in accordance with the shape of the tunnel T between the shoring S1 and the shoring S2 shown in FIG. 2. For example, (1) shown in FIG. 9 corresponds to the rock bolt RB1 (see FIG. 2), and (2) corresponds to the rock bolt RB2 (see FIG. 2). Furthermore, in the example shown in FIG. 9, the report preparation unit 18 prepares a report Re in which the arrangement interval of the ends E of the adjacent rock bolts RB is associated with the design value. For example, the report preparation unit 18 prepares a report Re in which the arrangement interval between the measured ends E of the rock bolts RB (1) and RB (2) (100.000 indicated by the measured value of (1)-(2)) is associated with the design value (111.000 indicated by the design value of (1)-(2)). Similarly, the document preparation unit 18 prepares a document Re that associates the arrangement intervals of the adjacent ends E with the design values for the rock bolts RB of (3) to (16).
[0066] As described above, the management system 100 creates a report Re in which the arrangement intervals and the design values are associated with each other, and the user does not need to manually calculate the difference between the arrangement intervals and the design values for the arrangement intervals, check the consistency with the standard values, etc. Therefore, the user can easily and quickly create the report.
[0067] The record preparation unit 18 may create a record Re in which the arrangement intervals of the multiple end portions E, the design values, and the difference corresponding to the arrangement intervals and the design values are associated. Referring to FIG. 9, the record preparation unit 18 creates a record Re in which the arrangement intervals (100.000 indicated by the measured values of (1)-(2)) between the end portions E of the rock bolt RB (1) and the end portions E of the rock bolt RB (2)), the design values (111.000 indicated by the design values of (1)-(2)), and the difference between the measured arrangement intervals and the design values (11.000 indicated by the difference between the design values of (1)-(2)) are associated. Similarly, the record preparation unit 18 creates a record Re in which the arrangement intervals of the adjacent end portions E of the rock bolts RB (3) to (16) are associated with the design values, and the difference corresponding to the arrangement intervals and the design values.
[0068] As described above, the management system 100 creates a report Re in which the arrangement interval, the design value, and the difference corresponding to the arrangement interval and the design value are associated with each other. This eliminates the need for the user to manually input the difference into the report Re. The user can also obtain the report Re in which the difference between the arrangement interval and the design value created by the report creation unit 18 is input. This allows the user to quickly create the report Re in which the difference between the arrangement interval and the design value is input. The user can also easily check the difference between the arrangement interval and the design value in the report Re created by the management system 100.
[0069] The report creation unit 18 may create a report Re in which at least one of the spacing between the ends E of multiple rock bolts RB that are visible and arranged in the direction of extension of the tunnel T and the spacing between the ends E of multiple rock bolts RB that are visible and arranged in a direction different from the direction of extension of the tunnel T is associated with a design value.
[0070] 9, the record preparation unit 18 prepares a record Re in which, for example, the arrangement interval between the end E of the rock bolt RB (1) and the end E of the adjacent rock bolt RB in the extension direction of the tunnel T (the measured value of (1) at the rock bolt interval (extension direction) DI2) and the design value (the design value of (1) at the rock bolt interval (extension direction) DI2). Note that the extension direction is the extension direction of the tunnel T. Similarly, for the rock bolts RB of (2) to (16), the record preparation unit 18 prepares a record Re in which the arrangement interval between the end E of the rock bolt RB and the end E of the adjacent rock bolt RB in the extension direction of the tunnel T and the design value are associated.
[0071] The report creation unit 18 may create a report Re in which the arrangement distance between end E of rock bolt RB (1) and end E of rock bolt RB (2), which is an adjacent rock bolt RB in a direction different from the extension direction of the tunnel T (the measured value of (1)-(2) at rock bolt spacing (circumferential direction) DI1 shown in Figure 9) is associated with the design value (the design value of (1)-(2) at rock bolt spacing (circumferential direction) DI1 shown in Figure 9).
[0072] From the above, the management system 100 creates a report Re in which at least one of the arrangement intervals of the ends E of the rock bolts RB embedded in the extension direction of the tunnel T and the arrangement intervals of the ends E of the rock bolts RB embedded in a direction different from the extension direction of the tunnel T is associated with a design value. Therefore, the user can check the three-dimensional arrangement of the rock bolts RB in the tunnel T by using the created report Re.
[0073] <Operation process> Next, an operation according to the embodiment will be described with reference to Fig. 10 and Fig. 11. Fig. 10 is a flowchart showing an example of processing of the management system according to the embodiment.
[0074] In step S 11 , the RGB image acquisition unit 12 acquires the RGB image information 22 .
[0075] In step S12, distance image acquisition unit 13 acquires distance image information 23.
[0076] In step S13, the composite image generating unit 14 generates composite image information 24 based on the RGB image information 22 and the distance image information 23.
[0077] In step S14, the arrangement interval measuring unit 15 measures the arrangement intervals between the multiple ends E based on the composite image information 24.
[0078] In step S15, the display unit 16 displays the composite image information 24 and the measurement result information 26 on the screen.
[0079] A detailed example of the processing of the layout interval measurement unit 15 will be described with reference to Fig. 11. Fig. 11 is a flowchart relating to the processing of the layout interval measurement unit 15 according to this embodiment. In the example shown in the figure, in step S21, the layout interval measurement unit 15 acquires composite image information 24 from the composite image generation unit 14.
[0080] In step S22, the user selects at least two adjacent end portions E included in the composite image information 24. For example, the user selects the end portions E included in the composite image information 24 by tapping them on the screen of the communication terminal M. The end portions E may also be selected by voice input or eye movement. The arrangement interval measurement unit 15 may also automatically select at least two adjacent end portions E included in the composite image information 24. In this case, the arrangement interval measurement unit 15 performs image analysis of the composite image information 24, for example, to automatically recognize and select the end portions E included in the composite image information 24.
[0081] In step S23, the arrangement interval measurement unit 15 measures the arrangement interval between the selected adjacent ends E.
[0082] <Second embodiment> Fig. 12 is a diagram for explaining an overview of a management system 200 (information processing system) according to the second embodiment of the present disclosure. In the example shown in Fig. 12, the management system 200 does not include an information processing device 10, unlike the management system 100. Therefore, in the second embodiment, the communication terminal M includes a record creation unit 18.
[0083] Fig. 13 is a block diagram showing an example of the configuration of a communication terminal M according to the second embodiment. In the example shown in Fig. 13, the information processing unit 11 further includes an audit record creation unit 18. The storage unit 21 further stores audit record information 28.
[0084] The record information 28 is, for example, record Re shown in FIG. 9 in which the design values, the measured values, and the values of the difference from the design values are left blank.
[0085] The record preparation unit 18 acquires the record information 28 from the storage unit 21, and creates the record Re by applying the same processing as that of the record preparation unit 18 described in the first embodiment above.
[0086] As described above, by equipping the communication terminal M with the record creation unit 18, the user can use the communication terminal M to not only measure the placement interval of the ends E of the lock bolts RB, but also to create the record Re.
[0087] <Hardware configuration> Next, the hardware configuration of each device related to the management system 100 will be described with reference to FIG.
[0088] The hardware 1 is configured, by way of example and not limitation, with a CPU (Central Processing Unit) 2, a memory 3, a communication interface 4, and an input / output interface 5, all of which are interconnected via a bus 6.
[0089] The CPU 2 executes various arithmetic processes related to the operation of each piece of hardware in accordance with the programs recorded in the memory 3, and executes the acquisition and generation of each piece of information.
[0090] The memory 3 also stores data and the like necessary for the CPU 2 to execute various processes. The memory 3 is, for example, a read only memory (ROM) and a random access memory (RAM). The storage unit 21 shown in FIGS. 3 and 13 corresponds to the memory 3.
[0091] The communication interface 4 transmits and receives various data to and from other hardware in accordance with instructions from the CPU 2. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication is possible.
[0092] The input / output interface 5 includes an input device for inputting various operations for each piece of hardware, and an output device for outputting the results of processing by each piece of hardware. The input / output interface 5 may be an integrated input device and an output device, or may be separate input device and output device.
[0093] Examples of the input device include, but are not limited to, a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera (operation input by eye movement), and a microphone (operation input by voice). Examples of the output device include, but are not limited to, a touch panel, a touch display, a monitor (examples include, but are not limited to, a liquid crystal display, an OELD (Organic Electroluminescence Display), etc.), a head mounted display (HDM), projection mapping, a hologram, a device capable of displaying images, text information, etc. in the air (which may be a vacuum), a speaker (audio output), a printer, etc. Note that these output devices may be capable of displaying display data in 3D.
[0094] <Modification> The above-mentioned embodiment or each example is for facilitating understanding of the present invention, and is not to be construed as limiting the present invention. The present invention may be modified / improved without departing from the spirit thereof, and the present invention also includes equivalents thereof. In addition, the present invention can form various disclosures by appropriate combinations of multiple components disclosed in the above-mentioned embodiment or each example. For example, some components may be deleted from all components shown in the embodiment. Furthermore, components may be appropriately combined in different embodiments.
[0095] In the above embodiment, the display unit 16 has been described as displaying each piece of information on a screen, but this is not limited thereto. For example, the display unit 16 may output each piece of information by a speaker provided in the communication terminal M. More specifically, the display unit 16 may output at least one of the above-mentioned design value information 25, measurement result information 26, history information 27, and warning message by voice through the speaker. [Explanation of symbols]
[0096] 1...Hardware, 2...CPU, 3...Memory, 4...Communication interface, 5...Input / output interface, 6...Bus, 10...Information processing device, 11...Information processing unit, 12...RGB image acquisition unit, 13...Distance image acquisition unit, 14...Synthetic image generation unit, 15...Layout interval measurement unit, 16...Display unit, 17...Difference calculation unit, 18...Report creation unit, 21...Memory unit, 22...RGB image information, 23...Distance image information, 24...Synthetic image information, 25...Design value information, 26...Measurement result information, 27...History information, 28...Report information, 100, 200...Management system, DI1...Rock bolt spacing (circumferential direction), DI2...Rock bolt spacing (extension direction), E...End, E1 to E6...End, M...Communication terminal, N...Network, RB, RB1, RB2...Rock bolt, Re...Report, S, S1, S2...Support, SN...Number, T...Tunnel, U...Worker
Claims
1. An information processing system for managing the arrangement of a plurality of rod-shaped support members whose ends are embedded in a structure in a visible state, comprising: a first acquisition unit that acquires a first image relating to the ends of the plurality of support members that are in a visible state; a second acquisition unit that acquires a second image different from the first image, the second image including a distance image related to the plurality of ends; a generating unit that generates a composite image based on the first image and the second image; a measurement unit that measures the arrangement intervals of the multiple ends based on the composite image.
2. a display unit that displays the composite image and the arrangement interval on a screen; The information processing system according to claim 1 , wherein the display unit displays on the screen an arrangement interval between at least two edges selected from the plurality of edges included in the displayed composite image.
3. A storage unit storing a design value related to the arrangement interval, The information processing system according to claim 2 , wherein the display unit displays the layout interval and the design value in association with each other.
4. a difference calculation unit that calculates a difference between the arrangement interval and a design value for the arrangement interval, 4. The information processing system according to claim 2, wherein the display unit displays a warning message when the difference is not within a predetermined range.
5. A storage unit is further provided that stores the arrangement intervals of the plurality of ends measured in the past as history information, The information processing system according to claim 2 or 3, wherein when the arrangement spacing of the multiple ends is measured to be the same as the arrangement spacing of the multiple ends measured in the past, the display unit displays the arrangement spacing of the multiple ends and the history information in association with each other on the screen.
6. The information processing system according to claim 1 , further comprising a report creation unit that creates a report in which the arrangement interval and a design value related to the arrangement interval are associated with each other.
7. The information processing system according to claim 6 , wherein the report creation unit creates the report in which the arrangement interval, the design value, and a difference between the arrangement interval and the design value are associated with each other.
8. The structure is a structure extending in one direction, The information processing system described in claim 7, wherein the report creation unit creates a report in which the design values are associated with at least one of the arrangement spacing of the ends of the multiple support members in the visible state arranged in the extension direction of the structure and the arrangement spacing of the ends of the multiple support members in the visible state arranged in a direction other than the extension direction of the structure.
9. A computer that manages the arrangement of a plurality of rod-shaped support members that are embedded in a structure with their ends visible is provided. a first acquisition step of acquiring a first image of the visible ends of the plurality of support members; a second acquisition step of acquiring a second image different from the first image, the second image including a distance image related to the plurality of ends; generating a composite image based on the first image and the second image; a measuring step of measuring an arrangement interval of the plurality of ends based on the composite image; A program that executes the following.
10. An information processing method executed by a computer for managing the arrangement of a plurality of rod-shaped support members whose ends are embedded in a structure in a visibly recognizable state, comprising: a first acquisition step of acquiring a first image of the visible ends of the plurality of support members; a second acquisition step of acquiring a second image different from the first image, the second image including a distance image related to the plurality of ends; generating a composite image based on the first image and the second image; a measuring step of measuring an arrangement interval of the plurality of ends based on the composite image; An information processing method comprising:
Citation Information
Patent Citations
System for execution support of tunnel excavation using three-dimensional laser scanner
JP2010217018A
Construction information management system
JP2017215878A
Diagnosis processor, diagnosis system, input method, and program
JP2019061667A
Measuring system
JP2022029957A
Measurement device and measurement method
WO2020066847A1
