Impact point analysis system, impact point analysis method, and program
Patent Information
- Application Number
- JP2024544603
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Priority Date
- 2023-09-01
- Filing Date
- 2023-09-01
- Publication Date
- 2026-09-08
AI Technical Summary
The training of inspectors for hammering sound inspections is inefficient due to reliance on on-site guidance, limited scalability, and the need for a more effective method to analyze and visualize inspection techniques, which hampers the mechanization of internal defect detection in concrete structures.
An impact point analysis system and method that includes a detection unit to track hammer strikes, a processing unit to specify positional and time information, and a display unit to visualize impact points on a coordinate plane, enabling efficient data generation and display for training and mechanization of inspections.
Facilitates the creation of effective training materials and streamlines the mechanization of hammering sound inspections by providing a systematic and efficient way to analyze and visualize inspection techniques, reducing the reliance on on-site guidance and improving inspector training efficiency.
Abstract
Description
Hitting point analysis system, hitting point analysis method, and program
[0001] The present invention relates to a hitting point analysis system, a hitting point analysis method, and a program.
[0002] The lifespan of concrete structures such as tunnels, road bridges, and bridge girders (simply referred to as "structures" unless otherwise specified) is said to be approximately 50 years. Many structures were constructed during the period of rapid economic growth, and approximately half of these will be 50 years old within the next 10 years. If defects such as cracks develop near the surface of a structure due to aging, the surface may collapse, potentially resulting in a serious accident. Visual inspections are the mainstream method for determining whether or not there are defects on the surface of a structure, and mechanization is advancing. Meanwhile, internal inspections, which determine whether or not there are defects inside a structure, are primarily conducted by hammering inspections (see, for example, Patent Document 1), in which an inspector strikes the wall surface of the structure with a tool such as a hammer and listens to the hammering sounds produced. However, mechanization of hammering inspections is still insufficient, and the annual decline in the number of inspectors due to population trends has become a social issue. Patent Document 1: JP 2016-50876 A Problem to be solved
[0003] Currently, the training of hammering inspectors relies on on-site training by experienced inspectors. However, it is said that it takes at least three years to master hammering inspection techniques (also simply referred to as inspection techniques). Furthermore, because on-site training is the norm, there are problems with the inefficiency of training due to the inability to write down the content of instruction from experienced inspectors, the inability to self-study or review, and the limited number of people who can be trained at one time. Therefore, more efficient methods of training inspectors or training materials are needed. Therefore, analyzing, quantifying, or visualizing the inspection techniques of experienced inspectors can be used as training materials for inspectors, and is also expected to be effective in improving the efficiency of machine-based hammering inspections. General disclosure
[0004] (Item 1) An impact point analysis system may analyze impact points during impact testing of an inspection object. The impact point analysis system may include a detection unit that detects an inspector striking the inspection object with a hammer. The impact point analysis system may include a processing unit that processes the detection results and identifies position information regarding the positions of the impact points struck by the hammer on a coordinate plane including the inspection object. The impact point analysis system may include a generation unit that calculates distribution information regarding the distribution of the impact points on the coordinate plane based on the position information and generates impact point data including the position information and the distribution information. (Item 2) The impact point analysis system may further include a display unit that displays impact points at impact positions on an image of the inspection object based on the position information, and decorates a section including the impact point displayed on the image of the inspection object based on the distribution information, and displays the image on a display screen. (Item 3) The display unit may display a range in which the impact points are distributed on the image of the inspection object. (Item 4) The display unit may decorate sections including each impact point on the image of the test object according to the density at which the impact points are distributed. (Item 5) The processing unit may further identify time information regarding the time at which the impact point was struck by the hammer. The display unit may display each impact point in impact order at the impact position on the image of the test object based on the position information and the time information. (Item 6) The display unit may decorate the display of each impact point according to the impact order. (Item 7) The display unit may enable the decoration based on the impact order according to user input. (Item 8) The display unit may further read impact point data recorded on a non-transitory storage medium and display on the display screen a second image of the test object in which the impact points are displayed and sections including the impact points are decorated based on the position information and distribution information included in the impact point data. (Item 9) The distribution information may include the range and density at which the impact points are distributed on the coordinate plane. (Item 10) The impact point analysis system may further include a recording unit that records the impact point data in a non-transitory storage medium.
[0005] (Item 11) This may be an impact point analysis method for analyzing impact points when performing an impact inspection on an inspection object. The impact point analysis method may include a step of detecting an inspector striking the inspection object with a hammer. The impact point analysis method may include a step of processing a result of the detection to identify position information regarding the position of the impact point struck by the hammer on a coordinate plane including the inspection object. The impact point analysis method may include a step of calculating distribution information regarding the distribution of the impact points on the coordinate plane based on the position information, and generating impact point data including the position information and the distribution information.
[0006] (Item 12) A program for analyzing impact points during a hit inspection of an inspection object may be provided. The program may cause a computer to execute a procedure for detecting an inspector striking the inspection object with a hammer. The program may cause the computer to execute a procedure for processing a result of the detection and identifying position information regarding positions of the impact points struck by the hammer on a coordinate plane including the inspection object. The program may cause the computer to execute a procedure for calculating distribution information regarding a distribution of the impact points on the coordinate plane based on the position information, and generating impact point data including the position information and the distribution information.
[0007] The above summary of the invention does not list all of the features of the present invention, and subcombinations of these features may also be inventions.
[0008] 1 shows the configuration of an impact point analysis system according to this embodiment. It shows a situation in which an inspector is hitting an inspection object (wall surface) with a hammer. It shows the functional configuration of a processing device. It shows an example of position information and time information of impact points. It shows an example of impact point distribution information. It shows the structure of impact point data. It shows a state in which an image of an inspection object is displayed. It shows a state in which impact points are displayed on an image of an inspection object. It shows a state in which each section on an image of an inspection object is decorated and statistical information is displayed. It shows an example of an image of an inspection object in which impact points are displayed based on impact point data and each section containing impact points is decorated. It shows another example image of an inspection object. It shows yet another example image of an inspection object. It shows the flow of an impact point analysis method according to this embodiment. It shows a situation in which an inspector is performing a hammering inspection of an inspection object (tunnel ceiling surface) with a hammer. It shows the display flow of impact point data according to this embodiment. It shows a situation in which an inspector is checking an image of the inspection object in which impact points, etc. are displayed based on the impact point data after the hammering inspection of the inspection object. It shows an example of a dual-screen display of an impact image. It shows an example of the configuration of a computer according to this embodiment.
[0009] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention as claimed. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.
[0010] 1 shows the configuration of an impact point analysis system 100 according to this embodiment. The impact point analysis system 100 is a system that analyzes the impact point when an inspector 1 uses a hammer 40 to perform a tapping test on an inspection object 99, and includes a detection device 10 and a processing device 20. Here, the inspection object 99 is, as an example, the wall surface of a tunnel. The hammer 40 is an example of a tool used to strike the inspection object, and a hammer having a head made of a material that is likely to produce a tapping sound and a grip of an appropriate length is selected and used depending on the inspection object and its location.
[0011] The detection device 10 is a device that detects the inspector 1 striking the inspection object 99 with the hammer 40. In this embodiment, the detection device 10 is a wearable device that is detachably fixed to the inspector 1.
[0012] 2 shows an inspector 1 striking an inspection object 99 with a hammer 40 during a hammering inspection. The inspector 1 observes the surface of the inspection object 99 to predict the location of an internal defect, and then infers the structure of the defect from more detailed observation and any abnormalities in the hammering sounds generated by the strike. Here, the detection device 10 is fixed facing forward to the front of the helmet worn by the inspector 1 using a fixing band 10a or the like so that an image of the inspector 1 striking the inspection object 99 with the hammer 40 can be easily captured. The detection device 10 includes a detection unit 11 and a transmission unit 12.
[0013] The detection unit 11 has an imaging camera and a microphone. The imaging camera is a device that captures an image of the inspector 1 striking the inspection object 99 with the hammer 40, and may be, for example, a CCD image sensor. The imaging camera is capable of capturing images at a sufficiently high frame rate and sufficiently high resolution so that the three-dimensional position of the head of the hammer 40 (particularly the striking end 41) can be identified. The microphone is a device that detects the impact sound generated when the inspector 1 strikes the inspection object 99 with the hammer 40. The detection unit 11 synchronizes the imaging data obtained by the imaging camera and the sound data obtained by the microphone to generate one piece of detection data.
[0014] The transmitter 12 includes a communication device. The communication device may employ short-range wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). The transmitter 12 transmits the detection data generated by the detector 11 to the processing device 20.
[0015] The processing device 20 is a device that processes the detection data generated by the detection unit 11 to generate impact point data, and includes a central processing unit (CPU) 21, a communication device 22, a display 23, and a storage device 24. In this embodiment, the processing device 20 is a mobile terminal that can be used at the site of the hammering test.
[0016] The CPU 21 executes a processing program to process the detection data and generate impact point data. The functional configuration of the processing device 20 will be described later. The processing program is activated by being stored, for example, in a ROM (not shown) and read by the CPU, or by being stored in a storage medium such as a CD-ROM and read by the CPU using a reading device (not shown) and loaded into RAM.
[0017] The communication device 22 is a device for communicating with the detection device 10. The communication device 22 may use the short-range wireless communication described above as a communication means. The communication device 22 receives detection data from the detection device 10.
[0018] The display 23 is a device that displays an image that visualizes the inspection technique by displaying the impact points superimposed on the image of the inspection object 99 and decorating the area including the impact points. Through the displayed image, the inspector 1 can visually confirm his / her own inspection technique or visually learn the inspection technique of another inspector.
[0019] The storage device 24 is a device that records the impact point data generated by the processing device 20 on a non-transitory storage medium 30. The non-transitory storage medium 30 includes, for example, a hard disk incorporated in the processing device 20, a compact disk that can be transported away from the processing device 20, a magneto-optical disk, a magnetic tape, a flash memory, or other tangible storage medium. The storage device 24 is incorporated in the processing device 20, but is not limited to this, and may also be located outside the processing device 20 so as to be communicable via an interface such as SCSI or SATA, or via a network.
[0020] 3 shows the functional configuration of the processing device 20 realized by executing the processing program. The processing device 20 includes a processing unit 26, a generating unit 27, a display unit 28, and a storage unit 29.
[0021] The processing unit 26 is a unit that processes the detection data received from the detection device 10, and identifies position information regarding the position of the impact point struck by the hammer 40 and time information regarding the time at which the impact point was struck on a coordinate plane including the inspection object 99. Here, the coordinate plane including the inspection object 99 is, as an example, a two-dimensional plane that projects the wall surface of the inspection object 99 at a certain magnification when viewed directly from the normal direction.
[0022] The processing unit 26 first detects the inspection object 99 from the image of each frame included in the imaging data. Here, because the inspector 1 moves during the hammering inspection, the inspection object 99 moves within the captured image, and its position, orientation, and magnification are usually not constant. Therefore, the processing unit 26 extracts an appropriate number of landmarks (e.g., four or more) from the captured image of the inspection object 99 to identify its two-dimensional position on a standardized coordinate plane, and processes the landmarks so that their mutual distances and orientations are constant on the two-dimensional plane. For example, when the wall surface of the inspection object 99 is viewed from the normal direction, the image of each frame is translated, rotated, enlarged, or reduced. This standardizes the coordinate plane in which the inspection object 99 is centered with a constant size and orientation within the image of each frame. Note that in subsequent processing, the image of each frame is similarly standardized, and the coordinate plane (origin, orientation, and scale) is assumed to be consistent across each frame.
[0023] Next, the processing unit 26 identifies the hammer 40 from the image of each frame and thereby identifies the position of the impact point on the inspection object 99 that was struck. The processing unit 26 stores the shape of the hammer 40 in advance, processes the image of each frame, identifies the stored shape of the hammer 40 from the image, and identifies the position of the impact tip 41 of the head. Here, the impact tip 41 of the head may be colored in advance with a specific color to make it easier to identify. When the inspector 1 strikes the inspection object 99 with the hammer 40, the impact tip 41 of the head first moves toward the inspection object 99, contacts the inspection object 99, and then moves away from the inspection object 99. Therefore, the processing unit 26 selects an image of a frame in which the impact tip 41 of the hammer 40 changes its direction of movement and identifies the position of the impact tip 41 in that image, thereby identifying the position of the impact point on a coordinate plane including the inspection object 99 and the time (referred to as the impact time) at which the impact point struck the inspection object 99 from the selected image frame.
[0024] In addition to processing the imaging data, the processing unit 26 may process the acoustic data to detect the sound (referred to as an impact sound) generated when the inspection object 99 is struck. The processing unit 26 may determine the time when the impact sound is detected as the impact time, select an image of a frame corresponding to that time, and identify the position of the striking end 41 in that image to thereby identify the position of the striking point.
[0025] The processing unit 26 may process the acoustic data to detect abnormal sounds caused by defects such as cracks present inside the inspection object 99. Abnormal sounds can be identified, for example, by detecting delayed sounds that are reflected by an internal defect in the inspection object 99 relative to the sound generated when the inspection object 99 is struck by the hammer 40, or by detecting sounds that exhibit a frequency spectrum that is predominantly distorted by an internal defect compared to the frequency spectrum of normal sounds generated when the inspection object 99 without an internal defect is struck by the hammer 40.
[0026] The processing unit 26 processes all of the imaging data included in the detection data or imaging data within a selected time range, as well as the corresponding acoustic data, thereby identifying the positions of multiple impact points, the impact times, and the presence or absence of abnormal sounds.
[0027] FIG. 4 shows an example of position information and time information for identified impact points. The position information and time information include the impact point number, impact time, impact position, and whether or not abnormal sounds are present. The impact points are numbered and arranged in the order in which they were identified (i.e., in order of impact time). The impact time may be represented as an absolute time, or as a relative time based on the impact time of the first impact point. The impact position is represented as a two-dimensional position (X, Y) on a standardized coordinate plane that includes the inspection object 99. The presence or absence of abnormal sounds is represented by whether abnormal sounds are detected (yes) or not (no) for each impact point, or by the operator's judgment (yes) or not (no).
[0028] The generation unit 27 calculates distribution information regarding the distribution of impact points on a coordinate plane including the inspection target 99, based on the impact point position information identified by the processing unit 26. Here, the distribution information includes the range and density in which multiple impact points are distributed on the coordinate plane. The generation unit 27 reads the impact point position information (see FIG. 4), divides the coordinate plane into multiple sections arranged in a matrix in a two-dimensional direction, counts the number of impact points located within each section (or within that section and its adjacent sections), and determines the density of the impact points based on the number of impact points. The range in which the impact points are distributed is identified so as to include multiple sections within which the density of impact points exceeds a predetermined threshold density.
[0029] FIG. 5 shows an example of calculated impact point distribution information. The distribution information includes the section number, section position, number of impact points, and density determination. The section number is a number that identifies each of multiple sections when a coordinate plane including the inspection object 99 is divided into a matrix. The section position is the center position of the section on the coordinate plane including the inspection object 99. The number of impact points is the number of impact points located within each section. The impact point density is expressed as a degree determined according to the number of impact points in each section, and is expressed as one of the following, for example: extremely low (0 to 1 impact points), low (2 to 3 impact points), medium (4 to 5 impact points), and high (6 or more impact points). The degree of impact point density (extremely low, low, medium, high, etc.) may also be determined based on the standard deviation of the number of impact points in each section.
[0030] The generation unit 27 may generate statistical information about the impact points along with the distribution information about the impact points. The statistical information may include, for example, the total number of impact points. Alternatively, the number of sections that include very low density, low density, medium density, and high density impact points may be counted, and these count values may be included in the statistical information. Alternatively, the width of the range in which the impact points are distributed may be calculated, or the number of sections included in that range may be counted, and the calculated value or count value may be included in the statistical information.
[0031] The structure of the impact point data is shown in Fig. 6. The generation unit 27 generates impact point data including an image of the inspection object 99, position information and time information of the impact points generated as described above, as well as distribution information and statistical information.
[0032] The display unit 28 uses the impact point data to display the impact results on the display 23 of the processing device 20. That is, the display unit 28 displays the impact points at the impact positions on the image of the test object 99 based on the position information, and also decorates the sections including the impact points displayed on the image of the test object 99 based on the distribution information, and displays the image on the display 23.
[0033] The display unit 28 first reads image data (see FIG. 6) of the inspection object 99 from the impact point data. As a result, an image of the inspection object 99 is displayed on the display 23, as shown in FIG. 7A. In this example, the image is displayed so that a defect C (a crack or a lift, for example) inside the inspection object 99 is positioned at the center.
[0034] Next, the display unit 28 reads the position information and time information of the impact points from the impact point data (see FIG. 4 ). Then, the display unit 28 displays the impact points at the impact positions on the image of the inspection object 99 based on the position information of the impact points. As a result, as shown in FIG. 7B , multiple impact points D are displayed using black circles on the image of the inspection object 99. The display unit 28 may display the multiple impact points in the order of impact on the image of the inspection object 99 based on the time information of the impact points. At this time, each impact point may be displayed with a time interval corresponding to the interval between impact times from the previous impact point. Furthermore, the time interval may be set to be equal to the interval between impact times, so that the multiple impact points are displayed at a constant speed in the order of impact, or the time interval may be shortened or lengthened, so that the multiple impact points are displayed at a high or low speed in the order of impact.
[0035] In this way, by using the display unit 28 to display each impact point in the order of impact at the impact position on the image of the inspection object 99 based on the position information and time information of the impact point, the inspection technique by which the inspector 1 narrows down the range to be struck can be visualized, and it is also possible to visually grasp the inspector 1's narrowing down inspection technique through the image.
[0036] Furthermore, the display unit 28 may decorate the display of each impact point according to the time of impact, i.e., the impact order. For example, when displaying each impact point, the display unit 28 displays the trajectory of the impact point by displaying a straight line connecting the previously displayed impact point. The display unit 28 may display multiple impact points by changing the color tone as the display progresses, for example, by gradually changing from light to dark colors (gradation display). In this case, the display unit 28 may enable or disable these decorations based on the impact order in accordance with user input via the interface of the processing device 20.
[0037] Furthermore, the display unit 28 may decorate the display of each impact point depending on whether or not an abnormal sound is detected. For example, when displaying each impact point, the display unit 28 may display the impact point in a different color if an abnormal sound is detected at that impact point than if no abnormal sound is detected. This allows the inspector 1 to visually grasp, through the display of the impact points, the inspection technique for narrowing down the area to be impacted when an abnormal sound is detected.
[0038] Next, the display unit 28 reads the impact point distribution information (see FIG. 5) from the impact point data. The display unit 28 then decorates the sections containing each impact point on the image of the inspection object 99 according to the density at which the impact points are distributed. For example, the high-density section A3 is displayed in red, the medium-density section A2 in yellow, and the low-density section A1 in green. As a result, each section on the image of the inspection object 99 is decorated, as shown in FIG. 7C. Furthermore, the display unit 28 displays a range R on the image of the inspection object 99 within which the impact points are distributed at a certain density or higher. As a result, the outer edge of the range R is displayed as a straight line on the image of the inspection object 99, as shown in FIG. 7C.
[0039] Finally, the display unit 28 reads the impact point statistical information from the impact point data, and as a result, the total number N of impact points, the number of high-density sections (3), the number of medium-density sections (4), and the number of low-density sections (13) are displayed below the image of the inspection object 99, as shown in FIG.
[0040] 7D shows an example of an image of an inspection object 99 in which impact points D are displayed based on impact point data and each section containing an impact point is decorated. The range R0 indicated by a white line in the image is the range marked by inspector 1 after actually performing a hammering inspection of the inspection object 99 and estimating that there are defects such as cracks inside. Multiple impact points D are displayed as black circles on the image of the inspection object 99. Sections with a high density of impact points are also decorated, with high-density section A3 displayed in red, medium-density section A2 in yellow, and low-density section A1 in green. The outer edge of the range R in which impact points are distributed at a certain density or above is displayed as a straight line.
[0041] In this example, there are five areas C1 to C5 where impact points are concentrated, and areas C1 to C4 in particular contain multiple high-density sections A3. It can be seen that inspector 1 noticed something abnormal in the impact sounds in these areas C1 to C5 and narrowed down his impact to these areas. It can be seen that the impact point distribution range R identified by the generation unit 27 includes these areas C1 to C5 and is approximately consistent with the range R0 in which inspector 1 estimated that there were actual defects.
[0042] 7E and 7F show other examples of images of inspection objects 99a and 99b. Similar to the example shown in FIG. 7D, the area R0 indicated by the white line in the image represents the area marked by inspector 1 after a hammering test of the inspection objects 99a and 99b, where cracks or other defects are estimated to exist. Multiple impact points D are displayed as black circles on the images of the inspection objects 99a and 99b. However, in these examples, the density of impact points is determined based on the deviation value of the number of impact points in each section, with section A3, which has a high deviation value (i.e., high density), displayed in red, section A2, which has a medium deviation value (medium density), displayed in yellow, and section A1, which has a low deviation value (low density), displayed in green. The outer edge of the range R, where impact points are distributed above a certain deviation value, is displayed as a straight line.
[0043] 7E, which shows a small number of strikes, and the example of FIG. 7F, which shows a large number of strikes, it can be seen that there are two areas C1 and C2 where strike points are concentrated, and that these areas contain multiple high-density sections A3. Furthermore, it can be seen that the strike point distribution range R identified by the generation unit 27 includes the areas C1 and C2, and is approximately consistent with the range R0 in which the inspector 1 estimated that there were actual defects.
[0044] In this way, by displaying the impact points based on the position information and distribution information on the display unit 28 and displaying an image of the inspection object 99 with the area including the impact points decorated, as well as other statistical information about the impact points on the display 23, it is possible to visualize the inspection technique of the inspector 1 who narrows down the area to be struck and estimates the structure of the internal defect or the area where the defect will spread, and it is also possible to visually grasp the inspection technique of the inspector 1 through the image.
[0045] The storage unit 29 is a unit that records impact point data in a non-transitory storage medium 30. By recording impact point data representing the inspection technique of the inspector 1 in a non-transitory storage medium, the recorded impact point data can be read out at different locations and times to display the inspection technique of the inspector 1 on the display 23. In addition, based on the distribution information of the impact points contained in the impact point data, an area where impacts should be concentrated can be extracted, and when another inspector or robot performs a hammering test on the inspection object 99 again, the inspection technique of the inspector 1 can be reproduced and used for efficient hammering testing. Such impact point data is also useful as training data for machine learning to select impact points when performing a hammering test on the inspection object 99.
[0046] 8 shows a flow S10 of the impact point analysis method according to this embodiment. As an example, inspector 1 personally strikes an inspection object 99 with hammer 40 as training for the hammering inspection. Prior to the training, inspector 1 wears detection device 10 on his / her head as shown in FIG.
[0047] In step S11 , the detection device 10 detects that the inspector 1 is striking the inspection object 99 with the hammer 40 .
[0048] 9 shows a situation in which an inspector 1 is performing a hammering test on an inspection object 99 with a hammer 40. In this example, the inspection object 99 is the ceiling surface of a tunnel, and the inspector 1 stands on the elevated work platform of an inspection vehicle and strikes the ceiling surface with the hammer 40 while capturing an image of the striking of the ceiling surface with a detection device 10 worn on his head.
[0049] When the inspector 1 finishes striking the inspection object 99, he stops imaging by the detection device 10. In response, the detection unit 11 synchronizes the imaging data and the acoustic data to generate detection data. The inspector 1 operates the detection device 10 to transmit the detection data to the processing device 20.
[0050] In step S12, the detection data is processed by the processing device 20. When the processing device 20 receives the detection data from the detection device 10, the processing unit 26 processes the detection data to identify position information regarding the position of the impact point struck by the hammer 40 on a coordinate plane including the inspection object 99 and time information regarding the time at which the impact point was struck. The details of the processing of the detection data by the processing unit 26 are as described above. As a result, the position information and time information of the impact point shown in FIG. 4 are generated.
[0051] In step S13, impact point data is generated. The generation unit 27 calculates distribution information regarding the distribution of impact points on a coordinate plane including the inspection object 99, based on the position information of the impact points. Details of how the generation unit 27 calculates the distribution information are as described above. As a result, the impact point distribution information shown in Fig. 5 is generated. Furthermore, the generation unit 27 generates the impact point data shown in Fig. 6, including the position information, time information, distribution information, and statistical information of the impact points.
[0052] In step S14, the storage unit 29 records the impact point data generated in step S13 in the non-transitory storage medium 30. This completes flow S10 of the impact point analysis method.
[0053] Note that the flow S10 of the impact point analysis method may be followed by the flow S20 of displaying impact point data.
[0054] FIG. 10 shows a flow S20 for displaying the batting result on the display 23 of the processing device 20 using the batting point data.
[0055] In step S21, the display unit 28 of the processing device 20 reads out the impact point data stored in the non-transitory storage medium 30. Note that this step may be skipped if the display flow S20 is executed following step S13 of generating impact point data in the impact point analysis method flow S10.
[0056] In step S22, the display unit 28 reads image data of the inspection object 99 from the impact point data, thereby displaying an image of the inspection object 99 on the display 23, as shown in FIG.
[0057] In step S23, the display unit 28 reads the position information and time information of the impact points from the impact point data (see FIG. 4). Then, the display unit 28 displays the impact points at the impact positions on the image of the inspection object 99 based on the position information of the impact points. As a result, as shown in FIG. 7B, multiple impact points D are displayed using black circles on the image of the inspection object 99. The details of displaying the impact points, such as displaying the impact points in the order of impact, are as described above.
[0058] In step S24, the display unit 28 reads the impact point distribution information (see FIG. 5) from the impact point data. The display unit 28 then decorates the sections on the image of the inspection object 99 that include each impact point according to the density at which the impact points are distributed, and displays the range R in which the impact points are distributed at a certain density or higher. As a result, as shown in FIG. 7C , each section on the image of the inspection object 99 is decorated, and the outer edge of the range R is displayed as a straight line on the image of the inspection object 99. The details of decorating the image of the inspection object 99 are as described above.
[0059] In step S25, the display unit 28 reads the impact point statistical information from the impact point data. As a result, the impact point statistical information is displayed below the image of the inspection object 99, as shown in Fig. 7C. In this way, the display 23 displays a plurality of impact points and an image of the inspection object 99 in which each section containing the impact points is decorated (referred to as an impact image), and the impact point data display flow S20 ends.
[0060] 11 shows a situation in which inspector 1 is checking the impact image (see FIG. 7C ) displayed on display 23 of processing device 20 based on the impact point data after conducting a hammering test on inspection object 99. As training for the hammering test, inspector 1 can hit inspection object 99 with hammer 40 himself, and then check the analysis results on display 23 of processing device 20.
[0061] It is also possible to display a plurality of impact images, each displaying an impact point based on different impact point data, on the display 23. The display unit 28 analyzes the impact test according to flow S10 to generate impact point data, and uses that data to generate an impact image according to flow S20, while also reading other impact point data recorded on a non-transitory storage medium, generating an impact image in which the impact points are displayed and the sections containing the impact points are decorated based on the position information and distribution information included in the impact point data, and displaying the two impact images side by side on the display 23. It is also possible for the display unit 28 to read a plurality of impact point data recorded on a non-transitory storage medium, and generate a plurality of impact images, each displaying an impact point, based on the data, and display the generated impact images on the display 23.
[0062] FIG. 12 shows an example of a dual-screen display of impact images. In this example, an impact image generated when inspector 1 performs a hammering test on the inspection object 99 is displayed on the right side of the display 23, and an impact image generated from past impact point data read from a non-transitory storage medium is displayed alongside it on the left side for comparison. The past impact point data was generated when an experienced inspector performed a hammering test on the same inspection object 99. It can be seen that the impacts were concentrated on the outer edges of defects within the inspection object 99, particularly on four areas that roughly define the area where the defects exist. In contrast, inspector 1's hammering test shows that the inspector evenly hit a wide area, including the defects. Inspector 1 can compare his own impact image (right) with the displayed comparative image of an experienced inspector (left), i.e., compare his own inspection technique with that of the experienced inspector, thereby efficiently learning the skilled inspector's inspection technique.
[0063] Note that the display of multiple impact images is not limited to being arranged side by side on the display 23, and may be superimposed. In such a case, the display unit 28 displays on the display 23 an impact image generated when the inspector 1 performs a hammering test on the inspection object 99, and displays impact points superimposed on the impact image based on the position information of the impact points contained in the impact point data read from the non-transitory storage medium. This makes it possible to compare the inspection techniques of two people.
[0064] The impact point analysis system 100 according to this embodiment is a system for analyzing impact points when an inspection object is impacted, and includes a detection unit 11 that detects when an inspector 1 impacts an inspection object 99 with a hammer 40, a processing unit 26 that processes the detection results and identifies position information regarding the positions of the impact points impacted by the hammer 40 on a coordinate plane including the inspection object 99, and a generation unit 27 that calculates distribution information regarding the distribution of the impact points on the coordinate plane based on the position information and generates impact point data including the position information and distribution information. By processing the detection results of the impact inspection by the inspector 1 to identify position information regarding the positions of the impact points impacted by the hammer 40, calculating distribution information regarding the distribution of the impact points based on the position information, and generating impact point data including the position information and distribution information, it becomes possible to know, based on the impact point data, the range in which the inspector 1 concentratedly impacted the inspection object with the hammer 40 during the impact inspection and how to narrow down the range in which the impacts are concentrated.
[0065] Furthermore, the impact point analysis method S10 according to this embodiment is a method for analyzing impact points when an inspection object is impacted during an impact inspection, and includes a step S11 of detecting that the inspector 1 is impacting the inspection object 99 with the hammer 40, a step S12 of processing the detection results to identify position information relating to the positions of the impact points impacted by the hammer 40 on a coordinate plane including the inspection object 99, and a step S13 of calculating distribution information relating to the distribution of the impact points on the coordinate plane based on the position information, and generating impact point data including the position information and distribution information. By processing the detection results of the impact inspection by the inspector 1 to identify position information relating to the positions of the impact points impacted by the hammer 40, calculating distribution information relating to the distribution of the impact points based on the position information, and generating impact point data including the position information and distribution information, it becomes possible to know, based on the impact point data, the range in which the inspector 1 concentratedly impacted the inspection object with the hammer 40 during the impact inspection and how to narrow down the range in which the impacts are concentrated.
[0066] In the impact point analysis method according to this embodiment, step S11 in which the detection device 10 detects that the inspector 1 is striking the inspection object 99 with the hammer 40, and step S12 in which the processing device 20 processes the detection data are executed independently, but this is not limited to this. In parallel with the detection device 10 detecting that the inspector 1 is striking the inspection object 99 with the hammer 40, the processing device 20 may process the detection data and generate impact point data, and the impact point may be displayed on the image including the inspection object 99 on the display 23 each time a strike is made.
[0067] In the impact point analysis system 100 according to this embodiment, an example of impact point analysis has been described using a concrete structure such as a tunnel as the subject of the hammering test, but the impact point analysis according to this embodiment may also be performed using structures such as road bridges, bridge girders, dams, other concrete structures, steel products such as railroad tracks, railway cars, and aircraft as the subject of the hammering test.
[0068] The hammer 40 used in the impact test may have any structure and any head shape, as long as the shape allows the position of the head (particularly the end on the impact side) to be detected from the image data using image processing technology.
[0069] Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, where the blocks may represent (1) stages of a process in which operations are performed or (2) sections of apparatus responsible for performing the operations. Particular stages and sections may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable medium, and / or a processor provided with computer-readable instructions stored on a computer-readable medium. Dedicated circuitry may include digital and / or analog hardware circuitry, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuitry may include reconfigurable hardware circuitry including logical AND, OR, XOR, NAND, NOR, and other logic operations, flip-flops, registers, memory elements such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like.
[0070] A computer-readable medium may include any tangible device capable of storing instructions that are executed by an appropriate device, such that the computer-readable medium having instructions stored thereon comprises an article of manufacture containing instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable media may include electronic, magnetic, optical, electromagnetic, and semiconductor storage media. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disc read-only memories (CD-ROMs), digital versatile discs (DVDs), Blu-ray (RTM) discs, memory sticks, integrated circuit cards, and the like.
[0071] The computer readable instructions may include either assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages such as the “C” programming language or similar programming languages.
[0072] The computer-readable instructions may be provided to a processor or programmable circuitry of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, either locally or over a local area network (LAN), a wide area network (WAN) such as the Internet, etc., which executes the computer-readable instructions to create means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.
[0073] 13 illustrates an example of a computer 2200 in which aspects of the present invention may be embodied, in whole or in part. Programs installed on the computer 2200 may cause the computer 2200 to function as or perform operations associated with an apparatus or one or more sections of the apparatus according to embodiments of the present invention, and / or to perform a process or steps of a process according to embodiments of the present invention. Such programs may be executed by the CPU 2212 to cause the computer 2200 to perform specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.
[0074] A computer 2200 according to this embodiment includes a CPU 2212, a RAM 2214, a graphics controller 2216, and a display device 2218, which are interconnected by a host controller 2210. The computer 2200 also includes input / output units such as a communication interface 2222, a hard disk drive 2224, a DVD-ROM drive 2226, and an IC card drive, which are connected to the host controller 2210 via an input / output controller 2220. The computer also includes legacy input / output units such as a ROM 2230 and a keyboard 2242, which are connected to the input / output controller 2220 via an input / output chip 2240.
[0075] The CPU 2212 operates according to programs stored in the ROM 2230 and RAM 2214, thereby controlling each unit. The graphics controller 2216 acquires image data generated by the CPU 2212 into a frame buffer or the like provided in the RAM 2214 or into the graphics controller 2216 itself, and causes the image data to be displayed on the display device 2218.
[0076] The communication interface 2222 communicates with other electronic devices via a network. The hard disk drive 2224 stores programs and data used by the CPU 2212 in the computer 2200. The DVD-ROM drive 2226 reads programs or data from the DVD-ROM 2201 and provides the programs or data to the hard disk drive 2224 via the RAM 2214. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.
[0077] ROM 2230 stores therein a boot program or the like that is executed by computer 2200 upon activation, and / or programs that depend on the hardware of computer 2200. I / O chip 2240 may also connect various I / O units to I / O controller 2220 via parallel ports, serial ports, keyboard ports, mouse ports, etc.
[0078] The programs are provided by a computer-readable medium such as a DVD-ROM 2201 or an IC card. The programs are read from the computer-readable medium, installed in the hard disk drive 2224, RAM 2214, or ROM 2230, which are also examples of computer-readable media, and executed by the CPU 2212. Information processing described in these programs is read by the computer 2200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing information manipulation or processing in accordance with the use of the computer 2200.
[0079] For example, when communication is performed between computer 2200 and an external device, CPU 2212 may execute a communication program loaded into RAM 2214 and instruct communication interface 2222 to perform communication processing based on the processing described in the communication program. Under the control of CPU 2212, communication interface 2222 reads transmission data stored in a transmission buffer processing area provided in RAM 2214, hard disk drive 2224, DVD-ROM 2201, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes received data received from the network to a reception buffer processing area or the like provided on the recording medium.
[0080] Furthermore, the CPU 2212 may cause all or a necessary portion of a file or database stored on an external recording medium such as the hard disk drive 2224, the DVD-ROM drive 2226 (DVD-ROM 2201), an IC card, etc. to be read into the RAM 2214, and may perform various types of processing on the data on the RAM 2214. The CPU 2212 then writes back the processed data to the external recording medium.
[0081] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 2212 may perform various types of processing on data read from the RAM 2214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to the RAM 2214. The CPU 2212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored on the recording medium, the CPU 2212 may search for an entry that matches a condition specified by the attribute value of the first attribute from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.
[0082] The above-described programs or software modules may be stored in a computer-readable medium on or near the computer 2200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable medium, thereby providing the programs to the computer 2200 via the network.
[0083] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.
[0084] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order.
[0085] 1... inspector, 10... detection device, 10a... fixed band, 11... detection unit, 12... transmission unit, 20... processing device, 21... CPU, 22... communication device, 23... display, 24... storage device, 26... processing unit, 27... generation unit, 28... display unit, 29... storage unit, 30... non-transitory storage medium, 40... hammer, 41... striking end, 99... inspection object, 100... impact point analysis system, 2200... computer, 2201... DVD-ROM, 2210... host controller, 2214... RA M, 2216...graphics controller, 2218...display device, 2220...input / output controller, 2222...communication interface, 2224...hard disk drive, 2226...DVD-ROM drive, 2240...input / output chip, 2242...keyboard, A1, A2, A3...division, C...defect, C1 to C5...area, D...impact point, R...distribution range, R0...range, S10...flow of impact point analysis method, S20...flow of display of impact point data.
Claims
1. A striking point analysis system that analyzes the point of impact when performing a striking test on an object to be inspected, A detection unit that detects when an inspector strikes the object being inspected with a hammer, A processing unit that processes the results of the detection and identifies positional information relating to the position of the impact point struck by the hammer on a coordinate plane including the object to be inspected, A generation unit that calculates distribution information relating to the distribution of the hit points on the coordinate plane based on the position information and generates hit point data including the position information and the distribution information, A display unit that displays the impact point at the impact location on the image of the object to be inspected based on the position information, and displays the image of the object to be inspected on a display screen by decorating the section containing the impact point among a plurality of sections arranged on a coordinate plane including the object to be inspected based on the distribution information, A strike point analysis system equipped with the following features.
2. The impact point analysis system according to claim 1, wherein the display unit displays an index representing the outer edge of the range in which the impact points are distributed on the image of the object to be inspected.
3. The impact point analysis system according to claim 1, wherein the display unit decorates the area containing the impact point among the plurality of areas on the image of the object to be inspected according to the density of the distribution of the impact points.
4. The processing unit further identifies time information relating to the time when the hammer struck the striking point, The impact point analysis system according to claim 1, wherein the display unit displays each impact point in order of impact at the impact position on the image of the object to be inspected, based on the position information and the time information.
5. The impact point analysis system according to claim 4, wherein the display unit decorates the display of each impact point in accordance with the impact sequence.
6. The impact point analysis system according to claim 5, wherein the display unit enables the decoration based on the impact sequence according to user input.
7. The impact point analysis system according to claim 1, further comprising: the display unit reading impact point data recorded on a non-temporary storage medium, and displaying on the display screen a second image of the object to be inspected, in which the impact points are displayed based on the positional information and distribution information contained in the impact point data, and the area including the impact points is decorated.
8. The impact point analysis system according to claim 1, wherein the distribution information includes the range and density of the impact points distributed on the coordinate plane.
9. The striking point analysis system according to claim 1, wherein the processing unit determines the position of the striking point by identifying the position of the striking end on the coordinate plane when the striking end of the hammer changes direction of movement.
10. The impact point analysis system according to any one of claims 1 to 9, further comprising a recording unit for recording the impact point data on a non-temporary storage medium.
11. A method for analyzing the point of impact when performing a striking test on an object to be inspected, The stage where the inspector strikes the object being inspected with a hammer, The steps include processing the results of the detection to identify positional information relating to the position of the impact point struck by the hammer on a coordinate plane including the object to be inspected, Based on the position information, the step of calculating distribution information regarding the distribution of the striking points on the coordinate plane, and generating striking point data including the position information and the distribution information, The steps include: displaying the strike point at the strike location on the image of the object to be inspected based on the position information, and decorating the section containing the strike point among a plurality of sections arranged on a coordinate plane including the object to be inspected based on the distribution information, and displaying the image of the object to be inspected on a display screen; A method for analyzing the point of impact, comprising the following features.
12. To analyze the impact point when performing impact testing on the object being inspected, a computer is used. Procedures for detecting when an inspector strikes the object under inspection with a hammer, A procedure for processing the results of the detection and identifying positional information relating to the position of the impact point struck by the hammer on a coordinate plane including the object to be inspected, A procedure for calculating distribution information relating to the distribution of the striking points on the coordinate plane based on the position information, and for generating striking point data including the position information and the distribution information, A procedure to display the image of the object to be inspected on a display screen by displaying the strike point at the strike location on the image of the object to be inspected based on the position information, and decorating the section containing the strike point among a plurality of sections arranged on a coordinate plane including the object to be inspected based on the distribution information, A program that executes the command.