Image display device, operating method for image display device, and operating program for image display device
By using a local image display area and index bar in the image display device to display part images of the structure and its shooting position, the problem that users find it difficult to determine the image shooting position is solved, and more efficient and accurate image display and abnormal position determination are achieved.
Patent Information
- Application Number
- CN202380078115.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-01-10
- Filing Date
- 2023-10-05
- Publication Date
- 2025-06-27
AI Technical Summary
In image display of large-scale structures such as tunnels, it is difficult for the user to determine where the displayed image was taken from, resulting in the inability to accurately determine the abnormal position.
An image display device is designed, which includes a processor-controlled display screen, including a local image display area and an index bar. The partial image display area displays part of the image of the structure, while the index bar indicates the distance range of the structure, and displays photography position marks in the image to help the user identify the shooting position of the image.
Through a simple picture structure, users can clarify where the displayed image comes from, solving the problem of abnormal position determination and improving the efficiency and accuracy of image display.
Smart Images

Figure CN120226343A_ABST
Abstract
Description
Technical Field
[0001] The technology of the present invention relates to an image display device, an operation method of the image display device, and a working program of the image display device. Background Art
[0002] For example, as described in Japanese Unexamined Patent Application Publication No. 2022-056085, Japanese Unexamined Patent Application Publication No. 2022-139903, and Japanese Unexamined Patent Application Publication No. 2017-168077, technologies for extracting abnormalities generated in a structure from an image obtained by photographing the structure with a photographing device have been proposed. The structure is so-called infrastructure, such as a dam, a bridge, or a tunnel. Abnormalities are, for example, cracks, peeling, rusting, water leakage, or exposure of steel bars. Summary of the Invention
[0003] Technical Problem to be Solved by the Invention
[0004] In the technologies described in Japanese Unexamined Patent Application Publication No. 2022-056085 and Japanese Unexamined Patent Application Publication No. 2022-139903, in the case of relatively large-scale structures such as dams, bridges, or tunnels, for example, the structure is photographed multiple times while moving the photographing device from the entrance to the exit of the tunnel or the like, thereby obtaining an image covering the entire structure. An image covering such an entire structure has a very long size, such as an image from the entrance to the exit of a 5-km-long tunnel.
[0005] Moreover, in the technologies described in Japanese Unexamined Patent Application Publication No. 2022-056085 and Japanese Unexamined Patent Application Publication No. 2022-139903, the image is displayed on a display together with the abnormality extraction result or the like for the user to view. The image displayed at this time is a part of the image covering the entire structure, for example, an image in a 50-m distance range from 2 km to 2.05 km in a 5-km-long tunnel.
[0006] In the case of the above-described image display method, the user often does not know where on the structure the displayed image is taken. Thus, a problem arises that the position of the structure where the abnormality has occurred cannot be determined.
[0007] Japanese Unexamined Patent Application Publication No. 2017-168077 describes a method of displaying an image covering the entire structure (referred to as a panoramic image in Japanese Unexamined Patent Application Publication No. 2017-168077) and a partial image of the image covering the entire structure (referred to as an inspection image in Japanese Unexamined Patent Application Publication No. 2017-168077) on the same screen. And, as a solution to the above problem, in Japanese Unexamined Patent Application Publication No. 2017-168077, a frame of the inspection image is displayed on the panoramic image so that the user can identify where on the structure the inspection image is taken.
[0008] However, in Japanese Unexamined Patent Application Publication No. 2017-168077, since the panoramic image and the inspection image are displayed on the same screen and the frame of the inspection image is displayed on the panoramic image, the screen structure is cluttered.
[0009] One embodiment of the technology of the present invention provides an image display device, an operation method of the image display device, and a working program of the image display device, which can enable a user to identify an image of where on a structure is captured through a simple screen structure.
[0010] Means for Solving the Technical Problem
[0011] The image display device of the present invention includes a processor that controls the display of a display screen on a display. The display screen has: a partial image display area, which is obtained by a photographing device photographing a structure extending in a first direction and is a part of a long image whose long side direction is along the first direction; and a first index bar, which extends in the first direction and represents at least a part of a first distance range of the distance range of the structure in the first direction. A photographing position mark is displayed in the first index bar, and the photographing position mark represents the photographing position of the partial image being displayed in the display area on the structure.
[0012] Preferably, the processor receives a position designation at any position of the first index bar and displays the partial image corresponding to the position designated and the photographing position in the display area.
[0013] Preferably, a second index bar can be displayed, which represents a second distance range wider than the first distance range and indicates which position in the second distance range the displayed first index bar corresponds to.
[0014] Preferably, the second distance range is the entire distance range of the structure in the first direction.
[0015] Preferably, in the display area, the partial image can be enlarged and displayed, and an auxiliary window can be displayed, and the auxiliary window indicates which position of the partial image the enlarged part corresponds to.
[0016] Preferably, an operation unit is provided on the display screen, and the operation unit is used to input an instruction to switch the partial image being displayed in the display area to a partial image adjacent to the partial image being displayed in the display area.
[0017] Preferably, a focus area mark can be displayed on the first index bar, and the focus area mark represents the focus area of the long image.
[0018] The preferred regions of interest include at least one of the regions specified by the user and the regions where specific subjects are present.
[0019] Preferably, it is possible to display the text memo or voice memo input by the user in association with the region of interest.
[0020] Preferably, the region specified by the user is at least one of the regions specified by the photographer of the long image when shooting the long image and the regions specified by the inspector of the long image when inspecting the long image.
[0021] Preferably, in the first index bar, it is possible to distinguish and display the regions where the partial images are shown and the regions where the partial images are not shown.
[0022] Preferably, in the first index bar, by displaying a displayed mark indicating the region where the partial image is shown, it is possible to distinguish and display the regions where the partial images are shown and the regions where the partial images are not shown.
[0023] Preferably, by changing at least one of the brightness, color, and pattern of the first index bar, the regions where the partial images are shown and the regions where the partial images are not shown are distinguished and displayed.
[0024] Preferably, the processor receives the designation of the measurement object within the partial image, and according to the designation, displays at least one of the position of the measurement object in the structure and the actual size of the measurement object.
[0025] Preferably, the long image is an image obtained by synthesizing a plurality of photographed images along at least the first direction among the first direction and the second direction intersecting the first direction, and the plurality of photographed images are obtained by photographing different parts of the structure with a photographing device multiple times.
[0026] Preferably, the plurality of photographed images are images obtained by moving the photographing device along the first direction and photographing the structure at a plurality of different positions in the first direction.
[0027] Preferably, the photographing device has a plurality of cameras arranged along the second direction, and the plurality of photographed images are images obtained by photographing the structure with the plurality of cameras. Also, preferably, the photographing device has a plurality of cameras arranged along the first direction, and the plurality of photographed images are images obtained by photographing the structure with the plurality of cameras.
[0028] The photographing device has a plurality of cameras arranged along the second direction, and the plurality of photographed images are images obtained by moving the photographing device along the first direction and photographing the structure with the plurality of cameras, and the long image is an image obtained by synthesizing the plurality of photographed images along the first direction and the second direction.
[0029] Preferably, the structure is a tunnel, the first direction is the longitudinal direction connecting the entrance and the exit of the tunnel, and the second direction is the circumferential direction of the tunnel.
[0030] A method for operating an image display device according to the present invention includes a step of controlling to display a display screen on a display. The display screen has: a partial image display area, which is obtained by a photographing device photographing a structure extending in a first direction and is a part of a long image whose long side direction is along the first direction; and a first index bar, which extends in the first direction and represents at least a part of a first distance range of the distance range of the structure in the first direction. A photographing position mark is displayed in the first index bar, and the photographing position mark represents the photographing position of the partial image being displayed in the display area in the structure.
[0031] A working program of an image display device according to the present invention causes a computer to execute a process that includes a step of controlling to display a display screen on a display. The display screen has: a partial image display area, which is obtained by a photographing device photographing a structure extending in a first direction and is a part of a long image whose long side direction is along the first direction; and a first index bar, which extends in the first direction and represents at least a part of a first distance range of the distance range of the structure in the first direction. A photographing position mark is displayed in the first index bar, and the photographing position mark represents the photographing position of the partial image being displayed in the display area in the structure.
[0032] Advantages of the Invention
[0033] According to the technology of the present invention, it is possible to provide an image display device, a method for operating an image display device, and a working program of an image display device, and the image display device can enable a user to recognize where on a structure the displayed image is photographed through a simple screen structure. Description of the Drawings
[0034] Figure 1 It is a diagram showing a situation where the inner wall surface of a tunnel is photographed using a photographing device.
[0035] Figure 2 It is a side view of the photographing device.
[0036] Figure 3 It is a perspective view of the main body of the photographing device.
[0037] Figure 4 It is a side view of the main body of the photographing device.
[0038] Figure 5 It is a diagram showing the photographing areas of the first photographing unit and the second photographing unit.
[0039] Figure 6 It is a diagram for explaining the composition of the long image.
[0040] Figure 7 It is a figure showing photographic image information.
[0041] Figure 8 It is a figure showing an operation screen.
[0042] Figure 9 It is a figure showing the operation screen when the part designation button is selected.
[0043] Figure 10 It is a figure showing the part information specified at the time of shooting.
[0044] Figure 11 It is a figure showing the information sent from the photographic apparatus, the information management server, the examiner terminal, and the photographic apparatus to the information management server.
[0045] Figure 12 It is a block diagram of the computers constituting the information management server and the examiner terminal.
[0046] Figure 13 It is a block diagram of the processing section of the CPU of the information management server.
[0047] Figure 14 It is a figure showing the part information specified at the time of inspection.
[0048] Figure 15 It is a figure showing the processing of the extraction section.
[0049] Figure 16 It is a figure showing the extracted image information.
[0050] Figure 17 It is a block diagram of the processing section of the CPU of the examiner terminal.
[0051] Figure 18 It is a figure showing an overview screen.
[0052] Figure 19 It is a figure showing an overview screen.
[0053] Figure 20 It is a figure showing a local index bar of the overview screen.
[0054] Figure 21 It is a figure showing the case where a text memo is displayed in association with the part mark specified at the time of shooting.
[0055] Figure 22 It is a figure showing the case where a text memo is displayed in association with the part mark specified at the time of inspection.
[0056] Figure 23 It is a figure showing a local image display screen.
[0057] Figure 24It is a diagram showing a local index bar for a local image display screen.
[0058] Figure 25 It is a diagram showing the position specification of an arbitrary position of the received local index bar and the process of displaying the local image corresponding to the received position specification position in the display area.
[0059] Figure 26 It is a diagram showing an operation button group.
[0060] Figure 27 It is a diagram showing the case where the local image is enlarged and displayed.
[0061] Figure 28 It is a diagram showing the case where the extracted image is overlapped and displayed on the local image.
[0062] Figure 29 It is a diagram showing the position and actual size of the measurement object specified within the local image.
[0063] Figure 30 It is a diagram showing the position and actual size of the measurement object specified within the local image.
[0064] Figure 31 It is a diagram showing the process of switching the local image being displayed in the display area to a local image adjacent to the local image being displayed in the display area.
[0065] Figure 32 It is a diagram showing the process of switching the local image being displayed in the display area to a local image adjacent to the local image being displayed in the display area.
[0066] Figure 33 It is a flowchart showing the processing steps of the information management server and the examiner terminal.
[0067] Figure 34 It is a diagram showing another example of distinguishing between the part where the local image is displayed and the part where the local image is not displayed.
[0068] Figure 35 It is a diagram showing an example of displaying the shooting position designation mark, etc. on the entire index bar.
[0069] Figure 36 It is a diagram showing another example of the shooting position designation information. Detailed implementation mode
[0070] Figure 1This shows a case where the inner wall surface 11 of the tunnel 10 along the circumferential direction CD is photographed by the photographer UP using the photographing device 12. The tunnel 10 has an entrance 13 and an exit 14, and extends along the longitudinal direction LD connecting the entrance 13 and the exit 14. The total length of the tunnel 10, which is the length from the entrance 13 to the exit 14, is, for example, 10000 m. The photographer UP moves the photographing device 12 along the longitudinal direction LD by moving the photographing device 12 from the entrance 13 to the exit 14, for example, along the center line of the road surface 15. The tunnel 10 is an example of the "structure" related to the technology of the present invention. The longitudinal direction LD is an example of the "first direction" related to the technology of the present invention. The circumferential direction CD is an example of the "second direction" related to the technology of the present invention. The photographer UP is an example of the "user" related to the technology of the present invention.
[0071] As an example, as Figure 2 shown, the photographing device 12 is composed of a photographing device main body 20 and a carriage 21 on which the photographing device main body 20 is mounted. Also as Figure 3 and Figure 4 shown, the photographing device main body 20 has a base 22, a first support column 231 and a second support column 232, a first mounting plate 241 and a second mounting plate 242, and a first photographing unit 251 and a second photographing unit 252.
[0072] The base 22 is in the shape of a rectangular plate and is mounted on the carriage 21 by means of screw fixation or the like. The first support column 231 and the second support column 232 are prisms extending in the vertical direction from the base 22. The first mounting plate 241 and the second mounting plate 242 are in the shape of circular plates, and their centers are fixed to the ends on the side opposite to the base 22 of the first support column 231 and the second support column 232.
[0073] Four first photographing units 251 are mounted on the first mounting plate 241 via a first mounting member 261. And five second photographing units 252 are mounted on the second mounting plate 242 via a second mounting member 262. That is, the photographing device main body 20 has a total of nine photographing units 25.
[0074] When the angles of the lower parts of the first mounting plate 241 and the second mounting plate 242 are set to 0°, and the angles of the left side parts of the first mounting plate 241 and the second mounting plate 242 are set to 90° clockwise from here, the angles of the upper parts are set to 180°, and the angles of the right side parts are set to 270° (refer to Figure 4), the first imaging unit 251 is disposed at positions of 90°, 150°, 210°, and 270°. Further, the second imaging unit 252 is disposed at positions of 60°, 120°, 180°, 240°, and 300°. That is, both the first imaging unit 251 and the second imaging unit 252 are disposed at an angular interval of 60°. Further, a total of nine imaging units 25 combining the first imaging unit 251 and the second imaging unit 252 are disposed at an angular interval of 30°. In addition, the number of the imaging units 25 is not limited to the illustrated nine. The imaging unit 25 may be one or more than nine.
[0075] The first imaging unit 251 and the second imaging unit 252 are composed of one camera 27 and two illumination lights 28 disposed at symmetric positions across the camera 27. The camera 27 is, for example, a high-performance single-lens reflex camera equipped with an imaging element of 20 million pixels or more and having a distance measurement function for measuring the distance to a subject and an image stabilization function for correcting shake. The illumination light 28 is, for example, an LED (Light-Emitting Diode) having a light distribution angle exceeding the imaging angle of view of the camera 27.
[0076] When the imaging device main body 20 is mounted on the carriage 21, the first support column 231, the first mounting plate 241, and the first imaging unit 251 are located on the front side in the traveling direction of the carriage 21. Further, the second support column 232, the second mounting plate 242, and the second imaging unit 252 are located on the rear side in the traveling direction of the carriage 21. Therefore, the cameras 27 of the first imaging unit 251 and the second imaging unit 252 are arranged along the traveling direction of the carriage 21. As Figure 1 shown, the traveling direction of the carriage 21 is along the length direction LD of the tunnel 10. Therefore, it can be said that the cameras 27 are arranged along the length direction LD. Further, the cameras 27 are mounted so as to surround the disk-shaped first mounting plate 241 and the second mounting plate 242, and the carriage 21 travels with the normal directions of the first mounting plate 241 and the second mounting plate 242 along the length direction LD. Thus, it can also be said that the cameras 27 are arranged along the circumferential direction CD. In addition, three or more cameras 27 may be arranged along the length direction LD. Further, a plurality of cameras 27 may not be arranged along the length direction LD. Similarly, a plurality of cameras 27 may not be arranged along the circumferential direction CD. For example, while moving one camera 27 along the circumferential direction CD, shooting may be performed a plurality of times in the circumferential direction CD.
[0077] In Figure 2 , the carriage 21 has a carriage main body 35, front wheels 36, rear wheels 37, a handle 38, and the like. The carriage main body 35 has a box shape. The imaging device main body 20 is mounted on a top plate portion of the carriage main body 35 parallel to the horizontal plane.
[0078] One front wheel 36 and one rear wheel 37 are arranged on the left and right sides of the lower part of the trolley body 35 respectively. The trolley 21 travels on the road surface 15 through the front wheel 36 and the rear wheel 37. The rear wheel 37 is rotationally driven by the rear wheel drive unit 39. The front wheel 36 rotates following the rotation of the rear wheel 37. That is, the trolley 21 has four wheels and is rear-wheel drive type.
[0079] The rear wheel drive unit 39 is two motors connected to the left and right rear wheels 37 respectively. The two motors rotate the left and right rear wheels 37 independently. Therefore, when the rotation speed of the right rear wheel 37 is faster than that of the left rear wheel 37 by the motor connected to the right rear wheel 37, the trolley 21 bends to the left. On the other hand, when the rotation speed of the left rear wheel 37 is faster than that of the right rear wheel 37 by the motor connected to the left rear wheel 37, the trolley 21 bends to the right.
[0080] The handle 38 is installed on the upper part of the rear surface of the trolley body 35. The handle 38 is in the shape of a cylinder that is long in the width direction of the trolley body 35. In order to operate the trolley 21, the photographer UP holds the handle 38. In other words, the trolley 21 travels on the road surface 15 through the operation of the photographer UP on the handle 38. Here, the operation of the photographer UP on the handle 38 means that the photographer UP holds the handle 38 and changes the way of applying force to the handle 38 or adjusts the direction of applying force to the handle 38. In this way, in the photographic device 12, through the operation of the handle 38, the photographer UP actively determines the traveling speed and traveling direction to make the trolley 21 travel.
[0081] The rear wheel drive unit 39 is also driven according to the operation of the photographer UP on the handle 38. However, the drive of the rear wheel drive unit 39 is only the drive according to the force applied to the trolley 21 by the photographer UP through the handle 38. Therefore, if the force of the photographer UP is not applied, the trolley 21 will not travel naturally. On the contrary, relying only on the force of the photographer UP, the trolley 21 will not travel. Only with the assistance of the rear wheel drive unit 39, the trolley 21 will travel. The force applied by the photographer UP to the trolley 21 is detected by, for example, a piezoelectric sensor (not shown), and the rear wheel drive unit 39 is driven according to the detection result. In addition, the photographer UP can also ride on the trolley 21 to operate. And the trolley 21 can also travel automatically without the help of the hand of the photographer UP.
[0082] A plurality of magnetic bodies 40 are installed at equal angles along the circumferential direction on the back surface of the rear wheel 37. And a magnetic sensor 41 is provided at the position of the trolley body 35 opposite to the magnetic body 40. The magnetic sensor 41 detects the magnetism emitted by the magnetic body 40. If the rear wheel 37 rotates, pulses PL corresponding to the magnetism of the magnetic body 40 are output from the magnetic sensor 41 along the time axis. Based on the number of these pulses PL, the circumference of the rear wheel 37, and the arrangement interval of the magnetic bodies 40, etc., the moving distance of the trolley 21 and the photographic device 12 can be derived.
[0083] A tablet terminal 42 is mounted on the inclined surface on the rear wheel 37 side of the carriage body 35. The tablet terminal 42 can be detached from the carriage body 35. The tablet terminal 42 is operated by the photographer UP. In addition, the tablet terminal 42 can be a commercially available terminal that can be used for other purposes, or a terminal that cannot be used except for the photographing device 12.
[0084] As an example, as Figure 5 shown, the camera 27 of the first photographing unit 251 photographs four regions (hereinafter referred to as the first photographing region) 501 out of every other region among the nine rectangular regions that divide the inner wall surface 11 into nine equal parts. The camera 27 of the second photographing unit 252 photographs five regions (hereinafter referred to as the second photographing region) 502 out of every other region among the nine rectangular regions that divide the inner wall surface 11 into nine equal parts.
[0085] The short side direction of both the first photographing region 501 and the second photographing region 502 is along the length direction LD, and the long side direction is along the circumferential direction CD. As Figure 4 shown, the arrangement phases of the first photographing unit 251 and the second photographing unit 252 in the circumferential direction CD are different, so the arrangements of the first photographing region 501 and the second photographing region 502 form a staggered grid pattern. The first photographing region 501 and the second photographing region 502 are an example of the "different parts of the structure" related to the technology of the present invention. In addition, although not shown in Figure 5 , the first photographing region 501 and the second photographing region 502 slightly overlap in the length direction LD and the circumferential direction CD. And in Figure 5 , the direction from the back side of the paper surface toward the front is the traveling direction of the carriage 21.
[0086] The photographing device 12 moves along the length direction LD. During this movement, the camera 27 of the first photographing unit 251 sequentially photographs the first photographing region 501, and the camera 27 of the second photographing unit 252 photographs the second photographing region 502. Therefore, as an example, as Figure 6 shown, a plurality of first photographic images 511 photographing the first photographing region 501 and a plurality of second photographic images 512 photographing the second photographing region 502 are obtained.
[0087] The obtained multiple first captured images 511 and multiple second captured images 512 are aligned based on the overlapping portions and synthesized in the longitudinal direction LD and the circumferential direction CD, so that a long image 55 covering the entire inner wall surface 11 can be generated. The long side direction of the long image 55 is along the longitudinal direction LD, and the short side direction of the long image 55 is along the circumferential direction CD. In addition, symbols such as A1 to A9 represent the correspondence between the actual positions on the inner wall surface 11 of the first captured images 511 and the second captured images 512 and the positions on the long image 55. The numbers 1 to 9 in the symbols such as A1 to A9 are the numbers sequentially assigned to nine regions obtained by equally dividing the inner wall surface 11 into nine parts. The even numbers 2, 4, 6, 8 are the first captured images 511, and the odd numbers 1, 3, 5, 7, 9 are the second captured images 512. And, in Figure 6 it is also the same as Figure 5 that the direction from the back side of the paper surface toward the front is the traveling direction of the carriage 21. Hereinafter, the first captured images 511 and the second captured images 512 may be collectively referred to as the captured images 51.
[0088] As an example, as Figure 7 shown, the imaging device 12 generates imaging information 60 of the multiple captured images 51. The imaging information 60 is information in which, for each image ID (Identification Data: identification data) for uniquely identifying the captured image 51, the captured image 51 itself, the capture date and time of the captured image 51, the capture position of the captured image 51 in the circumferential direction CD (denoted as the circumferential position in Figure 7 ), and the capture position of the captured image 51 in the longitudinal direction LD (denoted as the longitudinal position in Figure 7 ) are registered. At the capture position in the circumferential direction CD, any one of the numbers 1 to 9 in the symbols such as A1 to A9 shown in Figure 6 is registered. At the capture position in the longitudinal direction LD, the moving distance of the imaging device 12 derived based on the number of pulses PL or the like is registered. In addition, in the imaging information 60, basic information related to the captured image 51 such as the distance from the camera 27 to the subject (here, the inner wall surface 11) measured by the distance measurement function, the imaging magnification, the focal length, and the number of pixels of the imaging element is also registered.
[0089] As an example, an operation screen 65 shown in Figure 8 is displayed on the touch screen display (not shown) of the tablet terminal 42. A message 66 notifying the photographer UP of the distance from the entrance 13 of the tunnel 10, which is the imaging start point, to the current position is displayed on the operation screen 65. And, a imaging start button 67, a pause button 68, a imaging end button 69, and a part designation button 70 are provided on the operation screen 65.
[0090] The photographing start button 67 is a button for a photographer UP to indicate the start of photographing a photographic image 51 of the photographing device 12. The photographer UP selects the photographing start button 67, for example, at the entrance 13 of the tunnel 10. When the photographing start button 67 is selected, the illumination lamp 28 is lit, and the camera 27 starts photographing the photographic image 51. Also, the counting of the pulses PL output from the magnetic sensor 41 is started, and the moving distance of the photographing device 12 is derived.
[0091] The pause button 68 is a button for a photographer UP to indicate the pause and restart of photographing the photographic image 51 of the photographing device 12. When the pause button 68 is selected during photographing, the camera 27 pauses photographing the photographic image 51. When the pause button 68 is selected again in this state, the camera 27 restarts photographing the photographic image 51.
[0092] The photographing end button 69 is a button for a photographer UP to indicate the end of photographing the photographic image 51 of the photographing device 12. The photographer UP selects the photographing end button 69, for example, at the exit 14 of the tunnel 10. When the photographing end button 69 is selected, the illumination lamp 28 is turned off, and the camera 27 ends photographing the photographic image 51. Also, the counting of the pulses PL output from the magnetic sensor 41 ends.
[0093] The part designation button 70 is a button for a photographer UP to indicate the recording of a part when, while photographing the photographic image 51 and then photographing the long image 55, the photographer UP finds a part that is considered best to be carefully inspected during the subsequent inspection of the long image 55. When the photographer UP finds a part that is best to be carefully inspected during the inspection of the long image 55, the photographer UP first stops the travel of the photographing device 12. Then, after selecting the pause button 68 to pause the camera 27 from photographing the photographic image 51, the part designation button 70 is selected. When the part designation button 70 is selected, as Figure 9 shown, the operation screen 65 transitions.
[0094] As an example, as Figure 9 shown, an input box 71, a first recording button 721, and a second recording button 722 are provided on the operation screen 65 when the part designation button 70 is selected. The photographer UP inputs a text memo related to the designated part into the input box 71. The first recording button 721 is a button for indicating the associated recording of the text memo and the part. The second recording button 722 is a button for indicating the recording of only the part without recording the text memo. In this way, the part can be recorded with or without attaching a text memo.
[0095] As an example, as Figure 10As shown, the imaging device 12 generates imaging time specified part information 75. The imaging time specified part information 75 registers, for each part ID for uniquely identifying a part, the date and time of the specified part, the specified position of the part in the length direction LD (denoted as the length direction position in Figure 10 ), and information such as a text memo. Similar to the imaging position of the imaging image 51 in the length direction LD, the moving distance of the imaging device 12 derived based on the number of pulses PL, etc. is registered at the specified position of the part in the length direction LD. In addition, the part specified by the photographer UP is an example of the "part specified by the user" and the "part of interest" involved in the technology of the present invention.
[0096] As an example, as Figure 11 shown, the imaging device 12 is connected to an information management server 80 via a WAN (Wide Area Network) such as the Internet or a public communication network so as to be able to communicate with each other. The information management server 80 is, for example, a server computer. The information management server 80 receives imaging image information 60 and imaging time specified part information 75 from the imaging device 12.
[0097] The information management server 80 is also connected to an examiner terminal 81 via a WAN such as the Internet or a public communication network so as to be able to communicate with each other. The examiner terminal 81 is a desktop personal computer, a notebook personal computer, or a tablet terminal. The examiner terminal 81 is operated by an examiner UI of the long image 55. The examiner terminal 81 is an example of the "image display device" involved in the technology of the present invention. The examiner UI is an example of the "user" involved in the technology of the present invention. In addition, in Figure 11 , only one examiner terminal 81 is depicted, but in reality, multiple examiner terminals 81 are connected to the information management server 80. In addition, the examiner terminal 81 can be a commercially available terminal that can be used for other purposes, or a terminal that cannot be used except for the purpose of an image display device.
[0098] As an example, as Figure 12 shown, the computers constituting the information management server 80 and the examiner terminal 81 basically have the same structure, and include a storage device 85, a memory 86, a CPU (Central Processing Unit) 87, a communication unit 88, a display 89, and an input device 90. They are connected to each other via a bus 91.
[0099] The storage device 85 is a hard disk drive built into the computers constituting the information management server 80 and the inspector terminal 81, or connected via a cable or network. Alternatively, the storage device 85 is a disk array in which multiple hard disk drives are assembled. The storage device 85 stores control programs such as an operating system, various application programs (hereinafter simply referred to as AP (Application Program)), and various data attached to these programs. Additionally, a solid state drive can be used instead of the hard disk drive.
[0100] The memory 86 is a working memory for enabling the CPU 87 to execute processing. The CPU 87 loads the programs stored in the storage device 85 into the memory 86 and executes processing according to the programs. Thereby, the CPU 87 centrally controls each part of the computer. The CPU 87 is an example of the "processor" related to the technology of the present invention. Additionally, the memory 86 can also be built into the CPU 87.
[0101] The communication unit 88 is a network interface that controls the transmission of various information via a WAN or the like. The display 89 displays various screens. The various screens have an operation function based on a GUI (Graphical User Interface). The computers constituting the information management server 80 and the inspector terminal 81 receive the input of operation instructions from the input device 90 through the various screens. The input device 90 is a keyboard, mouse, touch panel, voice input microphone, etc.
[0102] Additionally, in the following description, each part (storage device 85 and CPU 87) of the computer constituting the information management server 80 is labeled with an additional mark "A", and each part (storage device 85 and CPU 87, display 89 and input device 90) of the computer constituting the inspector terminal 81 is labeled with an additional mark "B" for distinction.
[0103] As an example, as Figure 13 shown, a working program 95 is stored in the storage device 85A of the information management server 80. The working program 95 is an AP for enabling the computer to function as the information management server 80. In addition to the working program 95, a crack extraction model 96 and inspection target part information 97 are also stored in the storage device 85A.
[0104] When the working program 95 is started, the CPU 87A of the computer constituting the information management server 80 cooperates with the memory 86 and the like, and functions as an acquisition unit 100, a read / write (hereinafter referred to as RW (Read Write)) control unit 101, an extraction unit 102, and a screen transfer control unit 103.
[0105] The acquisition unit 100 acquires the photographed image information 60 from the photographing device 12 and the specified part information 75 at the time of photographing. The acquisition unit 100 outputs the photographed image information 60 and the specified part information 75 at the time of photographing to the RW control unit 101.
[0106] The RW control unit 101 controls the storage of various data in the storage device 85A and the reading of various data stored in the storage device 85A. The RW control unit 101 stores the photographed image information 60 and the specified part information 75 at the time of photographing from the acquisition unit 100 in the storage device 85A. The RW control unit 101 reads out the photographed image information 60 from the storage device 85A, and outputs the read photographed image information 60 to the extraction unit 102 and the screen transfer control unit 103. Also, the RW control unit 101 reads out the specified part information 75 at the time of photographing and the specified part information 97 at the time of inspection from the storage device 85A, and outputs the read specified part information 75 at the time of photographing and the specified part information 97 at the time of inspection to the screen transfer control unit 103. Moreover, the RW control unit 101 reads the crack extraction model 96 from the storage device 85A, and outputs the read crack extraction model 96 to the extraction unit 102.
[0107] The extraction unit 102 applies the photographed image 51 of the photographed image information 60 to the crack extraction model 96, and outputs the extraction image 110 (refer to Figure 15 ) of the crack 111 (refer to Figure 15 ) from the crack extraction model 96. The extraction unit 102 outputs the extraction image 110 for all the photographed images 51. The extraction unit 102 generates the information of the extraction images 110 of all the photographed images 51, that is, the extraction image information 105. The extraction unit 102 outputs the extraction image information 105 to the screen transfer control unit 103.
[0108] The screen transfer control unit 103 controls the generation of various screens and the transfer of various screens to the inspector terminal 81. For example, the screen transfer control unit 103 performs the following control: generates a partial image display screen 135 (refer to Figure 23 ) according to the photographed image information 60, the specified part information 75 at the time of photographing, the specified part information 97 at the time of inspection, etc., and transfers the generated partial image display screen 135 to the inspector terminal 81.
[0109] The screen transfer control unit 103 outputs various screens in the form of screen data for web page transfer created by a markup language such as XML (Extensible Markup Language), for example. Thereby, on the examiner terminal 81, various screens can be browsed on a web browser. The screen transfer control unit 103 determines the examiner terminal 81 which is the transfer destination of various screens based on the terminal ID that uniquely identifies the examiner terminal registered in the transfer requests of various screens. Additionally, other data description languages such as JSON (Javascript (registered trademark) Object Notation) can be used instead of XML.
[0110] The examination-time specified part information 97 is information generated by instructing to record the part in the partial image display screen 135 when the examiner UI finds a part that is considered best for regular observation while examining the long image 55 of the past. As an example, as Figure 14 shown, similar to the shooting-time specified part information 75, for each part ID used to uniquely identify a part, the examination-time specified part information 97 registers the date and time of the specified part, the specified position of the part in the length direction LD (denoted as the length direction position in Figure 14 ), and information such as a text memo. Similar to the part specified by the examiner UI and the part specified by the photographer UP, a text memo can be attached to record, or a text memo can be not attached to record. Similar to the part specified by the examiner UI and the part specified by the photographer UP, it is an example of the "part specified by the user" and the "part of concern" involved in the technology of the present invention.
[0111] As an example, as Figure 15 shown, the extraction unit 102 inputs the photographed image 51 into the crack extraction model 96 and outputs the extracted image 110 from the crack extraction model 96. The extracted image 110 is an image in which the crack 111 reflected on the photographed image 51 is represented by a red line, for example. The crack 111 is an example of the "specific subject" involved in the technology of the present invention. Additionally, an example where the crack 111 is extracted in the extracted image 110 is shown in Figure 15 , and of course, there are also cases where the crack 111 is not extracted in the extracted image 110.
[0112] The crack extraction model 96 is, for example, a machine learning model composed of a neural network. The crack extraction model 96 repeatedly learns by using the set of the learning photographic image 51 and the correct answer image in which the cracks 111 reflected in the learning photographic image 51 are manually annotated as teacher data. The crack extraction model 96 inputs and outputs the learning extraction image 110 for the learning photographic image 51. In the crack extraction model 96 stored in the storage device 85, the extraction accuracy of the cracks 111 in the learning extraction image 110 for the correct answer image reaches a preset level.
[0113] As an example, as Figure 16 shown, similar to the photographic image information 60, for each image ID (Identification Data) used to uniquely identify the extraction image 110, information such as the extraction image 110 itself, the position of the extraction image 110 on the circumferential CD (denoted as the circumferential position in Figure 16 ), and the position of the extraction image 110 on the longitudinal direction LD (denoted as the longitudinal position in Figure 16 ) of the extraction image 110 is registered. At the image ID of the extraction image 110, the position of the extraction image 110 on the circumferential CD, and the position of the extraction image 110 on the longitudinal direction LD, the image ID of the photographic image 51, the photographic position of the photographic image 51 on the circumferential CD, and the photographic position of the photographic image 51 on the longitudinal direction LD are transcribed.
[0114] As an example, as Figure 17 shown, the inspection AP112 is stored in the storage device 85B of the inspector terminal 81. The inspection AP112 is installed on the inspector terminal 81 by the inspector UI. The inspection AP112 is an AP for causing the computer constituting the inspector terminal 81 to function as the "image display device" related to the technology of the present invention. That is, the inspection AP112 is an example of the "operation program of the image display device" related to the technology of the present invention. When the inspection AP112 is started, the CPU 87B of the inspector terminal 81 cooperates with the memory 86, etc., and functions as the browser control unit 113. The browser control unit 113 controls the operation of the dedicated web browser of the inspection AP112.
[0115] The browser control unit 113 generates various screens. The browser control unit 113 receives the screen data of various screens from the information management server 80. The browser control unit 113 reproduces and displays various screens displayed on the web browser based on the screen data, and displays them on the display 89B. And the browser control unit 113 receives various operation instructions input by the inspector UI from the input device 90B through various screens. The browser control unit 113 sends various requests corresponding to the operation instructions to the information management server 80.
[0116] As an example, as Figure 18 and Figure 19 shown, the browser control unit 113 displays the bird's-eye view screen 115 transmitted from the information management server 80 according to a request from the examiner UI on the display 89. The bird's-eye view screen 115 is divided into an upper display area 116 and a lower display area 117. An overall index bar 118 is displayed in the upper display area 116. The overall index bar 118 is an elongated bar-shaped GUI whose long side direction coincides with the length direction LD. The overall index bar 118 represents a distance range of 0 m to 10,000 m. The distance range of 0 m to 10,000 m is the distance range of the total length of the tunnel 10. The overall index bar 118 is an example of the "second index bar" related to the technology of the present invention. Also, the distance range of 0 m to 10,000 m is an example of the "second distance range" related to the technology of the present invention.
[0117] The overall index bar 118 is divided into small areas 119 every 1000 m. Five small areas 119 in the range of 0 m to 5000 m in the first half of the tunnel 10 are arranged in the upper section of the upper display area 116, and five small areas 119 in the range of 5000 m to 10,000 m in the second half of the tunnel 10 are arranged in the lower section of the upper display area 116.
[0118] A partial index bar 120 is displayed in the lower display area 117. Similar to the overall index bar 118, the partial index bar 120 is an elongated bar-shaped GUI whose long side direction coincides with the length direction LD. The partial index bar 120 respectively represents ten distance ranges obtained by dividing the distance range of the total length of the tunnel 10, that is, 0 m to 10,000 m, into ten equal parts: 0 m to 1000 m, 1000 m to 2000 m, 2000 m to 3000 m,..., 7000 m to 8000 m, 8000 m to 9000 m, and 9000 m to 10,000 m. The partial index bar 120 is an example of the "first index bar" related to the technology of the present invention. Also, distance ranges such as 0 m to 1000 m and 1000 m to 2000 m are examples of the "first distance range" related to the technology of the present invention.
[0119] At most five partial index bars 120 for 5000 m are displayed in the lower display area 117. A scroll bar 121 is provided in the lower display area 117, and by operating this scroll bar 121, the partial index bar 120 displayed in the lower display area 117 can be changed. And by moving the cursor 130 of the mouse (refer to Figure 21Align the desired small area 119 of the overall index bar 118 (etc.) and click, and it is also possible to change the local index bar 120 displayed in the lower display area 117. For example, when a small area 119 in the distance range of 2000 m to 3000 m is selected, the local index bar 120 representing the distance range of 2000 m to 3000 m is used as the starting point, and the local index bar 120 representing the distance range of 6000 m to 7000 m is displayed in the lower display area 117 up to the end.
[0120] In the bird's-eye view screen 115, in the small area 119 of the overall index bar 118, at least one of the brightness, color, and pattern of the small area 119 corresponding to the distance range shown by the local index bar 120 being displayed in the lower display area 117 is changed (indicated by hatching) to be displayed separately from other small areas 119. Through this display, it is possible to indicate which position in the distance range of 0 m to 10000 m the local index bar 120 being displayed in the lower display area 117 corresponds to. In addition, Figure 18 illustrates the case where the local index bars 120 for 0 m to 1000 m, 1000 m to 2000 m, 2000 m to 3000 m, 3000 m to 4000 m, and 4000 m to 5000 m are being displayed in the lower display area 117. And, Figure 19 illustrates the case where the local index bars 120 for 5000 m to 6000 m, 6000 m to 7000 m, 7000 m to 8000 m, 8000 m to 9000 m, and 9000 m to 10000 m are being displayed in the lower display area 117.
[0121] As an example, as Figure 20 shown, the numerical values and scales 125 representing the distance are displayed every 100 m in the local index bar 120. And, the shooting-time designated part mark 126 is displayed at the upper part of the local index bar 120, the inspection-time designated part mark 127 is displayed at the lower part, and the crack existence part mark 128 is displayed inside. The shooting-time designated part mark 126, the inspection-time designated part mark 127, and the crack existence part mark 128 are an example of the "concerned part marks" related to the technology of the present invention.
[0122] The shooting-time designated part mark 126 is a mark in the shape of a simulated pin. The screen transmission control unit 103 arranges the shooting-time designated part mark 126 at the position of the local index bar 120 corresponding to the designated position of the part in the length direction LD of the shooting-time designated part information 75.
[0123] When checking, the designated part mark 127 is a triangular mark imitating an arrowhead shape. The screen transfer control unit 103 arranges the designated part mark 127 at the position of the local index bar 120 corresponding to the designated position of the part in the length direction LD of the designated part information 97 during inspection.
[0124] The crack existence part mark 128 is a line extending throughout the entire width direction of the local index bar 120. In order to distinguish it from the scale 125, the thickness of the crack existence part mark 128 is thicker than that of the scale 125. The screen transfer control unit 103 arranges the crack existence part mark 128 at the position of the local index bar 120 corresponding to the position in the length direction LD of the extraction image 110 obtained by extracting the crack 111 with a length above the threshold. In addition, the part where the crack 111 with a length above the threshold exists is an example of the "part of interest" related to the technology of the present invention, similar to the part designated by the photographer UP and the part designated by the inspector UI.
[0125] The shooting designated part mark 126 and the inspection designated part mark 127 can be selected by the cursor 130 of the mouse. When the shooting designated part mark 126 is selected, as an example, as Figure 21 shown, a dialog box 131 of the text memo recorded in association with the part designated by the photographer UP is displayed above the selected shooting designated part mark 126. And when the inspection designated part mark 127 is selected, as an example, as Figure 22 shown, a dialog box 132 of the text memo recorded in association with the part designated by the inspector UI is displayed below the selected inspection designated part mark 127. Of course, when no text memo is recorded, the dialog boxes 131 and 132 are not displayed.
[0126] In the bird's-eye view screen 115, for example, when it is indicated to double-click on a desired small area 119 of the overall index bar 118 with the cursor 130 of the mouse, the browser control unit 113 sends a transfer request for the local image display screen 135 to the information management server 80. The screen transfer control unit 103 receives the transfer request for the local image display screen 135 and generates, as an example, Figure 23 the local image display screen 135 as shown, and transfers the generated local image display screen 135 to the inspector terminal 81. The browser control unit 113 displays the local image display screen 135 on the monitor 89B.
[0127] The partial image display screen 135 has a partial index bar 120 and a partial image display area 136. A part of the long image 55, i.e., the partial image 137, is displayed in the partial image display area 136. Here, the partial image 137 is an image of a distance range of 50 m. In the initial display state of the partial image display screen 135, the partial image 137 of the distance range of 50 m at the end on the entrance 13 side is displayed.
[0128] At the upper part of the partial image display area 136, numerical values representing distances are displayed every 5 m. And, similar to the partial index bar 120, the shooting designated part mark 126, the inspection designated part mark 127, and the crack existence part mark 128 are displayed at the upper part of the partial image display area 136.
[0129] Figure 23 An example is shown in which a small area 119 of 0 m to 1000 m is double-clicked in the bird's-eye view screen 115, and the partial index bar 120 of 0 m to 1000 m and the partial image 137 of the distance range of 0 m to 50 m are displayed. In addition, the partial image display screen 135 is an example of the "display screen" related to the technology of the present invention. And, the partial image display area 136 is an example of the "display area" related to the technology of the present invention.
[0130] A return button 138 is provided at the upper part of the partial image display screen 135. When the return button 138 is selected, the display returns to the bird's-eye view screen 115. And, an auxiliary window 139 in which the partial image 137 in the initial display state before magnification is displayed is provided inside the partial image display area 136. Moreover, an operation button group 140 is provided on the left side of the partial image display area 136.
[0131] In the partial index bar 120 of the partial image display screen 135, numerical values representing distances and scales 125 are displayed every 100 m, and the shooting designated part mark 126, etc. are displayed. Basically, it is the same display method as the partial index bar 120 of the bird's-eye view screen 115. However, as an example, as Figure 24 shown, a photography position mark 145 is displayed in the partial index bar 120 of the partial image display screen 135. The photography position mark 145 indicates the photography position of the partial image 137 being displayed in the partial image display area 136 in the tunnel 10. Specifically, the photography position mark 145 is a frame surrounding the distance range of the tunnel 10 reflected in the partial image 137. In Figure 24 an example is shown in which the partial image 137 of the distance range of 0 m to 50 m is displayed in the partial image display area 136, and the photography position mark 145 surrounding the distance range of 0 m to 50 m is displayed in the partial index bar 120.
[0132] A displayed mark 146 is displayed at the bottom of the partial index bar 120, and the displayed mark 146 indicates the part where the partial image 137 is displayed. The displayed mark 146 is a fill bar extending in the longitudinal direction of the partial index bar 120. The displayed mark 146 can distinguish and display the part where the partial image 137 is displayed from the part where the partial image 137 is not displayed. Although not shown in the figure, in the partial image display screen 135, similarly to the case of the bird's-eye view screen 115, the text memo dialog boxes 131 and 132 are displayed in accordance with the selection of the designated part mark 126 for shooting and the designated part mark 127 for inspection.
[0133] Distance range switching buttons 147A and 147B are provided on the left and right of the local index bar 120. When the distance range switching button 147A is selected, the display of the local index bar 120 is switched to a local index bar 120 on the side of the entrance 13. On the other hand, when the distance range switching button 147B is selected, the display of the local index bar 120 is switched to a local index bar 120 on the side of the exit 14. In conjunction with the change in the display of the local index bar 120, the display of the local image 137 in the local image display area 136 is switched.
[0134] Consider, for example, a case where the local index bar 120 of the distance range of 3000m to 4000m is displayed and the distance range switching button 147A is selected. In this case, the display of the local index bar 120 of the distance range of 3000m to 4000m is switched to the local index bar 120 of the distance range of 2000m to 3000m. Also, the display of the local image 137 of the local image display area 136 is switched to the local image 137 of the distance range of 2000m to 2050m. Also, consider, for example, a case where the local index bar 120 of the distance range of 7000m to 8000m is displayed and the distance range switching button 147B is selected. In this case, the display of the local index bar 120 of the distance range of 7000m to 8000m is switched to the local index bar 120 of the distance range of 8000m to 9000m. Then, the display of the partial image 137 in the partial image display area 136 is switched to the partial image 137 in the distance range of 8000 m to 8050 m.
[0135] As an example, Figure 25As shown, in the partial image display screen 135, the position of any location on the partial index bar 120 can be specified by the cursor 130. When the position specification is received, the browser control unit 113 generates position specification information 150 indicating the specified position and sends it to the information management server 80. The screen transfer control unit 103 displays the partial image 137 corresponding to the specified position and the shooting position in the partial image display area 136. Also, the screen transfer control unit 103 changes the display of the shooting position mark 145 according to the display change of the partial image 137. Moreover, when the partial image 137 whose display is changed is a partial image 137 that has not been displayed before, the screen transfer control unit 103 displays a displayed mark 146 below the partial index bar 120. The screen transfer control unit 103 transfers the generated partial image display screen 135 to the examiner terminal 81.
[0136] In Figure 25 an example is illustrated where the position of 180 m on the partial index bar 120 is specified by the cursor 130 position. In this case, the partial image 137 in the partial image display area 136 is switched from the partial image 137 in the distance range of 0 m to 50 m to the partial image 137 in the distance range of 180 m to 230 m. Also, the shooting position mark 145 is switched from the distance range of 0 m to 50 m to the distance range of 180 m to 230 m, and the displayed mark 146 is displayed below the distance range of 180 m to 230 m.
[0137] As an example, as Figure 26 shown, the operation button group 140 includes a zoom button 155, a move / rotate button 156, an overlap / dissolve overlap button 157, a measurement button 158, and display change buttons 159A and 159B, etc.
[0138] The zoom button 155 is a button for enlarging or reducing the display size of the partial image 137 in the partial image display area 136. As an example, as Figure 27 shown, when the zoom button 155 is operated to enlarge the display size of the partial image 137 in the partial image display area 136, a frame 160 is displayed in the auxiliary window 139. The frame 160 indicates which position of the partial image 137 in the initial display state before the enlarged display corresponds to the currently enlarged display part.
[0139] The move / rotate button 156 is a button for changing the display position of the partial image 137 in the partial image display area 136 to any of the up, down, left, or right positions. Also, the move / rotate button 156 is a button for changing the display direction of the partial image 137 in the partial image display area 136 clockwise or counterclockwise at regular intervals (for example, 90°).
[0140] The overlap / detach overlap button 157 is a button for indicating the overlapping of the extraction image 110 onto the partial image 137 in the partial image display area 136 and the detachment therefrom. In Figure 23 , when the overlap / detach overlap button 157 is selected, as an example, as Figure 28 shown, the extraction image 110 is overlapped and displayed on the partial image 137 in the partial image display area 136. When the overlap / detach overlap button 157 is selected again in this state, the overlap of the extraction image 110 is detached, and it returns to Figure 23 the display mode.
[0141] The measurement button 158 is a button for displaying the position and actual size of the measurement object in the partial image 137 in the partial image display area 136 in the tunnel 10. As an example, as Figure 29 shown, when the measurement button 158 is selected and a rectangular area 165 surrounding the crack 111 as the measurement object is specified, a display window 166 including the position of the crack 111 specified by the area 165 in the tunnel 10 and the actual size of the crack 111 specified by the area 165 is displayed in the partial image display area 136. The position of the crack 111 specified by the area 165 in the tunnel 10 is the center position of the side along the length direction LD of the area 165. And, here, the actual size is the width W in the length direction LD of the crack 111 specified by the area 165 and the height H in the circumferential direction CD. In Figure 29 , the case where the position in the tunnel 10 is 24 m, the width W is 4.8 m, and the height H is 2 m is illustrated.
[0142] And, as an example, as Figure 30 shown, when the measurement button 158 is selected and a plurality of points 167 on the crack 111 as the measurement object are specified, a display window 166 including the position of the crack 111 specified by the points 167 in the tunnel 10 and the actual size of the crack 111 specified by the points 167 is displayed in the partial image display area 136. The position of the crack 111 specified by the points 167 in the tunnel 10 is the center position of the line connecting the points 167. And, here, the actual size is the length L of the line connecting the points 167. In Figure 30 , the case where the position in the tunnel 10 is 24 m and the length L is 4.8 m is illustrated. Thus, the specification of the measurement object can be Figure 29 the rectangular area 165 as shown, or can be Figure 30 the points 167 as shown. In addition, the actual size can be obtained based on the distance to the subject measured by the distance measurement function of the camera 27, the photographic magnification, the focal length, the number of pixels of the imaging element, the pixel size, and the pixel pitch, etc.
[0143] The display switching buttons 159A and 159B are buttons for switching the display of the partial image 137 being displayed in the partial image display area 136. The display switching buttons 159A and 159B are an example of the "operation unit" involved in the technology of the present invention.
[0144] As an example, as Figure 31 and Figure 32 shown, when the display switching buttons 159A and 159B are selected, the partial image 137 being displayed in the partial image display area 136 is switched to a partial image 137 adjacent to the partial image 137 being displayed in the partial image display area 136.
[0145] Figure 31 An example is shown where the partial image 137 in the distance range of 600m to 650m is being displayed in the partial image display area 136 and the display switching button 159A is selected. In this case, the display of the partial image 137 in the partial image display area 136 is switched to the partial image 137 in the distance range of 550m to 600m adjacent to the partial image 137 in the distance range of 600m to 650m. Also, the display of the photographing position marker 145 is switched from the distance range of 600m to 650m to the distance range of 550m to 600m. Moreover, the displayed marker 146 is also displayed at the lower part of the distance range of 550m to 600m. In this case, the partial image 137 in the distance range of 550m to 600m is an example of the "adjacent partial image" involved in the technology of the present invention. Additionally, when the partial image 137 in the distance range of 550m to 600m has been displayed until now, the displayed marker 146 at the lower part of the distance range of 550m to 600m has been displayed.
[0146] Figure 32Illustrated is a case where the display switching button 159B is selected when the local image 137 showing a distance range of 100 m to 150 m is displayed in the local image display area 136. In this case, the display of the local image 137 in the local image display area 136 is switched to the local image 137 of the distance range of 150 m to 200 m adjacent to the local image 137 of the distance range of 100 m to 150 m. Also, the display of the photographing position mark 145 is switched from the distance range of 100 m to 150 m to the distance range of 150 m to 200 m. Moreover, the displayed mark 146 is also displayed at the lower part of the distance range of 150 m to 200 m. In this case, the local image 137 of the distance range of 150 m to 200 m is an example of the "adjacent local image" related to the technology of the present invention. In addition, in the case where the local image 137 of the distance range of 150 m to 200 m has been displayed previously, the displayed mark 146 has been displayed at the lower part of the distance range of 150 m to 200 m.
[0147] Next, as an example, the operation based on the above structure will be described with reference to Figure 33 the flowchart shown. As shown in Figure 1 , Figure 5 and Figure 6 shown, the inner wall surface 11 of the tunnel 10 is photographed by the camera 27 of the photographing device 12. At this time, the moving distance of the photographing device 12 is derived based on the pulse PL output from the magnetic sensor 41 corresponding to the magnetism of the magnet 40 of the rear wheel 37 of the carriage 21 to which the photographing device 12 is attached. Then, as shown in Figure 7 shown, the photographing device 12 generates information of the photographed image 51 obtained by the above photographing, that is, the photographed image information 60. And, as shown in Figure 10 shown, information of the part designated by the photographer UP on the operation screen 65 shown in Figure 8 etc., that is, the designated part information 75 at the time of photographing is generated.
[0148] If the work program 95 is started in the information management server 80, then as shown in Figure 13 shown, the CPU 87A of the information management server 80 functions as the acquisition unit 100, the RW control unit 101, the extraction unit 102, and the screen transfer control unit 103. And, if the inspection AP 112 is started in the inspector terminal 81, then as shown in Figure 17 shown, the CPU 87B of the inspector terminal 81 functions as the browser control unit 113.
[0149] As shown in Figure 11As shown, photographic image information 60 and photographed specified part information 75 are sent from the photographic device 12 to the information management server 80. The photographic image information 60 and the photographed specified part information 75 are acquired by the acquisition unit 100 (step ST100). The photographic image information 60 and the photographed specified part information 75 are output from the acquisition unit 100 to the RW control unit 101, and are stored in the storage device 85A by the RW control unit 101 (step ST110).
[0150] In the examiner terminal 81, a transmission request for the bird's-eye view screen 115 is made by the examiner UI, and this transmission request is sent from the browser control unit 113 to the information management server 80 (step ST200). When the transmission request for the bird's-eye view screen 115 is received (step ST120), the RW control unit 101 reads out the photographic image information 60 and the photographed specified part information 75 from the storage device 85A (step ST130). The photographic image information 60 and the photographed specified part information 75 are output from the RW control unit 101 to the screen transmission control unit 103. Also, the photographic image information 60 is output to the extraction unit 102 together with the crack extraction model 96. Further, the inspected specified part information 97 is also read out by the RW control unit 101 from the storage device 85A, and is output from the RW control unit 101 to the screen transmission control unit 103 together with the photographic image information 60, etc.
[0151] The screen transmission control unit 103 generates Figure 18 and Figure 19 the bird's-eye view screen 115 shown, and transmits it to the examiner terminal 81 (step ST140). In the examiner terminal 81, the browser control unit 113 displays the bird's-eye view screen 115 on the display 89B (step ST210). The overall index bar 118 is displayed in the upper display area 116 of the bird's-eye view screen 115, and the local index bar 120 is displayed in the lower display area 117.
[0152] The overall index bar 118 is divided into a plurality of small areas 119 of every 1000 m. The small areas 119 corresponding to the distance range shown by the local index bar 120 being displayed in the lower display area 117 among the plurality of small areas 119 are displayed separately from the other small areas 119. And, as Figure 20 shown, the photographed specified part mark 126, the inspected specified part mark 127, and the crack existence part mark 128 are displayed in the local index bar 120.
[0153] A transmission instruction for the local image display screen 135 is made in the bird's-eye view screen 115, and a transmission request corresponding to this transmission instruction is sent from the browser control unit 113 to the information management server 80 (step ST220). When the transmission request for the local image display screen 135 is received (step ST150), the screen transmission control unit 103 generatesFigure 23 The local image display screen 135 as shown is displayed and transmitted to the examiner terminal 81 (step ST160). In the examiner terminal 81, the browser control unit 113 displays the local image display screen 135 on the display 89B (step ST230).
[0154] The local image display screen 135 has a local index bar 120 and a local image display area 136. However, the local image display screen 135 does not have a display area for the long image 55. A part of the long image 55, that is, the local image 137, is displayed in the local image display area 136. A photographing position marker 145 is displayed in the local index bar 120, and the photographing position marker 145 indicates the photographing position of the local image 137 being displayed in the local image display area 136 in the tunnel 10.
[0155] When the zoom button 155 is operated and the local image 137 in the local image display area 136 is enlarged and displayed, as Figure 27 shown, a frame 160 is displayed in the auxiliary window 139, and the frame 160 indicates which position of the local image 137 in the initial display state before the magnification display corresponds to the currently magnified display part.
[0156] When the overlap / dissolve overlap button 157 is selected, as Figure 15 shown, in the extraction unit 102, the photographed image 51 is input into the crack extraction model 96, and thus an extraction image 110 is output from the crack extraction model 96. Then, as Figure 16 shown, information on the extraction images 110 of all the photographed images 51, that is, extraction image information 105, is generated. The extraction image information 105 is output from the extraction unit 102 to the screen transfer control unit 103. Then, as Figure 28 shown, the extraction image 110 is overlapped and displayed in the local image 137 in the local image display area 136.
[0157] When the measurement button 158 is selected and a rectangular area 165 surrounding the measurement object is specified as shown in Figure 29 or multiple points 167 on the measurement object are specified as shown in Figure 30 shown, a display window 166 including the position of the specified measurement object in the tunnel 10 and the actual size of the specified measurement object is displayed.
[0158] When the display switching buttons 159A and 159B are selected, as Figure 31 and Figure 32 shown, the local image 137 being displayed in the local image display area 136 is switched to an adjacent local image 137 to the local image 137 being displayed in the local image display area 136.
[0159] As described above, the CPU 87B of the inspector terminal 81 includes a browser control unit 113. The browser control unit 113 controls to display the partial image display screen 135 on the display 89B. The partial image display screen 135 has a partial index bar 120 and a partial image display area 136. A partial image 137 is displayed in the partial image display area 136. The partial image 137 is an image obtained by photographing the tunnel 10 extending along the length direction LD with the photographing device 12, and is a part of the long image 55 whose long side direction is along the length direction LD. The partial index bar 120 extends along the length direction LD and represents at least a part of the distance range in the distance range of the length direction LD of the tunnel 10. A photographing position mark 145 is displayed in the partial index bar 120, and the photographing position mark 145 indicates the photographing position of the partial image 137 being displayed in the partial image display area 136 in the tunnel 10.
[0160] Based on the photographing position mark 145, the inspector UI can recognize which part of the tunnel 10 the partial image 137 being displayed in the partial image display area 136 is an image of. Therefore, it is possible to prevent the problem of being unable to determine the position of the tunnel 10 where an abnormality such as a crack 111 occurs.
[0161] As described above, the partial image display screen 135 only has the partial index bar 120 and the partial image display area 136. Therefore, the screen structure is very simple. When setting the display area of the long image 55, a relatively large space corresponding to that amount is required, but for the partial index bar 120, a larger space is not required compared to the long image 55. And when the length of the structure such as the tunnel 10 in this example is very long, it is difficult to display in the long image 55, but even if the length of the structure becomes longer, the partial index bar 120 can be displayed. Therefore, according to the technology of the present invention, it is possible to enable the inspector UI to recognize which part of the tunnel 10 the partial image 137 being displayed in the partial image display area 136 is an image of with a simple screen structure.
[0162] As Figure 25 shown, the browser control unit 113 receives a position designation at an arbitrary position of the partial index bar 120. The browser control unit 113 displays the partial image 137 corresponding to the position designated and the photographing position in the partial image display area 136. Therefore, the inspector UI can immediately display the desired partial image 137 through a simple operation, thus smoothly performing the inspection of the long image 55.
[0163] As Figure 18As shown, in the examiner terminal 81, the overall index bar 118 can be displayed. The overall index bar 118 represents a distance range wider than that of the local index bar 120 and indicates which position in the distance range between the currently displayed local index bar 120 and the overall index bar 118 corresponds. Therefore, the examiner UI can identify the position corresponding to the currently displayed local index bar 120.
[0164] The distance range represented by the overall index bar 118 is the entire distance range in the length direction LD of the tunnel 10. Therefore, the examiner UI can identify which position in the entire distance range in the length direction LD of the tunnel 10 the currently displayed local index bar 120 corresponds to. Additionally, the distance range represented by the overall index bar 118 is not necessarily the entire distance range in the length direction LD of the tunnel 10. For example, the overall index bar 118 can represent half of the distance range in the length direction LD of the tunnel 10.
[0165] As Figure 27 shown, in the examiner terminal 81, the local image 137 can be magnified and displayed in the local image display area 136. Then, the auxiliary window 139 including the frame 160 indicating which position in the local image 137 the magnified part corresponds to can be displayed. Therefore, the examiner UI can identify which part of the local image 137 is magnified.
[0166] As Figure 26 、 Figure 31 and Figure 32 shown, the display switching buttons 159A and 159B are set on the local image display screen 135. The display switching buttons 159A and 159B are used to input an instruction to switch the local image 137 currently displayed in the local image display area 136 to the local image 137 adjacent to the local image 137 currently displayed in the local image display area 136. Therefore, the display of the local image 137 in the local image display area 136 can be immediately switched with a simple operation, facilitating the inspection of the long image 55.
[0167] As Figure 20 shown, in the examiner terminal 81, the attention part markers such as the shooting - specified part marker 126 representing the attention part of the long image 55 can be displayed on the local index bar 120. Therefore, the examiner UI can identify where the attention part of the long image 55 is located. The attention part is the part that the examiner UI should prioritize and focus on during inspection. Therefore, as long as the examiner UI can identify where the attention part is located, the inspection of the long image 55 can be carried out more smoothly.
[0168] The parts of interest include the parts designated by the user, i.e., the photographer UP or the examiner UI, and the parts where the specific subject, i.e., the crack 111, exists. Therefore, the examiner UI can identify where the parts designated by the photographer UP or the examiner UI and the parts where the crack 111 exists are located.
[0169] As Figure 21 and Figure 22 shown, in the examiner terminal 81, the text memo made by the photographer UP or the examiner UI can be displayed in association with the parts designated by the photographer UP or the examiner UI. Therefore, the examiner UI can easily confirm the text memo.
[0170] The parts designated by the user are the parts designated by the photographer UP of the long image 55 when shooting the long image 55 and the parts designated by the examiner UI of the long image 55 when examining the long image 55. Therefore, the examiner UI can identify where the parts designated by the photographer UP of the long image 55 when shooting the long image 55 and the parts designated by the examiner UI of the long image 55 when examining the long image 55 are located.
[0171] As Figure 24 shown, in the examiner terminal 81, by displaying the displayed mark 146 indicating the part where the partial image 137 is displayed, the part where the partial image 137 is displayed and the part where the partial image 137 is not displayed can be distinguished and displayed in the partial index bar 120. Therefore, the examiner UI can identify the part where the partial image 137 is displayed and examined and the part where the partial image 137 is not displayed and examined. The trouble of rechecking due to not knowing the parts that have been examined can be eliminated.
[0172] As Figure 29 and Figure 30 shown, the browser control unit 113 receives the designation of the measurement object within the partial image 137. The browser control unit 113 displays the position of the measurement object in the tunnel 10 and the actual size of the measurement object according to the designation. Therefore, the examiner UI can simply know the position of the measurement object in the tunnel 10 and the actual size of the measurement object. In addition, it is not limited to both the position of the measurement object in the tunnel 10 and the actual size of the measurement object, and at least one of them can be displayed.
[0173] As Figure 6As shown, the long image 55 is an image obtained by synthesizing a plurality of photographic images 51, which are obtained by photographing different parts of the tunnel 10 multiple times with the photographic device 12, at least along the length direction LD and in the circumferential direction CD (orthogonal) intersecting the length direction LD. Therefore, the long image 55 becomes an image that shows different parts of at least the inner wall surface 11 of the tunnel 10 along the length direction LD, and is an image suitable for comprehensively inspecting the inner wall surface 11 of the tunnel 10 along the length direction LD. In addition, "intersecting" means that the first direction and the second direction intersect at a certain angle, and includes cases other than the "orthogonal" of the exemplified length direction LD and circumferential direction CD.
[0174] As Figure 1 , Figure 5 and Figure 6 shown, the plurality of photographic images 51 are images obtained by photographing the inner wall surface 11 of the tunnel 10 at a plurality of different positions in the length direction LD while moving the photographic device 12 along the length direction LD. Therefore, it is possible to easily obtain a plurality of photographic images 51 that show different parts of the inner wall surface 11 of the tunnel 10 along the length direction LD.
[0175] And, as Figures 2 to 4 shown, the photographic device 12 has a plurality of cameras 27 arranged along the circumferential direction CD. And the plurality of photographic images 51 are images obtained by photographing the tunnel 10 with the plurality of cameras 27 arranged along the circumferential direction CD. Therefore, it is possible to easily obtain a plurality of photographic images 51 that show different parts of the inner wall surface 11 of the tunnel 10 along the circumferential direction CD. And the photographic device 12 has a plurality of cameras 27 arranged along the length direction LD. And the plurality of photographic images 51 are images obtained by photographing the tunnel 10 with the plurality of cameras 27 arranged along the length direction LD. Therefore, it is possible to easily obtain a plurality of photographic images 51 that show different parts of the inner wall surface 11 of the tunnel 10 along the length direction LD.
[0176] More specifically, the photographic device 12 has a plurality of cameras 27 arranged along the circumferential direction CD. And the plurality of photographic images 51 are images obtained by photographing the tunnel 10 with the plurality of cameras 27 while moving the photographic device 12 along the length direction LD. The long image 55 is an image obtained by synthesizing the plurality of photographic images 51 along the length direction LD and the circumferential direction CD. Therefore, it is possible to easily obtain a plurality of photographic images 51 that show different parts of the inner wall surface 11 of the tunnel 10 along the length direction LD and the circumferential direction CD. And the long image 55 becomes an image that shows different parts of the inner wall surface 11 of the tunnel 10 along the length direction LD and the circumferential direction CD, and is an image suitable for comprehensively inspecting the inner wall surface 11 of the tunnel 10 along the length direction LD and the circumferential direction CD.
[0177] The structure is the tunnel 10. The first direction is the longitudinal direction LD connecting the entrance 13 and the exit 14 of the tunnel 10, and the second direction is the circumferential direction CD of the tunnel 10. Therefore, the inner wall surface 11 of the tunnel 10 can be comprehensively inspected.
[0178] In the partial image display screen 135, the inspection-time designated part marker 127 can be displayed not only at the part designated by the past examiner UI but also at the part designated by the examiner UI browsing the partial image display screen 135.
[0179] The partial image 137 displayed in the partial image display area 136 can be an image of a distance range with a certain margin of ±10 m set within a preset distance range such as 50 m. In this case, the adjacent partial images 137 whose display is switched according to the selection of the display switching buttons 159A and 159B also become images of a distance range with a certain margin set. For example, when the display switching button 159B is selected while the partial image 137 in the distance range of 190 m to 260 m (the distance range without margin is 200 m to 250 m) is being displayed in the partial image display area 136, the display is switched to the partial image 137 in the distance range of 240 m to 310 m (the distance range without margin is 250 m to 300 m). In this case, the partial image 137 in the distance range of 240 m to 310 m is an example of the "adjacent partial image" related to the technology of the present invention.
[0180] As a method for distinguishing between the part where the partial image 137 is displayed and the part where the partial image 137 is not displayed, it is not limited to the exemplified displayed marker 146. As an example, in Figure 34 , as shown by the hatching, the part where the partial image 137 is displayed can be displayed with at least one of different brightness, color, and pattern from the part of the partial image 137 where the partial index bar 120 is not displayed, so as to perform distinguishing display. Through this display method, the examiner UI can also recognize the part where the partial image 137 is displayed and inspected and the part where the partial image 137 is not displayed and inspected, and the trouble of rechecking due to not knowing the inspected part can be eliminated.
[0181] And, as an example, as Figure 35 shown, not only the photographing-time designated part marker 126, the inspection-time designated part marker 127, the crack presence part marker 128, and the displayed marker 146 can be displayed on the partial index bar 120, but also on the overall index bar 118.
[0182] The memorandum recorded in association with the part designated by the photographer UP is not limited to the exemplified text memorandum. As an example, as Figure 36As with the shooting-specification part information 170 shown, a voice memo can also be recorded in place of a text memo. When the shooting-specification part marker 126 of the local index bar 120 is selected, the voice memo is played from the speaker. Also, although not shown, the memo recorded in association with the part specified by the examiner UI can also be a voice memo. In short, the memo recorded in association with the part specified by the photographer UP or the examiner UI only needs to be at least one of a text memo and a voice memo.
[0183] It is also possible to perform local shooting and inspection on the right side, left side, or ceiling of the inner wall surface 11, etc., instead of the entire surface of the inner wall surface 11 of the tunnel 10. And not only can the inner wall surface 11 be photographed and inspected, but the road surface 15 can also be photographed and inspected.
[0184] The specific subject to be extracted is not limited to the illustrated crack 111. Other abnormalities such as peeling, rusting, water leakage, or exposure of steel bars can also be extracted. Multiple abnormalities can be extracted, and according to the operation of the overlap / dissolve overlap button 157, the extracted images of multiple abnormalities are selectively overlapped and displayed on the local image 137. And the specific subject to be extracted is not limited to abnormalities. It can also be lighting fixtures, ventilation openings, etc. arranged at constant intervals in the tunnel 10.
[0185] The structure is not limited to the tunnel 10. It can also be a dam, bridge, levee, or public facility, etc. The photographing device 12 can also be a flying object such as a drone. In the case of a dam, for example, the width direction of the dam becomes the first direction, and the height direction becomes the second direction. In the case of a bridge, for example, the length direction of the bridge becomes the first direction, and the height direction becomes the second direction.
[0186] The hardware structure of the computer constituting the information management server 80 can be variously deformed. For example, for the purpose of improving processing power and reliability, the information management server 80 can be constituted by multiple computers separated as hardware. Specifically, the functions of the acquisition unit 100 and the RW control unit 101 and the functions of the extraction unit 102 and the screen transfer control unit 103 are distributed to two server computers to bear. In this case, the information management server 80 is constituted by two server computers. And it is also possible to make the examiner terminal 81 bear a part or all of the functions of the information management server 80.
[0187] In this way, the hardware structure of the computer can be appropriately changed according to the required performance such as processing power, security, and reliability. Moreover, not only the hardware, but also the work program 95 and other APs can of course be dualized or distributed and stored in multiple storage devices for the purpose of ensuring security and reliability.
[0188] The setting location and the operating entity of the information management server 80 may be a data center operated by a company different from the inspection company of the structure, or may be one of multiple inspection companies.
[0189] In the above-described embodiment, for example, as the hardware structure of the processing unit (Processing Unit) that executes various processes such as the acquisition unit 100, the RW control unit 101, the extraction unit 102, the screen transfer control unit 103, and the browser control unit 113, various processors (Processor) shown below can be used. As described above, in addition to the general-purpose processors, namely the CPUs 87A and 87B, which execute software (the work program 95 and the inspection AP 112) and function as various processing units, the various processors also include programmable logic devices (Programmable Logic Device: PLD) such as FPGA (Field Programmable Gate Array), which can change the circuit structure after manufacturing, and dedicated circuits such as ASIC (Application Specific Integrated Circuit), which have a circuit structure specifically designed to execute specific processes.
[0190] One processing unit may be constituted by one of these various processors, or may be constituted by a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs and / or a combination of a CPU and an FPGA). Also, multiple processing units may be constituted by one processor.
[0191] As an example of constituting multiple processing units by one processor, first, as represented by computers such as clients and servers, there is a method in which a combination of one or more CPUs and software constitutes one processor, and this processor functions as multiple processing units. Second, as represented by a system on chip (System On Chip: SOC), there is a method of using a processor that realizes the overall function of a system including multiple processing units with one IC (Integrated Circuit) chip. Thus, the various processing units are constituted by using one or more of the above-described various processors as the hardware structure.
[0192] In addition, as the hardware structure of these various processors, more specifically, a circuitry composed of circuit elements such as semiconductor elements can be used.
[0193] Based on the above description, the technology described in the following supplementary notes can be grasped.
[0194] [Supplementary Note 1]
[0195] An image display device includes a processor,
[0196] wherein the processor controls to display a display screen on a display, and the display screen has:
[0197] a partial image display area, which is obtained by a photographing device photographing a structure extending in a first direction and is a part of a long image whose long side direction is along the first direction; and
[0198] a first index bar, which extends along the first direction and represents a first distance range that is at least a part of the distance range of the structure in the first direction, and a photographing position mark is displayed in the first index bar, and the photographing position mark represents the photographing position of the partial image being displayed in the display area in the structure.
[0199] [Supplementary Note Item 2]
[0200] The image display device according to Supplementary Note Item 1, wherein
[0201] the processor receives a position designation at an arbitrary position of the first index bar,
[0202] and displays the partial image corresponding to the position designated by the position in the display area.
[0203] [Supplementary Note Item 3]
[0204] The image display device according to Supplementary Note Item 1 or Supplementary Note Item 2, wherein
[0205] a second index bar can be displayed, which represents a second distance range wider than the first distance range and represents which position in the second distance range the displayed first index bar corresponds to.
[0206] [Supplementary Note Item 4]
[0207] The image display device according to Supplementary Note Item 3, wherein
[0208] the second distance range is the entire distance range of the structure in the first direction.
[0209] [Supplementary Note Item 5]
[0210] The image display device according to any one of Supplementary Note Items 1 to 4, wherein
[0211] in the display area, the partial image can be enlarged and displayed,
[0212] An auxiliary window can be displayed, and the auxiliary window indicates the position in the local image corresponding to the magnified display part.
[0213] [Supplementary Note Item 6]
[0214] The image display device according to any one of Supplementary Note Items 1 to 5, wherein
[0215] An operation part is provided on the display screen, and the operation part is used to input an instruction to switch the local image being displayed in the display area to a local image adjacent to the local image being displayed in the display area.
[0216] [Supplementary Note Item 7]
[0217] The image display device according to any one of Supplementary Note Items 1 to 6, wherein
[0218] A region of interest marker can be displayed on the first index bar, and the region of interest marker indicates the region of interest of the long image.
[0219] [Supplementary Note Item 8]
[0220] The image display device according to Supplementary Note Item 7, wherein
[0221] The region of interest includes at least one of the region specified by the user and the region where a specific subject exists.
[0222] [Supplementary Note Item 9]
[0223] The image display device according to Supplementary Note Item 8, wherein
[0224] A text memo or voice memo input by the user can be displayed in association with the region of interest.
[0225] [Supplementary Note Item 10]
[0226] The image display device according to Supplementary Note Item 8 or 9, wherein
[0227] The region specified by the user is at least one of the region specified by the photographer of the long image when shooting the long image and the region specified by the inspector of the long image when inspecting the long image.
[0228] [Supplementary Note Item 11]
[0229] The image display device according to any one of Supplementary Note Items 1 to 10, wherein
[0230] In the first index bar, the part where the local image is displayed and the part where the local image is not displayed can be distinguished and displayed.
[0231] [Supplementary Note Item 12]
[0232] The image display device according to Supplementary Note Item 11, wherein,
[0233] In the first index bar, by displaying a displayed mark indicating the part where the partial image is displayed, the part where the partial image is displayed and the part where the partial image is not displayed can be distinguished and displayed.
[0234] [Supplementary Note Item 13]
[0235] The image display device according to Supplementary Note Item 11, wherein,
[0236] By changing at least one of the brightness, color, and pattern of the first index bar, the part where the partial image is displayed and the part where the partial image is not displayed are distinguished and displayed.
[0237] [Supplementary Note Item 14]
[0238] The image display device according to any one of Supplementary Note Items 1 to 13, wherein,
[0239] The processor receives the designation of the measurement object within the partial image,
[0240] According to the designation, at least one of the position of the measurement object in the structure and the actual size of the measurement object is displayed.
[0241] [Supplementary Note Item 15]
[0242] The image display device according to any one of Supplementary Note Items 1 to 14, wherein,
[0243] The long image is an image obtained by synthesizing a plurality of photographed images along at least the first direction among the first direction and the second direction intersecting the first direction, and the plurality of photographed images are obtained by photographing different parts of the structure with the photographing device multiple times.
[0244] [Supplementary Note Item 16]
[0245] The image display device according to Supplementary Note Item 15, wherein,
[0246] The plurality of photographed images are images obtained by moving the photographing device along the first direction and photographing the structure at a plurality of different positions in the first direction.
[0247] [Supplementary Note Item 17]
[0248] The image display device according to Supplementary Note Item 15 or 16, wherein,
[0249] The photographing device has a plurality of cameras arranged along the second direction,
[0250] The plurality of photographed images are images obtained by photographing the structure with the plurality of cameras.
[0251] [Appended Note Item 18]
[0252] The image display device according to Appended Note Item 17, wherein,
[0253] The photographing device has a plurality of cameras arranged along the first direction,
[0254] The plurality of photographed images are images obtained by photographing the structure with the plurality of cameras.
[0255] [Appended Note Item 19]
[0256] The image display device according to any one of Appended Note Items 15 to 18, wherein,
[0257] The photographing device has a plurality of cameras arranged along the second direction,
[0258] The plurality of photographed images are images obtained by photographing the structure with the plurality of cameras while moving the photographing device along the first direction,
[0259] The long image is an image obtained by synthesizing the plurality of photographed images along the first direction and the second direction.
[0260] [Appended Note Item 20]
[0261] The image display device according to any one of Appended Note Items 15 to 19, wherein,
[0262] The structure is a tunnel,
[0263] The first direction is the longitudinal direction connecting the entrance and the exit of the tunnel,
[0264] The second direction is the circumferential direction of the tunnel.
[0265] The technology of the present invention can also appropriately combine the above various embodiments and / or various modification examples. And, it is not limited to the above embodiments, and various structures can of course be adopted as long as the gist is not deviated from. Moreover, the technology of the present invention relates not only to a program but also to a storage medium for storing the non-temporary program.
[0266] The description and illustration content shown above are detailed descriptions of parts related to the technology of the present invention and are only examples of the technology of the present invention. For example, the description of the above structure, function, effect, and operation is an example of the structure, function, effect, and operation of parts related to the technology of the present invention. Therefore, of course, within the scope of not departing from the gist of the technology of the present invention, for the description and illustration content shown above, unnecessary parts can be deleted, and new elements can be added or replaced. Also, in order to avoid complication and facilitate understanding of the parts related to the technology of the present invention, in the description and illustration content shown above, based on the ability to implement the technology of the present invention, descriptions related to common technical knowledge that does not require special explanation are omitted.
[0267] In this specification, "A and / or B" has the same meaning as "at least one of A and B". That is, "A and / or B" means that it can be only A, only B, or a combination of A and B. Also, in this specification, when three or more cases are combined with "and / or", the same concept as "A and / or B" is applicable.
[0268] All documents, patent applications, and technical standards described in this specification are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually described as being incorporated by reference.
Claims
1. An image display device includes a processor, wherein the processor controls to display a display screen on a display, and the display screen has: a display area for a partial image, the partial image being a part of a long image obtained by a photographing device photographing a structure extending in a first direction and having a long side direction along the first direction; and a first index bar extending along the first direction, representing a first distance range that is at least a part of the distance range of the structure in the first direction, and a photographing position mark is displayed in the first index bar, and the photographing position mark represents the photographing position of the partial image being displayed in the display area in the structure.
2. The image display device according to claim 1, wherein the processor receives a position designation at an arbitrary position of the first index bar, and displays the partial image corresponding to the position where the position designation has been made in the display area.
3. The image display device according to claim 1, wherein a second index bar can be displayed, the second index bar representing a second distance range wider than the first distance range and indicating which position in the second distance range the first index bar being displayed corresponds to.
4. The image display device according to claim 3, wherein the second distance range is the entire distance range of the structure in the first direction.
5. The image display device according to claim 1, wherein in the display area, the partial image can be enlarged and displayed, and an auxiliary window can be displayed, and the auxiliary window indicates which position in the partial image the enlarged part corresponds to.
6. The image display device according to claim 1, wherein an operation unit is provided on the display screen, and the operation unit is used to input an instruction to switch the partial image being displayed in the display area to an adjacent partial image.
7. The image display device according to claim 1, wherein a focus part mark can be displayed on the first index bar, and the focus part mark represents the focus part of the long image.
8. The image display device according to claim 7, wherein the focus part includes at least one of a part designated by a user and a part where a specific subject exists.
9. The image display device according to claim 8, wherein a text memo or a voice memo input by the user can be displayed in association with the focus part.
10. The image display device according to claim 8, wherein the part designated by the user is at least one of a part designated by the photographer of the long image when photographing the long image and a part designated by the inspector of the long image when inspecting the long image.
11. The image display device according to claim 1, wherein in the first index bar, the part where the partial image is displayed and the part where the partial image is not displayed can be distinguished and displayed.
12. The image display device according to claim 11, wherein, In the first index bar, by displaying a displayed mark indicating the part where the partial image is displayed, the part where the partial image is displayed and the part where the partial image is not displayed can be distinguished and displayed.
13. The image display device according to claim 11, wherein, By changing at least one of the brightness, color, and pattern of the first index bar, the part where the partial image is displayed and the part where the partial image is not displayed are distinguished and displayed.
14. The image display device according to claim 1, wherein, The processor receives the designation of the measurement object in the partial image, According to the designation, at least one of the position of the measurement object in the structure and the actual size of the measurement object is displayed.
15. The image display device according to claim 1, wherein, The long image is an image obtained by synthesizing a plurality of photographed images along at least the first direction among the first direction and the second direction intersecting the first direction, and the plurality of photographed images are obtained by photographing different parts of the structure with the photographing device multiple times.
16. The image display device according to claim 15, wherein, The plurality of photographed images are images obtained by photographing the structure at a plurality of different positions in the first direction while moving the photographing device along the first direction.
17. The image display device according to claim 15, wherein, The photographing device has a plurality of cameras arranged along the second direction, The plurality of photographed images are images obtained by photographing the structure with the plurality of cameras.
18. The image display device according to claim 17, wherein, The photographing device has a plurality of cameras arranged along the first direction, The plurality of photographed images are images obtained by photographing the structure with the plurality of cameras.
19. The image display device according to claim 15, wherein, The photographing device has a plurality of cameras arranged along the second direction, The plurality of photographed images are images obtained by photographing the structure with the plurality of cameras while moving the photographing device along the first direction, The long image is an image obtained by synthesizing the plurality of photographed images along the first direction and the second direction.
20. The image display device according to claim 15, wherein, The structure is a tunnel, The first direction is the longitudinal direction connecting the entrance and the exit of the tunnel, The second direction is the circumferential direction of the tunnel.
21. An operation method of an image display device, which includes a step of controlling to display a display screen on a display, and the display screen has: A display area of a partial image, the partial image being a part of a long image obtained by a photographing device photographing a structure extending along a first direction and the long side direction thereof being along the first direction; and A first index bar that extends along the first direction and represents a first distance range that is at least a part of the distance range of the structure in the first direction. A photography position mark is displayed on the first index bar, and the photography position mark represents the photography position of the partial image being displayed in the display area within the structure.
22. An operating program for an image display device, the operating program of the image display device causing a computer to execute processing, the processing including a step of controlling to display a display screen on a display, the display screen having: A display area for a partial image, the partial image being a part of a long image obtained by photographing a structure extending along a first direction with a photographing device and having a long side direction along the first direction; and A first index bar that extends along the first direction and represents a first distance range that is at least a part of the distance range of the structure in the first direction. A photography position mark is displayed on the first index bar, and the photography position mark represents the photography position of the partial image being displayed in the display area within the structure.
Citation Information
Patent Citations
Image processing method, display device, and inspection system
JP2017168077A
Information processing device, information processing method, and program
JP2022056085A
Information processing apparatus, information processing method, and program
JP2022139903A