Photographing system, remote control device, and photographing program

The imaging system addresses map and wind-related inaccuracies by aligning guidelines with inspection targets, enabling precise image extraction for improved AI analysis.

JP7796501B2Active Publication Date: 2026-01-09DAIWA HOUSE INDUSTRY CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021161023
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-09-30
Publication Date
2026-01-09
Estimated Expiration
2041-09-30

AI Technical Summary

Technical Problem

Existing drone-based imaging systems for inspecting building exteriors face challenges in accurately capturing images due to errors in electronic maps and wind interference, leading to degraded AI analysis accuracy from unrelated objects in the images.

Method used

An imaging system with a remote control device that calculates and superimposes guidelines on the captured image to align with the inspection target, allowing for automatic extraction of partial images within these guidelines, adjusting flight positions to maintain accuracy and consistency.

Benefits of technology

Eliminates map errors and wind influence, ensuring accurate extraction of inspection targets for AI learning, enhancing the precision of image analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007796501000001
    Figure 0007796501000001
  • Figure 0007796501000002
    Figure 0007796501000002
  • Figure 0007796501000003
    Figure 0007796501000003
Patent Text Reader

Abstract

To extract a portion subjected to inspection from the image of a building.SOLUTION: A control unit 52 includes: a calculating unit 52a that calculates the width of a portion subjected to inspection displayed on the screen of a display unit 53 in accordance with the actual width of the portion subjected to inspection and with a distance from a flying imaging device 30 to an imaging object; a display control unit 52c that displays, on the display unit 53, a guide line G with the calculated width by the calculating unit 52a so as to be laid over on the picked-up image by the flying imaging device 30; and a first extracting unit 52d that extracts a partial image within the width of the guide line G from the picked-up image with the position of the guide line G and the display position of the portion subjected to inspection being aligned with each other on the screen of the display unit 53.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a system for capturing an image of an inspection target part that is exposed to the outside of a building and extends linearly. [Background technology]

[0002] When imaging the roof or exterior wall surfaces of a large building for inspection purposes, if the imaging range needs to include high altitudes far above the ground, a method is used in which a digital camera is attached to a small unmanned aerial vehicle such as a drone and the unmanned aerial vehicle and digital camera are operated with a radio-controlled device (remote control). Examples of such technologies include those described in Japanese Patent Application Publication No. WO2019 / 187166A1 (Patent Document 1), Japanese Patent Application Publication No. 2019-039849 (Patent Document 2), Japanese Patent Application Publication No. 2020-166490 (Patent Document 3), and Japanese Patent Application Publication No. 2021-014241 (Patent Document 4). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent re-publication WO2019 / 187166A1 [Patent Document 2] Japanese Patent Application Publication No. 2019-039849 [Patent Document 3] Japanese Patent Application Publication No. 2020-166490 [Patent Document 4] Patent Publication No. 2021-014241 Summary of the Invention [Problem to be solved by the invention]

[0004] There are two methods for capturing images using such drone cameras: one in which the user (human) manually operates a radio-controlled device to fly the drone and adjust the camera direction to capture images, and another method in which automatic flight and automatic capture are used instead of these manual operations.

[0005] Combinations of automatic flight and automatic imaging include scanning the entire wall surface at a fixed overlap rate, or focusing on linearly extending inspection target areas such as joints and gutters and imaging them sequentially from one end to the other. In either case, the general method is to automatically fly the drone to a specified flat position by inputting latitude and longitude information and altitude information on an electronic map that shows the flat position into a radio-controlled device, but errors on the electronic map and the effects of wind make it difficult to capture images in the composition the user desires.

[0006] Furthermore, in order to efficiently inspect the large number of acquired images, when using deep learning with artificial intelligence (AI) to analyze these images, it is desirable to extract only the portion of the image that corresponds to the area to be inspected. Specifically, for example, in image analysis to inspect and detect cracks in joint sealant installed along a wall surface, cropping only the joints from an image that shows the wall surface and joints and storing them in the AI ​​contributes to improving accuracy. Conversely, unrelated objects that appear in the image, such as windows, pipes, exterior wall panels, roof tiles, and other building elements other than the joints, degrade the accuracy of image analysis by AI.

[0007] An object of the present invention is to provide a technique for automatically trimming an inspection target portion from an image while eliminating the influence of errors on an electronic map, etc. [Means for solving the problem]

[0008] To this end, the present invention provides an imaging system for imaging an inspection target portion that is exposed outside a building and extends linearly, comprising an aerial imaging device with a flight function, a display unit that displays the image captured by the aerial imaging device, and a remote control device including a control unit that controls the flight of the aerial imaging device. The control unit includes a calculation means that calculates the width of the inspection target portion to be displayed on the screen of the display unit based on the actual width of the inspection target portion and the distance from the aerial imaging device to the object to be imaged, a display control means that superimposes guidelines having the width calculated by the calculation means on the image captured by the aerial imaging device and displays them on the display unit, and a first extraction means that extracts a partial image within the width of the guidelines from the image captured while the positions of the guidelines and the display position of the inspection target portion on the screen of the display unit are aligned.

[0009] In one aspect of the present invention, the remote control device further includes an input unit that accepts input of instructions from a user, the display control means displays guidelines at a predetermined position on the screen of the display unit, and the control unit further includes position adjustment means that adjusts the flight position of the flying imaging device or the position of the guidelines in accordance with instructions from the user, thereby aligning the position of the guidelines with the display position of the inspection target area.

[0010] In a preferred aspect of the present invention, the control unit further includes a movement control means for, after acquiring a partial image by the first extraction means, moving the flying imaging device along the extension direction of the inspection target portion by an amount of movement calculated according to the distance from the flying imaging device to the target while keeping the distance from the flying imaging device constant, and a second extraction means for extracting a partial image of the width of the guideline from the captured image when the flying imaging device is moved by the movement control means.

[0011] In a further preferred aspect of the present invention, the second extraction means calculates a deviation amount of the display position of the inspection target portion from the position of the guideline based on a difference between position information of the flight imaging device when it is moving and position information of the flight imaging device when the partial image is acquired by the first extraction means, and shifts the extraction position of the partial image based on the calculated deviation amount. Preferably, the photography system further includes storage means for storing the partial images extracted by the first and second extraction means.

[0012] The remote control device according to the present invention is a device for remotely controlling a flying imaging device and capturing images of an inspection target portion that is exposed outside a building and extends linearly, and includes a display unit that displays images captured by the flying imaging device and a control unit that controls the flight of the flying imaging device. The control unit includes a calculation means that calculates the width of the inspection target portion to be displayed on the screen of the display unit based on the actual width of the inspection target portion and the distance from the flying imaging device to the object to be captured, a display control means that displays guidelines having the width calculated by the calculation means on the display unit by superimposing them on the image captured by the flying imaging device, and a first extraction means that extracts a partial image within the width of the guidelines from the captured image while the positions of the guidelines and the display position of the inspection target portion on the screen of the display unit are aligned.

[0013] The photography program according to the present invention is a program for imaging an inspection target part that is exposed outside a building and extends in a straight line, and causes a computer to execute the following steps: calculating the width of the inspection target part to be displayed on the screen of a display unit based on the actual width of the inspection target part and the distance from the flying photography device to the object to be photographed; superimposing guidelines having the calculated width on the image captured by the flying photography device and displaying them on the display unit; matching the position of the guidelines with the display position of the inspection target part on the screen of the display unit; acquiring the image captured by the flying photography device with the position of the guidelines and the display position of the inspection target part matched; and extracting a partial image within the width of the guidelines from the captured image. [Effects of the Invention]

[0014] In this way, according to the present invention, for the inspection of building elements, errors on the electronic map and the influence of wind are eliminated and only the inspection target portion is extracted, thereby providing appropriate learning materials for artificial intelligence, and enabling accurate judgment of the inspection results. [Brief explanation of the drawings]

[0015] [Figure 1] FIG. 1 illustrates an embodiment of the present invention. [Figure 2]10 is a flowchart showing an image extraction procedure according to the embodiment. [Figure 3] 10 is an image of an inspection target portion acquired by the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0016] An embodiment of the present invention will be described in detail below with reference to the drawings. FIG. 1 is a diagram showing an imaging system according to one embodiment of the present invention, in which (A) shows the system configuration and the inspection target portion, (B) is a block diagram showing the configuration of an aerial imaging device, and (C) is a block diagram showing the configuration of a remote control device. As shown in FIG. 1, this embodiment includes an aerial imaging device 30, which is an unmanned aerial vehicle (a so-called drone) equipped with a camera (an imaging unit 35, described below), and a remote control device 50 that controls the aerial imaging device 30. The aerial imaging device 30 approaches an inspection target portion 11 of a building 10 and captures the object. The image of the inspection target portion 11 is used as information for image analysis of cracks, deterioration, etc.

[0017] The inspection target portion 11 is a long, narrow joint that extends vertically with a predetermined width. The inspection target portion 11 is a rubber sealant that fills the gap between wall materials. The flying image capture device 30 is a radio-controlled flying device that is wirelessly operated from a remote control device 50. Specifically, the user can operate the remote control device 50 to fly in all directions, including forward, backward, left, right, up, and down, and move or stand still in the air. The flying image capture device 30 also flies according to the planar position and height position set on the remote control device 50 without requiring user operation. Furthermore, video data captured by the flying image capture device 30 is sent to the remote control device 50, and the remote control device 50 can capture desired images (acquire still images) by user operation or without human intervention.

[0018] The remote control device 50 is, for example, a mobile terminal such as a smartphone, tablet terminal, or personal computer on which a predetermined program (application software) is installed. The remote control device 50 acquires and displays images captured by the flight imaging device 30.

[0019] As shown in FIG. 1(B), the flying image capture device 30 includes a transmitter / receiver 31, a receiver 33, a height sensor 34, an image capture unit 35, a drive unit 36, a memory unit 37, and a control unit 39. The transmitter / receiver 31 transmits and receives data to and from a remote control device 50. Examples of the main data that the transmitter / receiver 31 receives from the remote control device 50 include flight height data, flight path data, the amount of movement described below, and the image capture direction. Examples of the main data that the transmitter / receiver 31 transmits to the remote control device 50 include captured image data.

[0020] The receiver 33 receives GPS signals based on the Global Positioning System and calculates the planar position of the flying imaging device 30 based on the received GPS signals. The planar position is expressed, for example, as latitude and longitude set on the Earth's surface. The sensor 34 is, for example, a barometric pressure sensor that measures air pressure and detects the height position of the flying imaging device 30 relative to the ground. Note that the height sensor 34 may not be provided and the receiver 33 may calculate the height position of the flying imaging device 30 relative to the ground based on the GPS signals received.

[0021] The imaging unit 35 is a camera capable of capturing color digital images, and captures the inspection target 11 to generate image data in a predetermined pixel unit. This image data is associated with the planar position, height position, and imaging direction at the time of capturing the image. The imaging unit 35 has a pan function that moves the optical axis of the lens included in the imaging unit 35 horizontally and a tilt function that moves it up and down. The pan angle range is, for example, an angular range of approximately 75 degrees left and right from the front of the flying imaging device 30 as the center, and the tilt angle range is, for example, an angular range from a position 30 degrees above the front of the flying imaging device 30 to a position 90 degrees below the front of the flying imaging device 30 (a position pointing directly below the flying imaging device 30).

[0022] The drive unit 36 ​​includes a plurality of rotors, an electric motor that generates a driving force to be applied to the rotors, and a storage battery that supplies power to the electric motor. By individually controlling the rotation speeds of the plurality of rotors, it is possible to change the flight height, flight path, flight speed, and horizontality of the flying image capture device 30, i.e., the planar position, height position, and image capture direction of the image capture unit 35.

[0023] The control unit 39 controls the entire flying imaging device 30. The control unit 39 stores the flight height data, flight path data, and imaging position data received by the transmission / reception unit 31 in the memory unit 37. The control unit 39 also controls the drive unit 36 ​​based on the flight height data and flight path data to enable autonomous flight of the flying imaging device 30. The control unit 39 also controls the imaging unit 35 based on the imaging position data to capture an image of the inspection target portion 11 at a predetermined imaging position. The control unit 39 also stores the image data acquired by the imaging unit 35 in the memory unit 37 and transmits the image data to the remote control device 50.

[0024] As shown in FIG. 3, the remote control device 50 includes a transceiver unit 51, a control unit 52, a display unit 53, an input unit 54, and a storage unit 55. The transceiver unit 51 transmits and receives data to and from the flight imaging device 30. The display unit 53 is, for example, a liquid crystal display panel, and displays electronic map data, the planar position and height position of the flight imaging device 30, and the captured image captured by the imaging unit 35 of the flight imaging device 30. Note that the captured image is image data that is transmitted from the flight imaging device 30 to the remote control device 50 from time to time and evaporates, but it should be understood that it may also include data stored in a recallable memory.

[0025] The electronic map data may be acquired via a network communication means such as WiFi (registered trademark) or the Internet, or may be stored in advance in the storage unit 55. The input unit 54 is formed of, for example, a touch panel screen and a keyboard, and provides the user with an interface for operating the flight imaging device 30.

[0026] The storage unit 55 stores data received from the flying imaging device 30 and data generated by the control unit 52. The storage unit 55 is a memory that stores programs for operating the control unit 52 and extracted partial image data. Such a memory can be configured to include RAM, ROM, non-volatile memory, etc.

[0027] The control unit 52 is configured with, for example, a CPU (Central Processing Unit), and executes an operation program stored in the storage unit 55. The control unit 52 executes the program to realize each process described below. Such a program is acquired by downloading it via a network communication means such as WiFi (registered trademark) or the Internet, and is stored in the storage unit 55.

[0028] The control unit 52 controls the entire remote control device 50. The control unit 52 stores the image data received by the transmission / reception unit 51 in the storage unit 55. The control unit 52 also includes, as its functional configuration, a calculation unit 52a serving as a calculation means, a position adjustment unit 52b serving as a position adjustment means, a display control unit 52c serving as a display control means, a first extraction unit 52d serving as a first extraction means, a movement control unit 52e serving as a movement control means, and a second extraction unit 52f serving as a second extraction means.

[0029] In the system of this embodiment, the control unit 52 executes a program shown in FIG. 2, which will be described later, to extract an image of the inspection target portion 11 (hereinafter referred to as a joint) shown in FIG.

[0030] First, the flying camera device 30 flies to the vicinity of one end of the joint, and faces the lens of the imaging unit 35 directly toward the joint, directing the camera optical axis of the imaging unit 35 toward the joint to capture an image of one end of the joint. In this way, a first image including this one end and the area surrounding the joint is captured. This image capture is performed by the user manually operating the input unit 54 (manual operation). Alternatively, the flying camera device 30 may take the first image in semi-automatic flight by inputting the planar position, height position, normal direction of the wall surface, and width dimension of the one end of the joint into the input unit 54, and then the flying camera device 30 automatically flies to the destination, and then the user fine-tunes the position of the flying camera device 30.

[0031] Next, the flying imaging device 30 automatically flies and moves toward the other end of the joint, orients the camera optical axis of the imaging unit 35 toward the joint so that the lens of the imaging unit 35 faces the joint, and images the joint portion adjacent to the one end portion described above. Thus, a second image is captured, including this adjacent joint portion and the surrounding area of ​​the joint. Similarly, the third, fourth, and nth images are captured. Once the other end portion of the joint is imaged, image extraction in this embodiment is complete.

[0032] When capturing the next image, it is advisable to overlap the previous image. The image may be captured from one end to the other end either from top to bottom or from bottom to top.

[0033] 2 is a flowchart showing the image extraction procedure executed by each of the units 52a to 52f of the control unit 52. The procedure for extracting a partial image of the inspection target portion 11 (hereinafter also referred to as a joint) shown in FIG. 1 will be explained. First, in step S11, the calculation unit 52a calculates the width Wc (unit of pixels) of the joint shown in the image data (on the display screen of the display unit 53) based on the actual width dimension W of the joint, the distance L from the flying imaging device 30 (specifically, the imaging unit 35) to the joint to be photographed, the focal length, the angle of view of the imaging unit 35, and the resolution (number of pixels). For example, if the actual width dimension W=a [cm] and the distance L=b [m], Wc=c pixels is calculated based on the angle of view of the imaging unit 35 and the total number of pixels on the screen (hereinafter referred to as a "frame") F of the display unit 53. [Formula 1] Joint width Wc = actual joint size x focal length ÷ distance to joint This calculation is performed when capturing the first image or is completed before capturing the first image, and the width Wc is then repeatedly used for the second and subsequent images.

[0034] Next, the process proceeds to step S12. In step S12, the display control unit 52c displays two parallel guidelines G having the width Wc calculated in step S11 in the center of the frame F of the display unit 53 in the horizontal direction, as shown in FIG.

[0035] Next, the process proceeds to step S13. In step S13, as shown in FIG. 3(B), the flying imaging device 30 flies close to the joint and captures an image of the joint. The display control unit 52c displays a guideline G on the display unit 53 by superimposing it on the image captured by the flying imaging device 30. At this stage, as shown in FIG. 3(B), the position of the guideline G and the display position of the joint (the inspection target portion 11) may be misaligned in the left-right direction. However, the position adjustment unit 52b executes a process to align the position of the guideline G with the display position of the joint. Specifically, the position of the flying imaging device 30 is adjusted (aligned) by a user's operation via the input unit 54 so that the guideline G and the joint displayed on the display unit 53 are aligned. Note that such alignment may be performed by adjusting the position of the guideline G on the screen (in the left-right direction).

[0036] As a result of the alignment, the joint (the inspection target portion 11) coincides with the guide line G as shown in FIG. 3(C). The first extraction unit 52d outputs a shooting instruction to the flying imaging device 30 at the timing of the alignment, and acquires an image including the joint (the inspection target portion 11) and the surrounding area 16 captured by the imaging unit 35. Alternatively, the imaging unit 35 may continuously acquire video, and a still image may be acquired from the captured video when the alignment is completed.

[0037] In step S13, the position information including the latitude and longitude related to the above-mentioned positioning and the imaging direction are temporarily recorded in the internal memory.

[0038] Next, the process proceeds to step S14. In step S14, the first extraction unit 52d calculates the number of pixels I constituting the actual width dimension W of the joint displayed on the display unit 53 from the width dimension W of the joint, the separation distance L, and the angle of view and resolution of the imaging unit 35.

[0039] Next, the process proceeds to step S15. In step S15, a number of pixels I within the width of the two parallel guide lines G is trimmed from the captured image acquired in step S13. This extracts only the joints. Specifically, the first extraction unit 52d trims portions (partial images) that secure a number of pixels I / 2 on each side of the center line H of the screen of the display unit 53, as shown in FIG. 3(D). The image of the joints extracted by trimming is shown in FIG. 3(E). In step S15, Wc = I as a general rule. The partial images are stored in the memory unit 55.

[0040] For the second and subsequent images, the process proceeds from step S15 to step S16, and steps S16 to S19 are repeated. In step S16, the amount of movement of the flying imaging device 30 for the next image is calculated based on the separation distance L from the flying imaging device 30 (specifically, the imaging unit 35) to the joint to be photographed, the angle of view of the imaging unit 35, and the preset overlap rate Px [%]. The movement direction is parallel to the extension direction of the joint. The imaging direction for the next image may be the same as for the previous image.

[0041] The movement control unit 52e then flies the flying image capture device 30 by a movement amount calculated according to the distance L from the flying image capture device 30 to the subject, while keeping the distance (L) constant. In other words, in the case of a long vertical joint, the flying image capture device 30 moves up and down, and in the case of a long horizontal joint, the flying image capture device 30 moves left and right. In the case of a vertical movement, the actual movement amount is calculated from the flight altitude, and in the case of a left and right movement, the actual movement amount is calculated from the difference in latitude and longitude.

[0042] When the flight imaging device 30 reaches the target position in accordance with the control of the movement control unit 52e (without aligning the position of the guideline G with the display position of the joint), the imaging unit 35 captures an image in a predetermined imaging direction. Note that the flight imaging device 30 may automatically stop moving at the target position and automatically capture an image at the target position, or, when the flight imaging device 30 reaches the target position, a notification to that effect may be displayed on the display unit 53, and the flight imaging device 30 may stop moving and capture an image by a user operation.

[0043] Since the joints extend vertically, when the flying imaging device 30 is moved up or down for the second or subsequent image capture (when only the flight altitude is changed), the position of the guideline G and the displayed position of the joints will ideally coincide. However, since the position of the flying imaging device 30 may shift due to the influence of wind, etc., in the next step S17, the second extraction unit 52f calculates the amount of deviation from the guideline G displayed on the display unit 53 to the joints.

[0044] The amount of deviation in the left-right direction is calculated based on the difference between the latitude and longitude (position information) of the flying image capture device 30 when the image was captured in the previous step S16 and the latitude and longitude (position information) of the flying image capture device 30 when the alignment (when the partial image was acquired by the first extraction unit 52d) recorded in step S13. The position information of the flying image capture device 30 is obtained based on the GPS signal received by the receiver 33 and the detection information from the sensor 34.

[0045] In the next step S18, the second extraction unit 52f shifts the extraction position (trimming range) by the above-mentioned shift amount, and extracts a partial image of the width Wc (i.e., pixel I) of the guideline G. In this way, the second extraction unit 52f automatically extracts a partial image of the joint without requiring human intervention.

[0046] In this way, the joint is sequentially imaged in the longitudinal direction, and when the flight imaging device 30 is moved by the movement control unit 52e, the second extraction unit 52f extracts a partial image corresponding to the width of the guideline G. When the imaging of the other end of the joint is completed, the process proceeds to YES in step S19, and this flowchart ends. Note that the extraction (trimming) of the partial image by the second extraction unit 52f may be performed each time an image is captured, or may be performed after all images have been captured.

[0047] The partial images (trimmed images) extracted by the first and second extraction units 52d, 52f provide an overall image of only the long, narrow joint. The partial images extracted by the first and second extraction units 52d, 52f are stored in a storage device such as the storage unit 55. The partial images stored in the storage device may be transmitted to an external information processing device (not shown) or a cloud server.

[0048] The data from the series of partial images obtained is provided as training data for an artificial intelligence (AI) system that is set up separately from the system shown in Figure 1. The AI ​​then inspects joint deterioration, crack width and number of cracks in the sealant, discoloration, etc.

[0049] As described above, according to this embodiment, by manually aligning the position of the guide line G with the display position of the inspection target portion 11 when capturing the first image, it is possible to reliably obtain a partial image of the inspection target portion 11. Therefore, errors on the electronic map can be eliminated. Note that in fully automatic flight without manual operation, it is difficult to perform advance positioning, such as inputting latitude and longitude on the electronic map.

[0050] Furthermore, according to this embodiment, when capturing the first image, it is only necessary to perform an operation once to align the position of the guide line G with the display position of the inspection target part 11, and no alignment is required when capturing the second and subsequent images. Therefore, it is possible to sequentially capture images of all the joints while saving labor in the image capturing work.

[0051] The photographing process (image extraction process) by the remote control device 50 may also be provided as a program. Such a program can be provided by being recorded on an optical medium such as a CD-ROM (Compact Disc-ROM), or on a computer-readable non-transitory recording medium such as a memory card or USB memory. The program can also be provided by downloading it over a network.

[0052] The program according to the present invention may execute processing by calling necessary modules in a predetermined sequence at a predetermined timing among program modules provided as part of a computer's operating system (OS). In this case, the program itself does not include the modules, and executes processing in cooperation with the OS. Programs that do not include such modules may also be included in the program according to the present invention.

[0053] The program according to the present invention may be provided as a part of another program. In this case, the program itself does not include the modules included in the other program, and executes processing in cooperation with the other program. A program that does not include such modules may also be included in the program according to the present invention.

[0054] Although the embodiments of the present invention have been described above with reference to the drawings, the present invention is not limited to the illustrated embodiments. Various modifications and variations can be made to the illustrated embodiments within the same scope as the present invention or within an equivalent scope.

[0055] For example, in addition to the inspection target portion 11 shown in FIG. 1, even if a horizontal joint extending in the horizontal direction is to be imaged, a partial image of the horizontal joint can be extracted using the same process as in FIG. 2. For example, in step S15, an area with I / 2 pixels above and below the center is trimmed. In step S17, the amount of vertical deviation is calculated based on the difference in flight altitude. Position information, including latitude, longitude, and altitude, of the flying imaging device 30 is obtained based on the GPS signal received by the receiver 33 and the detection information from the sensor 34.

[0056] The imaging system of this embodiment can also be applied to building elements other than joints, as long as the inspection target is exposed to the outside of the building and extends linearly. For example, the inspection target may be a horizontally continuous half-pipe gutter 13 as shown in FIG. 1. This allows inspection of the gutter 13 for clogs and cracks. Alternatively, the linearly extending inspection target may be a vertically continuous storm sewer pipe 14 as shown in FIG. 1. When the inspection target is a gutter 13 or a storm sewer pipe 14, partial images of the gutter 13 or the storm sewer pipe 14 can be used to inspect for damage to the fixtures of the gutter 13 or the storm sewer pipe 14, which are arranged intermittently at predetermined intervals to support and secure the pipe. The inspection target may extend vertically, horizontally, or in another linear direction. The imaging unit 35 may use visible light, infrared light, X-rays, or other methods. [Industrial Applicability]

[0057] The present invention is advantageously used in construction. [Explanation of symbols]

[0058] 11 Inspection target part (joint sealing), 30 Flying imaging device, 50 Remote control device.

Claims

1. A system for imaging an inspection target part that is exposed outside a building and extends linearly, comprising: a flying imaging device having a flying function; A remote control device including a display unit that displays the captured image of the flying imaging device and a control unit that controls the flight of the flying imaging device, The control unit A calculation means for calculating the width of the inspection target portion displayed on the screen of the display unit according to the actual width of the inspection target portion and the distance from the flying imaging device to the object to be photographed; A display control means for superimposing a guideline having the width calculated by the calculation means on the image captured by the flight imaging device and displaying it on the display unit; an imaging system including a first extraction means for extracting a partial image within the width of the guideline from the captured image in a state in which the position of the guideline and the display position of the inspection object part are aligned on the screen of the display unit.

2. the remote control device further includes an input unit that accepts input of instructions from a user; the display control means displays the guideline at a predetermined position on the screen of the display unit; The photographing system of claim 1, wherein the control unit further includes a position adjustment means for adjusting the flight position of the flying imaging device or the position of the guideline in accordance with instructions from a user, thereby aligning the position of the guideline with the display position of the inspection target portion.

3. The control unit After acquiring the partial image by the first extraction means, a movement control means moves the flying imaging device along the extension direction of the inspection target portion by a movement amount calculated according to the distance while keeping the distance from the flying imaging device to the imaging target constant; The photography system according to claim 1 or 2, further comprising a second extraction means for extracting a partial image corresponding to the width of the guideline from the photographed image when the flying photography device is moved by the movement control means.

4. The photographing system described in claim 3, wherein the second extraction means calculates the amount of deviation of the display position of the inspection target portion from the position of the guideline based on the difference between the position information of the flying imaging device when it is moving and the position information of the flying imaging device when the partial image is acquired by the first extraction means, and shifts the extraction position of the partial image based on the calculated amount of deviation.

5. 5. The photographing system according to claim 1, further comprising a storage unit for storing the partial images extracted by said first and second extraction units.

6. A device that remotely controls a flying imaging device and images an inspection target part that is exposed outside a building and extends linearly, a display unit that displays the captured image of the flying imaging device; A control unit that controls the flight of the flying imaging device, The control unit A calculation means for calculating the width of the inspection target portion displayed on the screen of the display unit according to the actual width of the inspection target portion and the distance from the flying imaging device to the object to be photographed; A display control means for displaying a guideline having the width calculated by the calculation means on the display unit by superimposing the guideline on the image captured by the flight imaging device; a first extraction means for extracting a partial image within the width of the guideline from the captured image in a state in which the position of the guideline and the display position of the inspection object part are aligned on the screen of the display unit.

7. A program for capturing an image of an inspection target part that is exposed outside a building and extends linearly, Calculating the width of the inspection target portion displayed on the screen of the display unit according to the actual width of the inspection target portion and the distance from the flying imaging device to the object to be photographed; A step of superimposing a guideline having the calculated width on the image captured by the flying imaging device and displaying it on the display unit; a step of aligning the position of the guideline with the display position of the inspection object portion on the screen of the display unit; A step of acquiring a photographed image of the flying imaging device in a state where the position of the guideline and the display position of the inspection target part are aligned; and extracting a partial image within the width of the guideline from the captured video.

Citation Information

Patent Citations

  • Ceiling joint inspection method

    JP2019039849A

  • Roof inspection method and program

    JP2020166490A

  • Unmanned aircraft, image photographing system and program

    JP2021014241A

  • Degraded state detector and degraded state detection method

    JP2021032650A