System, method, and program for detecting sign of collapse of slope

The slope collapse sign detection system addresses the cost and efficiency issues of existing landslide detection systems by using a database and processing circuit to analyze two-dimensional codes on slopes, effectively monitoring wide areas for signs of collapse at a lower cost.

WO2024241822A1PCT designated stage expired Publication Date: 2024-11-28KAWASAKI JUKOGYO KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/016083
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-19
Filing Date
2024-04-24
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing landslide detection systems are costly and inefficient for wide-area monitoring due to the need for numerous sensors and cables, making it difficult to install and maintain them over large slopes.

Method used

A slope collapse sign detection system utilizing a database and processing circuit that captures initial and inspection images of two-dimensional codes on a slope, calculating and comparing their positional relationships to determine signs of collapse, allowing for low-cost, wide-area monitoring.

Benefits of technology

Enables efficient detection of slope collapse signs by analyzing changes in the relative positional relationships of two-dimensional codes, reducing costs and maintaining accuracy across a wide area.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024016083_28112024_PF_FP_ABST
    Figure JP2024016083_28112024_PF_FP_ABST
Patent Text Reader

Abstract

A processing circuit of this system for detecting a sign of collapse of a slope is configured to: calculate an initial positional relationship that indicates a relative positional relationship between a reference mark and a comparative two-dimensional code in an initial image; calculate an inspection positional relationship that indicates a relative positional relationship between the reference mark and the comparative two-dimensional code in an inspection image; compare the initial positional relationship and the inspection positional relationship that are associated with the same code ID information; and output the comparison result.
Need to check novelty before this filing date? Find Prior Art

Description

System, method and program for detecting signs of slope collapse

[0001] The present disclosure relates to a system, method, and program for detecting signs of slope collapse.

[0002] Patent Document 1 discloses a landslide detection device that detects landslides. This device includes an inclination sensor placed on a slope to monitor for the occurrence of landslides, a sensor cable laid on the slope, and a control device that receives the detection signal of the inclination sensor via the sensor cable.

[0003] Japanese Patent Application Laid-Open No. 2002-329271

[0004] In the above-mentioned device, since a large number of sensors and sensor cables are required, the cost of parts and construction is high, and cost constraints make it difficult to install the device over a wide area.

[0005] One aspect of the present disclosure aims to enable detection of signs of slope collapse over a wide area at low cost.

[0006] A system for detecting signs of slope collapse according to one embodiment of the present disclosure is a system for detecting signs of slope collapse in land that includes slopes, and comprises a database and a processing circuit connected to the database. The processing circuit is configured to: acquire an initial image captured at the initial stage of the slope, the image including a reference mark placed on the land and a comparison two-dimensional code placed on the slope; acquire an inspection image captured at the time of inspecting the slope, the image including the reference mark and the comparison two-dimensional code; calculate an initial positional relationship indicating the relative positional relationship between the reference mark and the comparison two-dimensional code in the initial image; associate code ID information of the comparison two-dimensional code included in the initial image with the initial positional relationship and store it in the database; calculate an inspection positional relationship indicating the relative positional relationship between the reference mark and the comparison two-dimensional code in the inspection image; associate code ID information of the comparison two-dimensional code included in the inspection image with the inspection positional relationship and store it in the database; compare the initial positional relationship and the inspection positional relationship associated with the same code ID information; and output a judgment result regarding signs of collapse of the slope based on the comparison between the initial positional relationship and the inspection positional relationship.

[0007] a comparison result of the comparison between the initial positional relationship and the inspection positional relationship; a comparison result of the ...

[0008] A collapse sign detection program according to one aspect of the present disclosure causes at least one processor to execute the method. The program may be stored in a computer-readable storage medium. The storage medium is a non-transitory, tangible medium. The storage medium may be built into or external to a computer (e.g., a mobile information terminal, a personal computer, a server, etc.). The storage medium may include RAM, ROM, EEPROM, storage, etc., and may be, for example, a hard disk, a flash memory, an optical disk, etc. The program stored in the storage medium may be executed on a computer to which the storage medium is directly connected, or on a computer connected to the storage medium via a network (e.g., the Internet).

[0009] According to one aspect of the present disclosure, signs of sloping land collapse can be detected by examining the change in the relative positional relationship of the comparison two-dimensional code with respect to the reference mark between the initial time and the time of inspection. Moreover, the comparison two-dimensional code also serves as ID information for identifying the paired initial positional relationship and inspection positional relationship. Therefore, signs of sloping land collapse can be detected at low cost even when the monitoring target is a wide area.

[0010] FIG. 1 is a schematic diagram of a system for detecting signs of collapse on sloped ground according to an embodiment. FIG. 2 is a block diagram of the drone of FIG. 1. FIG. 3 is a block diagram of the server of FIG. 1. FIG. 4 is a flowchart explaining the processing of the system of FIG. 1. FIG. 5 is a continuation of the flowchart of FIG. 4. FIG. 6 is a diagram showing an initial image obtained by capturing an image of each code at the beginning of sloped ground. FIG. 7 is a diagram showing an inspection image obtained by capturing an image of each code when inspecting sloped ground. FIG. 8 is a diagram explaining the photographing manner of each code in a modified example.

[0011] Hereinafter, an embodiment will be described with reference to the drawings.

[0012] Fig. 1 is a schematic diagram of a system 1 for detecting signs of collapse of a slope 12 according to an embodiment. As shown in Fig. 1, the detection system 1 is a system for detecting signs of collapse of a slope 12 of land 10. The detection system 1 includes, for example, a plurality of two-dimensional codes C0 to C3, a drone 2 equipped with a camera 29, a server 3, and a database 4.

[0013] The land 10 has a reference land 11 and a sloped land 12. The sloped land 12 includes a collection of granular materials. For example, the sloped land 12 includes soil as a collection of granular materials. The sloped land 12 includes soil from the surface to the interior, for example, but the surface may be covered with an artificial material such as asphalt or concrete. The sloped land 12 may also include snow as a collection of granular materials.

[0014] The reference land 11 is a location having a structure (e.g., an asphalt structure or a concrete structure) that is less susceptible to collapse than the sloping land 12. The reference land 11 is, for example, a level land, but may also be a non-level land or an object or building installed on the land. In the example of FIG. 1 , only one sloping land 12 is illustrated, but it may exist in multiple locations that are separated from each other. Furthermore, multiple sloping land 12 that exist in multiple locations that are separated from each other may each be managed by a different client company.

[0015] A reference two-dimensional code C0 is provided on the reference base 11. Specifically, the reference two-dimensional code C0 is provided on the reference base 11 via a reference member P0 fixed to the reference base 11. For example, the reference two-dimensional code C0 is affixed to the reference member P0. Note that the reference two-dimensional code C0 may be formed directly on the reference member P0 using a laser or the like.

[0016] A plurality of comparison two-dimensional codes C1 to C3 are provided on the slope 12. In this embodiment, for simplicity, three comparison two-dimensional codes C1 to C3 are illustrated, but a greater number of comparison two-dimensional codes may be placed on the slope 12.

[0017] Specifically, a plurality of pile members P1 to P3 are driven into the slope 12 at intervals. For example, a first comparative two-dimensional code C1 is affixed to a first comparative pile member P1 driven into the slope 12. A second comparative two-dimensional code C2 is affixed to a second comparative pile member P2 driven into the slope 12. A third comparative two-dimensional code C3 is affixed to a third comparative pile member P3 driven into the slope 12. The two-dimensional codes C0 to C3 are oriented in a direction W that is perpendicular to both a direction U along the slope from top to bottom of the slope 12 and a direction V that is perpendicular to the surface of the slope 12.

[0018] The comparison two-dimensional codes C1 to C3 are an example of a comparison mark. The normals of the reference two-dimensional code C0 and the comparison two-dimensional codes C1 to C3 are oriented in substantially the same direction. The reference two-dimensional code C0 and the first to third comparison two-dimensional codes C1 to C3 are two-dimensional codes of the same type. The two-dimensional codes C0 to C3 are, for example, QR Codes (registered trademark), but may be other types of two-dimensional codes as long as the angle of the two-dimensional code can be detected on an image. The comparison two-dimensional codes C1 to C3 may also be formed directly on the comparison stake members P1 to P3, respectively, using a laser or the like.

[0019] Each of the two-dimensional codes C0 to C3 is photographed by a camera 29. The camera 29 is mounted on, for example, the drone 2. The camera 29 may be mounted on a moving body other than the drone 2, or may be a surveillance camera installed on the land 10. The image data photographed by the camera 29 is uploaded to the server 3 via the communication network 6.

[0020] The server 3 is connected to a communication network 6 such as the Internet. The communication network 6 is not limited to the Internet, and may be other networks such as a LAN, a WAN, a satellite communication line, or a mobile phone network. The server 3 is connected to a database 4. The database 4 may be locally connected to the server 3, or may be connected to the server 3 via the communication network 6. The client terminal 5 is connected to the communication network 6. The client terminal 5 belongs to, for example, a client company that manages the slope 12. The client terminal 5 is a computer serving as an information processing device having a communication function, and may be, for example, a personal computer, a smartphone, a tablet terminal, or the like.

[0021] If the drone 2 is capable of wireless communication with the communication network 6, the image data captured by the camera 29 may be transmitted to the server 3 by connecting the drone 2 to the communication network 6. Alternatively, the image data captured by the camera 29 may be stored in the client terminal 5 from the drone 2 via a recording medium, wired communication, or wireless communication, and then transmitted from the client terminal 5 to the server 3 via the communication network 6.

[0022] FIG. 2 is a block diagram of the drone 2 of FIG. 1. As shown in FIG. 2, the drone 2 includes a processing circuit 20, a gyro sensor 24, an acceleration sensor 25, a satellite positioning sensor 26, an altitude sensor 27, a geomagnetic sensor 28, a camera 29, a communication interface 30, a propeller actuator 31, and a propeller 32. The processing circuit 20 includes a processor 21, a system memory 22, and a storage memory 23. The processor 21 may include a CPU. The system memory 22 may include RAM. The storage memory 23 may include a hard disk, a flash memory, or a combination thereof. The storage memory 23 stores a program 33. A configuration in which the processor 21 executes the program 33 read from the storage memory 23 to the system memory 22 is an example of a processing circuit 20. Part or all of the program 33 may be executed by a processor external to the drone 2, and the drone 2 may receive the execution results.

[0023] The gyro sensor 24 detects the angular velocity around each of the three attitude axes of the drone 2. The three attitude axes are mutually perpendicular and are set to correspond to the forward / backward, left / right, and up / down directions of the drone 2, respectively. The acceleration sensor 25 detects the acceleration of the drone 2 in each of the forward / backward, left / right, and up / down directions. The processor 21 calculates the speed by integrating the acceleration detected by the acceleration sensor 25. The satellite positioning sensor 26 detects the position of the drone 2 using a satellite positioning system. The satellite positioning system is, for example, a GPS (Global Positioning System). The altitude sensor 27 detects the altitude of the drone 2 and is, for example, a barometric pressure sensor or a radio wave sensor. The barometric pressure sensor can also serve as a speed sensor. The geomagnetic sensor 28 detects the Earth's magnetic force to determine the direction relative to the drone 2.

[0024] The camera 29 captures images of the surroundings of the drone 2. The communication interface 30 may include a communicator that wirelessly communicates with the operation terminal and a communicator that wirelessly communicates with the communication network 6. The drone 2 is equipped with, for example, multiple propellers 32. The behavior of the drone 2 is determined by adjusting the rotation speed of the multiple propellers 32. A propeller actuator 31 is provided individually for each of the multiple propellers 32 and drives each of the propellers 32. The sensors 24 to 28, the camera 29, the communication interface 30, and the propeller actuator 31 are connected to the processor 21.

[0025] The drone 2 flies automatically based on flight plan information stored in the storage memory 23. The flight plan information includes information about the planned flight route, planned flight speed, and takeoff and landing points. The processor 21 controls the propeller actuator 31 in accordance with the detection signals from the sensors 23 to 28 so as to follow the flight plan information, thereby flying automatically.

[0026] The drone 2 may fly based on commands received by the communication interface 30 via direct wireless communication from an operation terminal operated by an operator. The operator may input manual operations such as commands to ascend or descend, move right or left, move forward or backward, and turn right or left to the operation terminal. The processor 21 may control the propeller actuator 31 in accordance with these commands.

[0027] FIG. 3 is a block diagram of the server 3 in FIG. 1 . As shown in FIG. 3 , the server 3 includes a processing circuit 40 and a communication interface 44. The processing circuit 40 includes a processor 41, a system memory 42, and a storage memory 43. The processor 41 may include a CPU. The system memory 42 may include RAM. The storage memory 43 may include a hard disk, a flash memory, or a combination thereof. The storage memory 43 stores a program 45. A configuration in which the processor 41 executes the program 45 read from the storage memory 43 to the system memory 42 is an example of the processing circuit 40. The communication interface 44 includes a communication interface that is communicatively connected to the communication network 6 via a wired or wireless connection. The communication interface 44 includes a communication interface that is communicatively connected to the database 4 via a wired or wireless connection, but the server 3 may also include the database 4 built in.

[0028] Fig. 4 is a flowchart explaining the processing of the detection system 1 in Fig. 1. Fig. 5 is a flowchart continuing from Fig. 4. Below, the explanation will be given along the flow of Figs. 4 and 5 while appropriately referring to the configurations in Figs. 1 to 3. Note that in the following explanation, the processing of the drone 2 is executed by the processing circuit 20, and the processing of the server 3 is executed by the processing circuit 40.

[0029] When the reference two-dimensional code C0 is installed on the reference ground 11 and the first to third comparison two-dimensional codes C1 to C3 are installed on the sloping ground 12, i.e., at the initial stage when the sloping ground 12 is normal, the drone 2 uses the camera 29 while flying to capture an image that includes at least one of the first to third comparison two-dimensional codes C1 to C3 and the reference two-dimensional code C0 in one image (step S1). The image captured at this time is referred to as an initial image M (see FIG. 6). In this embodiment, a case where each of the codes C0 to C3 is included in one initial image M will be described as an example.

[0030] 6 is a diagram showing an initial image M obtained by capturing images of each code C0 to C3 at the initial stage of the slope 12. As shown in FIG. 6, the drone 2 initially captures the reference two-dimensional code C0 and the comparison two-dimensional codes C1 to C3 together and saves the image as the initial image M (step S2). The drone 2 then uploads the initial image M to the server 3 via the communication network 6 (step S3). At this time, the drone 2 attaches property information to the initial image M before transmitting it.

[0031] The property information may include, for example, client ID information that can identify the manager of the slope 12. The property information may include location information of the drone 2 at the time of capturing the initial image M. The property information may include identification information for identifying the slope 12.

[0032] The server 3 receives the initial image M uploaded from the drone 2 via the communication network 6 (step S4). The server 3 stores the received initial image M in the database 4 (step S5). The server 3 reads the reference two-dimensional code C0 and the comparison two-dimensional codes C1 to C3 in the initial image M by image processing (step S6). As a result, the server 3 reads the recorded information of each of the two-dimensional codes C0 to C3 and obtains the position and angle of each of the two-dimensional codes C0 to C3 on the initial image M.

[0033] For example, for two-dimensional codes C0 to C3, which are QR Codes (registered trademark), the position, size, and angle (tilt) of the two-dimensional codes C0 to C3 on the image can be detected by identifying the finder patterns at three of the four corners of the square. This makes it possible to know the relative positional relationship (e.g., relative angle, relative distance, etc.) of the comparison two-dimensional codes C1 to C3 with respect to the reference two-dimensional code C0.

[0034] The recorded information of the reference two-dimensional code C0 includes code ID information indicating the identification information of the two-dimensional code itself. Client ID information indicating the identification information of the manager of the slope 12 may be included in the recorded information of the reference two-dimensional code C0, or may be included in the property information attached to the initial image M by the drone 2. The recorded information of the reference two-dimensional code C0 may include position information of the reference two-dimensional code C0. The recorded information of the reference two-dimensional code C0 may include identification information of the slope 12.

[0035] The recorded information of the comparison two-dimensional codes C1 to C3 includes code ID information indicating the identification information of the two-dimensional code itself. Client ID information indicating the identification information of the manager of the slope 12 may be included in the recorded information of the comparison two-dimensional codes C1 to C3, or may be attached to the initial image M and the inspection image N by the drone 2. The recorded information of the comparison two-dimensional codes C1 to C3 may each include its own location information. The recorded information of the comparison two-dimensional codes C1 to C3 may also include identification information of the slope 12. The server 3 may associate the recorded information read from at least one of the two-dimensional codes C0 to C3 with the code ID information and store it in the database 4.

[0036] If the acquired images of the two-dimensional codes C0 to C3 are captured obliquely rather than frontally, the square two-dimensional codes C0 to C3 will be distorted into trapezoids on the image. Therefore, if the two-dimensional codes C0 to C3 on the image are distorted into trapezoids, the server 3 performs distortion correction. As a first example of distortion correction, if the two-dimensional codes C0 to C3 are QR codes (registered trademark), a known method of correcting distortion using multiple alignment patterns contained in the QR code (registered trademark) may be employed. In this example, the center coordinates of the multiple alignment patterns contained in the QR code (registered trademark) are determined, and the entire QR code (registered trademark) on the image is corrected so that these center coordinates are aligned in a predetermined position. As a second example of distortion correction, a known method of acquiring the shapes of the two-dimensional codes C0 to C3 on the image through image processing and converting the distortion of the shapes of the two-dimensional codes C0 to C3 on the image into a front-facing image through image correction may be employed.

[0037] The server 3 calculates an initial positional relationship indicating the relative positional relationship between the reference two-dimensional code C0 and the comparison two-dimensional codes C1 to C3 in the initial image M (step S7). Specifically, as shown in Fig. 6, the server 3 calculates the reference angle α0 of the reference two-dimensional code C0 and the comparison angles α1 to α3 of the comparison two-dimensional codes C1 to C3 in the initial image M using a known two-dimensional code recognition technology. Note that because the initial image M was captured by the drone 2 in flight, the coordinate axes (x1, y1) of the initial image M in Fig. 6 may not match the coordinate axes (X, Y) of the actual land 10 in Fig. 1.

[0038] The two-dimensional codes C1 and C2, which are QR Codes (registered trademark), have finder patterns at three of the four corners of a square, and the orientation when the finder patterns are at the upper right, upper left, and lower left corners can be considered to be the basic orientation. For example, the server 3 calculates the angle between the top edge of the reference two-dimensional code C0 in the basic orientation and the horizontal axis x1 on the image as the reference angle α0 of the reference two-dimensional code C0. The top edge is the line connecting the finder pattern at the upper left corner and the finder pattern at the upper right corner of the two-dimensional code.

[0039] Similarly, the server 3 calculates the angle between the top side of the first comparison two-dimensional code C1 in the basic position and the horizontal axis x1 on the image as the comparison angle α1 of the first comparison two-dimensional code C1. Similarly, the server 3 calculates the angle between the top side of the second comparison two-dimensional code C2 in the basic position and the horizontal axis x1 on the image as the comparison angle α2 of the second comparison two-dimensional code C2. Similarly, the server 3 calculates the angle between the top side of the third comparison two-dimensional code C3 in the basic position and the horizontal axis x1 on the image as the comparison angle α3 of the third comparison two-dimensional code C3. Note that the method for calculating the angles of the two-dimensional codes C0 to C3, which are QR Codes (registered trademark), is not limited to this, and other known methods (e.g., angle calculation based on changes in the width of the finder pattern) may also be used.

[0040] The server 3 calculates a first initial relative angle (α1-α0) between the reference two-dimensional code C0 and the first comparison two-dimensional code C1 as a first initial positional relationship between the reference two-dimensional code C0 and the first comparison two-dimensional code C1. Similarly, the server 3 calculates a second initial relative angle (α2-α0) between the reference two-dimensional code C0 and the second comparison two-dimensional code C2 as a second initial positional relationship between the reference two-dimensional code C0 and the second comparison two-dimensional code C2. Similarly, the server 3 calculates a third initial relative angle (α3-α0) between the reference two-dimensional code C0 and the third comparison two-dimensional code C3 as a third initial positional relationship between the reference two-dimensional code C0 and the third comparison two-dimensional code C3.

[0041] The server 3 stores the calculated initial relative angles (α1-α0, α2-α0, and α3-α0) for each of the comparison two-dimensional codes C1 to C3 in the database 4 as the initial positional relationship (step S8). Specifically, the server 3 stores the first initial relative angle (α1-α0) between the reference two-dimensional code C0 and the first comparison two-dimensional code C1 in the database 4 in association with the code ID information of the first comparison two-dimensional code C1. The server 3 stores the second initial relative angle (α2-α0) between the reference two-dimensional code C0 and the second comparison two-dimensional code C2 in association with the code ID information of the second comparison two-dimensional code C2 in the database 4. The server 3 stores the third initial relative angle (α3-α0) between the reference two-dimensional code C0 and the third comparison two-dimensional code C3 in association with the code ID information of the third comparison two-dimensional code C3 in the database 4.

[0042] At this time, the server 3 stores the calculated relative angles (α1-α0, α2-α0, and α3-α0) in the database 4 in association with the client ID information related to the initial image M. The server 3 may also store the property information of the initial image M in the database 4 in association with the code ID information of the reference two-dimensional code C0.

[0043] Next, when it is time to inspect the slope 12, the drone 2 uses the camera 29 while flying to capture an image that includes at least one of the first to third comparison two-dimensional codes C1 to C3 and the reference two-dimensional code C0 in one image (step S9). The image captured at this time is referred to as inspection image N (see FIG. 7).

[0044] 7 is a diagram showing an inspection image N obtained by capturing images of each code C0 to C3 during an inspection of a slope 12. As shown in FIG. 7, the drone 2 captures the reference two-dimensional code C0 and the comparison two-dimensional codes C1 to C3 together during the inspection and saves the resulting image as inspection image N (step S10). The drone 2 uploads the inspection image N to the server 3 via the communication network 6 (step S11). The server 3 receives the inspection image N uploaded from the drone 2 via the communication network 6 (step S12).

[0045] The server 3 stores the received inspection image N in the database 4 (step S13). The server 3 reads the reference two-dimensional code C0 and the comparison two-dimensional codes C1 to C3 in the inspection image N by image processing (step S14). As a result, the server 3 reads the recorded information of the two-dimensional codes C0 to C3 and obtains the positions and angles of the two-dimensional codes C0 to C3 on the inspection image N.

[0046] The server 3 determines whether the two-dimensional codes C0 to C3 have been read successfully (step S15). If the server 3 is unable to read any of the two-dimensional codes C0 to C3 successfully (step S15: N), it outputs an error. For example, if the members P0 to P3 on which the two-dimensional codes are provided are no longer in their designated positions due to being toppled or blown away, an error is output. The server 3 may transmit information about the two-dimensional code indicating the error, such as location information of the two-dimensional code indicating the error, together with information indicating the error, to the client terminal 5 of the client managing the slope 12 on which the two-dimensional code is provided.

[0047] If the server 3 successfully reads all of the two-dimensional codes C0 to C3 (step S15: Y), it calculates an inspection position relationship indicating the relative positional relationship between the reference two-dimensional code C0 and the comparison two-dimensional codes C1 to C3 in the inspection image N (step S16). Specifically, as shown in FIG. 7, the server 3 calculates the reference angle β0 of the reference two-dimensional code C0 and the comparison angles β1 to β3 of the comparison two-dimensional codes C1 to C3 in the inspection image N. The method for calculating the angles β0 to β3 is the same as the method for calculating the angles α0 to α3 described above. Note that because the inspection image N was captured by the drone 2 in flight, the coordinate axes (x2, y2) of the inspection image N in FIG. 7 may not coincide with the coordinate axes (x1, y1) of the initial image M in FIG. 6.

[0048] The server 3 calculates a first inspection relative angle (β1-β0) between the reference two-dimensional code C0 and the first comparison two-dimensional code C1 as the first inspection positional relationship between the reference two-dimensional code C0 and the first comparison two-dimensional code C1. Similarly, the server 3 calculates a second inspection relative angle (β2-β0) between the reference two-dimensional code C0 and the second comparison two-dimensional code C2 as the second inspection positional relationship between the reference two-dimensional code C0 and the second comparison two-dimensional code C2. Similarly, the server 3 calculates a third inspection relative angle (β3-β0) between the reference two-dimensional code C0 and the third comparison two-dimensional code C3 as the third inspection positional relationship between the reference two-dimensional code C0 and the third comparison two-dimensional code C3.

[0049] The server 3 stores the calculated inspection relative angles (β1-β0, β2-β0, and β3-β0) for each of the comparison two-dimensional codes C1 to C3 in the database 4 as inspection position relationships (step S17). Specifically, the server 3 stores the first inspection relative angle (β1-β0) between the reference two-dimensional code C0 and the first comparison two-dimensional code C1 in the database 4 in association with the code ID information of the first comparison two-dimensional code C1. The server 3 stores the second inspection relative angle (β2-β0) between the reference two-dimensional code C0 and the second comparison two-dimensional code C2 in association with the code ID information of the second comparison two-dimensional code C2 in the database 4. The server 3 stores the third inspection relative angle (β3-β0) between the reference two-dimensional code C0 and the third comparison two-dimensional code C3 in association with the code ID information of the third comparison two-dimensional code C3 in the database 4.

[0050] For the first comparison two-dimensional code C1, the server 3 extracts from the database 4 a first initial relative angle (α1-α0) and a first inspection relative angle (β1-β0) associated with the code ID information that matches the first comparison two-dimensional code C1, and compares the extracted first initial relative angle (α1-α0) with the extracted first inspection relative angle (β1-β0) (step S18). Similarly, for the second comparison two-dimensional code C2, the server 3 extracts from the database 4 a second initial relative angle (α2-α0) and a second inspection relative angle (β2-β0) associated with another code ID information that matches the second comparison two-dimensional code C2, and compares the extracted second initial relative angle (α2-α0) with the extracted second inspection relative angle (β2-β0). Similarly, with respect to the third comparison two-dimensional code C3, the server 3 extracts from the database 4 the third initial relative angle (α3-α0) and the third inspection relative angle (β3-β0) associated with yet another code ID information that matches each other, and compares the extracted third initial relative angle (α3-α0) with the extracted third inspection relative angle (β3-β0) with each other.

[0051] Specifically, with respect to the first comparison two-dimensional code C1, the server 3 determines that a sign of collapse has occurred in the slope 12 when the absolute value of the difference {(β1-β0)-(α1-α0)} between the first inspection relative angle (β1-β0) and the first initial relative angle (α1-α0) exceeds a predetermined threshold. With respect to the second comparison two-dimensional code C2, the server 3 determines that a sign of collapse has occurred in the slope 12 when the absolute value of the difference {(β2-β0)-(α2-α0)} between the second inspection relative angle (β2-β0) and the second initial relative angle (α2-α0) exceeds a predetermined threshold. With respect to the third comparison two-dimensional code C3, the server 3 determines that a sign of collapse has occurred in the slope 12 when the absolute value of the difference {(β3-β0)-(α3-α0)} between the third inspection relative angle (β3-β0) and the third initial relative angle (α3-α0) exceeds a predetermined threshold. The server 3 then includes the result of this determination in a determination result report, which will be described later.

[0052] The server 3 may set an abnormality level for the signs of collapse. For example, for one slope 12, the abnormality level may be set higher as the number of comparison two-dimensional codes for which the change (absolute value of the difference) between the inspection relative angle and the initial relative angle exceeds a threshold increases. When there are multiple two-dimensional codes for which the change between the inspection relative angle and the initial relative angle exceeds a predetermined threshold, if the differences for the multiple two-dimensional codes contain a mixture of positive and negative signs, the abnormality level may be set higher than when positive and negative signs are not mixed. For the threshold determination, multiple thresholds may be set. That is, the abnormality level may be set so that the larger the threshold, the higher the abnormality level. Alternatively, the server 3 may use artificial intelligence to analyze changes in the initial relative angle relative to the inspection relative angle and determine whether or not there is an abnormality.

[0053] When multiple inspections are performed periodically, the server 3 may use artificial intelligence to calculate the timing of maintenance if the change is greater than zero, even if it determines that the change does not exceed the threshold. For example, the server 3 may include a machine-learned progression prediction model that inputs the progress of the change obtained through multiple inspections and the inspection interval (number of days or hours) and outputs the time until the change exceeds the threshold. The server 3 inputs the progress of the change obtained through multiple inspections (e.g., the amount obtained by subtracting the change from the first inspection from the amount of change obtained through the second inspection) and the inspection interval into the progression prediction model, obtains the time from the present time until the change exceeds the threshold, and estimates when in the future the change will exceed the threshold. The input to the progression prediction model may include at least one of data on the surrounding environment of the slope 12 (e.g., weather) and data on past natural phenomena that have occurred on the slope 12 (e.g., earthquakes). This can further improve maintenance accuracy. The server 3 then includes the estimation results in the assessment result report described below.

[0054] The server 3 transmits a determination result report to the destination indicated by the client destination information corresponding to the client ID information associated with the inspection relative angle used in the comparison (step S19). The determination result report includes an output in which identification information for specifying the slope 12 indicated by the code ID information in which it has been determined that an abnormality has occurred and information indicating the fact that a sign of collapse has occurred are associated with each other. Upon receiving the determination result report, the client terminal 5 of the client company that manages the slope 12 uses it as a reference and carries out maintenance work on the slope 12 as necessary.

[0055] According to the configuration described above, by examining the change in the relative positional relationship of the comparison two-dimensional codes C1 to C3 with respect to the reference two-dimensional code C0 between the initial time and the time of inspection, it is possible to detect signs of collapse of the slope 12. Moreover, the reference two-dimensional code C0 also serves as ID information for identifying the paired initial positional relationship and inspection positional relationship. Therefore, even if the monitoring target is a wide area, signs of collapse of the slope can be detected at low cost.

[0056] FIG. 8 is a diagram illustrating the manner in which each code C0-C3 is photographed in a modified example. As shown in FIG. 8, one image photographed by the camera 29 of the drone 2 does not include all of the two-dimensional codes C0-C3 that need to be photographed, and may include a number of two-dimensional codes that is less than the number of two-dimensional codes C0-C3 that need to be photographed. In other words, when photographing any of the comparison two-dimensional codes C1-C3, the camera 29 of the drone 2 may photograph one image without including the reference two-dimensional code C0. This prevents each of the two-dimensional codes C0-C3 from appearing small in a single image, even when many two-dimensional codes C0-C3 are dispersed.

[0057] Specifically, at the initial stage of the slope 12, the drone 2 captures a first initial image M1 to include the reference two-dimensional code C0 and the first comparison two-dimensional code C1, captures a second initial image M2 to include the first comparison two-dimensional code C1 and the second comparison two-dimensional code C2 without including the reference two-dimensional code C0, and captures a third initial image M3 to include the second comparison two-dimensional code C2 and the third comparison two-dimensional code C3 without including the reference two-dimensional code C0.

[0058] The server 3 receives the first to third initial images M1 to M3 via the communication network 6. For the first initial image M1, the server 3 calculates a reference angle α0 of the reference two-dimensional code C0 and a comparison angle α1 of the first comparison two-dimensional code C1. For the second initial image M2, the server 3 calculates a comparison angle 2α1 of the first comparison two-dimensional code C1 and a comparison angle 2α2 of the second comparison two-dimensional code C2. For the third initial image M3, the server 3 calculates a comparison angle 3α2 of the second comparison two-dimensional code C2 and a comparison angle 3α3 of the third comparison two-dimensional code C3. Note that because the first initial images M1 to M3 were captured by the drone 2 in flight, the coordinate axes of the first to third initial images M1 to M3 may not coincide with one another.

[0059] Since the second initial image M2 does not include the reference two-dimensional code C0, the server 3 calculates the relative angle α2 of the second comparison two-dimensional code C2 with respect to the reference two-dimensional code C0 using the angles α1 and 2α1 of the first comparison two-dimensional code C1 in the first initial image M1 and the second initial image M2.

[0060] Specifically, the server 3 calculates the relative angle (α1-α0) between the reference two-dimensional code C0 and the first comparison two-dimensional code C1 as a first initial positional relationship between the reference two-dimensional code C0 and the first comparison two-dimensional code C1. The server 3 calculates the relative angle (2α2-2α1) between the first comparison two-dimensional code C1 and the second comparison two-dimensional code C2 as a second initial positional relationship between the first comparison two-dimensional code C1 and the second comparison two-dimensional code C2. Then, based on the first initial positional relationship and the second initial positional relationship associated with the same code ID information (the code ID information of the first comparison two-dimensional code C1), the server 3 calculates a third initial positional relationship indicating the relative positional relationship between the reference two-dimensional code C0 and the second comparison two-dimensional code C2.

[0061] More specifically, the server 3 calculates the relative angle (α2-α0) of the second comparison two-dimensional code C2 with respect to the reference two-dimensional code C0 as the third initial positional relationship by adding the relative angle (α1-α0) of the first comparison two-dimensional code C1 with respect to the reference two-dimensional code C0 to the relative angle (2α2-2α1) of the second comparison two-dimensional code C2 with respect to the first comparison two-dimensional code C1. Similarly, the server 3 calculates the relative angle (α3-α0) of the third comparison two-dimensional code C3 with respect to the reference two-dimensional code C0 as the fourth initial positional relationship.

[0062] The server 3 stores the calculated relative angles (α1-α0, α2-α0, and α3-α0) as initial positional relationships in the database 4 together with the corresponding code ID information for each of the comparison two-dimensional codes C1 to C3.

[0063] Next, when the time arrives to inspect the slope 12, the drone 2 captures a first inspection image N1 that includes the reference two-dimensional code C0 and the first comparison two-dimensional code C1, captures a second inspection image N2 that includes the first comparison two-dimensional code C1 and the second comparison two-dimensional code C2 without including the reference two-dimensional code C0, and captures a third inspection image N3 that includes the second comparison two-dimensional code C2 and the third comparison two-dimensional code C3 without including the reference two-dimensional code C0.

[0064] The server 3 receives the first to third inspection images N1 to N3 via the communication network 6. In the first inspection image N1, the server 3 calculates the reference angle β0 of the reference two-dimensional code C0 and the comparison angle β1 of the first comparison two-dimensional code C1. In the second inspection image N2, the server 3 calculates the comparison angle 2β1 of the first comparison two-dimensional code C1 and the comparison angle 2β2 of the second comparison two-dimensional code C2. In the third inspection image N3, the server 3 calculates the comparison angle 3β2 of the second comparison two-dimensional code C2 and the comparison angle 3β3 of the third comparison two-dimensional code C3.

[0065] Since the second inspection image N2 does not include the reference two-dimensional code C0, the server 3 uses the angles β1 and 2β1 of the first comparison two-dimensional code C1 in the first inspection image N1 and the second inspection image N2 to calculate the relative angle β2 of the second comparison two-dimensional code C2 with respect to the reference two-dimensional code C0.

[0066] Specifically, as in the initial state, the server 3 calculates the relative angle (β1-β0) between the reference two-dimensional code C0 and the first comparison two-dimensional code C1 as the first inspection position relationship between the reference two-dimensional code C0 and the first comparison two-dimensional code C1. The server 3 calculates the relative angle (2β2-2β1) between the first comparison two-dimensional code C1 and the second comparison two-dimensional code C2 as the second inspection position relationship between the first comparison two-dimensional code C1 and the second comparison two-dimensional code C2. Then, based on the first inspection position relationship and the second inspection position relationship associated with the same code ID information (the code ID information of the first comparison two-dimensional code C1), the server 3 calculates a third inspection position relationship indicating the relative position relationship between the reference two-dimensional code C0 and the second comparison two-dimensional code C2.

[0067] More specifically, the server 3 calculates the relative angle (β2-β0) of the second comparison two-dimensional code C2 with respect to the reference two-dimensional code C0 as the third inspection positional relationship by adding the relative angle (β1-β0) of the first comparison two-dimensional code C1 with respect to the reference two-dimensional code C0 to the relative angle (2β2-2β1) of the second comparison two-dimensional code C2 with respect to the first comparison two-dimensional code C1. Similarly, the server 3 calculates the relative angle (β3-β0) of the third comparison two-dimensional code C3 with respect to the reference two-dimensional code C0 as the fourth inspection positional relationship.

[0068] For the first comparison two-dimensional code C1, the server 3 compares the initial relative angle (α1-α0) and the inspection relative angle (β1-β0) associated with the matching code ID information. Similarly, for the second comparison two-dimensional code C2, the server 3 compares the initial relative angle (α2-α0) and the inspection relative angle (β2-β0) associated with another matching code ID information. Similarly, for the third comparison two-dimensional code C3, the server 3 compares the initial relative angle (α3-α0) and the inspection relative angle (β3-β0) associated with yet another matching code ID information. The comparison is performed by determining the difference threshold value, as in the above-described embodiment.

[0069] The technology disclosed herein is not limited to the above-described embodiments and modifications. For example, in the above-described embodiments and modifications, a reference two-dimensional code C0 is provided on the reference ground 11. However, instead of providing a reference two-dimensional code C0 on the reference ground 11, one of the comparison two-dimensional codes C1 to C3 provided on the slope 12 may be used as the reference two-dimensional code. The two-dimensional codes C0 to C3 may also be positioned facing upward so that they can be photographed from the sky. Furthermore, instead of determining the relative positional relationship between the reference two-dimensional code and the comparison two-dimensional code based on the relative angle between them, the distance between the reference two-dimensional code and the comparison two-dimensional code may be used as the relative positional relationship between them. This makes it possible to detect movement of the slope 12, such as the parallel movement of the pile members P1 to P3, or to detect the displacement of the two-dimensional code along the slope when the two-dimensional code is positioned facing upward.

[0070] As described above, the above embodiments have been described as examples of the technology disclosed in this application. However, the technology of the present disclosure is not limited to these and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made as appropriate. Furthermore, the components described in the above embodiments can be combined to create new embodiments. For example, some configurations or methods in one embodiment may be applied to other embodiments, and some configurations in an embodiment can be separated and arbitrarily extracted from other configurations in that embodiment. Furthermore, the components described in the accompanying drawings and detailed description include not only components essential for solving the problem, but also components that are not essential for solving the problem, and are used to illustrate the technology.

[0071] The functions of the elements disclosed herein can be performed using circuits or processing circuits, including general-purpose processors, special-purpose processors, integrated circuits, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), conventional circuits, and / or combinations thereof, configured or programmed to perform the disclosed functions. Processors are considered processing circuits or circuits because they include transistors and other circuitry. In this disclosure, a circuit, unit, or means is hardware that performs the recited functions or hardware that is programmed to perform the recited functions. The hardware may be hardware disclosed herein or other known hardware that is programmed or configured to perform the recited functions. Where the hardware is a processor, which is considered a type of circuit, the circuit, means, or unit is a combination of hardware and software, and the software is used to configure the hardware and / or processor.

[0072] Each of the following sections is a disclosure of a preferred embodiment.

[0073] [Item 1] A system for detecting signs of slope collapse in land including a slope, comprising: a database; and a processing circuit connected to the database, wherein the processing circuit: acquires an initial image captured at the initial stage of the slope, the image including a reference mark provided on the land and a comparison two-dimensional code provided on the slope; acquires an inspection image captured at the time of inspection of the slope, the image including the reference mark and the comparison two-dimensional code; calculates an initial positional relationship indicating a relative positional relationship between the reference mark and the comparison two-dimensional code in the initial image; associates code ID information of the comparison two-dimensional code included in the initial image with the initial positional relationship and stores the association in the database; calculates an inspection positional relationship indicating a relative positional relationship between the reference mark and the comparison two-dimensional code in the inspection image; associates code ID information of the comparison two-dimensional code included in the inspection image with the inspection positional relationship and stores the association in the database; compares the initial positional relationship and the inspection positional relationship associated with the same code ID information with each other; and outputting a judgment result regarding the signs of collapse of the slope based on a comparison between the initial positional relationship and the inspection positional relationship.

[0074] With this configuration, signs of sloping land collapse can be detected by examining the change in the relative position of the comparison two-dimensional code with respect to the reference mark between the initial time and the time of inspection. Moreover, the comparison two-dimensional code also serves as ID information for identifying the paired initial positional relationship and inspection positional relationship. Therefore, signs of sloping land collapse can be detected at low cost even when the monitoring target is spread over a wide area.

[0075] [Item 2] A system for detecting signs of collapse of slopes described in Item 1, wherein the comparison two-dimensional code is provided on the slope via a stake member driven into the slope, and the relative positional relationship between the reference mark and the comparison two-dimensional code includes a relative angle between the reference mark and the comparison two-dimensional code.

[0076] With this configuration, even a slight movement of the slope will cause the pile members driven into the slope to tilt, which will easily cause angular displacement in the comparison two-dimensional code. This makes it possible to detect signs of slope collapse at an early stage.

[0077] [Item 3] The system for detecting signs of collapse of sloped ground according to Item 1 or 2, wherein the land further includes a reference ground different from the sloped ground, and the reference mark is provided on the reference ground.

[0078] With this configuration, when the reference ground remains stationary and the slope moves, the relative position between the reference mark and the comparison two-dimensional code changes, thereby enabling accurate detection of signs of slope collapse.

[0079] [Item 4] A system for detecting signs of collapse on slopes according to any one of items 1 to 3, wherein the reference mark includes a reference two-dimensional code that is the same type of two-dimensional code as the comparison two-dimensional code.

[0080] According to this configuration, the reference two-dimensional code can be image-recognized using an algorithm that is common to the image recognition of the comparison two-dimensional code, thereby facilitating faster processing for detecting signs of collapse on slopes.

[0081] [Item 5] A system for detecting signs of collapse of slopes described in any one of Items 1 to 4, wherein acquiring the initial image and the inspection image includes receiving the initial image and the inspection image uploaded via a communication network.

[0082] This configuration allows for the condition of slopes at various locations to be detected in a unified manner.

[0083] [Item 6] A system for detecting signs of collapse of slopes described in Item 5, wherein the database stores client destination information corresponding to client ID information, acquiring the initial image and the inspection image includes acquiring the initial image and the inspection image including the client ID information, storing the initial positional relationship and the inspection positional relationship in the database includes storing the initial positional relationship and the inspection positional relationship in the database in association with the client ID information, and outputting the determination result includes transmitting the determination result to a destination indicated by the client destination information corresponding to the client ID information associated with the compared inspection positional relationship.

[0084] According to this configuration, the condition of the slopes managed by each of a large number of clients can be managed in a unified manner, and the results of the inspections can be reported to each client.

[0085] [Item 7] A system for detecting signs of collapse on slopes described in any one of Items 1 to 6, wherein comparing the initial positional relationship and the inspection positional relationship with each other includes determining that an abnormality has occurred when the amount of change in the inspection positional relationship relative to the initial positional relationship exceeds a threshold value.

[0086] According to this configuration, signs of slope collapse can be easily detected by determining the amount of change based on a threshold value.

[0087] [Item 8] A system for detecting signs of collapse on slopes described in any one of Items 1 to 6, wherein comparing the initial positional relationship and the inspection positional relationship with each other includes using artificial intelligence to analyze changes in the inspection positional relationship relative to the initial positional relationship and determine whether or not there is an abnormality.

[0088] With this configuration, artificial intelligence can easily detect signs of slope collapse with high accuracy.

[0089] [Item 9] The comparison two-dimensional code is a first comparison two-dimensional code, and a second comparison two-dimensional code is provided on the slope, the initial positional relationship is a first initial positional relationship, and the inspection positional relationship is a first inspection positional relationship, the initial image includes the reference mark, the first comparison two-dimensional code, and the second comparison two-dimensional code, the inspection image includes the reference mark, the first comparison two-dimensional code, and the second comparison two-dimensional code, and the processing circuit: calculates a second initial positional relationship indicating the relative positional relationship between the reference mark and the second comparison two-dimensional code in the initial image; associates code ID information of the second comparison two-dimensional code included in the initial image with the second initial positional relationship and stores them in the database; calculates a second inspection positional relationship indicating the relative positional relationship between the reference mark and the second comparison two-dimensional code in the inspection image; associates code ID information of the second comparison two-dimensional code included in the inspection image with the second inspection positional relationship and stores them in the database; A system for detecting signs of collapse on slopes described in any one of items 1 to 8, which is configured to compare the second initial positional relationship and the second inspection positional relationship associated with the same code ID information with each other, and outputting the judgment result includes outputting the judgment result based on a comparison between the second initial positional relationship and the second inspection positional relationship.

[0090] According to this configuration, the movement of a plurality of comparison two-dimensional codes can be monitored to effectively detect signs of slope collapse.

[0091] [Item 10] The first comparison two-dimensional code and the second comparison two-dimensional code are provided on the slope via stake members driven into the slope, the relative positional relationship between the reference mark and the first comparison two-dimensional code includes a relative angle between the reference mark and the first comparison two-dimensional code, the relative positional relationship between the reference mark and the second comparison two-dimensional code includes a relative angle between the reference mark and the second comparison two-dimensional code, comparing the first initial positional relationship and the first inspection positional relationship with each other includes calculating a first difference that is a difference between the relative angle between the reference mark and the first comparison two-dimensional code at the initial stage of the slope and the relative angle between the reference mark and the first comparison two-dimensional code at the time of inspection of the slope, and comparing the second initial positional relationship and the second inspection positional relationship with each other includes calculating a second difference that is a difference between the relative angle between the reference mark and the second comparison two-dimensional code at the initial stage of the slope and the relative angle between the reference mark and the second comparison two-dimensional code at the time of inspection of the slope, Item 9: A system for detecting signs of collapse on slopes, wherein the processing circuit is configured to determine that the abnormality level is higher when the positive and negative signs of the first difference and the second difference are different from each other than when the positive and negative signs of the first difference and the second difference are the same.

[0092] With this configuration, the abnormality level can be appropriately set taking into consideration the behavior of sloped land when it collapses.

[0093] [Item 11] The comparison two-dimensional code is a first comparison two-dimensional code, a second comparison two-dimensional code is provided on the slope, the initial image is a first initial image, and the inspection image is a first inspection image, the initial positional relationship is a first initial positional relationship, and the inspection positional relationship is a first inspection positional relationship, and the processing circuit: acquires a second initial image captured at the initial stage of the slope so as to include the first comparison two-dimensional code and the second comparison two-dimensional code but not the reference mark; acquires a second inspection image captured at the time of inspection of the slope so as to include the first comparison two-dimensional code and the second comparison two-dimensional code but not the reference mark; calculates a second initial positional relationship indicating a relative positional relationship between the first comparison two-dimensional code and the second comparison two-dimensional code in the second initial image; and stores the code ID information of the second comparison two-dimensional code included in the second initial image and the second initial positional relationship in the database in association with each other. 11. A system for detecting signs of collapse of slopes described in any one of items 1 to 10, which is configured to: calculate a second inspection positional relationship indicating the relative positional relationship between the first comparison two-dimensional code and the second comparison two-dimensional code in the second inspection image; associate code ID information of the second comparison two-dimensional code included in the second inspection image with the second inspection positional relationship and store them in the database; calculate a third initial positional relationship indicating the relative positional relationship between the reference mark and the second comparison two-dimensional code based on the first initial positional relationship and the second initial positional relationship associated with the same code ID information; calculate a third inspection positional relationship indicating the relative positional relationship between the reference mark and the second comparison two-dimensional code based on the first inspection positional relationship and the second inspection positional relationship associated with the same code ID information; and compare the third initial positional relationship and the third inspection positional relationship associated with the same code ID information with each other; and outputting the determination result includes outputting the determination result based on a comparison between the third initial positional relationship and the third inspection positional relationship.

[0094] This configuration eliminates the need to capture the reference mark, first comparison two-dimensional code, and second comparison two-dimensional code all together in a single image, making it possible to perform inspections without using a special camera even when the codes are far apart.

[0095] [Item 12] The first comparison two-dimensional code and the second comparison two-dimensional code are provided on the slope via stake members driven into the slope, the relative positional relationship between the reference mark and the first comparison two-dimensional code includes a relative angle between the reference mark and the first comparison two-dimensional code, the relative positional relationship between the reference mark and the second comparison two-dimensional code includes a relative angle between the reference mark and the second comparison two-dimensional code, comparing the first initial positional relationship and the first inspection positional relationship with each other includes calculating a first difference that is a difference between the relative angle between the reference mark and the first comparison two-dimensional code at the initial stage of the slope and the relative angle between the reference mark and the first comparison two-dimensional code at the time of inspection of the slope, and comparing the third initial positional relationship and the third inspection positional relationship with each other includes calculating a second difference that is a difference between the relative angle between the reference mark and the second comparison two-dimensional code at the initial stage of the slope and the relative angle between the reference mark and the second comparison two-dimensional code at the time of inspection of the slope. Item 12: A system for detecting signs of collapse on slopes, wherein the processing circuit is configured to determine that the abnormality level is higher when the positive and negative signs of the first difference and the second difference are different from each other than when the positive and negative signs of the first difference and the second difference are the same.

[0096] With this configuration, the abnormality level can be appropriately set taking into consideration the behavior of sloped land when it collapses.

[0097] [Item 13] A method for detecting signs of collapse of a slope in land that includes a slope, comprising: acquiring an initial image captured at an initial stage of the slope, the image including a reference mark provided on the land and a comparison two-dimensional code provided on the slope; acquiring an inspection image captured at the time of inspecting the slope, the image including the reference mark and the comparison two-dimensional code; calculating an initial positional relationship indicating the relative positional relationship between the reference mark and the comparison two-dimensional code in the initial image; storing code ID information of the comparison two-dimensional code included in the initial image and the initial positional relationship in association with each other; calculating an inspection positional relationship indicating the relative positional relationship between the reference mark and the comparison two-dimensional code in the inspection image; storing code ID information of the comparison two-dimensional code included in the inspection image and the inspection positional relationship in association with each other; comparing the initial positional relationship and the inspection positional relationship associated with the same code ID information with each other; and outputting a determination result regarding the signs of collapse of the slope based on the comparison between the initial positional relationship and the inspection positional relationship.

[0098] This method detects signs of sloping land collapse by examining the change in the relative position of the comparison two-dimensional code to the reference two-dimensional code between the initial and inspection times. Furthermore, the comparison two-dimensional code also serves as ID information for identifying the paired initial and inspection positions. Therefore, even if the area being monitored is wide, signs of sloping land collapse can be detected at low cost.

[0099] [Item 14] A collapse sign detection program that causes at least one processor to execute the method described in Item 13.

[0100] REFERENCE SIGNS LIST 1 Slope collapse warning detection system 2 Drone 3 Server 4 Database 5 Client terminal 6 Communication network 10 Land 11 Reference site 12 Slope 29 Camera 40 Processing circuit 45 Program C0 Reference two-dimensional code C1 First comparison two-dimensional code C2 Second comparison two-dimensional code C3 Third comparison two-dimensional code M Initial image N Inspection image P0 Reference member P1 First comparison pile member P2 Second comparison pile member P3 Third comparison pile member

Claims

1. A system for detecting signs of collapse of a slope in land including a slope, comprising: a database; and a processing circuit connected to the database, wherein the processing circuit: acquires an initial image captured at the initial stage of the slope, the image including a reference mark provided on the land and a comparison two-dimensional code provided on the slope; acquires an inspection image captured at the time of inspection of the slope, the image including the reference mark and the comparison two-dimensional code; calculates an initial positional relationship indicating a relative positional relationship between the reference mark and the comparison two-dimensional code in the initial image; associates code ID information of the comparison two-dimensional code included in the initial image with the initial positional relationship and stores the initial positional relationship in the database; calculates an inspection positional relationship indicating a relative positional relationship between the reference mark and the comparison two-dimensional code in the inspection image; associates code ID information of the comparison two-dimensional code included in the inspection image with the inspection positional relationship and stores the inspection positional relationship in the database; compares the initial positional relationship and the inspection positional relationship associated with the same code ID information with each other. A slope collapse sign detection system configured to: output a judgment result regarding a sign of collapse of the slope based on a comparison between the initial positional relationship and the inspection positional relationship.

2. A system for detecting signs of collapse of slopes as described in claim 1, wherein the comparison two-dimensional code is provided on the slope via a stake member driven into the slope, and the relative positional relationship between the reference mark and the comparison two-dimensional code includes a relative angle between the reference mark and the comparison two-dimensional code.

3. A system for detecting signs of collapse on sloping land as described in claim 1 or 2, wherein the land further includes a reference land different from the sloping land, and the reference mark is provided on the reference land.

4. A system for detecting signs of collapse on slopes as described in claim 1 or 2, wherein the reference mark includes a reference two-dimensional code which is a two-dimensional code of the same type as the comparison two-dimensional code.

5. A system for detecting signs of collapse of slopes as described in claim 1 or 2, wherein acquiring the initial image and the inspection image includes receiving the initial image and the inspection image uploaded via a communications network.

6. A system for detecting signs of collapse on sloping land as described in claim 5, wherein the database stores client destination information corresponding to client ID information, acquiring the initial image and the inspection image includes acquiring the initial image and the inspection image including the client ID information, storing the initial positional relationship and the inspection positional relationship in the database includes storing the initial positional relationship and the inspection positional relationship in the database in association with the client ID information, and outputting the determination result includes transmitting the determination result to a destination indicated by the client destination information corresponding to the client ID information associated with the compared inspection positional relationship.

7. A system for detecting signs of collapse on slopes as described in claim 1 or 2, wherein comparing the initial positional relationship and the inspection positional relationship with each other includes determining that an abnormality has occurred when the amount of change in the inspection positional relationship relative to the initial positional relationship exceeds a threshold value.

8. A system for detecting signs of collapse of slopes as described in claim 1 or 2, wherein comparing the initial positional relationship and the inspection positional relationship with each other includes using artificial intelligence to analyze changes in the inspection positional relationship relative to the initial positional relationship and determine whether or not there is an abnormality.

9. the comparison two-dimensional code is a first comparison two-dimensional code, a second comparison two-dimensional code is provided on the slope, the initial positional relationship is a first initial positional relationship, and the inspection positional relationship is a first inspection positional relationship, the initial image includes the reference mark, the first comparison two-dimensional code, and the second comparison two-dimensional code, the inspection image includes the reference mark, the first comparison two-dimensional code, and the second comparison two-dimensional code, and the processing circuit: calculates a second initial positional relationship indicating a relative positional relationship between the reference mark and the second comparison two-dimensional code in the initial image; stores in the database, in association with code ID information of the second comparison two-dimensional code included in the initial image, and the second initial positional relationship; calculates a second inspection positional relationship indicating a relative positional relationship between the reference mark and the second comparison two-dimensional code in the inspection image; stores in the database, in association with code ID information of the second comparison two-dimensional code included in the inspection image, and the second inspection positional relationship; 3. A system for detecting signs of collapse on slopes as described in claim 1 or 2, which is configured to compare the second initial positional relationship and the second inspection positional relationship associated with the same code ID information with each other, and outputting the determination result includes outputting the determination result based on a comparison between the second initial positional relationship and the second inspection positional relationship.

10. The first comparison two-dimensional code and the second comparison two-dimensional code are respectively provided on the slope via stake members driven into the slope, the relative positional relationship between the reference mark and the first comparison two-dimensional code includes a relative angle between the reference mark and the first comparison two-dimensional code, the relative positional relationship between the reference mark and the second comparison two-dimensional code includes a relative angle between the reference mark and the second comparison two-dimensional code, comparing the first initial positional relationship and the first inspection positional relationship with each other includes calculating a first difference which is a difference between the relative angle between the reference mark and the first comparison two-dimensional code at the initial time of the slope and the relative angle between the reference mark and the first comparison two-dimensional code at the time of inspection of the slope, and comparing the second initial positional relationship and the second inspection positional relationship with each other includes calculating a second difference which is a difference between the relative angle between the reference mark and the second comparison two-dimensional code at the initial time of the slope and the relative angle between the reference mark and the second comparison two-dimensional code at the time of inspection of the slope, The system for detecting signs of collapse on slopes as described in claim 9, wherein the processing circuit is configured to determine that the abnormality level is higher when the positive and negative signs of the first difference and the second difference are different from each other than when the positive and negative signs of the first difference and the second difference are the same.

11. The comparison two-dimensional code is a first comparison two-dimensional code, a second comparison two-dimensional code is provided on the slope, the initial image is a first initial image, and the inspection image is a first inspection image, the initial positional relationship is a first initial positional relationship, and the inspection positional relationship is a first inspection positional relationship, and the processing circuit: acquires a second initial image captured at the initial stage of the slope so as to include the first comparison two-dimensional code and the second comparison two-dimensional code without including the reference mark; acquires a second inspection image captured at the inspection of the slope so as to include the first comparison two-dimensional code and the second comparison two-dimensional code without including the reference mark; calculates a second initial positional relationship indicating a relative positional relationship between the first comparison two-dimensional code and the second comparison two-dimensional code in the second initial image; and stores in the database in association with code ID information of the second comparison two-dimensional code included in the second initial image and the second initial positional relationship.

3. The system for detecting signs of collapse of sloping ground as described in claim 1 or 2, wherein the system is configured to: calculate a second inspection position relationship indicating the relative positional relationship between the first comparison two-dimensional code and the second comparison two-dimensional code in the second inspection image; associate code ID information of the second comparison two-dimensional code included in the second inspection image with the second inspection position relationship and store them in the database; calculate a third initial position relationship indicating the relative positional relationship between the reference mark and the second comparison two-dimensional code based on the first initial position relationship and the second initial position relationship associated with the same code ID information; calculate a third inspection position relationship indicating the relative positional relationship between the reference mark and the second comparison two-dimensional code based on the first inspection position relationship and the second inspection position relationship associated with the same code ID information; and compare the third initial position relationship and the third inspection position relationship associated with the same code ID information with each other, and wherein outputting the judgment result includes outputting the judgment result based on a comparison between the third initial position relationship and the third inspection position relationship.

12. The first comparison two-dimensional code and the second comparison two-dimensional code are respectively provided on the slope via stake members driven into the slope, the relative positional relationship between the reference mark and the first comparison two-dimensional code includes a relative angle between the reference mark and the first comparison two-dimensional code, the relative positional relationship between the reference mark and the second comparison two-dimensional code includes a relative angle between the reference mark and the second comparison two-dimensional code, comparing the first initial positional relationship and the first inspection positional relationship with each other includes calculating a first difference which is a difference between the relative angle between the reference mark and the first comparison two-dimensional code at the initial time of the slope and the relative angle between the reference mark and the first comparison two-dimensional code at the time of inspection of the slope, and comparing the third initial positional relationship and the third inspection positional relationship with each other includes calculating a second difference which is a difference between the relative angle between the reference mark and the second comparison two-dimensional code at the initial time of the slope and the relative angle between the reference mark and the second comparison two-dimensional code at the time of inspection of the slope, The system for detecting signs of collapse on slopes as described in claim 11, wherein the processing circuit is configured to determine that the abnormality level is higher when the positive and negative signs of the first difference and the second difference are different from each other than when the positive and negative signs of the first difference and the second difference are the same.

13. A method for detecting signs of collapse of a slope in land including a slope, comprising: acquiring an initial image captured at an initial stage of the slope, the image including a reference mark provided on the land and a comparison two-dimensional code provided on the slope; acquiring an inspection image captured at the time of inspection of the slope, the image including the reference mark and the comparison two-dimensional code; calculating an initial positional relationship indicating the relative positional relationship between the reference mark and the comparison two-dimensional code in the initial image; storing code ID information of the comparison two-dimensional code included in the initial image and the initial positional relationship in association with each other; calculating an inspection positional relationship indicating the relative positional relationship between the reference mark and the comparison two-dimensional code in the inspection image; storing code ID information of the comparison two-dimensional code included in the inspection image and the inspection positional relationship in association with each other; comparing the initial positional relationship and the inspection positional relationship associated with the same code ID information with each other; and outputting a judgment result regarding the signs of collapse of the slope based on the comparison between the initial positional relationship and the inspection positional relationship.

14. A program for detecting a sign of collapse, which causes at least one processor to execute the method according to claim 13.

Citation Information

Patent Citations

  • Geological disaster early warning method based on feature code image pose detection

    CN114663501A

  • Ground surface image monitoring device

    JP2000251059A

  • System and method for measuring amount of relative displacement

    JP2001272228A

  • Remote monitoring device

    JP2003240613A

  • Method and device for continuously monitoring structure displacement

    JP2015197344A