Surveying leveling rod and system

Abstract

The present invention realizes automation of survey work by enabling the size of a figure drawn on an actual surveying leveling rod targeted for image capture to be identified from an image captured of the surveying leveling rod. Drawn on a surveying leveling rod 11 according to the present invention are a figure indicating three or more points, the positions of which are in a known relationship, and size information indicating the size of the figure. The figure drawn on the surveying leveling rod 11 is a polygon colored in different colors, and indicates intersection points of boundary lines between two adjacent regions colored in different colors. The positional relationship between the intersections is known. Since the size information pertaining to the figure drawn on the surveying leveling rod 11 appears in the image captured of the surveying leveling rod 11, the size of the figure drawn on the actual surveying leveling rod 11 that appears in the image can be identified from the image.

Description

Surveying Scale and System

[0001] The present invention relates to the technology of photogrammetry.

[0002] There is a photogrammetry technique in which two surveying scales (hereinafter referred to as a "pair of surveying scales") that are paired are arranged side by side on the surface of the object to be measured, and the positional relationship between different points on the surface of the object to be measured is measured based on an image taken by a photographing device so that the pair of surveying scales is within the field of view. As a patent document describing such a technique, for example, there is Patent Document 1.

[0003] Japanese Unexamined Patent Application Publication No. 2011-123008

[0004] From the image of the surveying scale described in Patent Document 1, the size of the figure drawn on the actual surveying scale that has been photographed cannot be specified, so the automation of the surveying work cannot be realized.

[0005] An object of the present invention is to realize the automation of surveying work by making it possible to specify the size of the figure drawn on the actual surveying scale from the image of the surveying scale.

[0006] In order to solve the above-described problems, the present invention provides a surveying scale on which a figure showing three or more points with known positional relationships and size information indicating the size of the figure are drawn.

[0007] Further, the present invention provides a surveying scale on which a figure showing three or more points with known positional relationships and figure identification information for identifying the figure from other different figures are drawn.

[0008] Further, the present invention stores size information indicating the size of each of a plurality of figures having at least different sizes in association with figure identification information for identifying the figure from other figures, acquires an image of the surveying scale according to claim 2, reads the figure identification information from the acquired image, and provides a system that reads the size information corresponding to the figure identification information read from the image from among the plurality of stored size information.

[0009] Furthermore, the present invention provides a surveying rod on which a surveying figure, which is a figure indicating three or more points whose positional relationship is known, is drawn, and which has a rod identification information drawn on it that identifies itself from other surveying rods, and for each of a plurality of surveying rods, size information indicating the size of the surveying figure drawn on the surveying rod is stored in association with the rod identification information that identifies the surveying rod from other surveying rods, an image of the surveying rod is taken, the rod identification information is read from the acquired image, and the size information corresponding to the rod identification information read from the image is read from the plurality of stored size information.

[0010] According to the present invention, the size of the figure drawn on the actual surveying rod can be determined from an image of the surveying rod that has been photographed.

[0011] A diagram showing the configuration of a surveying system according to one embodiment. A diagram showing a pair of surveying rods according to one embodiment. A diagram showing a group of straight lines forming the outer edges of multiple squares that constitute the staggered pattern of the surveying rods according to one embodiment. A diagram showing the configuration of a terminal device according to one embodiment. A diagram showing the configuration of a server device according to one embodiment. A diagram showing the screen for capturing images displayed by the terminal device according to one embodiment. A flowchart of the processing performed by the processor of the terminal device according to one embodiment. A diagram for explaining the intersection identification and recognition process performed by the terminal device according to one embodiment. A diagram for explaining the intersection identification and recognition process performed by the terminal device according to one embodiment. A diagram for explaining the intersection identification and recognition process performed by the terminal device according to one embodiment. A diagram for explaining the intersection identification and recognition process performed by the terminal device according to one embodiment. A diagram for explaining the intersection identification and recognition process performed by the terminal device according to one embodiment. A diagram for explaining the intersection identification and recognition process performed by the terminal device according to one embodiment. A diagram showing the configuration of a data table stored by the server device according to one embodiment. A diagram illustrating lines forming the intersections of a surveying rod according to one modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the lines forming the intersection of a surveying rod in a modified example. A diagram illustrating the advantages of a surveying rod in a modified example. A diagram illustrating the advantages of a surveying rod in a modified example. A diagram illustrating a pair of surveying rods according to one modified example. A diagram illustrating a pair of surveying rods according to one modified example. A diagram illustrating a pair of surveying rods according to one modified example. A diagram illustrating a pair of surveying rods according to one modified example. A diagram illustrating a surveying rod according to one modified example.A diagram illustrating a measuring rod related to one modified example. A diagram illustrating a measuring rod related to one modified example. A diagram showing the configuration of the data table stored by the server device related to one modified example. A diagram showing the configuration of the data table stored by the server device related to one modified example. A diagram illustrating a measuring rod related to one modified example. A diagram illustrating a measuring rod related to one modified example. A diagram illustrating a measuring rod related to one modified example. A diagram illustrating a measuring rod related to one modified example. A diagram illustrating a measuring rod related to one modified example. A diagram illustrating a measuring rod related to one modified example. A diagram illustrating a measuring rod related to one modified example.

[0012] A surveying system 1 according to one embodiment of the present invention is described below. Figure 1 is a diagram showing the configuration of the surveying system 1. The surveying system 1 is a system that uses photogrammetry to determine the positional relationship of different points on the surface of an object 9 to be surveyed.

[0013] The surveying system 1 comprises a surveying rod 11S (an example of a first surveying rod) and a surveying rod 11T (an example of a second surveying rod) fixedly placed on the surface of the object to be surveyed 9 by adhesive or the like, a terminal device 12 used by the user, and a server device 13 that communicates with the terminal device 12.

[0014] In the example shown in Figure 1, a crack 91 has formed in the object to be surveyed 9, and a surveying rod 11S and a surveying rod 11T are positioned on either side of the crack 91. The surveying system 1 uses an image taken with both the surveying rod 11S and the surveying rod 11T within its field of view to measure the positional relationship between the reference point on the surveying rod 11S and the survey point on the surveying rod 11T.

[0015] Figure 2 shows a surveying rod 11S and a surveying rod 11T. The surveying rod 11S is the reference surveying rod, and the surveying rod 11T is the surveying rod being surveyed. The surveying rods 11S and 11T constitute a surveying rod pair 10. Hereafter, when the surveying rods 11S and 11T are not distinguished from each other, they will be referred to as the surveying rod 11.

[0016] The surveying rod 11 comprises a plate-shaped or sheet-shaped medium and an image formed on the surface of the medium by printing, laser engraving, or the like.

[0017] The image of the surveying rod 11 contains a staggered pattern of the same shape and size. The image of the surveying rod 11T contains a QR code (registered trademark). Alternatively, the image of the surveying rod 11S may contain a QR code (registered trademark) instead of the image of the surveying rod 11T. This QR code (registered trademark) is a mark that identifies one surveying rod from other similar surveying rods. That is, decoding this QR code (registered trademark) yields identification information that distinguishes the surveying rod 11T containing that QR code (registered trademark) from other surveying rods 11T.

[0018] Figure 3 shows the group of straight lines that form the outer edges of the multiple squares that make up the staggered pattern drawn on the surveying rod 11. In other words, the group of straight lines shown in Figure 3 is the group of straight lines drawn by the staggered pattern on the surveying rod 11.

[0019] The group of straight lines drawn by the staggered pattern of the surveying rod 11 includes line segments L1 to L4, which are four line segments arranged parallel to each other at intervals of distance D, and line segments M1 to M4, which are four line segments perpendicular to line segments L1 to L4 and arranged parallel to each other at intervals of distance D.

[0020] The lengths of line segments L1 and M1 are three times the distance D. Line segments L1 and M1 are positioned such that one of their endpoints coincides at the intersection point P(1,1).

[0021] The lengths of line segments L2 and M2 are three times the distance D. One endpoint of line segment L2 coincides with the intersection point P(2,1), which is a distance D from the intersection point P(1,1) on line segment M1, and it is positioned to extend in the same direction as line segment L1 extends from intersection point P(1,1). One endpoint of line segment M2 coincides with the intersection point P(1,2), which is a distance D from the intersection point P(1,1) on line segment L1, and it is positioned to extend in the same direction as line segment M1 extends from intersection point P(1,1).

[0022] The lengths of line segments L3 and M3 are twice the distance D. One endpoint of line segment L3 coincides with the intersection point P(3,1), which is twice the distance D from the intersection point P(1,1) on line segment M1, and it is positioned to extend in the same direction as line segment L1 extends from intersection point P(1,1). One endpoint of line segment M3 coincides with the intersection point P(1,3), which is twice the distance D from the intersection point P(1,1) on line segment L1, and it is positioned to extend in the same direction as line segment M1 extends from intersection point P(1,1).

[0023] The lengths of line segments L4 and M4 are distance D. One endpoint of line segment L4 coincides with the intersection point P(4,1) (i.e., the other endpoint of line segment M1), which is three times the distance D from the intersection point P(1,1) on line segment M1, and is positioned to extend in the same direction as line segment L1 extends from the intersection point P(1,1). One endpoint of line segment M4 coincides with the intersection point P(1,4) (i.e., the other endpoint of line segment L1), which is three times the distance D from the intersection point P(1,1) on line segment L1, and is positioned to extend in the same direction as line segment M1 extends from the intersection point P(1,1).

[0024] As shown above, there are a total of 13 intersection points P, which are the points where each of the line segments L1 to L4 intersects with each of the line segments M1 to M4. As shown in Figure 3, the intersection point of line segment Li (where i is one of the natural numbers from 1 to 4) and line segment Mj (where j is one of the natural numbers from 1 to 4) is represented as intersection point P(i,j).

[0025] As described above, the positional relationship of the 13 intersection points P is known. Furthermore, the positional relationship of the 13 intersection points P is not rotationally symmetric.

[0026] When the surveying rods 11S and 11T are superimposed such that the intersection point P of 13 points on the surveying rod 11S and the intersection point P of 13 points on the surveying rod 11T overlap, the parts of the image of the surveying rod 11S that depict line segments L1 to L4 and line segments M1 to M4 are different in color from the parts of the image of the surveying rod 11T that overlap with those parts and depict line segments L1 to L4 and line segments M1 to M4. For example, line segment L1 of the surveying rod 11 is depicted as the sides of the following three squares.

[0027] First square: A square with vertices at intersections P(1,1), P(1,2), P(2,2), and P(2,1). Second square: A square with vertices at intersections P(1,2), P(1,3), P(2,3), and P(2,2). Third square: A square with vertices at intersections P(1,3), P(1,4), P(2,4), and P(2,3).

[0028] Furthermore, the color of the first square of the surveying rod 11S (for example, white) is different from the color of the first square of the surveying rod 11T (for example, black). Also, the color of the second square of the surveying rod 11S (for example, black) is different from the color of the second square of the surveying rod 11T (for example, white). Furthermore, the color of the third square of the surveying rod 11S (for example, white) is different from the color of the third square of the surveying rod 11T (for example, black).

[0029] In this application, "different colors" means that at least one of the hue, lightness, and saturation of the colors is different.

[0030] The intersection point P(1,1) of the surveying rod 11S will be the reference point. Also, the intersection point P(1,1) of the surveying rod 11T will be the survey point.

[0031] The coordinate system C is determined by three or more intersection points P of the surveying rod 11S. The coordinate system C is as follows:

[0032] Origin: Intersection P(1,1) of the leveling rod 11S. X-axis positive direction: Direction from intersection P(1,4) to intersection P(4,1) of the leveling rod 11S. Y-axis positive direction: Direction from intersection P(2,2) to intersection P(1,1) of the leveling rod 11S.

[0033] The coordinate system E is determined by three or more intersection points P of the surveying rod 11T. The coordinate system E is as follows:

[0034] Origin: Intersection point P(1,1) of the leveling rod 11T. X-axis positive direction: Direction from intersection point P(1,4) to intersection point P(4,1) of the leveling rod 11T. Y-axis positive direction: Direction from intersection point P(2,2) to intersection point P(1,1) of the leveling rod 11T.

[0035] Figure 4 shows the configuration of the terminal device 12. The terminal device 12 is a computer that includes a memory 121 for storing various data and a processor 122 for performing various data processing according to a program continuously stored in the memory 121. The type of computer for the terminal device 12 is not limited, but it is desirable that it be a small and lightweight computer that can be easily carried by the user.

[0036] Furthermore, the terminal device 12 includes a camera 123 (an example of a shooting device) that generates video and still images by shooting, a touchscreen 124 having a stacked display (an example of a display device) and a touch panel, and a communication interface 125 which is an interface for communication with the server device 13.

[0037] The terminal device 12 may also be equipped with a display and an input device that accepts user input, such as a mouse, instead of the touchscreen 124. Furthermore, at least one of the camera 123, the touchscreen 124 (or a substitute thereof), and the communication interface 125 may be connected to the terminal device 12 as an external device, rather than being built into the terminal device 12.

[0038] In the following description, terminal device 12 is assumed, for example, to be a smartphone capable of communication and calls via a mobile communication network using a communication interface 125.

[0039] Figure 5 shows the configuration of the server device 13. The server device 13 is a computer that includes a memory 131 for storing various data, a processor 132 for performing various data processing according to a program continuously stored in the memory 131, and a communication interface 133 for communication with the terminal device 12.

[0040] The user uses the camera 123 of the terminal device 12 to photograph the pair of measuring rods 10 on the object under survey 9 in order to measure the positional relationship between the reference point and the survey point of the object under survey 9.

[0041] Figure 6 shows the screen displayed by the terminal device 12 when the user photographs the pair of measuring rods 10 on the object to be measured 9 (hereinafter referred to as the "photography screen").

[0042] The imaging screen includes an area R1 which is an area for displaying the video captured by the camera 123 in real time and for displaying the guiding display object G, a display object R2 for displaying the similarity (hereinafter referred to as "similarity S") indicating the degree of coincidence between the image of the surveying scale 11S displayed in the area R1 and the guiding display object G, a button R3 which is a virtual button that the user touches to instruct the camera 123 to capture a still image, and an area R4 which is an area for displaying a message prompting the user to touch the button R3 when the user should be in a state of touching the button R3.

[0043] While displaying the imaging screen on the touch screen 124 according to the program stored in the memory 121, the processor 122 of the terminal device 12 performs the following processing.

[0044] A process of causing the camera 123 to capture a video and acquiring the video generated by the camera 123 by the capture. A process of displaying the video acquired from the camera 123 in real time in the area R1 of the imaging screen on the touch screen 124. A process of causing the guiding display object G to be overlaid and displayed on the video acquired from the camera 123 in the area R1 of the imaging screen on the touch screen 124. A process of continuously calculating the similarity S indicating the degree of coincidence between the image of the surveying scale 11S displayed in the area R1 of the imaging screen and the guiding display object G. A process of causing the display object R2 representing the continuously updated similarity S to be displayed on the touch screen 124. A process of causing a message (for example, "Please press the shutter.") prompting the user to perform a touch operation on the button R3 to be displayed in the area R4 of the imaging screen on the touch screen 124 when the similarity S satisfies a predetermined condition (hereinafter referred to as "condition Q").

[0045] The guiding display object G is a display object for guiding the position and size of the image of the surveying scale 11S displayed in the area R1 of the imaging screen. The guiding display object G illustrated in FIG. 6 represents the positions where the line segments L1 to L4 and the line segments M1 to M4 of the image of the surveying scale 11S should be captured. However, the form of the guiding display object G may be variously changed as long as it guides the position and size of the image of the surveying scale 11S displayed in the area R1 of the imaging screen.

[0046] To calculate the similarity S, the processor 122 first recognizes the image of the survey scale 11S from the image displayed in the area R1 by using a known image recognition method.

[0047] Subsequently, the processor 122 calculates the similarity S between the recognized image of the survey scale 11S and the guidance display G.

[0048] As an example, the processor 122 calculates the degree of coincidence between the positions of 13 intersection points P (an example of feature points) specified from the image of the survey scale 11S and the intersection points P (an example of feature points) of the guidance display G as the similarity S. More specifically, for example, the processor 122 associates the 13 intersection points P specified from the image of the survey scale 11S with the intersection points P of the guidance display G, specifies 13 pairs of intersection points, calculates the distance between the two intersection points P for each of the 13 pairs of intersection points, and calculates a value obtained by subtracting the sum of those distances from a constant as the similarity S. Note that the method for calculating the similarity S is not limited to this, and any method may be adopted as long as it calculates an index value indicating the degree of coincidence between the positions of the feature points extracted from the image of the survey scale 11S and the positions of the feature points of the guidance display G corresponding to those feature points as the similarity S.

[0049] The condition Q is, for example, a condition that is satisfied if the similarity S is equal to or greater than a predetermined threshold value T. When the processor 122 continuously calculates the similarity S, it continuously determines whether the similarity S satisfies the condition Q. While the similarity S does not satisfy the condition Q, a message such as "Please align the image with the guide." is displayed on the touch screen 124 in the area R4, and while the similarity S satisfies the condition Q, a message such as "Please press the shutter." is displayed.

[0050] Note that while the similarity S does not satisfy the condition Q, the processor 122 may make the touch screen 124 in a state where it does not accept a touch operation by the user on the button R3 (non-active state), and while the similarity S satisfies the condition Q, the touch screen 124 may be made in a state where it accepts a touch operation by the user on the button R3 (active state).

[0051] The user adjusts the orientation of the terminal device 12 and the distance between the terminal device 12 and the object to be measured 9, while referring to the display object R2, so that the image of the surveying rod 11S displayed in area R1 matches the guidance display object G as closely as possible. In response to this adjustment, the similarity S displayed by the display object R2 changes, and when the similarity S exceeds the threshold T, a message such as "Please take a picture." is displayed in area R4. In response to this message, the user touches button R3.

[0052] In response to a user touching button R3, the processor 122 instructs the camera 123 to take a still image. The camera 123 takes a still image in response to the instruction and outputs the captured still image (hereinafter referred to as "still image I") to the processor 122. The processor 122 acquires the still image I output from the camera 123 and stores the still image I, along with the time it was acquired, in the memory 121.

[0053] Next, the processor 122 uses the still image I to perform processing according to the flowchart shown in Figure 7.

[0054] The processor 122 decodes the QR code (registered trademark) contained in the still image I and obtains identification information for the surveying rod 11T (step S1).

[0055] Next, the processor 122 identifies and distinguishes a total of 26 intersection points P indicated by the images of the surveying rods 11S and 11T included in the still image I (step S2).

[0056] Figures 8A to 8G are diagrams illustrating the processing performed by the processor 122 in step S2.

[0057] Figure 8A shows a still image I. The processor 122 detects multiple intersection points P from the checkerboard pattern contained in the images of the surveying rod 11S and surveying rod 11T included in the still image I, using a known corner detection method. Figure 8B shows the multiple intersection points P thus detected. In Figure 8B, the intersection points P are represented as the center point of the X mark (the intersection point of the two line segments that make up X).

[0058] Next, the processor 122 identifies the two furthest apart points from the multiple intersection points P detected as intersection point A1 and intersection point A2. Figure 8C shows intersection points A1 and A2 as identified in this way.

[0059] Next, the processor 122 identifies the two points closest to intersection A1 as intersection B1 and intersection C1, and confirms that the lengths of line segments A1B1 and A1C1 are equal and that the angle B1A1C1 is 90 degrees. This confirmation is performed because points that are not intersection P may be mistakenly included in the points detected from the still image I, and the processor 122 excludes any points that do not satisfy the above conditions from intersection P. This process will be referred to below as the "identification process of adjacent intersections".

[0060] The processor 122 also performs the process of identifying adjacent intersections with respect to intersection A2, and identifies intersections B2 and C2 that are adjacent to intersection A2.

[0061] Figure 8D shows the intersections A1-C1 and A2-C2 identified as described above.

[0062] The processor 122 repeats the process of identifying adjacent intersections for each of the newly identified adjacent intersections (for example, intersections B1, C1, B2, and C2 mentioned above) until it identifies 13 intersections starting from intersection A1 (including intersection A1) and 13 intersections starting from intersection A2 (including intersection A2).

[0063] Figure 8E shows the newly identified intersection D1 adjacent to intersection B1, intersections E1 and F1 adjacent to intersection C1, intersection D2 adjacent to intersection B2, and intersections E2 and F2 adjacent to intersection C2.

[0064] Figure 8F shows the state in which 13 intersections (including intersection A1) starting from intersection A1 and 13 intersections (including intersection A2) starting from intersection A2 have been identified. The 13 intersections (including intersection A1) starting from intersection A1 are the intersection point P group of the surveying rod 11S. The 13 intersections (including intersection A2) starting from intersection A2 are the intersection point P group of the surveying rod 11T.

[0065] The processor 122 identifies the pair with the smallest distance between two intersection points P, one arbitrarily selected from the group of intersection points P of the surveying rod 11S and the other arbitrarily selected from the group of intersection points P of the surveying rod 11T, as intersection point P(1,1). As previously described, the intersection point P(1,1) identified from the group of intersection points P of the surveying rod 11S is the reference point, and the intersection point P(1,1) identified from the group of intersection points P of the surveying rod 11T is the survey point. Figure 8G shows the state in which the reference point and the survey point have been identified.

[0066] Next, the processor 122 identifies each of the other 12 intersection points P based on the positional relationship with respect to intersection point P(1,1) for each of the intersection point P groups of the surveying rod 11S and the surveying rod 11T. That is, the processor 122 identifies which intersection point P is intersection point P(1,2), intersection point P(2,1), etc.

[0067] The above describes the processing performed by the processor 122 in step S2 of Figure 7. The processing in step S2 described above is just one example of the processing performed by the processor 122 for identifying and distinguishing intersections P, and the processor 122 may identify and distinguish intersections P by different processing. For example, the processor 122 may perform grouping of the multiple intersections P detected from the checkerboard pattern and identification of each intersection P in each group by matching a reference image representing the positional relationship of the 13 intersections P with a comparison image representing the positional relationship of multiple intersections P detected from the checkerboard pattern contained in the images of the surveying rod 11S and surveying rod 11T contained in the still image I.

[0068] Following the processing in step S2, the processor 122 converts the image in which the 26 intersection points P are drawn into an orthogonal projection image using a known orthogonal projection transformation method so that the 26 intersection points P are the intersection points of line segments that are correctly orthogonal to each other (step S3).

[0069] Next, the processor 122 identifies coordinate system C based on the positions of the intersection points P of the surveying rod 11S included in the orthographic projection image obtained by the transformation in step S3, and identifies coordinate system E based on the positions of the intersection points P of the surveying rod 11T included in the orthographic projection image obtained by the transformation in step S3 (step S4).

[0070] Next, the processor 122 identifies the coordinates in coordinate system C of the intersection point P(1,1) of the surveying rod 11T included in the orthographic projection image obtained by the transformation in step S3, i.e., the survey point (step S5). The coordinates of the survey point in coordinate system C, with the reference point as the origin, indicate the positional relationship between the reference point and the survey point (for example, the distance between the reference point and the survey point, and the direction of the survey point as seen from the reference point).

[0071] Next, the processor 122 determines the angle between the X-axis direction of coordinate system C and the X-axis direction of coordinate system E (synonymous with the angle between the Y-axis direction of coordinate system C and the Y-axis direction of coordinate system E) (hereinafter referred to as the "angle between coordinate systems") (step S6). The angle between coordinate systems indicates the positional relationship between coordinate system C and coordinate system E in the direction of rotation (for example, how much the X-axis (or Y-axis) of coordinate system E rotates around its origin (survey point) in coordinate system C).

[0072] Next, the processor 122 stores in memory 121 the time at which the still image I was acquired from camera 123, the identification information of the surveying rod 11T acquired from the QR code (registered trademark) in step S1, the coordinates of the survey point in coordinate system C identified in step S5, and the angle between coordinate systems identified in step S6, and also controls the communication interface 125 to transmit this information to the server device 13 (step S7).

[0073] The above is a description of the processing performed by the processor 122 of the terminal device 12 according to the flow chart in Figure 7.

[0074] When the server device 13 receives the acquisition time of the still image I, the identification information of the surveying rod 11T, the coordinates of the survey point, and the angle between coordinate systems transmitted from the terminal device 12, it stores that information.

[0075] When a user takes a photograph of the object to be measured 9 with the camera 123 of the terminal device 12, which has a shooting screen displayed on the touchscreen 124, so that the pair of measuring rods 10 are in the field of view, the identification information of the measuring rod 11T, the coordinates of the measurement point, and the angle between the coordinate systems, which are identified from the still image I obtained by the photograph, are transmitted from the terminal device 12 to the server device 13 along with the time the still image I was taken, and are stored in the server device 13.

[0076] Figure 9 shows the configuration of a data table (hereinafter referred to as the "survey result table") in which the server device 13 stores information received from the terminal device 12. The server device 13 stores, for example, a different survey result table for each identification information of the surveying rod 11T, and each of these survey result tables has a data field "time" that stores the time received from the terminal device 12, a data field "coordinates of the survey point" that stores the coordinates of the survey point received from the terminal device 12, and a data field "angle between coordinate systems" that stores the angle between coordinate systems received from the terminal device 12. The data records included in the survey result table are, for example, arranged in chronological order from oldest to newest.

[0077] The coordinates of the survey point stored in the first data record (the oldest time) in the survey results table indicate the initial positional relationship between the control point and the survey point. Furthermore, the angle between coordinate systems stored in the first data record (the oldest time) in the survey results table indicates the initial positional relationship between coordinate system C and coordinate system E in the direction of rotation.

[0078] Furthermore, the coordinates of the survey points stored in the second row and subsequent rows of the data records included in the survey results table are compared with the coordinates of the survey points stored in the first data record to show the change in the position of the survey points relative to the reference point over time. In addition, the angles between coordinate systems stored in the second row and subsequent rows of the data records included in the survey results table are compared with the angles between coordinate systems stored in the first data record to show the change in the rotation angle around the origin of coordinate system E relative to coordinate system C over time. Therefore, the user of the survey system 1 can, for example, know the speed and direction of expansion of cracks 91 in the object being surveyed 9 based on the information stored in the survey results table.

[0079] The surveying rod 11 has the following advantages compared to the surveying rod (target) used in the prior art described in Patent Document 1 (hereinafter simply referred to as "prior art").

[0080] (1) Conventional surveying rods indicate the positions of reference points, survey points, etc., using circular marks, which requires a process to identify the center point of the marks, and this process increases the surveying error. On the other hand, the surveying rod 11 used in surveying system 1 indicates the positions of reference points, survey points, etc., using line intersections, so the process of identifying the center point of the marks as in conventional technology is unnecessary, and higher accuracy surveying results can be obtained compared to when using conventional surveying rods.

[0081] (2) Conventional surveying rods indicate the positions of reference points, survey points, etc., with circular marks. Therefore, when a surveying rod is photographed from an oblique angle, the marks included in the photographed image become ellipses, and the number of parameters that must be identified from the image to determine its center point increases compared to the case of a circle. As a result, when using conventional surveying rods, the direction in which the surveying rod is photographed greatly affects the accuracy of the survey results. On the other hand, the surveying rod 11 used in surveying system 1 indicates the positions of reference points, survey points, etc., with line intersections. Therefore, compared to when using conventional surveying rods, the direction in which the surveying rod 11 is photographed has less influence on the accuracy of the survey results.

[0082] (3) Conventional surveying rods indicate the positions of reference points, survey points, etc., with circular marks. If dirt adheres to the surveying rod or dust adheres to the lens of the camera 123, etc., and dot-like noise images appear in the image of the surveying rod, these noise images may be mistaken for marks, making it easy to incorrectly identify the positions of reference points, survey points, etc. On the other hand, the surveying rod 11 used in the surveying system 1 indicates the positions of reference points, survey points, etc., with line intersections. Therefore, even if dot-like noise images appear in the image of the surveying rod 11, the positions of reference points, survey points, etc., will not be incorrectly identified by these noise images.

[0083] Furthermore, since the aforementioned terminal device 12 displays an image in which the guidance display object G is overlaid on the image captured by the camera 123, the user can adjust the orientation of the terminal device 12 and the distance between the terminal device 12 and the object to be measured 9 so that the image of the surveying rod 11 matches the guidance display object G as closely as possible, thereby enabling the capture of images that yield highly accurate survey results.

[0084] This is because the position and size of the image of the surveying rod 11 captured by camera 123 coincide with the position and size of the guide sign G, which means that camera 123 is photographing the surveying rod 11 from the front, that is, the direction of the camera 123's shooting direction and the direction of the normal of the surveying rod 11 coincide, thus minimizing errors in the conversion process to an orthographic projection image (step S3 in Figure 7).

[0085] Furthermore, the state in which the position and size of the image of the surveying rod 11 captured by camera 123 coincide with the position and size of the guide sign G is because the surveying rod 11 is captured in the central area of ​​camera 123's field of view where distortion is minimal. Therefore, by using the image captured in this state for surveying, the impact of image distortion on the accuracy of the surveying results is suppressed.

[0086] Furthermore, according to the terminal device 12 described above, the user is notified of the similarity S between the image of the surveying rod 11 captured by the camera 123 and the guide display object G. When the similarity S is sufficiently high, a message prompting the user to operate the shutter is displayed. As a result, the user can easily capture images that yield sufficiently high-precision survey results by operating the shutter in response to these notifications or messages.

[0087] [Modifications] The embodiments described above can be modified in various ways within the scope of the technical idea of ​​the present invention. Examples of such modifications are shown below. Two or more of the exemplary modifications shown below may be combined and adopted.

[0088] [Modified versions of the surveying rod] The following shows modified versions of the surveying rod 11. Figures 10A to 10D illustrate the lines forming the intersection point P of the surveying rod 11 according to the following modified versions (1) to (4).

[0089] (1) The lines forming the intersection point P of the surveying rod 11 described above are the boundaries of adjacent areas painted in different colors. The boundaries of adjacent areas painted in different colors have no width. If lines with width are used, it is necessary to determine the center of the line, and errors occur in that process. On the other hand, with the surveying rod 11 described above, such errors do not occur.

[0090] However, if the above-mentioned error caused by the wide lines is within an acceptable range, the image of the surveying rod 11 may include wide lines instead of the checkerboard pattern. Figure 10A is a diagram illustrating the lines forming the intersection point P of the surveying rod 11 according to this modified example. (2) The lines forming the intersection point P of the surveying rod 11 described above include a first group of straight lines (for example, line segments L1 to L4) arranged parallel to each other, and a second group of straight lines (for example, line segments M1 to M4) arranged parallel to each other and perpendicular to those groups of straight lines. When the first group of straight lines and the second group of straight lines are perpendicular to each other, the angle verification process included in the adjacent intersection point identification process performed in step S2 of Figure 7 is easier compared to the case when they are not perpendicular to each other.

[0091] However, if it is acceptable for the angle verification process to be somewhat complex, the first group of lines and the second group of lines do not have to be orthogonal. Figure 10B is an example of the checkerboard pattern of the surveying rod 11 according to this modified example.

[0092] (3) The group of lines forming the intersection points P of the surveying rod 11 described above is non-rotationally symmetric. Therefore, regardless of the direction in which the surveying rod 11 is positioned on the object to be surveyed 9, each of the intersection points P of the control points, survey points, etc., can be uniquely identified.

[0093] However, if the leveling rods 11S and 11T are positioned in an appropriate positional relationship with respect to the object 9 being surveyed, then each of the intersection points P, such as the control point and the survey point, can be identified from their positional relationship. Therefore, the group of lines forming the intersection points P of the leveling rods 11 may be rotationally symmetric. Figure 10C is an example of a checkerboard pattern of the leveling rods 11 according to this modified example.

[0094] (4) The lines forming the intersection points P of the surveying rod 11 can be any lines, as long as they are three or more lines drawn on a plane that form three or more intersection points P whose relative positions are known to each other. Figure 10D is a diagram illustrating the lines forming the intersection points P of the surveying rod 11 according to this modified example.

[0095] (5) In the surveying rod pair 10 described above, a QR code (registered trademark) indicating identification information is drawn on the surveying rod 11T, but instead of the surveying rod 11T, the QR code (registered trademark) may be drawn on the surveying rod 11S.

[0096] (6) The surveying rod 11T described above has a QR code (registered trademark) drawn on it as a mark to distinguish it from other surveying rods 11T. However, the form of the mark to distinguish the surveying rod 11T from other surveying rods 11T is not limited to a QR code (registered trademark). An image representing a code such as a two-dimensional barcode or a one-dimensional barcode may be drawn on the surveying rod 11T in place of a QR code (registered trademark). In addition, a sequence of letters, numbers, symbols, etc. may be drawn on the surveying rod 11T in place of a QR code (registered trademark).

[0097] (7) The surveying rod 11T described above is marked with a QR code (registered trademark) as a mark to distinguish it from other surveying rods 11T. This mark makes it easy to distinguish the object 9 on which the surveying rod 11T is placed from other objects 9.

[0098] However, if the object to be measured 9 can be identified by other means, it is not necessary to have a mark on the surveying rod 11T that distinguishes it from other surveying rods 11T.

[0099] (8) The surveying rod 11 described above comprises a plate-shaped or sheet-shaped medium and an image formed on the medium. Alternatively, the surveying rod 11 may not have a medium and may instead have an image formed on the object being surveyed. For example, an object being surveyed may be realized by directly forming an image including a checkerboard pattern or a QR code (registered trademark) on the object being surveyed by printing, laser engraving, etc.

[0100] (9) The checkerboard pattern of the surveying rod 11S and the checkerboard pattern of the surveying rod 11T are painted in different colors in areas corresponding to each other. Therefore, the user or device can easily distinguish between the surveying rod 11S and the surveying rod 11T in the two surveying rods 11 included in the surveying rod pair 10 based on their colors.

[0101] However, if the surveying rods 11S and 11T can be distinguished by means other than color, then the surveying rods 11S and 11T do not need to be distinguished by color.

[0102] (10) The figure drawn on the measuring rod 11 (see Figure 3) according to the above embodiment has the following characteristics: (Characteristic 1) It comprises a first line segment (line segment L1) and a second line segment (line segment M1) that have the same starting point. (Characteristic 2) It comprises one or more polygons (polygons exemplified by six squares such as squares P(1,1), P(1,2), P(2,2), P(2,1), etc.) that are placed on the interior angle side of the first line segment (line segment L1) and the second line segment (line segment M1). (Characteristic 3) The length of the entire figure in the direction of the angle bisector of the angle formed by the first line segment and the second line segment (the length exemplified by the length of line segment P(1,1), P(3,3)) is shorter than the length between the endpoints of the first line segment and the second line segment (the length exemplified by the length of line segment P(1,4), P(4,1)).

[0103] A surveying rod with a figure drawn on it possessing the above characteristics offers the following advantages: Because it has three or more points drawn on it, it can be used to measure the positional relationship between two adjacent areas of an object being surveyed. Since the common starting point of the first and second line segments drawn on it is always located at the tip of the convex part of the outer edge of the entire figure, by using that point as the reference point of one surveying rod and the survey point of the other surveying rod in a pair of surveying rods, the distance between the reference point and the survey point can be shortened, and as a result, the accuracy of the survey can be improved. Because the entire figure drawn on it has an elongated shape in which the length in the direction of the angle bisector formed by the first and second line segments is short, it can also be used to survey objects with a narrow width.

[0104] While possessing the above-described features 1 to 3, a surveying rod with a different figure drawn on it may be used, compared to the surveying rod 11 according to the embodiment described above (see Figure 3). Examples of figures drawn on such modified surveying rods 11 are shown in Figures 11A to 11I.

[0105] The figure illustrated in Figure 11A has fewer first line segments (line segment L1) and line segments parallel to the first line segment, and fewer second line segments (line segment M1) and line segments parallel to the second line segment, compared to the figure in Figure 3. Furthermore, the figure illustrated in Figure 11B has more first line segments (line segment L1) and line segments parallel to the first line segment, and more second line segments (line segment M1) and line segments parallel to the second line segment, compared to the figure in Figure 3.

[0106] In the figure illustrated in Figure 11C, the number of line segments parallel to the first line segment (line segment L1) is different from the number of line segments parallel to the second line segment (line segment M1).

[0107] In the figure shown in Figure 3, the angle between the first line segment (L1) and the second line segment (M1) is 90 degrees. In contrast, in the figure illustrated in Figure 11D, the angle (interior angle) between the first line segment (L1) and the second line segment (M1) is acute. Also, in the figure illustrated in Figure 11E, the angle (interior angle) between the first line segment (L1) and the second line segment (M1) is obtuse.

[0108] In the figure illustrated in Figure 11F, the interval between the first line segment (line segment L1) and two adjacent line segments parallel to the first line segment is different from the interval between the second line segment (line segment M1) and two adjacent line segments parallel to the second line segment.

[0109] In the figure illustrated in Figure 11G, the distance between the first line segment (line segment L1) and two adjacent line segments parallel to the first line segment is not constant. Also, in the figure illustrated in Figure 11G, the distance between the second line segment (line segment M1) and two adjacent line segments parallel to the second line segment is not constant.

[0110] In all the diagrams illustrated in Figures 3 and 11A to 11G, the starting points of all line segments parallel to the first line segment (line segment L1) lie on the second line segment, and the starting points of all line segments parallel to the second line segment (line segment M1) lie on the first line segment. In contrast, the diagram illustrated in Figure 11H includes a line segment LX parallel to the first line segment (line segment L1) whose starting point does not lie on the second line segment (line segment M1).

[0111] The figure illustrated in Figure 11I has a portion where the polygons positioned on the interior angles of the first line segment (line segment L1) and the second line segment (line segment M1) are not touching. Note that, as in the example in Figure 11I, if the endpoint of the first line segment (line segment L1) or the second line segment (line segment M1) is not an intersection with another line segment, that endpoint may be used as a known feature point.

[0112] Figures possessing the above-described features 1 to 3 are figures that, as a whole, fit within a flattened triangular region, as illustrated in Figures 3 and 11. Therefore, compared to figures that do not satisfy features 1 to 3, such as the figure in Figure 10C, the size of the surveying rod 11 on which the figure is drawn (the length in the Y-axis direction in Figure 3, i.e., the length in the direction of the angle bisector of the angle formed by the first and second line segments) can be reduced.

[0113] (11) The surveying rod 11 according to the above embodiment comprises a plate-shaped or sheet-shaped medium and an image formed on the medium, as shown in Figure 2. For example, in the case of the surveying rod 11S shown in Figure 2, the outer edge of the portion of the medium adjacent to the first line segment (line segment L1) is parallel to the first line segment, but the outer edge of the portion adjacent to the second line segment (line segment M1) is not parallel to the second line segment.

[0114] In contrast, the measuring rod 11 may be configured such that the outer edge of the portion adjacent to the first line segment (line segment L1) is parallel to the first line segment, and the outer edge of the portion adjacent to the second line segment (line segment M1) is parallel to the second line segment.

[0115] In this application, "the portion of the outer edge of the medium adjacent to the line segment" means the portion of the outer edge of the medium between the point closest to the starting point of the line segment and the point closest to the ending point of the line segment.

[0116] Figures 12A and 12B are diagrams illustrating the advantages of the measuring rod 11 according to this modified example. Figure 12A shows the pair of measuring rods 10 from Figure 2, positioned on the object to be measured 9 so as to straddle the crack 91. Figure 12B shows the pair of measuring rods 10 according to this modified example, positioned on the object to be measured 9 so as to straddle the crack 91.

[0117] In Figure 12A, the portion p1 of the measuring rod 11S that constitutes the measuring rod pair 10 is not parallel to the second line segment (line segment M1) but protrudes outward. Also, in Figure 12A, the portion p2 of the measuring rod 11T that constitutes the measuring rod pair 10 that constitutes the measuring rod pair 10 is not parallel to the first line segment (line segment L1) but protrudes outward.

[0118] On the other hand, in the surveying rod pair 10 shown in Figure 12B, the portion p1 of the medium of the surveying rod 11S adjacent to the second line segment (line segment M1) is parallel to the second line segment and does not protrude outwards. Also, in the surveying rod pair 10 shown in Figure 12B, the portion p2 of the medium of the surveying rod 11T adjacent to the first line segment (line segment L1) is parallel to the first line segment and does not protrude outwards.

[0119] Therefore, compared to using the pair of surveying rods 10 shown in Figure 12A, using the pair of surveying rods 10 shown in Figure 12B makes it possible to shorten the distance d between the intersection point P(1,1) (reference point) of the surveying rods 11S and the intersection point P(1,1) (survey point) of the surveying rods 11T.

[0120] In surveying using the leveling rod pair 10, the shorter the distance between the reference point and the survey point, the higher the accuracy of the survey. Therefore, the leveling rod pair 10 shown in Figure 12B can be used to perform surveys with higher accuracy than the leveling rod pair 10 shown in Figure 12A.

[0121] (12) In the two surveying rods 11 (surveying rod 11S and surveying rod 11T) that constitute the surveying rod pair 10 according to the above embodiment, as shown in Figure 2, the color schemes for drawing multiple line segments that form multiple intersection points P between the two surveying rods 11 are different.

[0122] As described above, if the two surveying rods 11 that make up the pair of surveying rods 10 have different color schemes for drawing line segments, when simultaneously photographing the two surveying rods 11 with a camera, if you adjust the aperture (F-number), shutter speed, ISO sensitivity, etc. to prevent overexposure or underexposure in the figure of one of the surveying rods 11 in the captured image, it is likely that overexposure or underexposure will occur in the figure of the other surveying rod 11.

[0123] To avoid the above inconveniences, the color scheme for drawing line segments on the two surveying rods 11 that make up the pair of surveying rods 10 may be made identical.

[0124] In this application, "identical color scheme for drawing line segments" means that the combination of background color and other colors is identical.

[0125] If the color scheme for drawing the line segments of the two surveying rods 11 that constitute the pair of surveying rods 10 is the same, then, in order to distinguish each of the two surveying rods 11, a mark that distinguishes the surveying rod 11 from other surveying rods 11 may be drawn on one or both of the mediums, in addition to a plurality of line segments that form a plurality of intersection points P.

[0126] Figures 13A to 13C illustrate a pair of surveying rods 10 in which identification information is printed on one or both of the media in order to distinguish each of the two surveying rods 11 that make up the pair of surveying rods 10, which have the same color scheme.

[0127] The surveying rods 11S and 11T that constitute the pair of surveying rods 10 shown in Figure 13A have roughly the same trapezoidal shape. In both the surveying rod 11S and the surveying rod 11T, multiple line segments forming multiple intersection points P are drawn as boundaries between adjacent and different regions, each painted with a color that differs in at least one of its hue, lightness, and saturation (in this case, white and black).

[0128] Furthermore, the color scheme used to draw multiple line segments forming multiple intersection points P is the same for both the surveying rod 11S and the surveying rod 11T. Therefore, unlike the pair of surveying rods 10 in Figure 2, in the pair of surveying rods 10 in Figure 13A, it is not possible to determine which of the two surveying rods 11 is surveying rod 11S and which is surveying rod 11T based on the color scheme used to draw the line segments.

[0129] Therefore, the medium provided by the surveying rod pair 10 in Figure 13A, consisting of the surveying rods 11S and 11T, has a region b (an example of a second region) adjacent to a region a (an example of a first region) that is colored for drawing line segments. This region b is tangent to region a from the outside in the direction in which the angle bisectors of the interior angles of the first line segment (line segment L1) and the second line segment (line segment M1) extend. As a result, when the surveying rod pair 10 is positioned on the object to be surveyed 9 so that the distance between the reference point of the surveying rod 11S and the survey point of the surveying rod 11T is as short as possible, as shown in Figure 12B, the region b of the medium does not affect that distance.

[0130] Furthermore, in the area b of the medium of the surveying rod 11S that constitutes the surveying rod pair 10 in Figure 13A, a QR code (registered trademark) indicating identification information that distinguishes this surveying rod 11S from other surveying rods 11 is drawn. Also, in the area b of the medium of the surveying rod 11T that constitutes the surveying rod pair 10 in Figure 13A, a QR code (registered trademark) indicating identification information that distinguishes this surveying rod 11T from other surveying rods 11 is drawn.

[0131] For example, the terminal device 12 can decode the QR code (registered trademark) contained in the image of the surveying rod pair 10 shown in Figure 13A, and identify each of the surveying rods 11S and 11T shown in the image.

[0132] The surveying rod pair 10 in Figure 13B differs from the surveying rod pair 10 in Figure 13A in that identification information is not inscribed on the medium area b of one of the surveying rods 11 (in this case, surveying rod 11S). The medium area b of the surveying rod 11S in Figure 13B is used, for example, as an area where the user can freely write notes with a pen or the like. In this case, the surveying rod 11S is not distinguishable from other surveying rods 11, but this surveying rod pair 10 is distinguishable from other surveying rod pairs 10 by the identification information of the surveying rod 11T.

[0133] The surveying rod pair 10 in Figure 13C differs from the surveying rod pair 10 in Figure 13A in that one of the surveying rods 11 (in this case, surveying rod 11S) does not have a medium b. In this case as well, similar to the surveying rod pair 10 in Figure 13B, surveying rod 11S is not distinguishable from the other surveying rods 11, but this surveying rod pair 10 is distinguishable from the other surveying rod pairs 10 by the identification information of surveying rod 11T.

[0134] In the surveying rod pair 10 illustrated in Figures 13A to 13C, a QR code (registered trademark) is depicted as a mark to distinguish the surveying rod 11 from other similar surveying rods 11. However, the mark may be depicted in a form other than a QR code (registered trademark). For example, the mark to distinguish the surveying rod 11 from other similar surveying rods 11 may be depicted as an image showing a code other than a QR code (registered trademark), such as a two-dimensional barcode or a one-dimensional barcode, or it may be depicted as characters, symbols, etc. that are easily recognizable by humans.

[0135] Figure 14 illustrates a pair of surveying rods 10 in which two surveying rods 11 constituting the pair of surveying rods 10 are configured such that, in order to distinguish which of the two surveying rods 11 is surveying rod 11S and which is surveying rod 11T, the two surveying rods 11 have the same color scheme for drawing line segments, but the shapes of the figures drawn by the line segments are different. In the surveying rod pair 10 of Figure 14, the surveying rods 11S and 11T constituting the pair of surveying rods 10 have shapes of figures drawn by line segments that are symmetrical to each other but different. Therefore, the surveying rods 11S and 11T can be distinguished based on the shapes of these figures, that is, the arrangement of the intersection point P.

[0136] [Modifications concerning information other than points drawn on the surveying rod] In the embodiment described above, for example, the surveying rod 11T shown in Figure 2 has, in addition to a figure having three or more characteristic points used for surveying (hereinafter referred to as "surveying figure"), identification information that distinguishes the surveying rod 11 from other surveying rods 11 is drawn using a QR code (registered trademark). The information drawn on the surveying rod 11 in addition to the surveying figure is not limited to identification information that distinguishes the surveying rod 11 from other surveying rods 11.

[0137] For example, the surveying rod 11S shown in Figure 2 has the surveying figure shown in Figure 3 drawn on it by color-coding, but it is not possible to determine the size of the surveying figure drawn on the actual surveying rod 11S from an image of the surveying rod 11S that was photographed.

[0138] Therefore, in addition to the surveying figure, size information indicating the size of the surveying figure may be drawn on the surveying rod 11.

[0139] Figures 15A and 15B illustrate an example of a surveying rod 11 according to this modified example. In addition to the surveying figure, the surveying rod 11 in Figure 15A has identification information "123456" to distinguish it from other surveying rods 11, and size information "length of one side of the square = 10 mm" depicted in text and a QR code (registered trademark).

[0140] As illustrated in Figure 15A, the surveying rod 11 can be used to determine the size of the surveying figure in the image by, for example, recognizing the characters in the image of the surveying rod 11 using OCR (Optical Character Recognition) or by decoding the QR code (registered trademark).

[0141] In Figure 15B, the surveying rod 11 has, in addition to the surveying diagram, a QR code (registered trademark) and numbers indicating identification information "123456" to distinguish this surveying rod 11 from other surveying rods 11, a scale bar indicating the actual unit length of the surveying rod 11, and letters indicating the unit length (in this case, 10 mm).

[0142] According to the surveying rod 11 illustrated in Figure 15B, for example, the terminal device 12 can recognize the characters in the image of the surveying rod 11 using OCR (Optical Character Recognition) to determine the unit length, and then determine the size of the surveying figure in the image based on the length of the scale bar in the image of the surveying rod 11 and the unit length recognized from the characters.

[0143] Furthermore, in addition to the surveying figure, the surveying rod 11 may also have identification information for referencing the size information of the surveying figure, rather than the size information of the surveying figure itself. In the terminal device 12 or server device 13, the size of the surveying figure captured in the image may be determined based on the identification information captured in the image of the surveying rod.

[0144] Figure 16 is an example of a surveying rod 11 according to this modified example. In addition to the surveying diagram, the surveying rod 11 in Figure 16 has identification information "123456" written in letters and a QR code (registered trademark) to distinguish it from other surveying rods 11.

[0145] Figures 17A and 17B show the configuration of the data table stored in the server device 13 of the surveying system 1 according to this modified example.

[0146] Figure 17A shows the structure of a data table (hereinafter referred to as the "figure table") that stores data for each of several different survey figures. Here, "different survey figures" means survey figures that differ in at least one of their shape and size. The figure table has the following data fields.

[0147] [Shape ID] field: Stores shape identification information to identify the shape used for surveying. [Shape Information] field: Stores shape information indicating the shape of the shape used for surveying. [Size Information] field: Stores size information indicating the size of the shape used for surveying.

[0148] Shape information, for example, is information indicating the coordinates of three or more feature points of a survey figure, but any description format is acceptable as long as it indicates the positional relationship between three or more feature points of a survey figure. For example, an image representing the figure may be stored as shape information in a figure table.

[0149] Size information, for example, when shape information indicates the coordinates of three or more feature points of a survey figure, is information that indicates the physical length of one coordinate unit (e.g., 1 millimeter) in the coordinate system that defines those coordinates. However, as long as it is information indicating the size of a survey figure, the description format may be any format.

[0150] Hereinafter, the shape information and size information of a particular surveying figure will be referred to as the geometric information of that surveying figure.

[0151] Figure 17B shows the structure of a data table (hereinafter referred to as the "leveling rod table") that stores data for each of several different leveling rods 11. Here, "several different leveling rods 11" refers to each of the actual leveling rods 11. Therefore, data for different leveling rods 11 on which the same leveling figure is drawn is stored in different data records in the leveling rod table. The leveling rod table has the following data fields.

[0152] [Measuring Rod ID]: Stores measuring rod identification information to identify the surveying measuring rod 11. [Figure ID]: Stores one of the figure IDs stored in [Figure ID] of the figure table.

[0153] In addition to the above-mentioned leveling rod ID and figure ID, the leveling rod table may also store the name of the object to which the leveling rod 11 is attached, the location of that object on Earth (latitude, longitude, etc.), and information about the person in charge of that object.

[0154] In this modified example, for instance, when a user photographs the surveying rod 11 shown in Figure 16 using the camera 123 of the terminal device 12, the terminal device 12 decodes the QR code (registered trademark) in the captured image and obtains the rod identification information "123456" for the surveying rod 11. The terminal device 12 then sends a request to the server device 13 to transmit graphic information including the rod identification information "123456" read from the QR code (registered trademark).

[0155] When the server device 13 receives a request to transmit graphic information from the terminal device 12, it searches the leveling rod table (Figure 17B) for a data record corresponding to the leveling rod identification information "123456" included in the transmission request. Subsequently, the server device 13 searches the graphic table (Figure 17A) for a data record corresponding to the graphic ID included in the data record found in the leveling rod table. The server device 13 transmits the graphic information (shape information and size information) included in the data record found in the graphic table to the terminal device 12 as a response to the transmission request.

[0156] The terminal device 12 receives graphic information (shape information and size information) transmitted from the server device 13 as a response to a transmission request, and uses the received graphic information for measurement (for example, processing according to the flow in Figure 7).

[0157] In the above-described embodiment, the surveying process that was performed by the terminal device 12 (for example, the process following the flow in Figure 7) may be performed by the server device 13. In that case, the terminal device 12 transmits the image captured by the camera 123 to the server device 13, and the server device 13 reads the leveling rod identification information from the image. Alternatively, the terminal device 12 may read the leveling rod identification information from the image captured by the camera 123, transmit the read leveling rod identification information to the server device 13, and the server device 13 may use that leveling rod identification information.

[0158] Alternatively, the terminal device 12 may receive a graphic table and a measuring rod table from the server device 13, and the terminal device 12 may identify shape information corresponding to the measuring rod identification information read from the image.

[0159] Note that the data table configurations illustrated in Figures 17A and 17B are examples, and other configurations may be used as long as they allow for the identification of size information corresponding to the measuring rod identification information. For example, a table may be used that is obtained by integrating a figure table (master table) with the figure ID illustrated in Figure 17A as the primary key and a measuring rod table illustrated in Figure 17B with the measuring rod ID as the primary key and the figure ID as a field, with the measuring rod ID as the primary key and shape information and size information as fields.

[0160] In this modified example, the shape of the surveying figure drawn on the surveying rod 11 is not limited to that shown in Figure 3. Figures 18A to 18G illustrate surveying rods 11 with surveying figures of a different shape from those in Figure 3.

[0161] In Figure 18A, the surveying rod 11 has a surveying figure drawn on it that consists of a single square. As in this example, the number of polygons included in a surveying figure is not limited to multiple sides.

[0162] The surveying rod 11 in Figure 18B has a surveying figure drawn on it that is composed of four equilateral triangles. As this example shows, the shape of the polygon included in the surveying figure is not limited to a quadrilateral.

[0163] The surveying rod 11 in Figure 18C has a surveying figure drawn on it that is composed of four right-angled triangles. As in this example, the polygons included in the surveying figure are not limited to regular polygons. Also, the ratio of the lengths of the three sides of the right-angled triangle drawn on the surveying rod 11 in Figure 18C is 3:4:5, so if the length of the hypotenuse is 10 millimeters, the lengths of the other two sides will be 6 millimeters and 8 millimeters, and so on, with all the side lengths being natural numbers. In this way, when a polygon with rational side lengths is drawn on the surveying rod 11, the amount of rounding of fractions during calculations for surveying is reduced, and as a result, the accuracy of the survey may be improved.

[0164] In Figure 18D, the surveying rod 11 has a surveying figure drawn on it, which consists of one square and four isosceles triangles. As in this example, the surveying figure may be composed of polygons of different shapes.

[0165] In Figure 18E, the surveying rod 11 has a surveying figure drawn on it, which consists of three points (more precisely, three small circles that are separated from each other). As in this example, the surveying figure may consist of three or more points (more precisely, three or more small circles that are separated from each other). In this case, the center points of the small circles become the feature points used in the survey.

[0166] In Figure 18F, the leveling rod 11 has leveling rod identification information and size information drawn inside the surveying figure. As in this example, the position where the leveling rod identification information and size information are drawn on the leveling rod 11 may be inside the surveying figure.

[0167] Furthermore, the surveying figures drawn on the surveying rod 11 in Figure 18F are drawn with lines rather than using different colors. As in this example, surveying figures may also be drawn with lines.

[0168] In Figure 18G, the surveying rod 11 incorporates a QR code (registered trademark) that serves as both a surveying graphic and a rod identification and size information. In this case, for example, the vertices of the three corners where the smaller squares are located are used as three feature points for surveying. The size information for this surveying rod 11 is, for example, information indicating the side length of the square that makes up the entire shape of the QR code (the distance between two adjacent vertices among the three corners where the smaller squares are located).

[0169] In the example described above, the leveling rod 11 is assumed to have leveling rod identification information drawn on it. However, instead of, or in addition to, the leveling rod identification information may be drawn on the leveling rod 11. In that case, the terminal device 12 or server device 13 reads the graphic identification information from the image captured by the camera 123, and searches for shape information and size information corresponding to the read graphic identification information (graphic ID) from the graphic table and uses it.

[0170] Furthermore, leveling rod identification information including figure identification information may be used. For example, leveling rod identification information may be used in which the upper m digits are figure identification information, and the following n digits are identification information that identifies individual leveling rods among leveling rods on which the same surveying figure is drawn. In this case, the terminal device 12 or server device 13 reads the leveling rod identification information from the image captured by the camera 123, and searches for and uses shape information and size information corresponding to the figure identification information (figure ID) contained in the read leveling rod identification information from the figure table.

[0171] [Variations of the processing performed by the surveying system] The following are variations of the processing performed by the surveying system 1. (13) When the similarity S satisfies predetermined conditions, the processor 122 of the terminal device 12 displays a message on the touchscreen 124 prompting the user to touch button R3. Alternatively, the processor 122 may perform a process to generate a still image from the video acquired from the camera 123 when the similarity S satisfies predetermined conditions.

[0172] In this modified example, a still image generated from the video by the processor 122 is used as still image I. Therefore, the user does not need to perform a touch operation on button R3 (i.e., the operation of pressing the shutter).

[0173] (14) The processor 122 of the terminal device 12 described above displays a message on the touchscreen 124 prompting the user to touch button R3 when the similarity S satisfies predetermined conditions. Alternatively, the processor 122 may perform the process of instructing the camera 123 to take a still image when the similarity S satisfies predetermined conditions, and the process of acquiring the still image I taken by the camera 123 in response to that instruction.

[0174] In this modified example, the process of taking a still image I by pressing the shutter is performed automatically by the terminal device 12. Therefore, the user does not need to touch button R3 (i.e., perform the shutter release operation).

[0175] (15) The processor 122 of the terminal device 12 described above calculates the similarity S and notifies the user when the similarity S satisfies predetermined conditions. Alternatively, instead of calculating the similarity S, the processor 122 may estimate the accuracy of the photogrammetry and notify the user when the estimated accuracy (hereinafter referred to as "accuracy X") satisfies predetermined conditions.

[0176] In this modified example, the processor 122 first identifies one or more of the following (a) to (e) as accuracy estimation parameters for each image (for example, a still image corresponding to each frame) that makes up the video acquired from the camera 123 in order to estimate the accuracy X.

[0177] (a) Position of the leveling rod 11 within the field of view of camera 123 (b) Angle between the shooting direction of camera 123 and the direction of the normal of the leveling rod 11 (c) Resolution of the scale indicated by the leveling rod 11 in the image captured by camera 123 (d) Clarity of the image of the leveling rod 11 included in the image captured by camera 123 (e) Contrast of the image captured by camera 123

[0178] (a) is the position of the image of the surveying rod 11 in the image captured by the camera 123 (for example, the position of a representative point such as the centroid of the area occupied by the image of the surveying rod 11). Generally, the further the position of the image of the surveying rod 11 is from the center of the image captured by the camera 123, the more the image of the surveying rod 11 is distorted, and the more likely the accuracy of the survey results is to decrease.

[0179] The angle in (b) indicates the degree to which the shooting direction of the camera 123, that is, the direction of the optical axis of the lens of the camera 123, deviates from the direction directly facing the plane on which the surveying rod 11 is positioned. This angle is calculated using a known orthographic projection transformation method. The larger this angle, the greater the error that appears in the transformation to the orthographic projection image in step S3 of Figure 7, and the more likely the accuracy of the surveying results is to decrease.

[0180] The resolution in (c) is the number of pixels per unit length in the image of the leveling rod 11, determined by the distance D between two adjacent intersection points P shown in the image of the leveling rod 11. For example, if the distance D between two adjacent intersection points P of the actual leveling rod 11 is 15 mm, and the number of pixels between the two adjacent intersection points P in the image of the leveling rod 11 is 4.5 million pixels, then the resolution in (c) is 300,000 pixels / mm, obtained by dividing 4.5 million by 15. The lower this resolution, the more likely the accuracy of the survey results is to decrease.

[0181] (d) The sharpness is an indicator of how well the image is in focus; the lower the value, the more likely the accuracy of the measurement results is to decrease. This sharpness can be determined using known methods (for example, methods that calculate it based on the power spectrum of the image, methods that use machine learning models such as deep learning, methods that calculate it using the Laplacian derivative, etc.).

[0182] (e) Contrast is the difference in brightness (luminance difference) between the brightest and darkest parts of an image. The larger the value, the easier it is to recognize the outlines and patterns of the objects in the image.

[0183] Based on the identified accuracy estimation parameters, the processor 122 estimates the accuracy X of the photogrammetry using the image captured by the camera 123 on the surveying rod 11.

[0184] Methods for estimating accuracy X based on accuracy estimation parameters include, but are not limited to, methods using known multivariate analyses or machine learning models.

[0185] For example, in the case of using a machine learning model, for each image of a pair of surveying rods 10 placed on various objects 9 to be measured, training data is prepared with the values ​​(a) to (d) above related to that image as explanatory variables and the accuracy of the photogrammetry results using that image as the target variable. Then, the computer is made to perform machine learning using this training data to generate a machine learning model (trained model). During operation, the processor 122 inputs the values ​​(a) to (d) above identified from the images acquired from the camera 123 as explanatory variables into the machine learning model and obtains the accuracy X output from the machine learning model as the target variable.

[0186] The processor 122 uses the accuracy X estimated as described above instead of the similarity S in the above embodiment. Therefore, in this modified example, for example, the display object R2 on the shooting screen represents accuracy X instead of similarity S. When accuracy X satisfies a predetermined condition (for example, accuracy X is greater than or equal to a predetermined threshold U), a message such as "Please press the shutter" is displayed in the area R4 of the shooting screen, and button R3 is activated.

[0187] Even with this modification, images that yield sufficiently high-precision survey results can be easily captured.

[0188] Furthermore, if the above-mentioned predetermined condition regarding accuracy X is, for example, "accuracy X is greater than or equal to a predetermined threshold U," the threshold U may be changed, for example, according to the accuracy of the survey results required by the user.

[0189] When this modification is combined with the above-described modification (13), the processor 122, when accuracy X satisfies a predetermined condition, performs a process to generate a still image from the video acquired from the camera 123, instead of displaying a message on the touchscreen 124 prompting the user to touch button R3.

[0190] Furthermore, when this modified version is combined with the modified version (14) described above, the processor 122, when the accuracy X satisfies a predetermined condition, instead of displaying a message on the touchscreen 124 prompting the user to touch button R3, performs the process of instructing the camera 123 to take a still image and the process of acquiring the still image I taken by the camera 123 in response to that instruction.

[0191] (16) The order of the processes shown in Figure 7 may be changed as appropriate. For example, the process of decrypting the QR code (registered trademark) and obtaining identification information of the surveying rod 11T (step S1), which is performed first in Figure 7, may be performed after the process of determining the angle between coordinate systems (step S6).

[0192] (17) In the embodiments described above, some of the processing that would be performed by the processor 122 of the terminal device 12 may be performed by the processor 132 of the server device 13. For example, the terminal device 12 may transmit a still image I to the server device 13, and the processing according to the flow in Figure 7 may be performed by the processor 132 of the server device 13. Also, some or all of the processing that would be performed by the processor 132 of the server device 13 in the embodiments described above may be performed by the processor 122 of the terminal device 12.

[0193] (18) In the embodiment described above, the similarity S, which indicates the degree of agreement between the image of the surveying rod 11 and the guide sign G, is defined as the degree of agreement between the position of the feature points (3 or more) of the image of the surveying rod 11 and the position of the feature points (3 or more) of the guide sign G corresponding to those feature points. However, the similarity S may be any other index as long as it indicates the degree of agreement between the image of the surveying rod 11 and the guide sign G.

[0194] For example, the similarity S may be calculated as any of the following: the area of ​​the overlap between the area occupied by the image of the surveying rod 11 and the area occupied by the directional sign G; or the ratio of the area of ​​the overlap between the area occupied by the image of the surveying rod 11 and the area occupied by the directional sign G to the area occupied by the directional sign G.

[0195] Furthermore, compared to the similarity S calculated based on the area of ​​the overlapping portion, the similarity S calculated based on the distance between corresponding feature points is superior in that it changes depending on the degree of agreement between the shooting direction and the normal direction of the plane of the surveying rod 11.

[0196] [Other variations] (19) The use of the surveying rod 11 is not limited to measuring the positional relationship between two points on the object to be measured 9 as described above. Also, the surveying rod 11 does not necessarily have to be used in a pair of surveying rods 11S and 11T. For example, if you want to measure the direction of the normal to the surface of the object to be measured 9, only one terminal device 12 needs to be placed on the object to be measured 9.

[0197] (20) In the embodiment described above, the entity that photographs the object to be measured 9 on which the surveying rod pair 10 is placed is assumed to be a user (person), but that entity may be a device such as a drone.

[0198] (21) In the above-described embodiment, the camera 123 that photographs the object to be measured 9 on which the surveying rod 11 is placed is built into the terminal device 12 or connected to the terminal device 12, but an image taken by a camera not connected to the terminal device 12 may also be used. In that case, the terminal device 12 will not display the guidance display object G, nor will it display the similarity S between the captured image and the guidance display object G, but the use of the surveying rod 11 makes it easier to obtain survey results with higher accuracy compared to when a conventional surveying rod is used.

[0199] (22) In the above-described embodiment, the coordinate system corresponding to the surveying rod 11 (coordinate system C corresponding to the surveying rod 11S, or coordinate system E corresponding to the surveying rod 11S) was determined as follows: Origin: Intersection P(1,1) X-axis positive direction: Direction from intersection P(1,4) to intersection P(4,1) Y-axis positive direction: Direction from intersection P(2,2) to intersection P(1,1)

[0200] The method for determining the coordinate system corresponding to the surveying rod 11 is not limited to the above, and the coordinate system may be determined by any method, as long as it is based on the positions of three or more intersection points P that are identified from an image of the surveying rod 11 and are not all on the same line.

[0201] (23) In the above-described embodiment, the leveling rod 11T is assumed to have three or more lines drawn on it that form three or more intersection points P, similar to the leveling rod 11S. However, if the angles between coordinate systems are not required from the information obtained from photogrammetry, the number of lines drawn on the leveling rod 11T may be two or less, and the number of intersection points P formed by those lines may be two or less. For example, two intersecting lines may be drawn on the leveling rod 11T, and only one intersection point P may be formed between those two lines.

[0202] (24) In the embodiments and modified examples (15) described above, the processor 122 of the terminal device 12 estimates the accuracy X of photogrammetry based on the video acquired in real time from the camera 123. This function for estimating accuracy X is not limited to real-time video recording, but may also be applied to videos or still images that have been taken in the past and are already stored in the memory 121, etc.

[0203] For example, the processor 122 acquires a previously recorded video file specified by the user, identifies the accuracy estimation parameters (leveling rod position, angle, resolution, sharpness, contrast) described in the modified example (15) for each frame (still image) that makes up the video, and estimates the accuracy X based on the identified accuracy estimation parameters. For example, the processor 122 generates the first frame in the video in which the accuracy X is equal to or greater than a predetermined threshold as a still image to be used for photogrammetry. Alternatively, the processor 122 estimates the accuracy X for all frames that make up the video and generates the frame in which the highest accuracy X is estimated to be obtained as a still image to be used for photogrammetry. This makes it possible to extract images suitable for photogrammetry from recorded videos.

[0204] Furthermore, the processor 122 may similarly estimate the accuracy X for still images (which may be frames constituting a video) already stored in memory 121 or the like, and notify the user of the estimated accuracy X by displaying it together with the still image on, for example, the touchscreen 124.

[0205] (25) In the modified examples (15) or (24) described above, the accuracy X estimated with respect to the photogrammetry using the image captured by the camera 123 may be stored in the memory 121 or server device 13, etc., in association with the results of the photogrammetry. This allows the user to know not only the results of the photogrammetry but also the accuracy of the results of the photogrammetry.

[0206] 1...Surveying system, 11...Surveying rod, 12...Terminal device, 13...Server device, 121...Memory, 122...Processor, 123...Camera, 124...Touchscreen, 125...Communication interface, 131...Memory, 132...Processor, 133...Communication interface.

Claims

1. A surveying rod on which a figure showing three or more points whose relative positions are known, and size information indicating the size of the figure, are drawn.

2. A surveying rod on which a figure representing three or more points whose positional relationship is known, and figure identification information that distinguishes the figure from other different figures, are drawn.

3. A system that stores size information indicating the size of each of at least several figures of different sizes, associated with figure identification information that identifies the figure from other figures; acquires an image of the surveying rod described in claim 2; reads figure identification information from the acquired image; and reads size information corresponding to the figure identification information read from the image from among the stored size information.

4. A surveying rod on which a surveying figure, which is a figure representing three or more points whose positional relationship is known, is drawn, and which has a rod identification information drawn on it that identifies itself from other surveying rods, wherein for each of a plurality of surveying rods, size information indicating the size of the surveying figure drawn on the surveying rod is stored in association with the rod identification information that identifies the surveying rod from other surveying rods, an image of the surveying rod is taken, the rod identification information is read from the acquired image, and the size information corresponding to the rod identification information read from the image is read from the plurality of stored size information.

Images