Survey support system and survey support method

JP2023077246A5Active Publication Date: 2024-11-28TOPCON CORPORATION
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2021190479
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-11-24
Publication Date
2024-11-28
Estimated Expiration
2041-11-24

AI Technical Summary

Technical Problem

Conducting survey work while confirming process charts and drawings at the survey site is cumbersome, especially for workers unfamiliar with the equipment, leading to difficulties in correctly selecting and installing surveying equipment.

Method used

A survey support system utilizing an eyewear display device that superimposes surveying process data and equipment images onto the real-world scenery, integrating a communication unit, three-dimensional coordinate measurement, and relative position/direction sensors to facilitate equipment installation and operation.

Benefits of technology

Reduces the burden of checking process charts and drawings at the survey site by providing a visual aid that guides workers on equipment installation and operation, enhancing efficiency and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

To reduce a burden of confirmation of a progress schedule and a chart in a survey site.SOLUTION: A survey support system 100 comprises: a measuring instrument 2 which includes a communication unit and a three-dimensional coordinate measurement unit; an eyewear display device 4 which includes a display 41; and a control arithmetic unit 64 which matches a coordinate space of information about a position and a direction of the eyewear display device 4, a coordinate space of the measuring instrument and a coordinate space of an absolute coordinate system with each other, and can manage them in a space with a common reference point as an original point. The system allows a user to observe an image in a manner of being superimposed on a scenery of a site observed by wearing the eyewear display device 4 by displaying the image of the absolute coordinate system created by the control arithmetic unit 64 on the display 41. The control arithmetic unit 64 reads out survey process data including at least machine information of the used survey instrument, three-dimensional position information in the absolute coordinate system of an instrument installation point and a measurement order of the instrument installation point, creates a work support image on the basis of the survey process data, and allows the user to observe a work support image including the instrument installation point and the image of the used survey instrument in a state of being installed at the instrument installation point so as to be superimposed on the scenery of the site.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a surveying support system and a surveying support method, and more particularly to a surveying support system and a surveying support method using an eyewear display device.

Background Art

[0002] Conventionally, when performing surveying work, various circumstances such as the structures, equipment installation points, reference points, etc. drawn on the drawings of the surveying site, the types and models of the surveying equipment owned, etc. are considered in advance, and a process table and drawings describing the position of the equipment installation point, the measurement order, and the surveying equipment to be used are created so that the target surveying work can be carried out as efficiently as possible. Then, at the surveying site, the surveying work is carried out while checking the process table and the drawings.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, it is cumbersome to perform surveying work while checking the process table and drawings at the surveying site. In particular, for workers who are not familiar with the work, it is necessary to pay attention to correctly selecting and installing the surveying equipment to be used for surveying at that equipment installation point.

[0005] On the other hand, Patent Document 1 discloses an eyewear display system that uses an eyewear display device to manage information on the position and direction of the eyewear display device and 3D CAD (Three-Dimensional·Computer·Aided·Design) design data of the site created in an absolute coordinate system in the same coordinate space, so that the data created in the absolute coordinate system can be superimposed and observed on the site scenery.

[0006] This invention has been made in view of the above circumstances, and aims to provide a surveying support system that reduces the burden of checking schedules and drawings at surveying sites by using an eyewear display system. [Means for solving the problem]

[0007] To achieve the above objective, the surveying support system according to the first aspect of the present invention includes: a measuring instrument comprising a communication unit and a three-dimensional coordinate measurement unit; an eyewear display device comprising a display, a relative position sensor for detecting its own position, and a relative direction sensor for detecting its own direction; and a control calculation unit comprising a synchronization measurement unit that aligns the coordinate space of the position and direction information of the eyewear display device with the coordinate space of the measuring instrument and the coordinate space of an absolute coordinate system, and enables management in a space with a common reference point as the origin; and by displaying the image of the absolute coordinate system created by the control calculation unit on the display, the image is superimposed on the field scenery observed while wearing the eyewear display device. A surveying support system that enables observation, comprising: a control calculation unit which reads surveying process data including at least instrument information of the surveying equipment to be used, three-dimensional position information of the equipment installation point in the absolute coordinate system, and the measurement order of the equipment installation point; a work support image creation unit which creates a work support image based on the surveying process data; and a work support image display unit which transmits the work support image to the eyewear display device and displays it on the display, wherein the work support image includes an image of the equipment installation point and an image of the surveying equipment to be used in the state installed at the equipment installation point, and the eyewear display device which enables observation of the work support image superimposed on the scenery of the site.

[0008] Furthermore, a surveying support method according to a second aspect of the present invention is a surveying support method using an eyewear display device comprising a measuring instrument having a communication unit and a three-dimensional coordinate measurement unit, a display, a relative position sensor for detecting its own position, and a relative direction sensor for detecting its own direction, wherein the coordinate space of the position and direction information of the eyewear display device is made to coincide with the coordinate space of an absolute coordinate system, and can be managed in a space with a common reference point as the origin; and by displaying an image of the absolute coordinate system created by the control calculation unit on the display, the wind of the site observed while wearing the eyewear display device is measured. The system includes: superimposing the aforementioned image onto the landscape for observation; reading out surveying process data including at least instrument information of the surveying equipment to be used, three-dimensional position information of the absolute coordinates of the equipment installation point, and the measurement sequence of the equipment installation point; creating a work support image based on the recorded surveying process data; transmitting the work support image to the eyewear display device for display on the display, wherein the work support image includes images of the equipment installation point and the surveying equipment to be used in the state installed at the equipment installation point, and the eyewear display device allows the work support image to be superimposed onto the landscape of the site for observation. [Effects of the Invention]

[0009] According to the above embodiment, it becomes possible to provide a surveying support system and surveying support method that reduces the burden of checking schedules and drawings at the surveying site. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic external view of a surveying support system according to the first embodiment of the present invention. [Figure 2] This is a block diagram of the surveying support system. [Figure 3] This is a block diagram of the surveying equipment (measuring instruments) that make up the surveying support system. [Figure 4] This is an external perspective view of the eyewear display device that constitutes the surveying support system. [Figure 5] This is a block diagram of the eyewear display device. [Figure 6] It is a configuration block diagram of a data management device constituting the above measurement support system. [Figure 7] It is a diagram showing an example of surveying process data used in the same measurement support system. [Figure 8] It is a diagram showing an example of work support data used in the same measurement support system. [Figure 9] It is a flowchart for explaining the processing of a surveying support method using the same measurement support system. [Figure 10] It is a diagram for explaining the detailed procedure of synchronization (coordinate system conversion) of position and orientation information executed after the initial setting of the same processing. [Figure 11] It is a diagram showing an example of a work support image in the same surveying support method. [Figure 12] It is a diagram showing an example of work support data used in one modification example of the same measurement support system. [[ID=...]] [Figure 13] It is a diagram showing an example of a work support image in the surveying support method according to the same modification example. [Figure 14] It is a diagram showing an example of work support data used in another modification example of the above measurement support system. [Figure 15] It is a diagram showing an example of a work support image in the surveying support method according to the same modification example. [Figure 16] It is a diagram showing an image of point cloud data that can be obtained by a general laser scanner. [Figure 17] It is a diagram for explaining a method of calculating an observation route in surveying process data used in a surveying support system according to the second embodiment of the present invention. [Figure 18] It is a diagram showing an example of the calculated observation route. [Figure 19] It is a configuration block diagram of an eyewear device and a data processing device of a surveying support system according to the second embodiment. [Figure 20] It is a flowchart for explaining the processing of a surveying support method using the same measurement support system.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings, but the present invention is not limited thereto. In addition, the same components common to each embodiment and modification example are denoted by the same reference numerals, and duplicate descriptions are omitted as appropriate. Also, the same hardware components are given the same names, and duplicate descriptions are omitted as appropriate.

[0012] I First Embodiment 1 Configuration of Survey Support System 100 FIG. 1 is a schematic external view of a survey support system (hereinafter simply referred to as "system") 100 according to an embodiment of the present invention. The system 100 includes a surveying instrument 2, an eyewear display device (hereinafter referred to as "eyewear device") 4, and a data management device ⑥. FIG. 2 is a configuration block diagram of the system 100.

[0013] 2 Surveying Instrument 2 (Measuring Instrument) FIG. 3 is a configuration block diagram of the surveying instrument 2 according to this embodiment. The surveying instrument 2 includes a three-dimensional coordinate measuring unit 21, a display unit 22, an operation unit 23, a storage unit 24, an external storage device 25, a communication unit 26, and an arithmetic processing unit 27. In the illustrated example, the surveying instrument 2 is a motor-driven total station installed at a survey site via a tripod.

[0014] The three-dimensional coordinate measuring unit 21 includes a distance measuring unit 21a, an angle measuring unit 21b, and a rotation drive unit 21c. The distance measuring unit 21a emits distance measuring light, receives the reflected light, and based on the received signals of the reflected distance measuring light and the internally referenced light obtained by splitting a part of the emitted distance measuring light, calculates the distance to the measurement object by the arithmetic processing unit 27. It is an optical distance meter.

[0015] The distance measuring unit 21a is provided in a telescope rotated in two axial directions (V-V axis and H-H axis in FIG. 1) of vertical and horizontal directions by the rotation drive unit 21c, and the angle measuring unit 21b, which is a rotary encoder, detects the sighting direction of the telescope to measure the angle of the measurement object.

[0016] The display unit 22 is, for example, a liquid crystal display. The operation unit 23 has a power key, number keys, decimal point key, plus / minus key, execute key, scroll key, etc., enabling the operator to operate the surveying instrument 2 and input information to the surveying instrument 2.

[0017] The memory unit 24 is, for example, a hard disk drive (HDD), and stores programs for executing the functions of the arithmetic processing unit 27.

[0018] The external storage device 25 is, for example, a memory card, and stores various data acquired by the surveying instrument 2.

[0019] The communication unit 26 is a communication control device such as a network adapter, network interface card, LAN card, or Bluetooth® adapter, and connects the surveying instrument 2 to the eyewear device 4 and the data management device 6 by wire or wireless connection. The arithmetic processing unit 27 can send and receive information with the eyewear device 4 and the data management device 6 via the communication unit 26.

[0020] The arithmetic processing unit 27 is a control arithmetic unit that includes at least one processor (e.g., CPU (Central Processing Unit)) and memory (e.g., SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory, etc.)). The processor reads the necessary data and programs from the storage unit 24 into the memory and executes processing to realize the functions of the surveying instrument 2. The arithmetic processing unit 27 controls the 3D coordinate measurement unit 21 to measure the distance and angle of the object to be measured and calculate the 3D position coordinates of the object to be measured.

[0021] Furthermore, the surveying instrument 2 corresponds to the measuring instrument in the claims attached to this specification. The measuring instrument is not limited to the total station exemplified, but may be any surveying instrument equipped with a communication unit 26 and a three-dimensional coordinate measurement unit capable of acquiring the three-dimensional position coordinates of an object to be measured. For example, the three-dimensional coordinate measurement unit 21 may be a laser scanner further equipped with a rotating mirror that scans the distance measuring light 360° vertically in a vertical rotation drive unit, or it may be a camera equipped with two cameras, such as the one exemplified in Patent Document 1, capable of acquiring the three-dimensional position coordinates of an object to be measured by photogrammetry.

[0022] 3 Eyewear device 4 Figure 4 is an external perspective view of the eyewear device 4, and Figure 5 is a block diagram of the eyewear device 4. The eyewear device 4 is a wearable device that is attached to the head of a worker. The eyewear device 4 comprises a display 41 and a control unit 43. The control unit 43 also comprises a communication unit 44, a relative position detection sensor 45, a relative direction detection sensor 46, a storage unit 47, an operation switch 48, and an arithmetic processing unit 49.

[0023] The display 41 is a goggle-lens type see-through display that covers both of the worker's eyes when worn. For example, the display 41 is an optical see-through display using a half-mirror, and displays the image received by the control unit 43 superimposed on the site scenery. Alternatively, the display 41 may be a video see-through display, and display an image in which the image received by the control unit 43 is superimposed on a front scenery image acquired in real time by a camera (not shown). Furthermore, the projection method may be a virtual image projection method or a retinal projection method. In this way, the worker can observe the work support image created from the surveying process data 91 and work support data 92 superimposed on the site scenery. The surveying process data 91 and work support data 92 will be described later.

[0024] If the display 41 is a video see-through display, the camera is equipped with an image sensor such as a CCD (Charge-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) and captures a front view image of the eyewear device 4 in real time. The image sensor has a Cartesian coordinate system with the camera center as the origin, and the local coordinates of each pixel are specified. The positional relationship between the center of the camera and the center of the eyewear device 4 is known, and the eyewear device 4 can convert the image acquired by the camera into its own coordinate space and manage it.

[0025] The communication unit 44 is a communication control device similar to the communication unit 26. It wirelessly connects the eyewear device 4 to a communication network such as the Internet or a mobile phone network. The arithmetic processing unit 49 can send and receive information with the surveying instrument 2 and the data management device 6 via the communication unit 44 and the communication network.

[0026] The relative position sensor 45 performs wireless positioning using GNSS (Global Navigation Satellite System) antennas, Wi-Fi® access points, ultrasonic oscillators, etc., installed at the observation site, and detects the position (self-position) of the eyewear device 4 within the observation site.

[0027] The relative direction sensor 46 consists of a combination of a three-axis accelerometer or gyroscope and a tilt sensor. The relative direction sensor 46 detects the tilt (self-direction) of the eyewear device 4, with the vertical direction being the Z-axis direction, the horizontal direction being the Y-axis direction, and the front-to-back direction being the X-axis direction.

[0028] The storage unit 47 is, for example, a memory card. The storage unit 47 stores programs for the arithmetic processing unit 49 to perform its functions.

[0029] The operation switch 48 is, for example, a push button provided on the outer surface of the display 41, as shown in Figure 4. The operation switch 48 includes, for example, a power button 48a for turning the power of the eyewear device 4 ON / OFF, and a function button 48b that works in conjunction with the display on the display 41 to enable the operator to input selections, instructions, etc. In this embodiment, as will be described later, the operator can input selections, confirmations, commands, etc., by pressing the function button 48b located at a position corresponding to the display button shown on the display 41.

[0030] The arithmetic processing unit 49 is, for example, a control arithmetic unit that implements at least one processor (CPU) and memory (SRAM, DRAM, etc.) on an integrated circuit. The arithmetic processing unit 49 outputs the position and direction information of the eyewear device 4 detected by the relative position sensor 45 and the relative direction sensor 46 to the data management device 6. It also displays the coordinate system of the support display data received from the data management device 6 on the display 41 in synchronization with the eyewear device 4.

[0031] 4 Data management device 6 Figure 5 is a block diagram of the data management device 6 according to this embodiment. The data management device 6 is an information processing device, typically a personal computer, server computer, etc., but may also be a tablet terminal, smartphone, etc. In the illustrated example, it is shown as a laptop computer. The data management device 6 may be a single computer, a computer system in which multiple computers perform processing in a distributed manner, or it may logically utilize a portion of the processing resources of one or more computers. The data management device 6 may be configured as part of the eyewear device 4, or as part of the surveying instrument 2. The data management device 6 may be configured to perform some of the processing on the eyewear device 4, or to perform some of the processing on the surveying instrument 2.

[0032] The data management device 6 comprises at least a communication unit 61, a display unit 62, an operation unit 63, a control calculation unit 64, and a storage unit 65.

[0033] The communication unit 61 is a communication control device such as a network adapter, network interface card, LAN card, or Bluetooth® adapter, and enables the data management device 6 to communicate with the surveying instrument 2 and eyewear device 4 via wired or wireless means. The control calculation unit 64 can send and receive information with the surveying instrument 2 and eyewear device 4 via the communication unit 61. The data management device 6 may be installed in a local environment and communicate with it, or it may be implemented in a so-called cloud environment and communicate with the surveying instrument 2 and eyewear device 4 via communication means such as the internet.

[0034] The display unit 62 is, for example, a liquid crystal display. The operation unit 63 is, for example, a keyboard, mouse, etc., which allows the operator to input various commands, selections, decisions, etc.

[0035] The control arithmetic unit 64 is a control arithmetic unit that includes, for example, at least one processor (e.g., CPU) and memory (DRAM, SRAM, etc.). The processor reads data and programs stored in the storage unit 65 into the memory and executes them, thereby enabling the functions of the functional unit to be executed. In addition, at least a part of the control arithmetic unit 64 may be implemented by dedicated circuitry.

[0036] The control calculation unit 64 includes, as functional units, a synchronous measurement unit 641, a surveying process data reading unit 642, a work support image creation unit 643, and a work support image display unit 644.

[0037] The synchronous measurement unit 641 receives information regarding the position and direction of the surveying instrument 2 and the position and direction of the eyewear device 4. It then converts the coordinate space of the surveying instrument 2 and the coordinate space of the 3D position information created in the absolute coordinate system to match the coordinate space of the eyewear device 4, which has a common reference point as its origin, and transmits this conversion to the eyewear device 4. This allows the information acquired by the surveying instrument 2 and the 3D position information created in the absolute coordinate system to be managed in the same coordinate space as the eyewear device 4.

[0038] In this specification, "synchronization" refers to aligning the coordinate spaces of devices with different coordinate spaces, or the coordinate spaces of position and orientation information in design data, as described above, and managing the relative position and relative orientation of each device in a common coordinate space with a common reference point as the origin.

[0039] The surveying process data reading unit 642 reads the surveying process data 91 stored in the storage unit 65. Figure 7(A) is an example of the surveying process data 91, and Figure 7(B) is a schematic diagram showing the surveying process data 91 of Figure 7(A) as a plan view of the surveying site for understanding purposes.

[0040] The surveying process data 91 corresponds to the schedule and construction drawings for the surveying work. While construction drawings generally refer to drawings necessary for on-site construction, here they refer to design drawings with added information necessary for performing the surveying work. Furthermore, the construction drawings are created based on the design drawings of the surveying site, which are created using 3D CAD data in an absolute coordinate system. Therefore, the location-related information in the surveying process data 91 included in the construction drawings is location information in an absolute coordinate system.

[0041] The surveying process data 91 includes at least three-dimensional position information in absolute coordinates of the equipment installation points, model information of the surveying equipment used, and the measurement sequence of the equipment installation points. Furthermore, as shown in Figure 7(A), the model information of the surveying equipment used may include the model code and model number. Here, the model number is a number assigned by the manufacturer according to the function and version. In addition to the surveying equipment, it may also include model and model number information of accessories used with the surveying equipment (e.g., tripods). The surveying process data 91 may also include design drawings of the survey site. Furthermore, the surveying process data may include information about the measurement points, which are the objects of measurement, and information about the scanner's measurement range if the surveying equipment is a scanner. Information about the measurement points and the scanner's measurement range is position-related information.

[0042] The contents of the surveying process data 91 can be appropriately determined depending on what is to be displayed as the work support image 93 (hereinafter also simply referred to as the "work support image"). In this specification, surveying equipment includes all types of surveying instruments used in surveying work, specifically including total stations, 3D scanners, electronic levels, theodolites, GNSS devices, etc.

[0043] In the survey process data 91, information related to the locations of equipment installation points P1, P2, ... (hereinafter referred to as equipment installation point P unless otherwise specified), measurement point Q1, and measurement areas A, B, C, ... includes 3D positional information in an absolute coordinate system. Although it is shown as a plan view in Figure 7(B), the survey process data is created as 3D data because the positional information is included as 3D positional information in an absolute coordinate system. Such survey process data 91 is created in advance according to the plan of the survey.

[0044] The work support image creation unit 643 uses the work support data 92 stored in the storage unit 65 to create a work support image that reflects the three-dimensional position information of instrument points and the surveying equipment used, based on the work process at instrument points in the surveying process data 91.

[0045] The work support data 92 is a database that organizes external images of various surveying instruments, linked to their model information, as shown in Figure 8, for example. The external images of the surveying instruments are taken using at least two cameras and created as three-dimensional data with actual dimensions using photogrammetry techniques.

[0046] The work support image creation unit 643 takes the external image of the surveying equipment obtained as 3D data and creates a work support image 93 as 3D data synchronized with the eyewear device 4, assuming the equipment is installed at the equipment installation point P.

[0047] The work support image 93 is an image that reflects the three-dimensional position information of the instrument installation point and the surveying equipment to be used. Specifically, for example, if the instrument to be used at instrument installation point P2 is a scanner S07, the image is displayed to show the state in which the scanner S07 is installed on instrument installation point P2.

[0048] The work support image display unit 644 transmits the work support image created by the work support image creation unit 643 to the eyewear device 4 and displays it on the display 41.

[0049] The storage unit 65 is, for example, an HDD or SSD (Solid State Drive). The storage unit 65 stores the surveying process data 91 and work support data 92 mentioned above. In addition, the storage unit 65 stores programs for executing each function of the control calculation unit 60, if each function is implemented as software.

[0050] 5. Surveying support method Figure 9 is a flowchart showing an example of the processing of the control calculation unit in a surveying support method using the surveying support system 100. In the surveying support method using the surveying support system 100, the first steps S01 to S03 are performed as initial setup. Figure 10 is an image diagram of the steps S01 to S03.

[0051] First, in step S01, the worker sets a reference point and a reference direction at the observation site. Specifically, by selecting a known point and any point within the site, the position of the eyewear device 4 while the worker is standing and wearing the eyewear device is set as the reference point. In addition, within the site, a feature point other than the reference point (for example, the corner of a structure) is arbitrarily selected, and the direction from the reference point to the feature point is set as the reference direction.

[0052] Moving on to step S02, the administrator synchronizes the surveying instrument 2. Specifically, the worker places the surveying instrument 2 at any point on the site and determines the absolute coordinates of the surveying instrument 2 using the resection method or other known methods that include the above-mentioned reference point and feature point, as well as the absolute coordinates of the reference point and feature point selected in step S101. The surveying instrument 2 transmits the acquired absolute coordinates of the surveying instrument 2, the reference point, and the feature point to the data management device 6.

[0053] Next, the process moves to step S03, where the administrator synchronizes the eyewear device 4. Specifically, the administrator places the eyewear device 4 at the reference point, aligns the center of the display 41 with the reference direction, sets the (x,y,z) of the relative position sensor 45 to (0,0,0), and the (roll,pitch,yaw) of the relative direction sensor 46 to (0,0,0). The synchronization measurement unit 641 of the data management device 6 then manages the relative position and relative direction of the eyewear device 4 in a space with the reference point as the origin, with respect to the information from the eyewear device 4. Alternatively, for the synchronization of the eyewear device 4, it is preferable to provide a laser device on the eyewear device 4 to indicate the center and direction axis of the eyewear device 4, and use the laser as a guide to align it with the reference point and reference direction.

[0054] Through the above process, the eyewear device 4 can manage image data containing three-dimensional positional information created in the same absolute coordinate system as the reference point, in a space with the reference point as the origin, and display it superimposed on the on-site scenery in correspondence with the position and direction of the on-site scenery.

[0055] Next, in step S04, if the operator starts the execution of surveying support by pressing a function button 48b corresponding to a function button displayed on the display 41, then in step S05, the surveying process data reading unit 642 reads the surveying process data 91 stored in the storage unit.

[0056] Next, in step S06, the work support image creation unit 643 creates a work support image using the work support image data.

[0057] Next, in step S07, the work support image display unit 644 transmits the work support image created by the work support image creation unit 643 to the eyewear device 4 and displays it on the display 41. The display is updated in accordance with changes in the orientation and position of the eyewear device 4.

[0058] Next, in step S08, the process terminates when an exit command is entered via the operation switch.

[0059] Figure 11 shows an example of a work support image. In the figure, the dashed lines show the site scenery, and the solid lines show the work support image 93 created by the work support image creation unit 643. As shown in Figure 11(A), the eyewear device 4 displays the equipment installation point P, an image of the surveying equipment installed at the equipment installation point P, and information about the surveying equipment such as its model and type number, as the work support image 93, superimposed on the site scenery. Accessories for the surveying equipment may also be displayed in a similar manner. The image of the surveying equipment has actual dimensions in an absolute coordinate system, and the display 41 displays it enlarged or reduced according to the distance from the eyewear device 4.

[0060] As described above, in this embodiment, the work support image 93 displays images of at least the equipment installation point P and the surveying equipment to be used installed at the equipment installation point P, superimposed on the site scenery. This allows the worker to easily recognize the location of the equipment installation point P and the surveying equipment to be installed at that point P. In particular, since the surveying equipment is displayed using photographic images, it can be identified by color, shape, etc., and the worker can select the equipment to be installed from the instruments they have brought without paying special attention. In addition, information such as the model and type number is also displayed, so it can be checked as needed.

[0061] Furthermore, the work support image 93 may be switchable between three display modes, as shown in Figures 11(A) to 11(C): a display mode that shows all of the work support image 93 (Display Mode 1: Figure 11(A)), a display mode that shows only the instrument point of the work support image 93 (Display Mode 2: Figure 11(B)), and a non-display mode that does not show the work support image 93 (Non-teaching mode: Figure 11(C)).

[0062] In the illustrated example, the modes can be switched sequentially by pressing the function button 48b corresponding to the display 94 on the mode switching button.

[0063] Furthermore, in the work support images 93, instead of simultaneously displaying images of the equipment for all equipment installation points, the images of the equipment at equipment installation point P may be displayed sequentially one by one according to the process. Then, each time work at an equipment installation point is completed, the display may be updated to show the equipment at the next equipment installation point P by pressing the function button 48b corresponding to the "Next" button display 95 shown in Figure 11(D). At this time, a gauge 96 showing the current progress relative to the overall process may also be displayed on the display 41.

[0064] With the above configuration, workers can identify the equipment needed for the next task without having to re-examine the process chart. Furthermore, by simply following the on-screen instructions, they can execute the work exactly as planned in the process chart. In particular, displaying a gauge indicating the progress of the process allows workers to easily grasp the overall progress of the process.

[0065] 6. Variation 1 Figure 12 shows the work support data 92A of the surveying support system 100A according to Modification 1. The hardware configuration of system 100A is the same as that of system 100 shown in Figure 6, although it is not shown in the figure. In system 100A, the memory unit 65 provides work support data 92A instead of work support data 92. In addition to the contents of work support data 92, work support data 92A includes information on precautions to take when measuring, depending on the model. Specifically, if the total station TS01 XYX1 is a device that requires high measurement precision, it includes information on precautions such as "measure when there is little haze (visibility of approximately 20 km), and when there is moderate sunlight and no heat haze." If the total station TS04 YYX3 is a device that uses wireless communication, it includes information on precautions to take depending on the characteristics of the model, such as "measure when there are no obstacles, no nearby radio interference, and no noise interference." The precaution information may also include various other precautions related to measurement.

[0066] When performing the surveying support method, as shown in Figure 13, the work support image creation unit displays the model information, as well as measurement precautions 98 specific to the model, on the work support image 93A. For example, as shown in Figure 13, the model information "S07 XZ21" and the precaution information "Measure when there is slight haze (visibility of approximately 40 km), it is cloudy, and there is no heat haze" are displayed. The operator confirms that the current conditions meet the conditions of the precaution, and if the conditions are not met, takes appropriate action such as waiting to start the measurement until the conditions are met.

[0067] While experienced workers have internalized these points through experience, it is difficult for younger workers to remember all the details of the various surveying instruments. The above configuration allows even young workers to perform surveying tasks while paying close attention to the appropriate points.

[0068] 7. Variation 2 Figure 14 shows the work support data 92B of the surveying support system 100B according to Modification 1 of Modification 2. The hardware configuration of system 100B is the same as that of system 100, but the work support data 92B includes images of surveying equipment that explain the work content for each detailed process at each equipment installation point. Similar to the work support data 92 in system 100, the images of surveying equipment that explain the work content are created as 3D data. The images that explain the work content may be still images or videos.

[0069] Figure 15 is an example of a work support image 93B created based on work support data 92B. The work support image creation unit 643B (not shown) creates 3D data of an image illustrating the work content, which is not an image of the surveying equipment installed at the equipment installation point P, but an image of the surveying equipment installed at a predetermined distance offset from the equipment installation point P.

[0070] Figure 15 is an example of a work support image 93B created based on work support data 92B. The work support image 93B displays an image explaining the work content (in this case, it explains the process of turning a leveling screw to adjust the level and center the bubble in the bubble tube) next to the actual surveying equipment within the same field of view.

[0071] With the above configuration, workers can perform their tasks while viewing the work support image 93B displayed next to the actual surveying equipment. Since they can view the image explaining the work hands-free within the same field of view, even inexperienced workers can perform the tasks without stress.

[0072] Note that the work support data 92B and work support image creation unit 643B (not shown) and the work support data 92 and work support image creation unit 643 are not mutually exclusive; both may be provided.

[0073] II. Second Embodiment 1. Method for calculating the observation route Before describing the surveying support system 200 according to the second embodiment, the locations of the equipment installation points and the measurement sequence included in the surveying process data 91 will be explained. In the first embodiment, the locations of the included equipment installation points and the measurement sequence were simply described as being planned in advance.

[0074] In point cloud observation using a scanner, the positions of the equipment installation points and the measurement order must be set so that the measurement range from each equipment installation point overlaps to achieve the desired point cloud density. For convenience, a route connecting such equipment installation points in a single continuous line according to the measurement order is called observation route 97.

[0075] Such observation routes can be calculated by an information processing device such as a personal computer, based on the scanner's instrument information (coordinates of the instrument center, pulse interval settings, and scan rotation speed settings) and 3D CAD design data of the survey site.

[0076] Figure 16 is a three-dimensional representation of the area K where point cloud data can be acquired by the scanner. Figure 17 is a schematic plan view showing the setting of equipment installation points for calculating the observation route. Figure 18(A) shows an example of the calculated observation route 97, and Figure 18(B) shows an example of the observation route 97 displayed on the display 41.

[0077] In this embodiment, the scanner is a 3D laser scanner that scans the distance measuring light vertically and horizontally, and is further equipped with a rotating mirror in the vertical rotation drive unit of the 3D coordinate measurement unit 21 of the surveying instrument 2 above, which scans the distance measuring light 360° in the vertical direction.

[0078] Therefore, as shown in Figure 16, the point cloud data acquisition area K is a roughly hemispherical area A centered on the scanner's instrument center C. For the sake of drawing convenience, the instrument center C is shown as being on the ground, but in reality, it is located above the ground by the scanner's instrument height.

[0079] Furthermore, the density of the point cloud acquired by the scanner increases with increasing pulse interval of the ranging light, decreases with increasing scanner rotation speed, and decreases with increasing distance from the scanner's center. Thus, the point cloud density depends on the ranging light pulse interval setting of the scanner, the scanner's rotation speed setting, and the distance from the scanner's center.

[0080] In point cloud data observation, the required point cloud density is set according to the purpose of the observation and the client's requests. Within the scanner's observation range, there is a region K1 where the required point cloud density can be met with a single measurement, and a region K2 where the required point cloud density cannot be met with a single measurement, but can be met by overlapping with measurements from other points. Therefore, when designing the observation route 97, it is necessary to set the equipment installation point P so that the entire observation site meets the required point cloud density, for example, as shown in Figure 17(A).

[0081] However, since point cloud data observation is a survey to acquire 3D data of three-dimensional structures at the observation site, three-dimensional structures (for example, structures S1, S2, and S3 in Figure 17) exist at the observation site. When three-dimensional structures exist, for example, as shown in Figure 17(B), if the ranging light from the scanner installed at equipment installation point P is shone (reflected) by three-dimensional structure S1, the ranging light will not reach part B on the opposite side of the scanner from the three-dimensional structure, and point cloud data cannot be acquired. The same thing happens in three dimensions.

[0082] Therefore, using 3D CAD design data of the surveying site, a computer simulation is performed that takes into account in three dimensions the pulse interval setting of the scanner's ranging light, the rotation speed setting of the scanner, the distance from the center of the scanner's instrument, and the positional relationship with the three-dimensional structure. As shown in Figure 17(C), the position of the minimum number of equipment installation points P that can cover the entire observation area with the required point cloud density is calculated. In other words, the point cloud data acquisition area is calculated by excluding the part B on the opposite side of the scanner from the three-dimensional structure from the scanner's point cloud data acquisition area K, and these are overlapped to calculate the position of equipment installation points P that can cover the entire observation site with the minimum number of equipment installation points while achieving the required point cloud density.

[0083] Furthermore, as shown in Figure 18(A), a route is calculated that connects the calculated equipment installation points P in a single continuous line using the shortest possible path. This calculates the observation route 97 that connects the equipment installation points, which are arranged to cover the entire observation site with the required point cloud density, using the shortest possible path.

[0084] 2. Surveying support system 200 The surveying support system 200 replaces the eyewear device 4 and data management device 6 of system 100 with an eyewear device 204 and a data management device 206. Figure 19 is a block diagram of the eyewear device 204 and data management device 206 that constitute system 200.

[0085] 3. Eyewear device 204 The eyewear device 204 includes a camera 42 in addition to the eyewear device 4. Camera 42 is equipped with an image sensor such as a CCD or CMOS, and captures a front view image of the eyewear device 4 in real time. The image sensor has a Cartesian coordinate system with the camera center as the origin, and the local coordinates of each pixel are specified. The positional relationship between the center of the camera and the center of the eyewear device 4 is known, and the eyewear device 4 can convert the image acquired by camera 42 into its own coordinate space and manage it. Note that if the display 41 is a video see-through type and the eyewear device 4 is equipped with a camera, it may be provided as a common camera.

[0086] 4. Data management device 206 In addition to the data management device 6, the data management device 206 includes a control calculation unit 264 which comprises an image acquisition unit 645, a 3D transformation unit 646, a difference calculation unit 647, and an observation route recalculation unit 648, and replaces the work support image creation unit 643 with a work support image creation unit 643A.

[0087] The image acquisition unit 645 acquires multiple landscape images of the site taken by the camera 42. The landscape images are acquired so that at least the entire survey site is captured from two or more different points within the survey site.

[0088] The 3D conversion unit 646 converts multiple landscape images acquired by the image acquisition unit 645 into 3D data in an absolute coordinate system using photogrammetry techniques. The 3D data of the survey site obtained from the acquired images is called the site 3D data.

[0089] The difference calculation unit 647 calculates the difference between the 3D field data and the CAD design data included in the surveying process data 91.

[0090] The observation route recalculation unit 648 recalculates the observation route 97 when the field 3D data and the CAD design data differ (when the difference exceeds a predetermined threshold).

[0091] The recalculated route reflection unit 649 reflects the recalculated observation route 97 (equipment installation points and measurement order) in the work support data 92, creating the work support data 692.

[0092] The work support image creation unit 643A creates a work support image based on the work support data 692, which has been recalculated.

[0093] Figure 20 is a flowchart of the processing of the control calculation unit 60 of the surveying support method using the surveying support system 200.

[0094] In steps S101 to S103, the surveying instrument 2 and the eyewear device 204 are synchronized, similar to steps S01 to S03.

[0095] When surveying support starts in step S104, the surveying process data reading unit 642 reads out the surveying process data 91 in step S105.

[0096] In step S106, the worker uses camera 42 to take photographs of the entire survey site from at least two points. The image acquisition unit 645 acquires multiple landscape images.

[0097] Next, in step S107, the 3D conversion unit 646 converts the multiple landscape images acquired by the image acquisition unit 645 into 3D field data in an absolute coordinate system using photogrammetry techniques.

[0098] Next, in step S108, the difference calculation unit 647 calculates the difference between the 3D field data and the CAD design data included in the surveying process data 91.

[0099] Next, in step S109, the observation route recalculation unit 648 recalculates the observation route 97 if the field 3D data and the CAD design data are different (if the difference exceeds a predetermined threshold).

[0100] Next, in step S110, the recalculated route reflection unit 649 reflects the recalculated observation route 97 (equipment installation points and measurement order) in the work support data 92, resulting in work support data 692.

[0101] Then, in step S111, the work support image creation unit 643A creates a work support image based on the work support data 692 that reflects the recalculation. The following processes are the same as in steps S07 and S08.

[0102] According to the above configuration, even if there are discrepancies between CAD design drawings or construction drawings based on CAD design data and the actual site, the surveying support method can be executed after reflecting these discrepancies in the surveying process data 91, making it possible to quickly reflect changes in the plan at the site.

[0103] Although preferred embodiments of the present invention have been described above, these embodiments are merely examples of the present invention, and it is possible to combine them based on the knowledge of those skilled in the art, and such forms are also included within the scope of the present invention. [Explanation of Symbols]

[0104] 2:Surveying instrument 4,204: Eyewear display device 21: 3D Coordinate Measurement Unit 26: Communications Department 41: Display 42: Camera 44: Communications Department 45: Relative position detection sensor 46: Relative direction detection sensor 61: Communications Department 64,264: Control calculation unit 91: Surveying process data 93, 93A, 93B: Work support images 96: Gauge 100, 100A, 100B, 200: Surveying support system 641: Synchronized Measurement Unit 642: Surveying process data reading unit 643, 643A, 643B: Work support image creation department 644: Work support image display unit

Claims

1. a measuring instrument including a communication unit and a three-dimensional coordinate measurement unit; An eyewear display device including a display, a relative position sensor that detects its own position, and a relative direction sensor that detects its own direction; and a control and calculation unit including a synchronous measurement unit that matches a coordinate space of information relating to the position and direction of the eyewear display device, a coordinate space of the measuring device, and a coordinate space of an absolute coordinate system, and enables management in a space with a common reference point as the origin; a surveying support system that displays an image of the absolute coordinate system created by the control and calculation unit on the display, thereby enabling the image to be superimposed on a scene of a site observed by wearing the eyewear display device, the control and calculation unit comprises a surveying process data reading unit that reads out surveying process data including at least instrument information of the surveying instrument to be used, three-dimensional position information of the instrument installation point in the absolute coordinate system, and a measurement sequence of the instrument installation point; a work support image creating unit that creates a work support image based on the surveying process data; and a work support image display unit that transmits the work support image to the eyewear display device and displays it on the display; A surveying support system characterized in that the work support image includes an image of the equipment installation point and the surveying equipment to be used installed at the equipment installation point, and the eyewear display device makes it possible to observe the work support image superimposed on the scenery of the site.

2. 2. The surveying support system according to claim 1, wherein the work support image is updated so that images of the surveying equipment installed at the equipment installation point are displayed in sequence in accordance with the measurement order.

3. 3. The survey support system according to claim 1, wherein the work support image displays a gauge indicating the progress of a surveying process.

4. 4. A survey support system according to claim 1, wherein the instrument information of the surveying instrument to be used includes information on accessories to be used together with the surveying instrument to be used.

5. the work support image includes an image explaining the work content of the surveying process, The surveying support system according to any one of claims 1 to 4, characterized in that the work support image creation unit displays, at the equipment installation point, an image explaining the work content of the surveying process next to the actual surveying equipment installed at the equipment installation point.

6. the eyewear display device further comprises a camera; the control and calculation unit further comprises an image acquisition unit that acquires a plurality of landscape images of the entire surveying site taken from at least two or more positions using the camera; a three-dimensional conversion unit that converts the plurality of landscape images into site three-dimensional data that is three-dimensional data of the surveying site; a difference calculation unit that calculates a difference between the site three-dimensional data and design data; an observation route recalculation unit that recalculates the equipment installation points and the measurement sequence when there is a difference between the site three-dimensional data and the design data; and a recalculated route reflection unit that reflects the recalculated equipment installation points and the measurement sequence in the work support data; 6. The surveying support system according to claim 1, wherein the work support image creation unit creates the work support image based on the work support data to which the recalculation has been reflected.

7. A surveying support method using a measuring instrument including a communication unit and a three-dimensional coordinate measurement unit, and an eyewear display device including a display, a relative position sensor that detects a self-position, and a relative direction sensor that detects a self-direction, the method comprising: The coordinate space of the information relating to the position and direction of the eyewear display device is made to coincide with the coordinate space of the absolute coordinate system, so that it can be managed in a space with a common reference point as the origin; By displaying the image of the absolute coordinate system on the display, the image can be superimposed on the scene scenery observed by wearing the eyewear display device; Reading out surveying process data including at least instrument information of the surveying instrument to be used, three-dimensional position information of the instrument installation point in the absolute coordinate system, and a measurement sequence of the instrument installation point; Creating a work support image based on the surveying process data; transmitting the work support image to the eyewear display device and displaying it on the display; A surveying support method characterized in that the work support image includes an image of the equipment installation point and the surveying equipment to be used installed at the equipment installation point, and the eyewear display device makes it possible to observe the work support image superimposed on the scenery of the site.