Mr guide system for road marking construction work and work method
The MR guide system addresses parallax issues in road marking by using three-point calibration and GPS-based self-location estimation, enabling precise alignment of virtual guides with the real road surface, thus enhancing work efficiency and accuracy.
Patent Information
- Application Number
- JP2024039911
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-14
- Publication Date
- 2025-09-29
AI Technical Summary
Existing MR technologies for road marking work fail to provide accurate and consistent guide displays across wide areas, especially on uneven surfaces, due to parallax issues arising from the worker's standing position and viewpoint, leading to potential alignment errors.
An MR guide system utilizing three-point calibration with QR markers, combined with a CAD system, spatial information generation, and GPS-based self-location estimation, ensures precise alignment of virtual guides with the real road surface, independent of the worker's position or viewpoint, and incorporates aerial photography drones for detailed topography data capture.
The system provides accurate and efficient road marking by ensuring consistent guide displays that match the road surface, reducing alignment errors and improving work efficiency and accuracy, even on complex terrain.
Smart Images

Figure 2025140481000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a system that accurately displays construction guides for aligning work to workers via a Mixed Reality (MR) device at road marking construction sites, and a work method using the system. [Background technology]
[0002] When carrying out road marking work, the positions where road marking lines are to be painted on the road surface have traditionally been determined by marking work. In this process, workers indicate the painting positions by drawing guide lines directly on the road surface using handheld tools such as tape measures and chalk. As described in Non-Patent Document 1, this work requires advanced skills and precision because the positions and sizes of road markings are strictly regulated by law, and is so time-consuming that it accounts for approximately half of the total work time for the work.
[0003] In recent years, with the development of mixed reality (MR) technology, there have been cases where MR technology has been introduced to work guidance at construction sites. Patent documents 1 and 2 propose a method of improving the efficiency of on-site work by using MR display devices such as Microsoft's Hololens. By utilizing these MR display devices to guide construction work, it is expected that the previously time-consuming and laborious marking work can be significantly simplified, enabling work to be completed in a short time. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Publication No. 2022139041 [Patent Document 2] Patent No. 6913268 [Non-patent literature]
[0005] [Non-Patent Document 1] "Road Marking Handbook, 5th Edition" by the National Road Sign and Marking Association
[0006] The method shown in Patent Document 1 uses an MR display device to guide the positioning of pile heads, and is specialized for aligning "points" in a relatively small area. Similarly, Patent Document 2 proposes a method for using an MR display device to position exhibition booth divisions and booth partitions at an exhibition venue, which is said to be suitable for aligning "lines." Although each of these methods is effective for specific applications, they do not meet the requirements for aligning "surfaces" over a wide area, such as road marking work.
[0007] Road marking work requires precise guide display of marking drawings (hereinafter referred to as construction drawings) on the road surface. This requires strict alignment across the entire construction area as a "surface." Road surfaces often contain slopes and unevenness, and precise alignment is required while taking these topographical features into account. However, the methods proposed in Patent Documents 1 and 2 do not take into account alignment across such a wide "surface," and the MR display may appear to be floating above the actual ground. This creates parallax during work, which can cause the position of the guide relative to the road surface to deviate from its intended position depending on the worker's standing position and line of sight, potentially resulting in errors in the accuracy of the work.
[0008] Furthermore, in road marking work, it is essential for workers to be able to clearly recognize the construction drawings used as guides against the road surface in order to improve work efficiency and accuracy. Therefore, it is difficult to fully meet these requirements with conventional methods that utilize MR technology, and a new method is needed to solve the issues specific to road marking work. Summary of the Invention [Problem to be solved by the invention]
[0009] The problem to be solved is to display guide displays using MR (Mixed Reality) technology on road surfaces that are construction targets over a wide area, accurately and in a way that is easy for workers to work on, without depending on the worker's standing position or viewpoint direction. This invention solves this problem and provides consistent MR guide displays from any standing position or viewpoint, allowing workers to easily and accurately carry out road marking construction work. [Means for solving the problem]
[0010] The mixed reality (MR) guide system and method for road marking construction, which has a first characteristic configuration of the present invention, utilizes mixed reality (MR) technology to provide guidance to workers during road marking construction. This system's main components are an MR display system, a CAD system, and an MR data generation unit. The MR display system displays virtual objects superimposed on real space, the CAD system electronically creates construction drawings, and the MR data generation unit has the function of converting the drawing data created by the CAD system into data that can be visually displayed on the MR display system. This enables workers to efficiently and accurately perform work in real space by following the construction guide clearly displayed superimposed on the road surface to be constructed through the MR display system.
[0011] One of the distinctive features of this system is three-point calibration. This process allows for precise alignment between the drawing data created by the CAD system and the construction guide visually superimposed on the road surface using the MR display system. Specifically, the MR display system sets the correspondence between the position information of the actual road surface and the MR data at three designated points on the construction site. This position information setting utilizes QR markers to accurately recognize specific points on the road surface, achieving a high degree of agreement with the MR data.
[0012] The MR data generation unit converts the CAD data into data that will display the construction guide in the MR display system in a format that is most easily recognizable to workers. During this process, the visual attributes of the construction guide, such as color, line width, and display items, can be finely configured to achieve the optimal guide display according to the situation at the work site.
[0013] With the above configuration, the present invention provides accurate and efficient work guidance that is not dependent on the worker's standing position or viewpoint direction, even in wide-area road construction work, thereby improving the work efficiency and accuracy of road marking work.
[0014] The second characteristic configuration of the present invention provides an MR guide system and method for road marking construction work that accurately displays work guides over a wide work site area, ranging from several hundred meters to several kilometers. This system includes an MR display system that displays electronic virtual space objects superimposed on real space, a CAD system that electronically creates construction drawings, and a spatial information generation system that generates spatial information including 3D point cloud data and latitude and longitude information of the construction site. Using these systems, road marking construction workers can perform work by following the construction guide displayed superimposed on the work object in real space through the MR display system.
[0015] The spatial information generation system is equipped with a photography unit that captures multiple still images of the construction site, a GPS that acquires the latitude and longitude information of the images taken, and a 3D point cloud data generation unit that generates 3D point cloud data from the still images with latitude and longitude information attached. In particular, the photography unit and GPS are characterized by being composed of aerial photography drones, which makes it possible to collect road surface topography data of construction sites over a wide area and efficiently.
[0016] Furthermore, this system is capable of height calibration, so when the MR display system is first used at a construction site, it measures the height above ground of the display device and appropriately corrects the MR data based on that information. Height measurement is performed using a ToF sensor and QR markers, which ensures that the MR display accurately matches the real ground.
[0017] The system also has a GPS-based self-location estimation function, which uses RTK-GNSS to acquire latitude and longitude information and accurately determines the worker's location and the construction guide display content based on that information. This allows workers to proceed with work while checking the necessary construction guide in their exact location, even on construction sites that cover a wide area.
[0018] With the above configuration, the present invention can improve the efficiency and accuracy of work in road marking construction work over a wide area. [Effects of the Invention]
[0019] The MR guide system for road marking work according to the present invention, in both the first and second configurations, provides an efficient and highly accurate work method that replaces conventional marking and drawing work. By using this system, workers can utilize MR technology to receive accurate and consistent MR guide displays independent of their position or viewpoint direction in real space, thereby improving work efficiency and accuracy.
[0020] The first configuration provides intuitive guidance through the MR display system for road marking work over a wide area, enabling workers to easily and quickly install markings in accurate positions. The second configuration combines the spatial information generation system with advanced calibration and self-location estimation functions using GPS to realize guide displays based on precise 3D point cloud data, further improving work accuracy, even for road construction work over a wider area spanning hundreds of meters to several kilometers or on construction sites with complex terrain.
[0021] In addition, the system of the present invention provides a consistent guide display that is independent of the worker's position or line of sight, eliminating parallax during work and allowing the worker to view the display in line with the road surface from any position without changing the position of the guide relative to the road surface, which reduces the burden on the worker and further improves the quality of construction work.
[0022] Therefore, the present invention improves the efficiency and accuracy of work in wide-ranging road marking construction work, reduces the burden on workers, and contributes to improving the quality of road marking construction work as a whole. [Brief explanation of the drawings]
[0023] [Figure 1] Conventional road marking work [Figure 2] Block diagram of a road marking construction guide system having a first characteristic configuration (Example 1) [Figure 3] Construction drawings created using a CAD system [Figure 4] Example of MR guide data generated by the MR data generation unit [Figure 5] A head-mounted display, an example of an MR display system [Figure 6] Calibration operation using QR markers [Figure 7] Example of MR guide display after calibration [Figure 8] Example 1 of work according to MR guide display: Applying masking tape [Figure 9] Example 2 of work according to MR guide marking: marking painting [Figure 10] Block diagram of the road marking construction guide system having the second characteristic configuration (Example 2) [Figure 11] Block diagram of the spatial information generation system [Figure 12] Example of aerial photography drone [Figure 13] Examples of photos taken with an aerial drone [Figure 14] Example of 3D point cloud data generated by the 3D point cloud data generator DETAILED DESCRIPTION OF THE INVENTION
[0024] The invention described in this specification relates to an MR guide system for road marking work, and details embodiments for implementing the system. The present invention can be broadly divided into two aspects: a first aspect and a second aspect. These aspects aim to improve the efficiency and accuracy of road marking work, and each has features that allow it to adapt to different work environments and requirements.
[0025] The first characteristic configuration is mainly applied to road marking work in a small area or under specific conditions. This configuration employs a system configuration that allows workers to perform work intuitively and precisely by superimposing an electronic virtual space object on the real space, with an MR display system, CAD system, and MR data generation unit at its core.
[0026] On the other hand, the second feature configuration is specialized for use in wide-area road marking work and construction sites with complex terrain. This configuration incorporates a spatial information generation system and advanced calibration and self-position estimation technology using GPS to achieve highly accurate guide display even for work over a wide area. In particular, it is possible to provide guide display that perfectly matches the actual terrain by using aerial photography data taken by drones and 3D point cloud data.
[0027] These embodiments will be described in detail below with respect to their specific components, functions, and work processes. [Example]
[0028] The first implementation describes the specific configuration and operation method of an MR guide system that provides intuitive guidance to workers during road marking construction. This system enables workers to construct road markings efficiently and accurately using MR technology.
[0029] FIG. 1 shows a conventional road marking construction project. The road surface in FIG. 1 has numerous thin white lines drawn on it with chalk as painting guidelines, and workers can be seen painting the road while looking at these lines. The task of drawing these white lines on the road is called drawing work, and requires workers to draw each line on the road with chalk while measuring with a tape measure or the like, which takes up a lot of time during on-site work. This embodiment of the system allows workers to efficiently perform construction work by wearing an MR display system such as an MR headset and working while viewing a work guide superimposed on the road surface through the MR headset, specifically a life-size guide for the "Stop" sign to be painted.
[0030] Figure 2 is a block diagram showing the configuration of the MR guide system for road marking construction work. This system is composed of a CAD system 21, an MR data generation unit 22, and an MR display system 23, and provides a method for realizing precise guidance at construction sites.
[0031] The CAD system 21 is comprised of a personal computer and CAD software, and is a device that digitizes construction drawings and electronically creates the drawing data as CAD data. In this embodiment, general CAD software such as SketchUp Pro is used. As shown in Figure 3, road markings such as "Caution: Rear-end Collisions" are designed using CAD software, and drawings are accurately drawn according to the required dimensions and design.
[0032] The MR data generation unit 22 converts the drawing data created by the CAD system 21 into a format usable by the MR display system 23. This conversion process includes processing to generate data from the drawing that is optimal for MR display, such as extracting outlines and adjusting colors to maximize the visibility of road markings. As shown in Figure 4, the outlines of the markings are extracted and yellow coloring and other visual enhancements are applied to enable workers to intuitively identify them at the construction site. The right image in Figure 4 shows the guide display visible to workers through the MR display system 23. The outlines of the construction drawings are presented in high contrast against the freshly paved black road surface, making it suitable for guiding painting work.
[0033] The MR display system 23 reads the data processed by the MR data generation unit 22 and displays the painted position and size of the road markings superimposed on the real world through an MR display device that can be viewed by the worker. The worker wears an MR headset or other MR display device and accurately performs painting work by following the MR guide in the actual work environment. Figure 5 shows a worker wearing Magic Leap 2, an MR system display system. By wearing an MR display headset on the head as shown in Figure 5, the worker can visually view the MR guide hands-free according to the work position and direction. The MR headset is equipped with a camera that can capture and process images in the worker's line of sight.
[0034] The operating procedure of the MR guide system for road marking construction in this embodiment is as follows: First, a construction drawing designed in advance by a CAD system is electronically created by a CAD operator. This drawing data must accurately reflect the road dimensions, marking design, and placement. Once this CAD data is complete, it is sent to the MR data generation unit and converted into a format that can be interpreted by the MR display system.
[0035] The converted MR data is downloaded to an MR display device for direct visual reference by workers on-site. Workers wear MR headsets and view the exact position, direction, and inclination of road markings through the MR display system. At this stage, MR technology blends the real world with digital information to provide intuitive guidance to workers.
[0036] Next, the calibration process begins. This process is essential for synchronizing the MR data with real-world locations so that the MR-displayed markings accurately match the actual road environment. Operators mark the ground and place QR markers at designated road surface locations. This marking and placement of the QR markers ensures accurate positioning and orientation of the road markings.
[0037] Calibration involves three main steps. First, QR marker A is placed at the origin of the road marking. Next, QR marker B is placed at the middle or end of the marking to indicate the long side direction of the marking. Finally, QR marker C is placed on any side between A and B, taking into account the inclination of the ground. These markers are scanned using an MR display device and read by the MR display system. This process ensures that the MR-displayed marking is accurately positioned relative to the actual road surface, taking into account the inclination.
[0038] Figure 6 is an example of a calibration operation using a QR marker. By precisely placing QR marker A on the road surface where the part corresponding to the origin of the drawing in Figure 3 is located and scanning that QR marker A with an MR headset, the real-world position of QR marker A is linked to the position coordinates of the MR data in the MR display system. The right image in Figure 6 is the image seen by the worker through the MR display device, with a gray plate displayed in MR indicating that the scan and linking of the position coordinates have been completed. By performing the operation in Figure 6 for the remaining two points in turn, it is possible to accurately match the road surface to be worked on throughout the work area with the marking graphic plane of the MR data.
[0039] Through this calibration, workers use the MR display device to obtain specific guidelines for accurately painting road markings. Figure 7 is an example of the MR guide display after the calibration operation. Part of the marking to be painted, "Rear-end Collision Warning," is displayed within the field of view of the MR display device worn by the worker, and it can be seen that the worker is ready to work using this as a guide. Figures 8 and 9 are examples of construction work, with Figure 8 showing the application of masking tape to prevent paint from adhering to unwanted areas, and Figure 9 showing the marking painting work. The worker was able to perform the work accurately by looking only at the guide displayed on the MR display device, and there were no guidelines in the form of white lines on the road surface as in Figure 1. In other words, it can be seen that road marking construction work was possible without any prior drawing work.
[0040] In this embodiment, an MR headset such as Magic Leap 2 is used as an example of an MR display device, but a tablet or smartphone with a camera attached to a worker or painting equipment can also provide the same effect as an MR display device, and the device is not limited to an MR headset.
[0041] Also, although the example given is that of using QR markers for calibration, any object that can accurately measure the three-dimensional position of the road surface on which the marker is placed, such as a plate of a specific shape, can also be used, and the calibration is not limited to QR markers. [Example]
[0042] In Example 2, detailed technology and methods of an MR guide system that supports road marking work in a wide and complex environment will be described. This embodiment is intended for use in construction sites that cover a wide area.
[0043] Figure 10 is a block diagram showing the technical configuration of the MR guidance system for road marking work to guide wide-area work. This system is designed to address the unique challenges that arise in wide-area road work exceeding 1 km. Specific challenges include road marking work that covers a wide area, such as painting road centerlines. In such wide-area road marking work, the work area includes slopes and road surface undulations, so accurate alignment of the MR data to match the three-dimensional shape of the road surface is essential. It is also necessary to ensure the accuracy of the spatial recognition and self-localization of the MR display system even in wide-area work areas.
[0044] The system is composed of a spatial information generation system 101, a CAD system 102, a spatial CAD data generation means 103, an MR data generation unit 104, a GPS 105, and an MR display system 106. The spatial information generation system 101 uses advanced surveying equipment such as drones and 3D laser scanners to collect 3D point cloud data, which is then used to construct a detailed 3D model of a wide-ranging work area. The CAD system 102 creates designed construction drawings, which are then integrated with the 3D model constructed by the spatial information generation system 101 by the spatial CAD data generation means 103. This makes it possible to generate MR data that matches the 3D shape of the work area.
[0045] The GPS 105 provides accurate position information for workers over a wide area, and the MR display system 106 uses this position information to accurately align the worker's MR display device. This allows workers to perform work based on accurate MR guidance that takes into account the undulations of the road surface over a wide area. The MR data generation unit 104 also converts data that integrates CAD data and spatial information into a format that can be handled by the MR display system 106, minimizing errors in the MR display system's spatial recognition for wide-area work. This technical configuration enables accurate work guidance using MR technology even in wide-area road marking work, significantly improving the quality and efficiency of work at large, complex construction sites, which was difficult to achieve with conventional methods.
[0046] 11 shows the configuration of the spatial information generation system in the MR guide system for road marking construction work. The spatial information generation system is made up of a photographing unit 111, a GPS 112, and a 3D point cloud data generation unit 113.
[0047] The photographing unit 111 is a device for capturing multiple still images of the construction site, and collects detailed image data of the entire construction site using drones, ground-based camera equipment, etc. This image data is important for capturing all the details necessary for constructing road markings, such as the construction area's topography, obstacles, and road conditions.
[0048] The GPS 112 provides latitude and longitude information for each captured still image. This highly accurate location information assigns captured images to precise geographic locations, improving accuracy during subsequent processing. This information is essential for providing geographic context to image data and for accurate image-to-image alignment during the subsequent 3D modeling process.
[0049] For example, a drone such as DJI's MATRICE 300RTK is used for the photographing unit 111 and GPS 112. As can be seen from the flight diagram shown in Figure 12, this drone is equipped with an ultra-high resolution camera and GPS, and has the ability to take multiple photos of the road surface in the construction area from the sky, accompanied by GPS information (latitude and longitude information). The aerial photograph shown in Figure 13 is a sample photo of the road surface in the construction area, and the large amount of photographic data covering the entire construction site becomes input data for the 3D point cloud data generation unit 113.
[0050] This drone photography method enables the efficient and rapid collection of photos with latitude and longitude coordinates of road surfaces over a wide construction area. The collected photo data has sufficient resolution to capture the detailed topography and road surface characteristics of the construction site, significantly improving the accuracy of generating 3D point cloud data. This process is important for accurately mapping the terrain relief and slope of large construction areas, creating a more accurate MR guide that is more representative of the real environment for subsequent MR data generation and integration.
[0051] The introduction of drones significantly reduces the time required for surveying compared to traditional ground surveying, while also enabling the collection of detailed data over a wide area. The data collected in this way is then used in a spatial information generation system to build a precise 3D model of the work area.
[0052] The three-dimensional point cloud data generation unit 113 uses the images obtained by the photographing unit 111 and the latitude and longitude information obtained from the GPS 112 to generate three-dimensional point cloud data of the construction site.
[0053] Figure 14 shows an example of 3D point cloud data generated by the 3D point cloud data generation unit 113 based on photos with latitude and longitude coordinates taken by a drone. In this process, specialized software such as DJI's Terra is used to reconstruct the 3D shape of the road surface of the work area from still images. Image data such as that shown in Figure 13, taken from the air by a drone, is an important source of information for accurately understanding the topography and road conditions of a construction site.
[0054] Image processing algorithms such as Structure from Motion (SfM) are used to generate 3D point cloud data. SfM algorithms automatically detect common feature points in a group of images taken from different angles and analyze the relative positions of those feature points to reconstruct the 3D structure of the object. This process estimates the position and orientation of each image and synthesizes a large point cloud dataset consisting of dozens to hundreds of images. The result is a highly accurate 3D model of the construction area, accurately reproducing even the subtle undulations and slopes of the road surface as 3D information.
[0055] The core technology of the MR guide system for road marking construction is to precisely match the 3D coordinates of the real world with the MR data in the electronic 3D space. This precise correspondence is essential to ensure that the 3D MR data that workers see through the MR display system is accurately overlapped with the real terrain.
[0056] During the calibration process, workers move to three specific locations on the construction site and use GPS to obtain the latitude and longitude information of these locations. This information is entered into the MR display system, and adjustments are made to match the coordinates of the MR data with the CAD data with latitude and longitude generated by the spatial CAD data generation system. This allows the MR data to be matched as a "surface" to the real terrain, enabling accurate MR display that is tailored to the undulations and slopes of the construction site.
[0057] The height above ground where the MR display system is located is also an important measurement during calibration. This height is measured using a ToF sensor or QR markers installed on the ground and used to correct the MR data. This ensures that the guidance provided by the MR display system accurately fits the real terrain, allowing workers to work according to intuitive visual guidance.
[0058] After calibration, self-location estimation determines the worker's location and the content of the construction guide display based on the latitude and longitude information acquired by GPS. The MR display system incorporates this GPS information in real time and continuously updates the MR guide display according to the worker's location as he or she moves. This enables workers to work safely and efficiently by following intuitive visual guidance, even on large-scale construction sites with complex topography, significantly improving the quality and efficiency of work.
[0059] In this embodiment, RTK-GNSS (Real Time Kinematic Global Navigation Satellite System) is used to generate spatial information. This system makes it possible to obtain highly accurate latitude and longitude information with an error of a few centimeters, contributing to the generation of more accurate 3D point cloud data. RTK-GNSS's highly accurate position information is essential for precise mapping, particularly at construction sites with extensive and complex terrain, and for road marking work based on MR guidance.
[0060] In addition, the use of RTK-GNSS improves the accuracy of calibration and self-localization of the MR display system, allowing workers to receive accurate guidelines tailored to the site's terrain through the MR display device. This technology directly improves the quality of work, resulting in increased work efficiency and accuracy. Therefore, the use of RTK-GNSS is effective in all work processes that require highly accurate position information.
[0061] The imaging unit and GPS used to generate spatial information in this embodiment are not limited to aerial photography drones. While an aerial photography drone is used as an example, this is merely an example, and other devices, such as an in-vehicle camera equipped with GPS, can also be used. What is important is the use of a device capable of efficiently collecting wide-area topographical and road surface information and generating highly accurate 3D point cloud data, including fixed camera systems and handheld camera systems. Therefore, this system can be used to expand its range of applications by combining various imaging and location information technologies.
[0062] In this embodiment, road marking work has been described as a specific example of road surface construction, but the construction work is not limited to road surfaces, and the present invention is also widely applicable to construction work on the ground and road construction. [Industrial Applicability]
[0063] The MR guide system for road marking work of this invention is intended for a wide range of construction work, including road construction, parking lot development, and field marking for sports facilities, and has a wide range of industrial applications. Compared to conventional methods, this system incorporating MR technology significantly improves work accuracy and shortens work time. This enables the establishment of efficient work processes and contributes to improving productivity in the construction and civil engineering industries.
[0064] This system's true value is particularly evident in large-scale construction work and work in areas with uneven terrain. Calibration technology based on 3D point cloud data and highly accurate GPS information enables precise positioning that was difficult to achieve with previous methods, enabling more accurate road marking work.
[0065] The present invention also contributes to improving worker safety. By displaying guidance using an MR display device, workers can proceed with their work while always understanding the situation on-site, reducing the risk of accidents. In this respect, the introduction of this system offers significant benefits at construction sites where safety is the top priority.
[0066] The introduction of this invention is expected to promote innovation in work processes in the construction and civil engineering industries, particularly in road marking and road construction. Furthermore, its applicability extends beyond the construction industry to a wide range of fields involving construction on the ground, such as landscape design, park management, and even the installation of art installations, making it possible for it to be widely used across the entire industrial sector. [Explanation of symbols]
[0067] 21 CAD systems 22 MR data generation unit 23 MR display system 101 Spatial Information Generation System 102 CAD system 103 Spatial CAD data generation system 104 MR Data Generation Unit 105 GPS 106 MR Display System 111 Filming Department 112 GPS 113 3D point cloud data generation unit
Claims
1. This is a system for guiding workers in road marking work using Mixed Reality (MR), The system comprises an MR display system that displays an electronic virtual space object superimposed on a real space, a CAD system that electronically creates construction drawings, and an MR data generation unit that converts drawing data created by the CAD system into data that can be directly visually displayed on the MR display system, An MR guide system for road marking construction that enables road marking construction workers to carry out work in real space by following construction guides displayed as images superimposed on the construction target through an MR display system.
2. 2. An MR guide system for road marking construction work according to claim 1, wherein said MR display system is in the form of a head-mounted display worn on the head of a worker.
3. 2. The MR guide system for road marking construction work according to claim 1, wherein the MR display system links positions and MR data at three locations on the road surface of the construction target in order to match the drawing data created by the CAD system with the position at which the construction guide is superimposed on the road surface of the construction target.
4. 4. The MR guide system for road marking construction work according to claim 3, wherein QR markers are installed at three locations on the road surface, the positions of each QR marker are recognized by an MR display system, and the MR data are linked to the QR markers.
5. 2. The MR guide system for road marking construction work according to claim 1, wherein the MR data generation unit receives CAD data in a specific data format as input and can set visual attributes such as color, line width, display items, etc. of the construction guide to be displayed on the MR display system.
6. The system comprises an MR display system that displays electronic virtual space objects superimposed on real space, a CAD system that electronically creates construction drawings, a spatial information generation system that generates spatial information including three-dimensional point cloud data and latitude and longitude information of a construction site, a spatial CAD data generation means that maps the spatial information of the construction site generated by the spatial information generation system onto the construction drawings created by the CAD system, an MR data generation unit that generates data that can be displayed on the MR display system from the spatial CAD data, and a GPS that acquires latitude and longitude information of the worker's location and inputs it into the MR display system, An MR guide system for road marking construction that enables road marking construction workers to carry out work in real space by following construction guides that are displayed as images superimposed on the construction target through an MR display system according to their position.
7. 7. The MR guide system for road marking construction work according to claim 6, wherein the MR display system links positions and MR data at three locations on the road surface of the construction target in order to match the drawing data created by the CAD system with the position at which the construction guide is superimposed on the road surface of the construction target.
8. 7. The MR guide system for road marking construction work according to claim 6, wherein the spatial information generation system comprises: a photographing unit that acquires a plurality of still images of the construction site; a GPS that acquires latitude and longitude information at which the still images were taken; and a three-dimensional point cloud data generation unit that generates three-dimensional point cloud data of the construction site from the plurality of still images to which the latitude and longitude information has been added.
9. 9. The MR guide system for road marking construction work according to claim 8, wherein the photographing unit and GPS of the spatial information generating system are configured by an aerial photography drone.
10. The MR guide system for road marking construction according to claim 6 has a function of measuring the height from the ground of the position where the display device of the MR display system is located and correcting the MR data based on the height information when the MR display system is first used at the construction site. This height measurement includes a method of recognizing and measuring a ToF sensor mounted on the MR display system or a QR marker installed on the ground at the construction site using a camera mounted on the MR display system.
11. 7. The MR guide system for road marking construction work according to claim 6, wherein the GPS acquires latitude and longitude information using an RTK-GNSS system, and the latitude and longitude information is used as input to determine the worker's position and the contents of the construction guide display.
12. A method for enabling road marking construction workers to perform work in real space by following a construction guide, comprising the steps of: inputting an electronically created construction drawing, converting the construction drawing into data that can be directly visually displayed on an MR display system, using the MR display system to display a video of the converted data superimposed as an object in an electronic virtual space on a construction object in real space, and having the worker perform road marking construction work while referring to the video display.
13. 13. The method of claim 12, further comprising the step of performing calibration between the MR display system and the actual construction object for accurate alignment at the work object location.
14. 14. The method of claim 13, wherein the calibration step includes one or more of: synchronizing the MR system display with a real-world location using three or more distinct points; linking the MR data with a real-world location using QR markers or other visual markers; and calibrating based on external location information using a location information system such as GPS or RTK-GNSS.
15. 13. The method according to claim 12, further comprising the step of allowing an operator to customize visual attributes such as color, line width, and display items of objects displayed in the MR data generating step.
Citation Information
Patent Citations
Support method for marking pile head reinforcing bar position
JP2022139041A
Marking and line drawing work method using MR (mixed reality) vision
JP6913268B2