System for providing augmented reality-based underground facility information, and method thereof

Abstract

The present invention relates to an augmented reality-based underground facility information provision system and method. The augmented reality-based underground facility information provision system according to the present invention comprises: an identification code attached to the vicinity of a location where an underground facility is buried and storing an identification ID; a first user terminal that transmits location and direction information corresponding to the point where the identification code is attached and the identification ID obtained through recognition of the identification code; an AR service server that stores and manages the identification ID received from the first user terminal and the location and direction information by matching them; and a second user terminal that requests the AR service server to provide information regarding the underground facility based on the identification ID obtained through recognition of the identification code. The AR service server is characterized by providing information regarding the underground facility to the second user terminal for generating an augmented reality image based on the location and direction information corresponding to the identification ID received from the second user terminal. Through this, accurate facility location information based on augmented reality can be provided without being limited by GPS signal reception status or location.

Description

Technology Field

[0001] The present invention relates to a technology for providing information on underground facilities, and more specifically, to a system and method for providing information on facilities buried underground using augmented reality. Background Technology

[0003] Augmented Reality (AR) technology overlays virtual objects containing additional information in real-time onto real-world images viewed by the user to display them as a single image, and is being used in various information provision fields.

[0004] In particular, since facilities buried underground, such as water and sewage pipes and power equipment, are difficult to identify visually and there are limitations to determining their locations using blueprints or surveying equipment, applications that provide the location of underground facilities based on augmented reality are being effectively utilized in the field.

[0005] As such, when providing facility location information through augmented reality, it is necessary to superimpose image objects related to the facility at the precise location corresponding to the actual image. Generally, according to conventional technology, the location and direction of the terminal are determined based on GPS information received from the terminal, and AR images are provided by superimposing image objects according to that location and direction.

[0006] However, in environments where GPS signal reception is poor, such as indoors, inside tunnels, or enclosed spaces enclosed by structures like sunshades, it is difficult to determine the location of the terminal via GPS; therefore, there are difficulties in providing AR images based on conventional GPS location information for facilities in such places.

[0007] Therefore, there is a need for a method to provide facility location information through augmented reality without being limited by GPS signal reception status or location. Prior art literature

[0009] Korean Patent Publication No. 10-0651508 (2006.11.22) The problem to be solved

[0010] The present invention has been devised to solve the problems of the prior art as described above, and aims to provide an underground facility information provision system and a method therefor that can provide facility location information through augmented reality without being limited by GPS signal reception status and location. means of solving the problem

[0012] The above objective can be achieved by an augmented reality (AR)-based underground facility information provision system according to one embodiment of the present invention, comprising: an identification code attached to the vicinity of a location where an underground facility is buried and storing an identification ID; a first user terminal that transmits location and direction information corresponding to the point where the identification code is attached and the identification ID obtained through recognition of the identification code; an AR service server that stores and manages the identification ID received from the first user terminal in correspondence with the location and direction information; and a second user terminal that requests the AR service server to provide information regarding the underground facility based on the identification ID obtained through recognition of the identification code, wherein the AR service server provides information regarding the underground facility for generating an augmented reality image to the second user terminal based on the location and direction information corresponding to the identification ID received from the second user terminal.

[0013] Here, the AR service server can correct the location and direction information stored corresponding to the identification ID based on the difference between the distance between the recognition code and the second user terminal and a preset reference distance when the second user terminal recognizes the recognition code, or the difference between the relative direction of the second user terminal with respect to the recognition code and a preset reference direction.

[0014] Additionally, the AR service server may further store information regarding a first distance corresponding to the distance between the recognition code and the first user terminal when the first user terminal recognizes the recognition code, and a first direction corresponding to the direction relative to the recognition code of the first user terminal, and correct the location and direction information stored corresponding to the identification ID based on the difference between the first distance and the second distance corresponding to the distance between the recognition code and the second user terminal when the second user terminal recognizes the recognition code, and the difference between the first direction and the second direction corresponding to the direction relative to the recognition code of the second user terminal.

[0015] The above objective may also be achieved by an augmented reality (AR)-based underground facility information provision method according to another aspect of the present invention, comprising: (a) a step in which an AR service server provides a map including a facility inquiry target area in response to a request from a first user terminal; (b) a step in which the first user terminal receives location and direction information corresponding to a point of attachment of an identification code attached around a location where an underground facility is buried on the map; (c) a step in which the AR service server stores the location and direction information by correlating it with the identification ID of the identification code recognized by the first user terminal; (d) a step in which the AR service server receives the identification ID of the identification code recognized by a second user terminal; and (e) a step in which the AR service server provides information regarding the underground facility for generating an augmented reality image to the second user terminal based on the location and direction information corresponding to the identification ID of the identification code received from the second user terminal.

[0016] Here, in step (b) above, the first user terminal can receive a direction value rotated relative to the true north direction of the map as the direction information.

[0017] In addition, the method may further include a step of modifying the initial location and direction information stored by the AR service server in correspondence with the identification ID based on the input of the first user terminal, based on the modified location and direction information entered through the second user terminal. Effects of the invention

[0019] As described above, according to the present invention, there is an effect of providing accurate facility location information based on augmented reality without being limited by the GPS signal reception status and location. Brief explanation of the drawing

[0021] FIG. 1 is a schematic diagram showing the schematic configuration of an augmented reality-based underground facility information provision system according to an embodiment of the present invention; FIG. 2 is a block diagram schematically showing the configuration of an AR service server according to an embodiment of the present invention; FIG. 3 is a flowchart illustrating a method for providing information on underground facilities based on augmented reality according to an embodiment of the present invention; FIG. 4 is an example of a screen provided to receive location and direction information from a first user terminal according to an embodiment of the present invention; and FIG. 5 is an example of a screen displayed on a first user terminal when the first user terminal recognizes a recognition code according to an embodiment of the present invention. Specific details for implementing the invention

[0022] Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, detailed descriptions of known functions or configurations that may obscure the essence of the present invention in the following description and the attached drawings are omitted. Additionally, it should be noted that identical components throughout the drawings are indicated by the same reference numerals whenever possible.

[0023] FIG. 1 is a schematic diagram showing the schematic configuration of an augmented reality-based underground facility information provision system (hereinafter referred to as the 'facility information provision system') according to an embodiment of the present invention. Referring to FIG. 1, the facility information provision system (100) according to an embodiment of the present invention includes an identification code (10), a first user terminal (20), a second user terminal (30), and an AR service server (40).

[0024] The recognition code (10) is a data-storing code attached to the vicinity of the location where the underground facility is buried, and stores an identification ID for identifying the recognition code (10). The recognition code (10) is not particularly limited to the type of code as long as the identification ID is stored as data, such as visible pattern codes like barcodes and QR codes, as well as invisible pattern codes, and can be recognized through a user terminal (20, 30) as described below. Meanwhile, the identification ID stored in the recognition code (10) is a symbol used as a standard to distinguish the recognition code (10) from other recognition codes (10), and can be composed of a combination of letters, numbers, special symbols, etc.

[0025] Below, we will explain the application of a QR code as an example of a recognition code (10).

[0026] The recognition code (10) is attached around the location where the target facility, such as a water pipe, power facility, or gas pipe, is buried, which the user wishes to view location information of the facility based on augmented reality. For example, the recognition code (10) may be attached to a wall or floor or a nearby structure around the location where the target facility is buried.

[0027] The first user terminal (20) performs a procedure to register location and direction information corresponding to a point where the recognition code (10) is attached to the AR service server (40) so that an AR-based facility information provision service can be provided through the AR service server (40) described later. To this end, the first user terminal (20) transmits the location and direction information corresponding to the point where the recognition code (10) is attached and the identification ID obtained through the recognition of the recognition code (10) to the AR service server (30).

[0028] The first user terminal (20) includes a communication module for communication with an AR service server (30), and has a camera module for capturing a recognition code (10), an application for recognizing and reading the recognition code (10), etc. built in. As the first user terminal (20), for example, a terminal such as a smartphone, tablet PC, or laptop may be used.

[0029] The second user terminal (30) is a terminal for querying facility information and requests the provision of AR-based information regarding the target underground facility by providing an identification ID obtained through the recognition of the recognition code (10) to the AR service server (40). Similar to the first user terminal (20), the second user terminal (30) also includes a communication module for communication with the AR service server (40), a camera module for capturing the recognition code (10), an application for recognizing and reading the recognition code (10), and an AR application for displaying data transmitted through the AR service server (40) as an augmented reality image, and terminals such as smartphones, tablet PCs, and laptops may be applied.

[0030] The AR service server (40) stores and manages location and direction information corresponding to a point where an identification code (10) is attached, received from the first user terminal (20), by matching it with the identification ID of the corresponding identification code (10), and provides an AR-based facility information provision service based on the stored information. When the AR service server (40) receives the identification ID of a predetermined identification code (10) from the second user terminal (30), it obtains location and direction information that is mapped to the identification ID and stored among the stored data, and provides information regarding underground facilities to the second user terminal (30) according to the location and direction information.

[0031] Below, with reference to FIG. 2, we will examine the configuration of the AR service server (40).

[0032] FIG. 2 is a block diagram schematically illustrating the configuration of an AR service server (40) according to an embodiment of the present invention. Referring to FIG. 2, the AR service server (40) includes a communication unit (41), a database (43), and a service providing unit (45).

[0033] The communication unit (41) communicates with the first user terminal (20) and the second user terminal (30) and transmits and receives data through various wired and wireless communication methods. For reference, the first user terminal (20) is a general term for a terminal that registers location and direction information corresponding to a point where the recognition code (10) is attached, and the second user terminal (30) is a general term for a terminal that requests a facility information provision service by transmitting the identification ID of the recognition code (10). There may be multiple first user terminals (20) and second user terminals (30). Additionally, the aforementioned distinction is based on their roles, and depending on the situation, a single user terminal may perform both the roles of the first user terminal (20) and the second user terminal (30).

[0034] The communication unit (41) transmits map data including the facility inquiry target area in response to a request from the first user terminal (20), and receives from the first user terminal (20) the identification ID of the recognition code (10) and location and direction information corresponding to the attachment point of the recognition code (10). In addition, the communication unit (41) receives a service request from the second user terminal (30) along with the identification ID of the recognition code (10) attached around the target facility to be queried, and transmits facility information in response to the request.

[0035] The database (43) stores and manages the identification ID of the recognition code (10) received from the first user terminal (20) and the location and direction information of the attachment point of the recognition code (10). The database (43) may also store information regarding the distance between the recognition code (10) and the first user terminal (20) when the first user terminal (20) recognizes the recognition code (10), and the relative direction of the first user terminal (20) to the recognition code (10) when the first user terminal (20) recognizes the recognition code (10). For reference, the distance and relative direction between the recognition code (10) and the first user terminal (20) can be calculated by comparing the shape or size of at least a portion of the image of the recognition code (10) captured through the camera module when the user terminal recognizes the recognition code with the standard shape and size of the recognition code (10).

[0036] Additionally, the database (43) stores map data including the area to be searched for underground facilities, and other general information regarding the target facilities, such as the buried location and pipeline information of the target facilities to be provided based on AR.

[0037] The service provider (45), in response to a service request from the second user terminal (30), creates an AR object regarding an underground facility based on location and direction information corresponding to an identification ID received from the second user terminal (30) among the location and direction information stored in the database (43), and provides it to the second user terminal (30). When a predetermined location and direction information is given, creating and providing an AR object regarding an underground facility according to the location and direction is based on known technology, so a detailed explanation regarding this is omitted for the sake of brevity.

[0038] For reference, as described above, the AR service server (40) may generate an AR object and provide it to the second user terminal (30), and the second user terminal (30) may generate an augmented reality image by superimposing the AR object onto a real image. However, alternatively, the AR service server (40) may provide only facility data corresponding to the location and direction, and the second user terminal (30) may be implemented to generate an augmented reality image by directly generating an AR object based on the above data.

[0039] Meanwhile, when providing AR-based facility information to the second user terminal (30), the service provider (45) may use the location and direction information stored in the database (43) as is, but may also apply it after correcting it to suit the situation of the second user terminal (30).

[0040] That is, when the second user terminal (30) requests the provision of AR-based facility information based on the identification ID, the service provider (45) can correct the location and direction information corresponding to the identification ID stored in the database (43) based on the distance between the recognition code (10) and the second user terminal (30) when the second user terminal (30) recognizes the recognition code (10) and the relative direction of the second user terminal (30) to the recognition code (10) when the second user terminal (30) recognizes the recognition code (10).

[0041] For example, it is assumed that when a first user terminal (20) recognizes a recognition code (10) attached to a wall, it recognizes the recognition code (10) by standing facing it vertically at a position spaced apart from the recognition code (10) by a distance 'a', and registers the corresponding position and direction in the database (43). In this case, if a second user terminal (30) requesting a service recognizes the same recognition code (10) from a direction facing the recognition code (10) at an angle at a position spaced apart by a distance 'b' which is different from 'a', there may be a difference between the position and direction registered by the first user terminal (20) and the current position and direction of the second user terminal (20). Accordingly, the service provider (45) can perform processing to correct the error resulting from the difference in relative position and direction between the first user terminal (20) and the recognition code (10) when location and direction information corresponding to the attachment point of the recognition code (10) is set by the first user terminal (20), and the difference in relative distance and direction between the second user terminal (30) and the recognition code (10) when a service request is made by the second user terminal (30).

[0042] To this end, the service provider (45) can correct the location and direction information corresponding to the identification ID of the database (43) based on the difference between the distance and relative direction between the first user terminal (20) and the recognition code (10) when the first user terminal (20) recognizes the recognition code (10) for setting the location and direction, and the difference between the distance and relative direction between the second user terminal (30) and the same recognition code (10) when the second user terminal (30) recognizes the recognition code (10) for requesting a service.

[0043] Alternatively, as described above, the service provider (45) may apply a preset reference distance value and reference direction value for error correction instead of the distance and direction information when the recognition code (10) of the first user terminal (20) is recognized, and correct the location and direction information stored corresponding to the identification ID based on the difference between the distance and relative direction between the second user terminal and the recognition code (10) and the reference distance value and reference direction value.

[0044] In this way, the AR service server (40) can provide a more accurate location-based AR service by considering the relative position and direction between the second user terminal (30) requesting facility information and the recognition code (10), and correcting the position and direction corresponding to the attachment point of the recognition code (10) initially registered by the first user terminal (20).

[0045] Underground facility information including AR objects provided by the service provider (45) is superimposed on a real-life image captured by the second user terminal (30) and displayed as an AR image.

[0046] FIG. 3 is a flowchart illustrating a method for providing information on underground facilities based on augmented reality according to an embodiment of the present invention. Hereinafter, with reference to FIG. 3, we will examine the operation performed in each component and the information exchange between components during the process of providing information on underground facilities based on AR through an AR service server (40).

[0047] Referring to FIG. 3, the AR service server (40) transmits a map including a facility inquiry target area in response to a request from the first user terminal (20) (S10).

[0048] The first user terminal (20) displays a map provided by the AR service server (40) on the display and receives location and direction information corresponding to the attachment point of the recognition code (10) attached near the underground facility on the map (S20).

[0049] FIG. 4 is an example of a screen provided to receive location and direction information from a first user terminal (20).

[0050] Referring to FIG. 4, the user can specify a location corresponding to the attachment point of the recognition code (10) by moving the position of the marker (M) on the map by actions such as dragging, and the direction can be specified by rotating the map. At this time, the location can be input as the latitude and longitude of the location on the map selected by the user, and the direction value can be input as a direction value rotated based on the true north reference line (NL) indicating the true north direction of the map.

[0051] Meanwhile, the location corresponding to the attachment point of the recognition code (10) may be entered by the user directly specifying the location on the map displayed on the first user terminal (20), but may also be entered based on the location value of the first user terminal (20) obtained using an external GPS receiver carried by the user.

[0052] Through the steps described above, when location and direction information corresponding to the attachment point of the recognition code (10) is input to the first user terminal (20), the first user terminal (20) recognizes the recognition code (10) and obtains the identification ID stored in the recognition code (10) (S30).

[0053] FIG. 5 shows an example of a screen displayed on the first user terminal (20) when the first user terminal (20) recognizes the recognition code (10).

[0054] Referring to FIG. 5, when the first user terminal (20) scans the recognition code (10), it can be seen that the identification ID value stored in the recognition code (10), the location and direction values ​​input into the first user terminal (20), and the distance value between the first user terminal (20) and the recognition code (10) are displayed. For reference, in FIG. 5, only the distance value between the first user terminal (20) and the recognition code (10) is displayed, but as previously described, the relative direction value of the first user terminal (20) relative to the recognition code (10) can also be displayed.

[0055] For reference, the distance and relative direction values ​​between the recognition code (10) and the first user terminal (20) can be determined based on the area or size of the recognition code (10) within the guide box (GB) for scanning the recognition code (10), and the size and shape of at least some of the patterns of the recognition code (10). At this time, the part of the recognition code (10) applied as a standard to determine the distance and relative direction may be a line, shape, or symbol that appears consistently as a common part for each recognition code (10).

[0056] For example, if the recognition code (10) is a QR code, the shape of the square pattern (R) on the three edges of the QR code can be applied as a standard for determining the distance or relative direction between the user terminal and the recognition code (10). Since the size or shape of the square pattern (R) captured through the first user terminal (20) appears differently depending on the relative position between the first user terminal (20) and the recognition code (10), the relative distance and direction between the first user terminal (20) and the recognition code (10) can be calculated based on the size and shape of the square pattern (R) appearing on the first user terminal (20) in this way. Alternatively, the relative position (distance and direction) may be calculated based on the overall shape or occupied area of ​​the recognition code (10) appearing within the guide box (GB).

[0057] The process for calculating such relative distance and direction can be performed internally within the first user terminal (20) through a code recognition application stored in the first user terminal (20).

[0058] Next, the first user terminal (20) transmits the identification ID of the acquired recognition code (10) and location and direction information corresponding to the point where the recognition code (10) is attached to the AR service server (40) (S40). At this time, the distance and relative direction values ​​between the first user terminal (20) and the recognition code (10) may be transmitted together.

[0059] The AR service server (40) stores the identification ID received from the first user terminal (20) and location and direction information, etc., in the database (43) (S50).

[0060] The above steps correspond to the process of registering location and direction information corresponding to the point where the recognition code (10) is attached to the AR service server (40) through the first user terminal (20). Once registration is completed in this manner, the service can then be provided using the registered information.

[0061] To explain this, a second user terminal (30) that wishes to look up facility information recognizes the recognition code (10) to obtain an identification ID, and transmits the identification ID to the AR service server (40) to request the provision of information regarding underground facilities (S60, S70). At this time, the distance and relative direction values ​​between the second user terminal (30) and the recognition code (10) may also be transmitted together.

[0062] The AR service server (40) obtains location and direction information stored in the database (43) that is mapped to the identification ID received from the second user terminal (30) in response to a request from the second user terminal (30), and provides underground facility information for generating an augmented reality image to the second user terminal (30) based on this (S80, S90).

[0063] That is, the AR service server (40) provides facility information, such as AR objects regarding underground facilities, that can generate augmented reality images on the second user terminal (30) according to location and direction information stored and mapped to an identification ID. The information regarding underground facilities provided by the AR service server (40), such as AR objects, is superimposed on a real-world image captured by the second user terminal (30) and displayed based on augmented reality.

[0064] Each step described above may be applied with additional steps added or modified as needed.

[0065] For example, between the aforementioned steps S80 and S90, an additional step may be added in which the AR service server (40) corrects the location and direction information stored in the database (43) based on the distance and relative direction information between the second user terminal (30) and the recognition code (10) received together when the service request is received through the second user terminal (30).

[0066] As described above, when correcting the stored location and direction information, the reference distance value and reference direction value between the pre-set user terminal and the recognition code (10) can be used, or the distance and relative direction value between the first user terminal (20) and the recognition code (10) can be applied when the first user terminal (20) recognizes the recognition code (10) for setting the location and direction.

[0067] Additionally, after providing facility information to the second user terminal (30), if the location or direction of the provided AR service does not match reality, a step may be performed in which the second user terminal (30) modifies the initial location and direction information registered by the first user terminal (20). The AR service server (40) may update the initially stored information based on the location and direction information modified by the second user terminal (30), and subsequently provide the service based on the updated information.

[0068] As described above, according to the augmented reality-based underground facility information provision system and method of the present invention, by storing location and direction information corresponding to an identification code provided near the location of an underground facility and applying this as a reference location of a user terminal that queries facility information, accurate facility location information can be provided through augmented reality without being restricted by the GPS signal reception status and location.

[0069] The foregoing description is merely an illustrative explanation of the technical concept of the present invention, and those skilled in the art to which the present invention pertains will be able to make various modifications and variations within the scope of the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are intended to explain, not limit, the technical concept of the present invention, and the scope of the technical concept of the present invention is not limited by these embodiments. The scope of protection of the present invention shall be interpreted by the claims below, and all technical concepts within an equivalent scope shall be interpreted as being included within the scope of rights of the present invention. Explanation of the symbols

[0071] 10: Recognition code 20: First user terminal 30: Second user terminal 40: AR Service Server 41: Communications Department 43: Database 45: Service provision

Claims

Claim 1 In an augmented reality (AR)-based underground facility information provision system, the system comprises: an identification code attached to the vicinity of a location where an underground facility is buried and storing an identification ID; a first user terminal that transmits location and direction information corresponding to the point where the identification code is attached and the identification ID obtained through recognition of the identification code, in order to register location and direction information corresponding to the point where the identification code is attached; and an AR service server that stores and manages the identification ID received from the first user terminal in correspondence with the location and direction information, and stores information regarding a first distance corresponding to the distance between the identification code and the first user terminal when the first user terminal recognizes the identification code, and a first direction corresponding to the relative direction of the first user terminal to the identification code. The augmented reality-based underground facility information provision system includes a second user terminal that requests the provision of information regarding the underground facility from the AR service server based on the identification ID obtained through the recognition of the recognition code, wherein the AR service server corrects the location and direction information stored corresponding to the identification ID received from the second user terminal based on the difference between the first distance and the second distance corresponding to the distance between the recognition code and the second user terminal when the second user terminal recognizes the recognition code, and the difference between the first direction and the second direction corresponding to the direction relative to the recognition code of the second user terminal, and provides information regarding the underground facility for generating an augmented reality image to the second user terminal based on the corrected location and direction information. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 A method for providing information on underground facilities based on augmented reality (AR), comprising: (a) a step in which an AR service server provides a map including a facility inquiry target area in response to a request from a first user terminal; (b) a step in which the first user terminal receives location and direction information corresponding to an attachment point of an identification code attached around a location where an underground facility is buried on the map, and transmits to the AR service server an identification ID obtained through the recognition of the input location and direction information and the recognition code in order to register the location and direction information corresponding to the attachment point of the recognition code to the AR service server; (c) a step in which the AR service server stores the location and direction information corresponding to the identification ID of the recognition code recognized by the first user terminal, and receives and stores from the first user terminal information regarding a first distance corresponding to the distance between the recognition code and the first user terminal when the first user terminal recognizes the recognition code, and a first direction corresponding to the relative direction of the first user terminal to the recognition code; (d) a step in which the AR service server receives the identification ID of the recognition code recognized by the second user terminal, and the second user A step of receiving information regarding a second distance corresponding to the distance between the recognition code and the second user terminal when the terminal recognizes the recognition code, and a second direction corresponding to the direction relative to the recognition code of the second user terminal; (e) a step in which the AR service server corrects the location and direction information stored corresponding to the identification ID received from the second user terminal based on the difference between the first distance and the second distance, and the difference between the first direction and the second direction;and (f) a method for providing information on underground facilities based on augmented reality, characterized by including the step of the AR service server providing information on underground facilities for generating augmented reality images to the second user terminal based on the corrected location and direction information. Claim 6 A method for providing information on underground facilities based on augmented reality, characterized in that, in step (b) above, the first user terminal receives, as direction information, a direction value rotated relative to the true north direction of the map. Claim 7 A method for providing information on underground facilities based on augmented reality, characterized in that, in claim 5, the AR service server further includes the step of modifying the initial location and direction information stored by corresponding to the identification ID based on the input of the first user terminal, based on the modified location and direction information entered through the second user terminal.

Images