Method for obtaining information about tourist points of interest using augmeted reality technology

Abstract

The invention relates to the field of organizing tourist and excursion routes using augmented reality technology. The technical result of the invention, which consists in increasing the amount of time that users spend at points of interest, is achieved by means of a method for obtaining information about tourist points of interest using augmented reality technology, in which first, for each tourist point of interest, a database containing augmented reality objects is generated, each augmented reality object having a unique design; then, on a map provided by a mapping service, an enclosed area is generated around each tourist point of interest, said area containing a sector for user access to the augmented reality object database for the given tourist point of interest; next, the mapping service plots a user's route to a tourist point of interest; once situated inside the sector for user access to the augmented reality object database, the user selects, according to their interest, a unique design option corresponding to the point of interest; the user then views content accompanying the augmented reality object having said unique design, thus allowing the user to obtain information about the tourist point of interest with the aid of the augmented reality object.

Description

[0001] A METHOD OF OBTAINING INFORMATION ABOUT TOURIST POINTS OF INTEREST USING AUGMENTED REALITY TECHNOLOGY

[0002] DESCRIPTION

[0003] The invention relates to the field of organizing tourist and excursion routes using augmented reality technologies [G06F17 / 00, G06Q10 / 00, GO6F3 / O1],

[0004] A METHOD FOR IMPROVED DETERMINATION OF POINTS OF INTEREST is known from the prior art [US8239130B1 12.11.2009], which includes determining the position and direction of movement of a mobile device, determining a point of interest based on the position and direction of movement of the mobile device, identifying one or more points of interest (POI), determining for each of the identified POIs the distance between the mobile device and the corresponding POI, selecting one or more identified POIs based on the distances, and displaying information identifying the selected POIs on the user interface of the mobile device.

[0005] Also known from the prior art is a PORTABLE VIRTUAL OVERLAY SYSTEM [US7557736B1 31.08.2005] which includes a global positioning system (GPS) receiver for detecting the global position of the HVOS device; a direction sensor and a tilt sensor for determining the direction and tilt of the HVOS device; a communication module for transmitting information on the position, direction and tilt to a data storage; and an input / output display. The data storage is configured to receive information on the position, direction and tilt, as well as to generate geocoded data for transmission to a server, wherein the server is configured to receive geocoded data, as well as to convert and visualize the geocoded data into an image. The user can point the HVOS device at an object, wherein the HVOS device will create an image characterizing the object.The closest in technical essence are the METHOD OF INTERACTION WITH POINTS OF INTEREST USING AUGMENTED REALITY TECHNOLOGY [US2011199479A1 12.02.2010] implemented on a portable communication device having a processor, an image capture device and a display, wherein the method includes: the ability to display a captured image; the ability to determine the geographic location of the device; the ability to process cartographic data describing map objects, including streets, buildings, and points of interest near the device, wherein the cartographic data is additionally processed to create a route from the geographic location of the device to a selected point of interest; the technical solution includes the ability to demonstrate the route to the user by comparing the cartographic data describing the route with the geographic location and direction of the camera of the device with the capture of the image for comparing the depicted objects in the captured image with the objects described on the map.

[0006] The main technical problem of analogues and prototypes is the low involvement of users in the study of points of interest on the route, due to the fact that the maps in cartographic services do not provide special places from which the point of tourist interest is viewed (which significantly reduces the convenience of using augmented reality technology). Also, the above-described technical solutions do not advise the ability to view augmented reality objects for different time periods or taking into account the trend of development of architectural art in the future. All of the above reduces the interest of users in tourist points of interest, does not contribute to the study of objects over a long period of time.

[0007] The objective of the invention is to eliminate the shortcomings of the prototype.

[0008] The technical result is an increase in the amount of time that users spend near points of interest. The said technical result is achieved due to the fact that the method for obtaining information about tourist points of interest using augmented reality technology is characterized by the fact that initially, for each point of tourist interest, a database with augmented reality objects is formed, each of the augmented reality objects has a unique design, then on the map of the cartographic service, a closed area is formed around each tourist point of interest, inside which the user's access sector to the database of augmented reality objects of this point of tourist interest is located, then, using the cartographic service, a route of the user's movement to the tourist point of interest is built,when the user is in the user access sector to the database of augmented reality objects, the user selects the desired unique design option for the point of interest, after which he views the content with the augmented reality object having a unique design, receiving information about the tourist point of interest.,

[0009] In particular, a closed area in the form of a circle is formed on the map of the cartographic service, inside which the user's access sector to the database of augmented reality objects of a given point of tourist interest is located.

[0010] In particular, a closed area in the form of a square is formed on the map of the cartographic service, inside which the user's access sector to the database of augmented reality objects of a given point of tourist interest is located.

[0011] In particular, a closed area in the form of a hexagon is formed on the map of the cartographic service, inside which the user's access sector to the database of augmented reality objects of a given point of tourist interest is located.

[0012] In particular, the user receives information about a tourist point of interest using an augmented reality object with the simultaneous use of text information.

[0013] In particular, the user receives information about a tourist point of interest using an augmented reality object with the simultaneous use of audio information.

[0014] In particular, the user receives information about a tourist point of interest using an augmented reality object with the simultaneous use of video information. Fig. 1 shows the hierarchy of the database used in the claimed method.

[0015] Fig. 2 shows a variant of implementation of the claimed method with three points of interest on the route.

[0016] The figures show: 1 - augmented reality database; 2 - augmented reality database linked to a specific point of interest; 3 - augmented reality objects linked to a specific point of interest and a specific type; 4 - point of interest; 5 - route; 6 - closed area; 7 - sector.

[0017] The method of obtaining information about tourist points of interest using augmented reality technology is characterized by the fact that it contains a preparatory stage.

[0018] The preparatory stage includes the formation of a database.

[0019] The formation of the database includes the formation of a separate database of augmented reality objects for each point of interest 4. In this case, when preparing a database of augmented reality objects (three-dimensional objects) for a specific point of interest 4, various materials are used, where the point of interest 4 is captured in various views (for example, the possible evolution of its design in 5, 10, 15 years is depicted). Among the set of materials, where the point of interest 4 is captured in various views (with several unique design options), several such views are selected and initial visual materials are formed for each of the several views.

[0020] Visual materials may include, for example, photographs, newsreels, artistic images, a 3D model based on historical sources, a 3D model based on the architects’ ideas about the possible design of the object, etc.

[0021] Based on the available information for each selected type - time interval (initial visual materials), an augmented reality object is formed (made, for example, in the form of a 3D model, or a 3D model with animation or video). In this case, the augmented reality object formed for a specific time interval is characterized by unique visual elements, in accordance with the initial visual materials, i.e. it visually characterizes a unique design (for example, in accordance with the time interval characterizing the expected development of the object's design in several years). Thus, a database of augmented reality objects is formed for each point of interest 4, and for each point of interest 4, several categories of augmented reality objects are formed that differ from each other and characterize the appearance of the point of interest 4 in different time intervals in the future.

[0022] The hierarchical structure of the formation of the database of augmented reality objects is shown in Fig. 1. In accordance with Fig. 1, the database of augmented reality 1 is divided into a finite number of databases of augmented reality with reference to a specific point of interest 2, each of which, in turn, is divided into a finite number of objects of augmented reality with reference to a specific point of interest and a specific type 3. The specified database is stored on the server, with the possibility of access to it by the user through the application.

[0023] After the formation of the database of augmented reality objects, 7 access sectors are formed on the map linked to the mapping service, to the augmented reality objects. In this case, a mapping service is understood to be any technology (implemented, for example, by means of applications or a set of applications) that allows for a unique comparison of a point on the map (linked to the mapping service) and its coordinate, as well as a unique comparison of a point on the map linked to the mapping service with the coordinate of the user using the service. Examples of mapping services include, for example, Yandex maps, Google maps, etc.

[0024] When forming the sector 7 of access to augmented reality objects, a closed area 6 is formed around each point of interest 4 on the map. The closed area 6 is formed based on the fact that when located inside the specified area, direct visual access to the given point of interest 4 is provided.

[0025] In an embodiment, the closed region 6 may be a circle, rectangle, hexagon, octagon, etc. (for example, when forming closed regions 6 in automatic mode).

[0026] In an embodiment, the closed area 6 on the map may have a complex geometric shape (for example, when forming closed areas 6 in manual mode, when studying the point of interest 4 on site, with the discovery of areas from which a direct view of the point of interest 4 will open).

[0027] In the embodiment of the claimed method, routes 5 connecting various points of interest 4 (with closed areas 6) are formed on the map in advance. In the embodiment of the claimed method, the user independently selects several points of interest 4 and the sequence of their visits, during which the route 5 connecting the selected points of interest 4.

[0028] The executive stage of the method is implemented as follows.

[0029] The user, using the mapping service, sees his / her geographic location on the map and sees the location of tourist points of interest 4 on the map. When selecting a specific point of interest 4 on the map, the service automatically builds a route 5 to the specified point of interest 4, while the user is shown a closed area 6 around the point of interest 4, the internal space of which is a sector 7 for accessing the database of augmented reality objects. When the user moves to the tourist point of interest 4, he / she preferably moves along the route 5 generated by the service, constantly comparing his / her position on the map relative to the point of interest 4 to which he / she is moving. When approaching the point of interest 4, the user crosses the closed area 6 on the map around the point of interest 4 and enters the sector 7 for accessing the database of augmented reality objects.

[0030] In this case, the algorithm by means of which access to the augmented reality objects database is provided works as follows. If the user's coordinate point is outside the closed area 6, access to the database is not provided. If the user's coordinate point is inside the closed area 6 (in the access sector 7), then access to the augmented reality database with reference to a specific point of interest 2 is provided. Thus, unambiguous links between map sections (specific access zones) and specific augmented reality databases with reference to a specific point of interest 2 are formed in advance on the server.

[0031] Thus, when the user is in sector 7, the user has the opportunity to use the augmented reality database on the mobile device with a link to a specific point of interest 2. In the interface menu, the user has the opportunity to select a specific type (unique design - how the object will presumably look in 5 / 10 / 15 years) of visual information about which he would like to receive. After selecting the design, the application used by the user (with the integrated mapping service) is connected to a specific augmented reality object with a link to a specific point of interest and a specific type 3. The specified augmented reality object is downloaded from the server to the user's device and is displayed when using a video camera when pointing at the object itself in the physical world.The user then views content about a specific point of interest 4 at a specific time period, using augmented reality technology.

[0032] After viewing, the user has the option to view content about a specific point of interest 4 at another time. The user also has the option to select another point of interest 4 and begin moving to it along a newly generated route 5.

[0033] In various implementation options, along with the augmented reality content, the user may simultaneously be shown text information, and audio and / or video information may be played.

[0034] In various embodiments of the claimed method, the user can select several points of interest and the sequence of their visits at his own discretion, after which the mapping service will build a route 5 for visiting them. Thus, the user can create his own tourist route 5. The user can also choose from pre-formed tourist routes 5 with points of interest 4 and the sequence of their visits specified in advance.

[0035] Also in the implementation options: when selecting a point of interest 4 when following a point of interest 4 or when being directly with a point of interest 4, the user may have access to other information (text, video, audio) about the point of interest 4.

[0036] An example of technical implementation of the claimed method.

[0037] 1. The user, using a mobile phone, goes to the application store (for example, App Store, play market).

[0038] 2. Finds the required application.

[0039] 3. Download and install this application on your phone.

[0040] 4. The user logs into the application and gives permission to determine his geolocation (the application receives information about the user's location using GPS, Wi-Fi or other known technologies).

[0041] 5. A map opens with the center at the user's location.

[0042] 6. Using the widget system on the smartphone screen, the user views information about various points of interest 4 on the map. 7. The user selects one of the points of interest on the map using interface elements.

[0043] 8. The user views visual and textual information about the point of interest 4 using interface elements, and also creates a route 5 to the point of interest 4 using the built-in automatic tools of the mapping service (the application uses information about the user's location to create a route 5 to the point where the augmented reality object will be located; the route 5 is created based on data about the terrain, road conditions and other factors; the application can use various algorithms to create a route 5; for example, the application can use an algorithm that minimizes the time or distance to the point of interest 4).

[0044] 9. As the user moves, his path and position are displayed on the map (the application determines the position of the object in the global coordinate system; the position of the object is determined based on its coordinates in the local coordinate system, as well as information about the user's location and terrain data; the application may use various methods to determine the position of the object; for example, the application may use a triangulation method or a method for determining the distance to the object).

[0045] 10. When the user reaches point of interest 4 and enters the access zone to augmented reality objects, he will be asked to launch the augmented reality function using the smartphone resources and camera, and also to select the time period of interest to the user.

[0046] 11. Using the phone’s camera, a 3D model of the point of interest 4 in the time period of interest will be shown on the smartphone screen, which can be viewed from different angles (in this case, the application places the object in augmented reality on the virtual surface of the terrain in accordance with its position in the global coordinate system when the user is in the access zone with the augmented reality database 1).

[0047] 12. The user can take pictures or record videos of the smartphone screen to share the augmented reality experience with other users.

[0048] 13. The user can write a comment or express his emotions by means of a “like”.

[0049] 14. The user can add the object to favorites and repeat the experience later. 15. The user can close the augmented reality window and continue exploring the points of interest, repeating steps 6 through 14.

[0050] In the example above, the application uses a client-server architecture to determine the client's location using the GPS or GLONASS system; when the user is in a certain location, the device's camera scans the area, constructing a virtual surface on which the virtual object is placed in accordance with global world coordinates.

[0051] An example of the implementation of the declared method at a specific point of tourist interest.

[0052] The clay monument in Moscow is used as a tourist point of interest 4.

[0053] In this case, the internal space of a circle with a radius of 10 m around the monument acts as sector 7 of access to augmented reality objects around the point of interest 4.

[0054] When the user is in the zone of sector 7 access to augmented reality objects, a notification is sent to the phone via the application with a choice of the type of interest, namely:

[0055] - what the monument will probably look like in five years (3D model of the monument taking into account aging);

[0056] - what the monument will probably look like in ten years (3D model of the monument taking into account restoration and the use of more rounded and smooth lines);

[0057] - what the monument will presumably look like in twenty years (3D model of the monument taking into account restoration and the use of sharp chopped forms);

[0058] - what the monument will presumably look like in thirty years (3D model of the monument taking into account the use of other colors in its design).

[0059] The declared technical result - an increase in the amount of time that users spend near points of interest 4, is achieved due to the fact that when implementing the declared method, an augmented reality database is formed, which, when the user is near the corresponding point of interest 4, allows obtaining additional information about a specific point of interest 4 in the form of interest, which is not necessarily associated with reality (for example, taking into account the development of architectural design of the future). Due to the fact that known sources of information (such as audio, video, text sources, etc.), the ability to obtain information from augmented reality objects is added, users are provided with the ability to see and interact with virtual elements in real time, making the process of studying a point of interest 4 more exciting and fascinating, which in turn helps to remember more details about a cultural heritage site and increases the amount of time spent studying it. Also, the presence of augmented reality provides a new unique experience of interaction with points of interest 4. All of the above increases user involvement and allows you to remember and retain information about a point of interest 4, as well as stay near it for a longer time.The ability to use augmented reality technology only in the zone of sector 7 of access to augmented reality objects eliminates cases of attempts to use this technology when the point of interest 4 is not in the space surrounding the user, which eliminates unnecessary waste of time and a decrease in user involvement when following the tourist route 5, and as a result reduces the likelihood that the user will not come to this point of interest 4. The ability to select the demonstration of an augmented reality object at different time intervals (for example, the expected future) also allows achieving the declared technical result, due to the ability to obtain additional visual information about the object (additional content).The use of closed areas 6 in the shape of a circle, square or hexagon when forming closed areas 6 in automatic mode allows with the greatest probability to ensure the possibility of direct visual contact of the user with the point of interest 4. The possibility of using the said closed areas 6 has been proven experimentally and does not exclude the possibility of using areas of another geometric shape. In particular, the use of closed areas 6 in the shape of a circle is advisable when it is possible to inspect the object of the point of interest 4 from all sides; the use of closed areas 6 in the shape of squares is advisable when it is possible to inspect the object of the point of interest 4 from one side (for example, on the facade of a building); the use of closed areas 6 in the shape of a hexagon is advisable when placing points of interest in urban development, where it is not possible to accurately determine the sides from which the object has a direct view.The ability to simultaneously receive information from both the augmented reality object and text (for example, popping up during visualization), audio (playing during visualization) or video (playing during visualization next to the augmented reality object on the screen) also allows achieving the stated technical result by combining various methods of obtaining information about a tourist point of interest 4, which also contributes to user involvement.

[0060] An example of achieving the stated result.

[0061] The claimed method was tested experimentally. During the experiment, three groups of ten users were selected to pass the same tourist route 5 (from three points of interest - Fig. 2):

[0062] The first group - completed route 5 in accordance with the declared method (of which 2 people used augmented reality with simultaneously displayed text information; 2 people used augmented reality with simultaneously played audio information, 2 people used augmented reality with simultaneously played video fragment).

[0063] The second group - followed route 5 in accordance with the declared method, with the exception of the possibility of using augmented reality technology (while there was photo, video and audio content about points of interest 4).

[0064] The third group - followed route 5 only along the points indicated on the map without their description (only the names of cultural heritage sites were used as information).

[0065] After completing route 5, all groups measured the total time spent near points of interest 4. The test results showed the following:

[0066] The first group - the average time spent near points of interest on the route is 3 hours 15 minutes (3 hours 12 minutes for users with additional text information; 3 hours 17 minutes for users with additional audio information; 3 hours 11 minutes for users with additional video information).

[0067] The second group - the average time spent near points of interest on the route is 1 hour 45 minutes.

[0068] The third group - the average time spent near points of interest on the route is 1 hour 05 minutes.

[0069] Based on the test results, it is clear that the claimed method, by increasing user involvement, motivates additional study of points of interest 4 while being near them and using augmented reality technology, which confirms the claimed technical result. At the same time, during the experiment, it was found out that the claimed method can be used not only to increase user erudition, but also to increase traffic near commercial facilities near points of interest 4.

Claims

FORMULA 1. A method for obtaining information about tourist points of interest using augmented reality technology, characterized by the fact that initially, for each point of tourist interest, a database with augmented reality objects is formed, each of the augmented reality objects has a unique design, then on the map of the mapping service, a closed area is formed around each tourist point of interest, inside which the user's access sector to the database of augmented reality objects of this point of tourist interest is located, then, using the mapping service, a route for the user to the tourist point of interest is built, when the user is in the user's access sector to the database of augmented reality objects, the user selects the desired unique design option for the point of interest, after which he views the content with the augmented reality object having a unique design,receiving information about a tourist point of interest, 2. The method according to paragraph 1, characterized in that a closed area in the form of a circle is formed on the map of the cartographic service, within which the user’s access sector to the database of augmented reality objects of a given point of tourist interest is located.

3. The method according to paragraph 1, characterized in that a closed area in the form of a square is formed on the map of the cartographic service, within which the user’s access sector to the database of augmented reality objects of a given point of tourist interest is located.

4. The method according to paragraph 1, characterized in that a closed area in the form of a hexagon is formed on the map of the cartographic service, within which the user’s access sector to the database of augmented reality objects of a given point of tourist interest is located.

5. The method according to paragraph 1, characterized in that the user receives information about a tourist point of interest using an augmented reality object with the simultaneous use of text information.

6. The method according to paragraph 1, characterized in that the user receives information about a tourist point of interest using an augmented reality object with the simultaneous use of audio information.

7. The method according to paragraph 1, characterized in that the user receives information about a tourist point of interest using an augmented reality object with the simultaneous use of video information.

Images