Information presentation system, information presentation method, and information presentation program

Abstract

Provided is an information presentation system or the like that can ensure the safety of a user during movement and present other information visually together with route information regarding guidance to the user's destination. **Solution**: The information presentation system of the present disclosure presents information using an augmented reality display terminal, stores map information including route information, location information, and virtual video information for displaying related information regarding a location as augmented reality content, acquires destination information indicating the user's destination and current location information indicating the current position from the augmented reality display terminal, extracts route information indicating a route from the current position to the destination from a storage device based on the destination information and the current location information, extracts related information indicating locations around the route from the storage device based on the route information, extracts virtual video information of related information regarding a location from the storage device based on the location information, and outputs the route information, the related information, and the virtual video information to the augmented reality display terminal.

Description

Technical Field

[0001] The present invention relates to an information presentation system, an information presentation method, and an information presentation program, and more particularly to an information presentation system, an information presentation method, and an information presentation program suitable for presenting information to a user using an augmented reality display terminal.

Background Art

[0002] Today, mobile information terminals such as smartphones and the environment surrounding them have advanced, and the usage time of consumers' information and communication media is on the increase. In particular, there are many consumers who use information and communication media during their mobile time as disposable time. However, in order to ensure safety during movement, since consumers' vision is exclusively used for movement, the use of information and communication media by consumers during movement is mainly auditory.

[0003] On the other hand, in recent years, augmented reality display terminals such as AR glasses have been becoming popular. (For example, see Patent Document 1). An augmented reality display terminal provides consumers with an augmented reality experience in which digital information such as CG (Computer Graphics) is superimposed on the real-world scene viewed through a transmissive lens, so that things that do not exist in the real world can be displayed or linked to real-world objects.

[0004] Under such circumstances, the possibility of achieving both visual use of information and communication media and ensuring safety during movement by using an augmented reality display terminal has been studied. In particular, there is a high demand from consumers for guidance to a destination during movement, and the emergence of a system that can present other information visually together with route information regarding guidance to a destination is desired.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] Therefore, an object of the present invention is to provide an information presentation system, an information presentation method, and an information presentation program that can ensure the safety of a user during movement and present other information together with route information for guiding the user to a destination using vision.

Means for Solving the Problems

[0007] That is, an information presentation system according to a first aspect is an information presentation system that presents information to a user using an augmented reality display terminal worn by the user during movement, and includes map information including route information, location information indicating the location of a facility or area on the map, and virtual video information for displaying related information based on the location as augmented reality content on the augmented reality display terminal. A storage device that stores, a terminal information acquisition unit that acquires destination information indicating the user's destination and current position information indicating the current position from the augmented reality display terminal, and extracts route information indicating a route from the current position to the destination from the storage device based on the destination information and the current position information. An information extraction unit that extracts location information indicating locations around the route from the storage device based on the route information, and extracts virtual video information of related information based on the location from the storage device based on the location information, and a route information, location information, and virtual video information are output to the augmented reality display terminal. And an output unit.

[0008] According to a second aspect, in the information presentation system according to the first aspect, when there are a plurality of locations, the information extraction unit extracts virtual video information of related information from the storage device for each of the plurality of locations, and the plurality of virtual video information is presented to the user using the augmented reality display terminal so as to exhibit an integrated visual effect in cooperation with each other. It may be.

[0009] In a third aspect, in the information presentation system according to the first aspect, the information presentation system further includes an avatar information generation unit that generates avatar information for causing an avatar to appear to the user based on route information, and the output unit may output the avatar information to the augmented reality display terminal.

[0010] In a fourth aspect, in the information presentation system according to the first aspect, the augmented reality display terminal is equipped with a sensor, and the terminal information acquisition unit acquires movement state information indicating the state of the user during movement detected by the sensor from the augmented reality display terminal. The information presentation system further includes a display mode determination unit that determines the display mode of the virtual video information to the user according to the movement state information, and the output unit may output display mode information indicating the determined display mode to the augmented reality display terminal.

[0011] In a fifth aspect, in the information presentation system according to the first aspect, a learning model is prepared in advance that learns action history information indicating a plurality of action histories of the user to extract the user's preferences, and is learned to select relevant information that matches the user's preferences based on the extracted user's preferences. The information presentation system further includes a recommended information acquisition unit that acquires, as recommended information, virtual video information of relevant information that matches the user's preferences selected by the learning model from among the virtual video information of relevant information based on each of the plurality of location information extracted by the information extraction unit. The output unit may output, to the augmented reality display terminal, the recommended information acquired by the recommended information acquisition unit and location information indicating the location related to the recommended information and the relevant information of the recommended information, together with the route information.

[0012] In a sixth aspect, in the information presentation system according to the first aspect, the output unit may preferentially output to the augmented reality display terminal the virtual video information of the relevant information based on the locations existing along the route among the locations around the route indicated by the route information.

[0013] In a seventh aspect, in the information presentation system according to the first aspect, the virtual video information may include gamification elements.

[0014] The eighth aspect is that in the information presentation system according to the first aspect, the augmented reality display terminal is provided with a camera for photographing the surroundings, the storage device stores signboard-related information and discount information associated with the related information, the terminal information acquisition unit acquires video information based on the video captured by the camera from the augmented reality display terminal, the information presentation system further includes a signboard recognition unit that analyzes the video information to recognize the signboard shown in the video and extracts signboard image information indicating the signboard from the video information, the information extraction unit extracts virtual video information of the related information associated with the signboard-related information and the discount information associated with the related information from the storage device based on the signboard-related information indicating the signboard, and the output unit may output the virtual video information to the augmented reality display terminal and output the discount information to the information terminal carried by the user.

[0015] The ninth aspect is that in the information presentation system according to the first aspect, the information presentation system further includes an evaluation unit that evaluates the significance of the virtual video information by comparing it with other virtual video information using an evaluation value represented by a mathematical model of covariance analysis that includes, as a covariate, an explanatory variable related to the preference of each user, which is an evaluation value obtained by evaluating the virtual video information by a plurality of users in comparison with other virtual video information while suppressing the influence of the preference of each user.

[0016] The tenth aspect is that in the information presentation system according to the first aspect, the information presentation system further includes a mirroring unit that acquires the virtual video information transmitted to the augmented reality display terminal of one of the plurality of users when the plurality of users are moving together, and the output unit may output the virtual video information acquired by the mirroring unit to the augmented reality display terminal of another user different from the one of the plurality of users.

[0017] The 11th aspect is that in the information presentation system according to the 1st aspect, the information presentation system further includes a pupil detection control unit that controls a pupil detection unit provided in the augmented reality display terminal to detect the state of the user's pupils. The terminal information acquisition unit acquires, from the augmented reality display terminal, pupil information detected and acquired by the pupil detection unit regarding the state of the user's pupils when the user views virtual video information. The information presentation system further includes an aversion feeling estimation unit that estimates the strength of the user's aversion feeling towards the virtual video information based on the pupil information, and an aversion feeling strength determination unit that determines whether the strength of the aversion feeling exceeds a threshold value. The output unit may restrict the virtual video information output to the augmented reality display terminal when it is determined that the strength of the aversion feeling exceeds the threshold value.

[0018] The 12th aspect is that in the information presentation system according to the 1st aspect, the augmented reality display terminal includes a microphone that collects the user's voice and a directional speaker that emits sound to the user. The information presentation system can access the generation AI. The terminal information acquisition unit acquires, from the augmented reality display terminal, voice information based on the user's voice collected by the microphone. The information presentation system further includes a text data generation unit that analyzes the voice information and generates text data of the user's voice, a prompt input unit that generates a prompt based on the text data and inputs the prompt to the generation AI, and a response acquisition unit that acquires response data indicating the response of the generation AI. The output unit may output the response data to the augmented reality display terminal.

[0019] Aspect 13 is that in the information presentation system according to Aspect 1, the storage device further stores route guidance mode information, which is an image projected onto an augmented reality display terminal provided for each mode of route guidance for the user. The information presentation system extracts location information indicating the location where the user is currently located from the storage device based on the current location information, and has a location state acquisition unit that acquires location state information indicating the state of the location based on the location information, a route guidance mode determination unit that determines the mode of route guidance for the user based on the location state information, and a route guidance mode acquisition unit that acquires route guidance mode information associated with the mode of route guidance from the storage device based on the determined mode of route guidance. The output unit may output the route guidance mode information to the augmented reality display terminal.

[0020] Aspect 14 is that in the information presentation system according to Aspect 13, the location state acquisition unit may acquire the video of a live camera installed for each location as location state information indicating the state of the location.

[0021] The information presentation method according to Aspect 15 is an information presentation method executed by an information presentation system that presents information to a user using an augmented reality display terminal worn by the user while moving. The information presentation system includes a storage device that stores map information including route information, location information indicating a facility or area on the map, and virtual video information for displaying related information based on the location as augmented reality content on the augmented reality display terminal. The information presentation system executes a terminal information acquisition step of acquiring destination information indicating the user's destination and current location information indicating the current location from the augmented reality display terminal, an information extraction step of extracting route information indicating the route from the current location to the destination from the storage device based on the destination information and the current location information, extracting location information indicating locations around the route from the storage device based on the route information, and extracting virtual video information of related information based on the location from the storage device based on the location information, and an output step of outputting the route information, the location information, and the virtual video information to the augmented reality display terminal.

[0022] The information presentation program according to the 16th aspect is an information presentation program executed by an information presentation system that presents information to a user using an augmented reality display terminal worn by the user while moving. The information presentation system includes a storage device that stores map information including route information, location information indicating a facility or area on the map, and virtual video information for displaying related information based on the location as augmented reality content on the augmented reality display terminal. The information presentation system is provided with a terminal information acquisition function for acquiring, from the augmented reality display terminal, destination information indicating the user's destination and current location information indicating the current location, an information extraction function for extracting, from the storage device, route information indicating a route from the current location to the destination based on the destination information and the current location information, extracting, from the storage device, location information indicating locations around the route based on the route information, and extracting, from the storage device, virtual video information of related information based on the location based on the location information, and an output function for outputting the route information, the location information, and the virtual video information to the augmented reality display terminal.

Effect of the Invention

[0023] The information presentation system according to the present invention is an information presentation system that presents information to a user using an augmented reality display terminal worn by the user while moving. The information presentation system includes a storage device that stores map information including route information, location information indicating the location of a facility or area on the map, and virtual video information for displaying related information based on the location as augmented reality content on the augmented reality display terminal, a terminal information acquisition unit for acquiring, from the augmented reality display terminal, destination information indicating the user's destination and current location information indicating the current location, an information extraction unit for extracting, from the storage device, route information indicating a route from the current location to the destination based on the destination information and the current location information, extracting, from the storage device, location information indicating locations around the route based on the route information, and extracting, from the storage device, virtual video information of related information based on the location based on the location information, and an output unit for outputting the route information, the location information, and the virtual video information to the augmented reality display terminal. Therefore, while ensuring the safety of the user while moving, other information can be presented visually together with the route information regarding the guidance to the user's destination.

[0024] In addition, the information presentation method and information presentation program according to the present invention, similar to the information presentation system according to the present invention, can ensure the safety of the user during movement and present other information visually together with the route information regarding the guidance to the user's destination.

Brief Description of the Drawings

[0025]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

MODE FOR CARRYING OUT THE INVENTION

[0026] (Regarding the outline of the information presentation system 10) The information presentation system 10 will be described with reference to FIGS. 1 to 11 according to an embodiment of the present disclosure. First, with reference to FIG. 1, the outline of the information presentation system 10 according to the present embodiment will be described. FIG. 1 is a diagram for explaining the outline of the information presentation system 10 according to the present embodiment.

[0027] The information presentation system 10 presents information to the user using the augmented reality display terminal 11 worn by the user while moving. The user is a person who carries and moves the augmented reality display terminal 11, and receives visual presentation of various types of information via the augmented reality display terminal 11 while moving. Moving includes moving on foot or running using the user's own body, and moving by driving a vehicle such as a bicycle, a car, or a motorcycle. Note that driving includes driving a vehicle by the user himself / herself and driving a vehicle on behalf of the user while riding together with the user. Therefore, driving may include the driving of a taxi driver that the user rides in. In addition, the movement may include the case of using public transportation such as trains and buses. The use of the information presentation system 10 during the movement on public transportation is assumed to visually present to the user transfer guidance information, route information, operation time, and route information within or around the destination station, location information 26, and related information 31 (see FIGS. 7 and 10).

[0028] Augmented reality (AR) refers to a technology that presents digital information such as CG (Computer Graphics) overlaid on the real world 1 to expand the reality. Specifically, it is a technology that presents to the user something that does not exist in the real world 1 using vision, or provides the user with an experience that can link to an object in the real world 1. The augmented reality display terminal 11, also called AR glasses, is an AR terminal worn on the face like glasses. It is a device that visually realizes augmented reality by superimposing digital information such as CG (Computer Graphics) on the scene of the real world 1 seen through a transmissive lens. Specifically, it is a device that arranges virtual objects constructed with digital information in the scene of the real world 1 and further enables the operation of the object. Note that in the augmented reality display terminal 11, goggles may be used instead of glasses.

[0029] As shown in FIG. 1, the information presentation system 10 provides guidance information 3 regarding guidance to the destination and augmented reality (AR) content 4 to the user 2 moving in the real world 1. The AR (augmented reality) content 4 is content that utilizes AR technology (technology for realizing augmented reality). Content refers to materials for conveying information or messages, and there are various forms of materials, specifically documents, images, videos, sounds, and three-dimensional computer graphics, etc.

[0030] (Regarding an example of the AR content 4) Next, with reference to FIG. 2, an example of the augmented reality (AR) content 4 of the information presentation system 10 will be described. FIG. 2 is a diagram for explaining an example of the AR content 4 of the information presentation system 10 according to the present embodiment. The augmented reality content 4 may be information content for allowing a user wearing the augmented reality display terminal 11 to experience augmented reality. The information presentation system 10 allows the user to experience the augmented reality content 4 by causing the virtual video information 27 to be read into the augmented reality display terminal 11.

[0031] With reference to FIG. 2(a), the AR content 4 used for a road guidance sign will be described. The AR arrow 5a and the AR text 5b shown in FIG. 2(a) are used for the road guidance sign. The AR arrow 5a indicates the walking of the user displayed in AR. The road route name displayed by the AR text 5b indicates the road route name that the user should pass through. By following the road guidance sign of the AR content 4, the user can enjoy the visual effect of the AR content 4 and proceed along the route to the destination without relying on a map even in a sparsely populated area.

[0032] With reference to FIG. 2(b), the AR content 4 used for ODM (Outdoor Media) will be described. The three-dimensional video advertisement 6 shown in FIG. 2(b) is the AR content 4 of the ODM, and is presented to the user as a three-dimensional video in the scenery of the real world 1 by AR technology. The AR content 4 of the ODM has an effect of attracting the user's attention with a sense of impact and presence.

[0033] Referring to FIG. 2(c), the AR content 4 used in the smart city concept will be described. The smart city concept is an endeavor aimed at leveraging information and communication technology (ICT) to streamline urban infrastructure and services and improve the quality of life of residents. The traffic guidance sign 7 shown in FIG. 2(c) may be displayed using the AR text 5b, presented to the user together with the recommendation information of the surrounding facilities of the station, and presented to the user as access information to the surrounding facilities starting from the station. By following the AR content 4 of the traffic guidance sign 7, the user can enjoy the visual effect of the AR content 4 and use the means of transportation to the destination without relying on a map even in a sparsely populated area.

[0034] Referring to FIG. 2(d), the AR content 4 of the avatar 8 will be described. The avatar 8 shown in FIG. 2(d) is humanoid and moves along a specific route in accordance with the user's moving speed while standing in front of or beside the user. When the user approaches other surrounding AR content 4, the avatar 8 explains the AR content 4 using voice or text. The user can feel familiar with the human appearance and movements of the avatar 8, obtain visual feedback through the expressions and gestures of the avatar 8, and move towards the destination without feeling lonely through conversation with the avatar 8, and can obtain various information from the avatar 8 along the way.

[0035] Referring to FIG. 2(e), the AR advertisement 9 of the store located in the high-rise building of the city will be described. The AR advertisement 9 shown in FIG. 2(e) is presented to the user so as to be superimposed on the scene of the exterior of the high-rise building in the real world 1, and presents the advertisement of the store in the high-rise building to the user. From the perspective of urban planning or architectural design, the high-rise building may emphasize beautifying the exterior or streetscape of the high-rise building, and the store located in the high-rise building may be restricted from advertising, but by using the AR advertisement 9, the store can advertise without being subject to such restrictions.

[0036] (Regarding the usage environment of the information presentation system 10) Next, a usage environment including the information presentation system 10 according to this embodiment will be described with reference to FIG. 3. FIG. 3 is a network configuration diagram for explaining an example of a usage environment including the information presentation system 10 according to this embodiment. The information presentation system 10 is connected to an information communication network 15. The information communication network 15 is a network including the Internet, which is a worldwide information communication network, and the information presentation system 10 is connected to other devices via the information communication network 15. The information presentation system 10 is connected to the augmented reality display terminal 11 via the information communication network 15. As shown in FIG. 3, three augmented reality display terminals 11 (11a, 11b, 11c) are connected to the information presentation system 10 via the information communication network 15, but the number is not limited to three, and it may be two or less, or four or more. That is, the information presentation system 10 can simultaneously connect multiple users' augmented reality display terminals 11.

[0037] The information presentation system 10 is connected to a storage server 12, a generation AI server 13, and a learning model server 14 via the information communication network 15. The storage server 12 is a type of server used for storing, protecting, and managing data on the information communication network 15, and is used as a storage device of the information presentation system 10. Note that the information presentation system 10 may use a built-in storage unit 10d described later together with or instead of the storage server 13 as a storage device. The generation AI server 13 refers to a server used for utilizing the generation AI 13a on the information communication network 15. The learning model server 14 refers to a server used for utilizing the learning model 14a on the information communication network 15.

[0038] (Regarding the configuration of the augmented reality display terminal 11) Next, with reference to FIGS. 4 and 5, the configuration of the augmented reality display terminal 11 will be described. FIGS. 4 and 5 are diagrams for explaining an example of the configuration of the augmented reality display terminal 11 used together with the information presentation system 10 according to the present embodiment. As shown in FIG. 4, the augmented reality display terminal 11 includes a glasses unit 20, a control unit 22, and a wired cable 21. The control unit 22 controls the operations of the respective functional units of the glasses unit 20 described later. The wired cable 21 connects the glasses unit 20 and the control unit 22. Note that the control unit 22 may be built into the glasses unit 20. In this case, the wired cable 21 is not necessary.

[0039] The augmented reality display terminal 11 may be used together with an information terminal 23 such as a smartphone, a notebook personal computer (hereinafter referred to as a PC), and a tablet PC carried by the user. The information terminal 23 and the control unit 22 may be connected by wireless communication 24 or may be connected by a wired connection (not shown). The information terminal 23 includes a display screen 23a and can display discount information 34 described later sent from the information presentation system 10 on the display screen 23a.

[0040] Also, the augmented reality display terminal 11 may be used together with a smartwatch 49 carried by the user. The smartwatch 49 and the control unit 22 are connected by wireless communication 24. The smartwatch 49 includes a display screen 49a and various sensors (not shown). The display screen 49a can display the discount information 34 described later sent from the information presentation system 10 on the display screen 49a. The various sensors of the smartwatch 49 can acquire movement state information described later indicating the state of the user during movement, instead of or together with the sensor 20a described later built into the glasses unit 20. The various sensors of the smartwatch 49 are composed of, for example, an acceleration sensor, an optical heart rate sensor, and a skin temperature sensor. The acceleration sensor detects the movement of the user's body, the optical heart rate sensor measures the user's heart rate, and the skin temperature sensor measures the temperature of the user's wrist. That is, the various sensors of the smartwatch 49 can measure the user's heart rate, electrocardiogram, activity level (exercise amount), blood oxygen, etc. as movement state information during the user's movement. Thereby, the smartwatch 49 can acquire the user's heart rate, electrocardiogram, activity level (exercise amount), blood oxygen, etc. during movement as movement state information and transmit it to the information presentation system 10.

[0041] (Regarding the configuration of the glasses part 20) As shown in FIG. 4, the glasses part 20 has a glasses shape and is worn on the user's face for use. Note that the glasses part 20 is not limited to the glasses shape and may be a goggle shape. The glasses part 20 has a right glass part 32 and a left glass part 33 having light transmissivity attached to a frame 19 to which the bases of the right temple 17 and the left temple 18 are attached. As shown in FIG. 5, the glasses part 20 includes functional parts such as a sensor 20a, a camera 20b, a microphone 20c, a pupil detection part 20d, a directional speaker 20e, a display part 20f, an input / output interface 20g, a bus 20h, and a GPS antenna 20i. Each functional part is communicably connected to each other by the bus 20h.

[0042] The display part 20f serves as an irradiation part for display light for displaying the AR content 4, and is, for example, embedded near the bases of the right temple 17 and the left temple 18, and presents the AR content 4 to the user's vision so as to be superimposed on the scene of the real world 1. Specifically, the display unit 20f irradiates the inner surfaces of the right glass part 32 and the left glass part 33 (the surfaces facing the user's left and right eyeballs) with display light modulated according to the AR content 4 to be displayed on the augmented reality display terminal 11, thereby displaying the AR content 4. As a result, the user wearing the augmented reality display terminal 11 can view the image of the AR content 4 as being superimposed on the scene of the real world 1 transmitted through the right glass part 32 and the left glass part 33.

[0043] The sensor 20a includes at least one of an IMU (Inertial Measurement Unit) sensor, a humidity sensor, and an illuminance sensor. Further, the sensor 20a may be configured to integrally include a plurality of these types of sensors. The sensor 20a is built into either one or both of the right temple 17 and the left temple 18. The IMU (Inertial Measurement Unit) sensor includes three-axis velocity (gyro) sensors, three-axis acceleration sensors, and a temperature sensor, and can measure three-dimensional inertial motion (translational motion and rotational motion in three orthogonal axis directions) and the ambient air temperature. Therefore, the IMU sensor can measure the speed, acceleration, change in moving direction, body movements, and ambient air temperature of the user during movement. The information measured by the IMU sensor is transmitted to the information presentation system 10 as movement state information indicating the state of the user during movement. The humidity sensor measures the humidity around the user, and the illuminance sensor measures the illuminance around the user. The measurement results obtained by measuring with the humidity sensor and the illuminance sensor are transmitted to the information presentation system 10 as movement state information indicating the state of the user during movement.

[0044] The camera 20b is built into the frame 19 and captures the front of the user. When the user turns the glasses part 20 around, the camera 20b captures the surroundings of the user. The video captured by the camera 20b is transmitted to the information presentation system 10 and acquired as video information based on the video by the terminal information acquisition unit 35 of the information presentation system 10.

[0045] The microphone 20c is built into any one of the right temple 17, left temple 18, and frame 19, and collects the user's voice and the sounds around the moving user. The user's voice collected by the microphone 20c is transmitted to the information presentation system 10 and is acquired as voice information based on the user's voice by the terminal information acquisition unit 35 of the information presentation system 10. The sounds around the moving user collected by the microphone 20c are transmitted to the information presentation system 10. The sounds around the moving user are acquired as movement state information indicating the state of the user during movement by the terminal information acquisition unit 35 of the information presentation system 10.

[0046] The pupil detection unit 20d is built into the frame 19 of the glasses unit 20 and detects the state of the pupil of the user's eyeball. That is, the pupil detection unit 20d includes an LED that irradiates near-infrared light and a camera, and the camera captures the reflection points and reflection patterns of the infrared light generated on the cornea of the user's eyeball irradiated with the near-infrared light, and acquires video information indicating an image of the user's eyeball. The video information indicating the image of the user's eyeball acquired by the pupil detection unit 20d is transmitted to the information presentation system 10. The video information indicating the image of the user's eyeball is acquired as pupil information indicating the state of the user's pupil by the terminal information acquisition unit 35 of the information presentation system 10. The pupil information is subjected to image analysis by the avoidance feeling estimation unit 43b described later in the information presentation system 10, and the intensity of the avoidance feeling with respect to the virtual video information of the user is estimated based on the pupil information.

[0047] The directional speaker 20e is built into the right temple 17 and the left temple 18. By incorporating the directional speaker 20e, the augmented reality display terminal 11 can enjoy music and make calls without covering the ears. The directional speaker 20e can let the user hear the voice based on the answer data indicating the answer of the generation AI 13a described later.

[0048] As described above, the display unit 20f is embedded near the base of each of the right temple 17 and the left temple 18, and serves as an irradiation unit for display light that displays the AR content 4.

[0049] The input / output interface 20g has a wired cable 21 connected thereto, and controls the exchange of data with the input / output interface 22a of the control unit 22 described later.

[0050] The GPS antenna 20i receives a GPS signal included in radio waves emitted from GPS (Global Positioning System) positioning satellites in the sky.

[0051] (Regarding the configuration of the control unit 22) As shown in FIG. 5, the control unit 22 includes functional units such as an input / output interface 22a, a processing unit 22b, a ROM 22c, a RAM 22d, a power supply unit 22e, a storage unit 22f, a GPS signal reception unit 22g, a wireless LAN communication unit 22h, a Bluetooth (registered trademark) communication unit 22i, a mobile data communication unit 22j, a bus 22k, and a destination reception unit 22l. Each functional unit is communicably connected to each other by the bus 22k.

[0052] The input / output interface 22a has a wired cable 21 connected thereto, and controls the exchange of data with the input / output interface 20g of the glasses unit 20.

[0053] The processing unit 22b includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphic Processing Unit), etc., and is realized by a logic circuit or a dedicated circuit formed by an integrated circuit (IC (Integrated Circuit) chip, LSI (Large-Scale Integration)). The processing unit 22b accesses the main memory that has taken in the firmware and the control program for controlling the augmented reality display terminal 11, and controls the operations of the glasses unit 20 and the control unit 22 by executing these programs.

[0054] The ROM 22c is used as a storage device of the control unit 22 and stores firmware for controlling the basic operations of the glasses unit 20 and various functional units of the control unit 22.

[0055] The RAM 22d constitutes a main memory accessed by the processing unit 22b. The firmware stored in the ROM 22c and a control program for controlling the extended reality display terminal 11 stored in the storage unit 22f are loaded into the main memory.

[0056] The power supply unit 22e is provided with a battery that supplies power to the glasses unit 20 and the control unit 22, and controls the power output from the battery.

[0057] The storage unit 22f stores a control program for controlling the extended reality display terminal 11 and various data used together with the control program.

[0058] The GPS signal receiving unit 22g measures the current position of the extended reality display terminal 11 based on the GPS signal received by the GPS (Global Positioning System) antenna 20i built into the glasses unit 20. The current position of the extended reality display terminal 11 measured by the GPS signal receiving unit 22g is transmitted to the information presentation system 10 as current position information indicating the current position of the user. The current position of the extended reality display terminal 11 is acquired as current position information indicating the current position of the user by the terminal information acquisition unit 35 of the information presentation system 10. The current position of the extended reality display terminal 11 is not limited to being measured by the GPS signal receiving unit 22g, and may be current position information obtained from an access point of wireless LAN communication or mobile data communication, or a current position directly input by the user to the extended reality display terminal 11, the information terminal 23, or the smart watch 49.

[0059] The wireless LAN communication unit 22h controls a wireless LAN module (not shown) built into the control unit 22 and controls the connection to the information communication network 15 via the wireless LAN. The augmented reality display terminal 11 connects to the information presentation system 10, the information terminal 23, and the smartwatch 49 using the wireless LAN.

[0060] The Bluetooth (registered trademark) communication unit 22i controls a Bluetooth module (not shown) built into the control unit 22. The augmented reality display terminal 11 communicates with the information terminal 23 and the smartwatch 49 using Bluetooth.

[0061] The mobile data communication unit 22j controls a mobile data communication module (not shown) built into the control unit 22 and controls the connection to the information communication network 15 using the mobile phone line network provided by a mobile phone communication company. The augmented reality display terminal 11 connects to the information presentation system 10, the information terminal 23, and the smartwatch 49 using mobile data communication. Note that the mobile data communication unit 22j and the mobile data communication module are not essential components. If these components are absent, the augmented reality display terminal 11 connects to the information presentation system 10, the information terminal 23, and the smartwatch 49 using the wireless LAN.

[0062] The destination reception unit 22l is realized as a functional unit in the main memory by the processing unit 22b accessing the main memory and executing a control program for controlling the augmented reality display terminal 11. The destination reception unit 22l receives destination information indicating the destination input by the user's voice collected by the microphone 20c. The destination reception unit 22l may also receive destination information indicating the destination input by the user through voice input or touch character input to the information terminal 23 or the smartwatch 49. Touch character input refers to character input performed by operating the touch panels provided on the display screen 23a of the information terminal 23 and the display screen 49a of the smartwatch 49. Destination information indicating the destination of the user received by the destination reception unit 22l is acquired by the terminal information acquisition unit 35 of the information presentation system 10.

[0063] (Regarding the hardware of the information presentation system 10) With reference to FIG. 6, an example of the hardware configuration of the information presentation system 10 according to the present embodiment will be described. FIG. 6 is a diagram for explaining an example of the hardware configuration of the information presentation system 10 according to the present embodiment. The information presentation system 10 is a so-called computer, and may be realized by a server, a personal computer (hereinafter referred to as a PC), a notebook PC, a tablet PC, a smartphone, etc., and includes a communication interface 10a, a ROM (Read Only Memory) 10b, a RAM (Random Access Memory) 10c, a storage unit 10d, a processing unit 10e, an input / output interface 10f, and the like.

[0064] The communication interface 10a controls communication with the information communication network 150. The information presentation system 10 communicates with the augmented reality display terminal 11, the storage server 12, the generation AI server 13, and the learning model server 14 through the communication interface 10a.

[0065] The storage unit 10d can be used as a storage device of the information presentation system 10, and is composed of, for example, a hard disk drive, a solid state drive, and a flash memory, and further, the storage unit 10d may be configured using cloud storage. The storage unit 10d stores an information presentation program described later, an OS (Operating System) required for the operation of the information presentation system 10, various other applications, and various data used by the applications. The storage unit 10d may be used as a storage device instead of or together with the storage server 12.

[0066] The processing unit 10e includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphic Processing Unit), etc., and is realized by a logic circuit or a dedicated circuit formed by an integrated circuit (IC (Integrated circuit) chip, LSI (Large-Scale Integration)), etc.

[0067] The information presentation system 10 stores the information presentation program described later in the ROM 10b or the storage unit 10d, and loads the information presentation program into the main memory composed of the RAM 10c, etc. The processing unit 10e accesses the main memory that has loaded the information presentation program and executes the information presentation program.

[0068] The input / output interface 10f transmits and receives data, etc. to and from the external devices of the information presentation system 10. The external devices are an input device 10g and an output device 10h that perform input / output of data, etc. to and from the information presentation system 10. The input device 10g may be, for example, a keyboard, a mouse, and a scanner (all not shown). The output device 10h may be, for example, a monitor, a printer, and a scanner (all not shown).

[0069] (Regarding various information stored in the storage device) Next, with reference to FIG. 7, various information stored in the storage device will be described. FIG. 7(a) is a diagram for explaining an example of various information stored in the storage device used together with the information presentation system 10 according to the present embodiment, and FIG. 7(b) is a diagram for explaining the relationship in which various information is associated with each other. The storage device may be configured as a database in order to efficiently manage a huge amount of data.

[0070] The memory device stores map information 25 including route information, location information 26 indicating the locations of facilities or areas on the map, and virtual video information 27 for displaying related information 31 based on the location on the extended reality display terminal 11 using the visual effects of extended reality. Specifically, as shown in Fig. 7(a), the storage server 12 used as the memory device may store user attribute information 16, map information 25, location information 26, virtual video information 27, action history information 28, situation information 29, signboard related information 30, related information 31, discount information 34, and route guidance mode information 62, etc. Note that the information stored in the storage server 12 is not limited to these, and other information may be stored in the storage server 12. In addition, the location in this embodiment may be treated as a meaning or concept including facilities or areas on the map. Therefore, the related information 31 based on the location refers to the related information 31 based on the facilities or areas on the map. In addition, the location in this embodiment may be specified as a point on the map regardless of the presence or absence of artificial structures or natural objects. The related information 31 refers to various information related to facilities or areas, as will be described later. For example, it may be information indicating publicity, advertisements, and public relations related to facilities or areas, as well as information related to events, incidents, accidents, or disasters occurring inside or near facilities or areas, planned construction work, operations, etc.

[0071] As shown in Fig. 7(b), the user attribute information 16 is stored in the memory device in association with the action history information 28 and the situation information 29 as indicated by the arrow 98. Therefore, the action history information 28 and the situation information 29 are stored in the memory device in association with each other via the user attribute information 16. As shown in Fig. 7(b), the location information 26 is stored in the memory device in association with the related information 31 as indicated by the arrow 98. As shown in FIG. 7(b), the related information 31 is stored in the storage device with the virtual video information 27, the discount information 34, and the signboard-related information 30 associated with each other as indicated by the arrow 98. Therefore, the virtual video information 27, the discount information 34, and the signboard-related information 30 are stored in the storage device associated with each other via the related information 31, and further associated with the location information 26 via the related information 31. As shown in FIG. 7(b), the signboard-related information 30 is stored in the storage device in association with the signboard image information 92 extracted by the signboard recognition unit 40 described later. As shown in FIG. 7(b), the route guidance mode information 62 is stored in the storage device associated with the mode of route guidance determined based on the location state information 64 acquired based on the location information 26.

[0072] The user attribute information 16 refers to information regarding the attributes of the user, such as the user's age, gender, residential area, and occupation. The user attribute information 16 may include information regarding the user's preferences extracted by the learning model 14a.

[0073] The map information 25 is an electronic map, which may be a map covering the whole country or a map covering a range suitable for the purpose. The map information 25 includes route information from the user's current location to the destination, including road lanes such as highways, general roads, and private roads, as well as sidewalks. Further, the map information 25 may include multiple patterns of route information from the user's current location to the destination. Furthermore, the map information 25 includes traffic regulation information such as speed limits, road closures, and traffic jams. When the traffic regulation information includes information regarding the route from the user's current location to the destination, the information presentation system 10 may present the corresponding traffic regulation information to the user together with the route information.

[0074] The location information 26 indicates the location of a facility or area on the map. Specifically, the location information 26 includes the location information of various facilities on the map, such as buildings, tourist attractions, stores, medical institutions, etc., their areas, the locations of entrances and exits, business hours, and other information. In addition, the location information 26 may include summary information indicating the overview of the facility, and the summary information may be presented to the user as part of the location information 26. In addition, the location information 26 includes information about various areas on the map, such as information about facilities within the area, information about events held within the area, information about accidents, disasters, etc. that occurred within the area. In addition, the location information 26 is extracted from the storage device as the location where the user is currently located based on the user's current location information with reference to the map information 25.

[0075] The virtual video information 27 is stored in the storage device in association with the related information 31, and is information for displaying the related information 31 indicating advertisements, etc. related to or associated with the facility or area on the augmented reality display terminal 11 as the AR content 4, and may be digital-formatted information. Therefore, the virtual video information 27 is produced by utilizing AR technology. The virtual video information 27 may be, for example, the above-described three-dimensional video advertisement 6 and may be used for ODM (see Fig. 2(b)). In addition, the virtual video information 27 may be the above-described AR advertisement 9 (see Fig. 2(e)). When a plurality of virtual video information 27 is presented to the user on one screen, it may be presented to the user using the augmented reality display terminal 11 so as to exhibit an integrated visual effect in cooperation with each other. For example, the virtual video information 27 of the related information 31 of a facility or area closer to the user's current location is presented to the user larger, and the virtual video information of the related information of the facility or area is presented to the user smaller as the distance between the user and the facility or area increases. And as the facility or area approaches the user, the virtual video information 27 of the related information of the facility or area may be gradually enlarged. By thus coordinating the sizes of the plurality of virtual video information 27 with each other, it is possible to suppress an excessive amount of visual information given to the user and suppress the arousal of the user's sense of repulsion. Also, the virtual video information 27 may include gamification elements. By incorporating gamification elements into the virtual video information 27, it is possible to increase the user's interest, motivation, etc. towards the virtual video information 27, and by extension, increase the user's interest, motivation, etc. towards the related information 31 or location information 26 associated with the virtual video information 27.

[0076] The action history information 28 is information indicating the history of the user's past actions, such as the departure point, destination, transit points, as well as the names and addresses of the facilities that became the destination and transit points, and is stored in the storage device in association with the user attribute information 16. Also, the action history information 28 may be the user's browsing history of websites, browsing time of websites, and click history on websites stored in the information terminal 23. Also, the action history information 28 may be the purchase history of the teleshopping site stored in the information terminal 23, and the registered favorite products, etc. Also, the action history information 28 may be the video viewing history, video posting history, and registered favorite videos of the video distribution site stored in the information terminal 23. Also, the action history information 28 may be the receiving history and sending history of e-mails stored in the information terminal 23. Also, the action history information 28 may be the posting history and browsing history of SNS (Social Networking Service) stored in the information terminal 23. Also, the action history information 28 may be the utilization history of the websites and web servers accessed by the user stored in the cookies of the web browser of the information terminal 23. Also, the action history information 28 may be the purchase history of purchase sites for games, music, applications, etc. stored in the information terminal 23.

[0077] The situation information 29 indicates the situation of the user at the time of the action that is the background of the action for each user action history. Specifically, the situation at the time of the user's action includes various information such as the departure date and time from the departure place, the arrival date and time at the destination, the weather at that time, the purpose of the user's action, the number of companions, and their relationship. Also, the situation information 29 may include at least any one of the user's location information at that time, weather information indicating the weather at that time, and event information at that time for each action history. Also, the situation information 29 indicates the situation at the time of browsing that is the background of the browsing for each browsing history of the user's websites stored in the information terminal 23. For example, it may be the language used for the website, the operator of the website, and the type of the website (corporate website, online shop, blog, news site, SNS, forum, etc.). Also, the situation information 29 indicates the situation of the user at the time of purchase that is the background of the purchase for each purchase history of the mail-order sales website stored in the information terminal 23. Specifically, it may be other purchased items purchased together with the purchased item, the past purchase times of the purchased item, the past purchase times of the purchased item, the language used for the site, etc. Also, the situation information 29 indicates the situation of the user at the time of video viewing that is the background of the video viewing for each video viewing history of the video distribution website stored in the information terminal 23. Specifically, it may be the audio language of the viewed video, the language of the subtitles, the speed of the viewed video, the number of viewing times of the viewed video, the actual viewing time of the viewed video by the user, the category of the viewed video with a large number of viewing times or a long viewing time, etc. Also, the situation information 29 may be the category and language used of the e-mail that is the background for each reception history and transmission history of the e-mail stored in the information terminal 23. The category of the e-mail is, for example, a category for classifying by the purpose of the e-mail. For example, there are social, forum, promotion, and new arrivals, etc. Social means a category in which notifications and messages from social media sites, SNS, online communities, etc. are received. A forum is a category where notifications and messages from online forums, discussion groups, group emails are received. A promotion is a category where marketing and advertising - targeted emails are received. New arrivals is a category where unread new - arrival emails not included in the above categories are received. In addition, the situation information 29 indicates the user's situation at that time, which is the background for each posting history and browsing history of the SNS (Social Networking Service) stored in the information terminal 23. For example, it may be the language used, the category with a large number of the user's postings or views, etc. In addition, the situation information 29 indicates the information that is the background for each website and web server accessed by the user, which is stored in the cookies of the web browser of the information terminal 23. For example, it may be the language used on the website, the category of the website, etc. The category of a website includes, for example, personal websites, business websites, news portal and online magazine websites, SNS, forum and community websites, websites introducing education and learning, websites introducing entertainment, websites introducing health and fitness, government and local government websites, information portal sites, etc. In addition, the situation information 29 indicates the user's purchase situation at the time of purchase, which is the background for each purchase history of purchase sites for games, music, applications, etc. stored in the information terminal 23. Specifically, it may be the language used on the user's purchase site, the target age of the purchased game, the category of the purchased game, music, and application, the number of purchases in the same category, etc. Note that the situation information 29 is stored in association with the user attribute information 16.

[0078] The billboard - related information 30 is associated with the billboard image information 92, which is the image information of the billboard, and the related information 31, and may include information about the requester of the promotion related to the billboard and the object of the promotion, etc. A signboard refers to promotional materials used for promotions such as publicity and advertising. The signboard image information refers to the image information of the signboard recognized by the signboard recognition unit 40 described later from the video captured by the camera 20b.

[0079] The related information 31 refers to various information related to a facility or area. For example, it may be information indicating publicity, advertising, and public relations related to the facility or area, as well as information related to events, incidents, accidents, or disasters occurring inside or near the facility or area, and planned construction, work, etc. The information indicating publicity, advertising, and public relations related to a facility or area refers to, for example, the specific content thereof, including the products or services targeted for publicity, advertising, and public relations, the information and values to be conveyed, etc.

[0080] The discount information 34 refers to the discount information of the products or services targeted for advertising, and may include specific prices, discount rates, etc. The discount information 34 may be displayed by a barcode or a QR code (registered trademark), and the user can easily get a discount by having the barcode scanner at the store read the discount information 34 of the barcode or QR code.

[0081] The route guidance mode information 62 refers to the video projected onto the augmented reality display terminal 11 provided for each mode of route guidance to the user. Specifically, the route guidance mode information 62 refers to the video that is used separately for each method of guiding the user and presented to the user through the augmented reality display terminal 11. The route guidance mode information 62 is, for example, a video that guides the user using an avatar, a video that superimposes a line indicating the course the user should follow on the real scenery, or a video that superimposes a pillar of light on the point the user should aim for in the real scenery. The video that guides the user using an avatar may not only guide the user using an avatar but also be a video that converses with the user during movement, and the conversation may be established by the avatar responding to the user's query. The route guidance mode information 62 may be associated with the location status information 64 indicating the status of the location where the user is currently located. For example, when the location where the user is currently located is inside a facility, a video that guides the user using an avatar may be selected as the route guidance mode information 62, and the user may be guided through the inside of the facility by the avatar. Furthermore, the user may receive information related to the facility, such as information on stores and sales floors inside the facility, from the avatar. Also, when the location where the user is currently located is a road with complex bends or intersections, a video that superimposes a line indicating the course the user should take on the real scenery may be selected as the route guidance mode information 62 and presented to the user through the augmented reality display terminal 11. Also, when the location where the user is currently located is in a crowded place or surrounded by tall buildings and the visibility is poor and it is impossible to see far, a video that superimposes a light column extending up to the sky at the point the user should aim for in the real scenery may be selected and presented to the user through the augmented reality display terminal 11.

[0082] (Regarding the functional configuration of the information presentation system 10) Next, with reference to FIG. 8, the functional configuration of the information presentation system 10 will be described. FIG. 8 is a diagram for explaining an example of the functional configuration of the information presentation system 10 according to the present embodiment.

[0083] By executing an information presentation program described later, the information presentation system 10 provides the processing unit 10e with functional units such as a terminal information acquisition unit 35, an information extraction unit 36, an avatar information generation unit 37, a display mode determination unit 38, a recommended information acquisition unit 39, a signboard recognition unit 40, an evaluation unit 41, a mirroring unit 42, an avoidance feeling estimation processing unit 43, a generation AI utilization processing unit 44, a location status acquisition unit 46, a route guidance mode determination unit 45, a route guidance mode acquisition unit 47, and an output unit 59. Note that the avoidance feeling estimation processing unit 43 includes a pupil detection control unit 43a, an avoidance feeling estimation unit 43b, and an avoidance feeling intensity determination unit 43c. The generation AI utilization processing unit 44 includes a text data generation unit 44a, a prompt input unit 44b, and an answer acquisition unit 44c.

[0084] (Terminal information acquisition unit 35) The terminal information acquisition unit 35 acquires destination information indicating the user's destination and current position information indicating the current position from the augmented reality display terminal 11. The destination information is received by the destination reception unit 22l of the augmented reality display terminal 11 based on the input of the user's destination. The user inputs the user's destination using the microphone 20c of the augmented reality display terminal 11, or voice input or touch character input of the information terminal 23 or the smart watch 49. The current position information is information indicating the current position of the user's augmented reality display terminal 11 measured based on the GPS signal. Further, the current position information may be acquired from the access point of the wireless LAN communication or mobile data communication of the user's augmented reality display terminal 11, or may be acquired based on the current position directly input by the user to the augmented reality display terminal 11, the information terminal 23, or the smart watch 49.

[0085] The augmented reality display terminal 11 is equipped with a sensor 20a, and the terminal information acquisition unit 35 acquires movement state information indicating the state of the user during movement detected by the sensor 20a from the augmented reality display terminal 11. The movement situation information may be the heart rate, electrocardiogram, activity level (momentum), blood oxygen, etc. of the moving user acquired by various sensors of the smart watch 49. The movement situation information may be the speed, acceleration, change in movement direction, body movement, and ambient temperature of the user during movement measured by the IMU sensor. The movement situation information may be the humidity around the moving user measured by the humidity sensor. The movement situation information may be the illuminance around the moving user measured by the illuminance sensor. The movement situation information may be the sound around the moving user collected by the microphone 20c. The movement situation information may be the current position of the user.

[0086] Further, the terminal information acquisition unit 35 may acquire video information based on the video captured by the camera 20b from the augmented reality display terminal 11. The video information based on the video refers to digital format information that can transmit, receive, and analyze the video as data, for example, MP4 format, AVI format, WMV format, etc.

[0087] (Information extraction unit 36) The information extraction unit 36 extracts route information indicating the route from the current location to the destination from the storage device based on the destination information and the current location information, extracts location information 26 indicating facilities or areas around the route from the storage device based on the route information, and extracts virtual video information 27 of the related information 31 based on the location from the storage device based on the location information 26. The location information 26 indicating a facility or an area refers to the location information of the facility or the area, and may be an address, latitude and longitude information, position coordinates, etc.

[0088] The information extraction unit 36 acquires the map information 25 from the storage device, performs route calculation based on the destination information and the current location information, and extracts the calculated route information from the storage device. The information extraction unit 36 refers to the traffic control information included in the map information 25. If there is a road closure or traffic jam in the middle of the route included in the calculated route information, it calculates an avoidance route to avoid these road closures or traffic jams, and extracts the calculated route information from the storage device. Further, the information extraction unit 36 may perform a plurality of route calculations such as the shortest route, the fastest route, and the lowest fare route, extract the calculated plurality of route information from the storage device, and present it to the user.

[0089] The facilities or areas around the route may be facilities or areas located along the road of the route and facing the route, or may be facilities or areas within a range at a predetermined distance from the route. Therefore, the information extraction unit 36 extracts location information 26 indicating a facility or area located along the road of the route and facing the route, or a facility or area within a range at a predetermined distance from the route, from the storage device.

[0090] Based on the extracted location information 26, the information extraction unit 36 extracts virtual video information 27 of associated information 31 associated with the location information 26 from the storage device. The virtual video information 27 is stored in the storage device in association with the associated information 31, and the information extraction unit 36 extracts the virtual video information 27 associated with the associated information 31 from the storage device.

[0091] When there are a plurality of facilities or areas, the information extraction unit 36 extracts virtual video information 27 of the associated information 31 from the storage device for each of the plurality of facilities or areas. That is, when there are a plurality of pieces of extracted location information 26, the information extraction unit 36 extracts virtual video information 27 of the associated information 31 from the storage device for each facility or area related to the plurality of pieces of location information 26. The plurality of pieces of virtual video information 27 are presented to the user using the augmented reality display terminal 11 so as to cooperate with each other and exhibit an integrated visual effect.

[0092] (Avatar information generation unit 37) The avatar information generation unit 37 generates avatar information for causing an avatar to appear to the user based on the route information. The avatar information includes a video or algorithm for guiding the user using the avatar or having a conversation with the user during the user's movement. Specifically, the avatar information includes information related to the appearance, movement, and gestures of the avatar, and information related to the voice of the avatar. Also, the avatar information may change the avatar's clothing according to the season. Specifically, if it is summer, the avatar may be dressed in summer clothes, and if it is winter, the avatar may be dressed in winter clothes. Furthermore, if it is a time close to Christmas, the avatar may be made to look like Santa Claus. The avatar information generation unit 37 may generate avatar information by referring to the user's preferences, the user's current location and destination, the departure date and time, etc. obtained in advance, or may generate a plurality of avatar information for the user to select.

[0093] (Display mode determination unit 38) The display mode determination unit 38 determines the display mode of the virtual video information 27 for the user according to the movement state information. For example, the display mode determination unit 38 may determine the speed at which the virtual video information 27 progresses along the route presented to the user according to the speed of the user during movement. Specifically, when the speed of the user during movement is high, the display mode determination unit 38 may increase the speed at which the virtual video information 27 progresses along the route presented to the user, and when the speed of the user during movement is low, the display mode determination unit 38 may decrease the speed at which the virtual video information 27 progresses along the route presented to the user.

[0094] For example, the display mode determination unit 38 may determine the size of the virtual video information 27 presented to the user according to the user's current location. Specifically, the display mode determination unit 38 may determine the size of the virtual video information 27 presented to the user according to the distance from the user's current location to the facility or area related to the associated information 31 associated with the virtual video information 27, and may increase the size of the virtual video information 27 presented to the user as the distance decreases, and decrease the size of the virtual video information 27 presented to the user as the distance increases.

[0095] The display mode determination unit 38 may determine the luminance of the virtual video information 27 presented to the user according to, for example, the illuminance around the moving user. Specifically, when the illuminance around the moving user is high, the display mode determination unit 38 may increase the luminance of the virtual video information 27 presented to the user, and when the illuminance around the moving user is low, the display mode determination unit 38 may decrease the luminance of the virtual video information 27 presented to the user.

[0096] The display mode determination unit 38 may determine the luminance of the virtual video information 27 presented to the user according to, for example, any one or more of the heart rate, electrocardiogram, activity level (amount of exercise), and blood oxygen of the moving user. Specifically, when any one or more of the heart rate, electrocardiogram, activity level (amount of exercise), and blood oxygen of the moving user show abnormal values, the display mode determination unit 38 may decrease the luminance of the virtual video information 27 presented to the user, or may stop presenting the virtual video information 27 to the user. In addition, the display mode determination unit 38 may determine the amount of information of the virtual video information 27 presented to the user according to, for example, any one or more of the heart rate, electrocardiogram, activity level (amount of exercise), and blood oxygen of the moving user. Specifically, when any one or more of the heart rate, electrocardiogram, activity level (amount of exercise), and blood oxygen of the moving user show abnormal values, the display mode determination unit 38 may determine to reduce the amount of information of the virtual video information 27 presented to the user, or may determine to stop presenting the virtual video information 27 to the user. On the other hand, when any one or more selected from the heart rate, electrocardiogram, activity level (amount of exercise), and blood oxygen of the moving user show normal values, the display mode determination unit 38 may determine to increase the amount of information of the virtual video information 27 presented to the user, or may determine not to change the amount of information.

[0097] The display mode determination unit 38 may determine the volume of the sound of the virtual video information 27 presented to the user according to, for example, the volume of the sound around the moving user. Specifically, when the sound around the moving user is loud, the display mode determination unit 38 may increase the volume of the sound of the virtual video information 27 presented to the user, and when the sound around the moving user is quiet, the display mode determination unit 38 may decrease the volume of the sound of the virtual video information 27 presented to the user.

[0098] The display mode determination unit 38 may determine whether to include weather information in the virtual video information 27 presented to the user according to, for example, the humidity level around the moving user. Specifically, when the humidity around the moving user is high, the display mode determination unit 38 may include weather information prompting attention to precipitation or fog formation, and when the humidity around the moving user is low, the display mode determination unit 38 may include weather information prompting attention to dryness.

[0099] For example, while the moving user is changing the moving direction, the display mode determination unit 38 may decrease the brightness of the virtual video information 27 presented to the user, or may stop presenting the virtual video information 27 to the user.

[0100] The display mode determination unit 38 may determine the brightness of the virtual video information 27 presented to the user according to, for example, the body movements of the moving user. Specifically, while the user is making a specific body movement during movement, the display mode determination unit 38 may decrease the brightness of the virtual video information 27 presented to the user, or may stop presenting the virtual video information 27 to the user. Specific body movements include ascending and descending stairs, falling, getting on and off a vehicle, conversation, eating and drinking, and operations of the information terminal 23, smart watch 49, and control unit 22, etc., but are not limited thereto and may be selected by the user.

[0101] The display mode determination unit 38 may determine the display mode of the virtual video information 27 presented to the user according to, for example, the ambient temperature around the moving user. Specifically, the display mode determination unit 38 may determine the brightness of the virtual video information 27 presented to the user, the appearance of the avatar for guidance such as clothing, etc., according to the ambient temperature around the moving user, or may stop presenting the virtual video information 27 to the user. For example, when the ambient temperature around the moving user is high or low, the display mode determination unit 38 may increase or decrease the brightness of the virtual video information 27 presented to the user, or may stop presenting the virtual video information 27 to the user.

[0102] (Recommendation information acquisition unit 39) Based on the location information 26 extracted by the information extraction unit 36, the recommendation information acquisition unit 39 acquires, as recommendation information, the virtual video information 27 of the relevant information 31 that matches the user's preference selected by the learning model 14a from among the virtual video information 27 of the relevant information 31 regarding the facility or area indicated in the location information 26. The information presentation system 10 is accessible to a pre-prepared learning model 14a. The learning model 14a is installed in the learning model server 14, and the information presentation system 10 accesses the learning model server 14 through the information communication network 15 and uses the learning model 14a.

[0103] (Learning model 14a) The learning model 14a is learned to learn the behavior history information 28 indicating a plurality of behavior histories of the user, extract the user's preference, and select the relevant information 31 that matches the user's preference based on the extracted user's preference. That is, the learning model 14a is subjected to unsupervised learning using the user's behavior history information 28 as learning data, extracts the user's preference from the learning data, and selects and recommends the relevant information 31 such as products or services that conform to the user's preference. The learning model 14a may use a content-based filtering, collaborative filtering, or deep learning learning model.

[0104] The learning model 14a using content-based filtering may extract the characteristics of the user's preferences from among the user's behavior history information 28 given as learning data, etc., and calculate the similarity between the vector generated based on the characteristics of the user's preferences and the vector generated based on the characteristics of the related information 31, and select and recommend the related information 31 having characteristics similar to the characteristics of the user's preferences. In this case, the cosine similarity is used as the similarity, but it is not limited to this, and for example, the Euclidean distance or the Mahalanobis distance may be used. Note that in order to improve the recommendation accuracy of the related information 31 of the learning model 14a, situation information 29 may be used together with the user's behavior history information 28 as learning data, and the learning model 14a may extract the user's preferences based on the user's behavior history information 28 and situation information 29 given as learning data.

[0105] The learning model 14a using collaborative filtering groups the users of the information presentation system 10 based on the user attribute information 16 of the users given as learning data, and may select and recommend the related information 31 recommended to other users in the same group as the user and not recommended to the user. Note that in order to improve the recommendation accuracy of the related information 31 of the learning model 14a, either one or both of the user's behavior history information 28 and situation information 29 may be used together with the user attribute information 16 of the user as learning data.

[0106] The learning model 14a using deep learning may use the user's behavior history information 28 as learning data, extract the feature amounts of the user's behavior history information 28, and select and recommend the related information 31 having feature amounts similar to the feature amounts. Note that in order to improve the recommendation accuracy of the related information 31 of the learning model 14a, either one or both of the user's user attribute information 16 and situation information 29 may be used together with the user's behavior history information 28 as learning data.

[0107] (Signboard recognition unit 40) The sign recognition unit 40 analyzes video information, recognizes a sign shown in the video, and extracts sign image information 92 indicating the sign from the video information. That is, the sign recognition unit 40 performs image analysis on video information based on the video captured by the camera 20b of the augmented reality display terminal 11 acquired by the terminal information acquisition unit 35, using a learning model, AI, etc., recognizes a sign shown in the video, and extracts sign image information 92 indicating the sign shown in the video from the video information.

[0108] (Evaluation unit 41) The evaluation unit 41 evaluates the significance of the virtual video information 27 in comparison with other virtual video information 27, using an evaluation value obtained by evaluating the virtual video information 27 by a plurality of users in comparison with other virtual video information 27, and using a mathematical model of covariance analysis that includes explanatory variables related to the preferences of each user as covariates to suppress the influence of the preferences of each user.

[0109] Covariance analysis is an analysis method that can compare between groups by removing the influence of data (covariates) that affect the average value, and is an analysis method having the characteristics of variance analysis and regression analysis. That is, covariance analysis performs inter-group analysis in the same way as variance analysis, but is an analysis method that uses regression analysis during this inter-group analysis. The covariance analysis in this embodiment evaluates which of the virtual video information 27 and other virtual video information 27 is useful based on a comparison between an evaluation group of evaluation values for the virtual video information 27 for each of a plurality of users and an evaluation group for other virtual video information 27. In this case, the average value refers to the average value of the evaluation values for the virtual video information 27 for each of a plurality of users, and the covariate is a value obtained by quantifying the preferences of each user that affect the evaluation value of each user. The covariate is incorporated as an explanatory variable in the mathematical model of covariance analysis. Therefore, the covariance analysis in this embodiment can evaluate the virtual video information 27 of the user with the influence of the user's preferences removed. The mathematical model of covariance analysis in this embodiment is represented by the following formula (1). The mathematical model of the covariance analysis includes the explanatory variables of the comparison group, and the "virtual video information" in the following formula (1) i " corresponds to the explanatory variables of the comparison group. Also, the "preference" in the following formula (1) j " is an explanatory variable incorporated as a covariate.

[0110]

Number

[0111] The covariance analysis according to this embodiment will be described with reference to FIG. 9. FIG. 9 is a diagram for explaining the evaluation unit 41 of the information presentation system 10 according to this embodiment, (a) shows sample data, and (b) is a graph of the sample data. In the sample of the covariance analysis shown in FIG. 9, eight users j (1 to 8 ∈ j) evaluate the virtual video information A and the virtual video information B and provide evaluation values, excluding the influence of the preferences of the eight users j, and analyzing which of the virtual video information A and the virtual video information B is more useful by evaluating them themselves.

[0112] The elements of the "virtual video information" that are the explanatory variables of the comparison group i " are the virtual video information A and the virtual video information B, and A and B are elements of i (A, B ∈ i). "Preference" j " is an explanatory variable incorporated as a covariate, 1 to 8 are the individual identification information of the users, and are elements of j (1 to 8 ∈ j). The values obtained by quantifying the preferences of each of the eight users may be the preferences of the users extracted from the user's behavior history information by giving the user's behavior history information as learning data to the above learning model, or may be the preferences of the users obtained by quantifying the preferences of the users through a questionnaire survey conducted in advance on the users.

[0113] The sample data shown in FIG. 9(a) is shown below. However, the evaluation value i,jis the evaluation value of user j for virtual video information i, and the evaluation value A,j is the evaluation value of user j for virtual video information A, and the evaluation value B,j is the evaluation value of user j for virtual video information B. For user 1: Evaluation value A,1 = A1, evaluation value B,1 = B1 For user 2: Evaluation value A,2 = A2, evaluation value B,2 = B2 For user 3: Evaluation value A,3 = A3, evaluation value B,3 = B3 For user 4: Evaluation value A,4 = A4, evaluation value B,4 = B4 For user 5: Evaluation value A,5 = A5, evaluation value B,5 = B5 For user 6: Evaluation value A,6 = A6, evaluation value B,6 = B6 For user 7: Evaluation value A,7 = A7, evaluation value B,7 = B7 For user 8: Evaluation value A,8 = A8, evaluation value B,8 = B8

[0114] The graph shown in Fig. 9(b) is the graph of the sample data shown in Fig. 9(a). The horizontal axis is the value obtained by quantifying the user's preference, and the vertical axis is the user's evaluation value i,j is As shown in Fig. 9(b), the evaluation unit 41 plots the evaluation values A,j and the evaluation value B,j which are the sample data of Fig. 9(a) on the graph, and prepares for the between-group analysis of the two groups.

[0115] Next, the evaluation unit 41 performs the between-group analysis between the group of the evaluation value A,j of the virtual video information A and the group of the evaluation value B,j of the virtual video information B by means of regression analysis. The evaluation unit 41 determines the evaluation value of the virtual video information A A,jRegression line 56 of the group and the evaluation value of the virtual video information B B,j Draw the regression line 57 of the group using the least squares method. As shown in Fig. 9(b), the evaluation unit 41 compares the regression line 56 and the regression line 57 by the difference 58 in the direction along the vertical axis. Therefore, "the evaluation value when the values of the same covariation (preference j ) were the same" i,j is being compared. The graph shown in Fig. 9(b) indicates that the virtual video information A is more useful than the virtual video information B.

[0116] (Mirroring unit 42) When a plurality of users are moving together, the mirroring unit 42 acquires the virtual video information 27 transmitted to the augmented reality display terminal 11 of one of the plurality of users. The virtual video information 27 acquired by the mirroring unit 42 is transmitted to the augmented reality display terminals 11 of other users who are moving together with the user, so that the same virtual video information 27 is presented to the plurality of users.

[0117] (Aversion feeling estimation processing unit 43) The aversion feeling estimation processing unit 43 includes a pupil detection control unit 43a, an aversion feeling estimation unit 43b, and an aversion feeling intensity determination unit 43c. The pupil detection control unit 43a analyzes the pupil information acquired by the pupil detection unit 20d to estimate the intensity of the user's aversion to the virtual video information 27, and restricts the virtual video information 27 presented to the user when the estimated intensity of the aversion feeling exceeds a threshold value.

[0118] (Pupil detection control unit 43a) The pupil detection control unit 43a controls the pupil detection unit 20d provided in the augmented reality display terminal 11 to detect the state of the user's pupils. The pupil detection unit 20d includes an LED that irradiates near-infrared light and a camera, is built into the frame 19 of the glasses unit 20 of the augmented reality display terminal 11, and acquires video information showing an image of the user's eyeball. The terminal information acquisition unit 35 of the information presentation system 10 acquires the video information transmitted from the augmented reality display terminal 11 as pupil information.

[0119] (Avoidance feeling estimation unit 43b) The avoidance feeling estimation unit 43b estimates the intensity of the user's avoidance feeling towards the virtual video information 27 based on the pupil information. The pupil information is information indicating the state of the user's pupils, and is video information showing the video of the user's eyeballs acquired by the pupil detection unit 20d.

[0120] The avoidance feeling estimation unit 43b performs image analysis on the pupil information to detect the size of the diameter of the user's pupils and the eye movement of the eyeballs in the state where the virtual video information 27 is presented to the user. The avoidance feeling estimation unit 43b refers to the correlation between the diameter of the user's pupils and the eye movement of the eyeballs and the intensity of the user's avoidance feeling, and based on the diameter of the user's pupils and the state of the eye movement obtained by performing image analysis on the pupil information, estimates the intensity of the user's avoidance feeling towards the virtual video information 27 presented to the user.

[0121] (Avoidance feeling intensity determination unit 43c) The avoidance feeling intensity determination unit 43c determines whether the intensity of the avoidance feeling exceeds a threshold value. That is, the avoidance feeling intensity determination unit 43c determines whether the intensity of the user's avoidance feeling towards the virtual video information 27 exceeds a threshold value. When it is determined that the intensity of the user's avoidance feeling exceeds the threshold value, the virtual video information 27 that causes the user's avoidance feeling is restricted from being output to the user's extended reality display terminal 11.

[0122] (Generated AI utilization processing unit 44) The generated AI utilization processing unit 44 includes a text data generation unit 44a, a prompt input unit 44b, and an answer acquisition unit 44c, and realizes a conversation with the user's generated AI 13a.

[0123] The extended reality display terminal 11 includes a microphone 20c that collects the user's voice and a directional speaker 20e that emits sound to the user. In addition, the information presentation system 10 is accessible to the generative AI 13a, and the terminal information acquisition unit 35 acquires voice information based on the user's voice collected by the microphone 20c from the augmented reality display terminal 11.

[0124] (Text data generation unit 44a) The text data generation unit 44a analyzes the voice information and generates text data of the user's voice. That is, the text data generation unit 44a analyzes the voice information acquired by the terminal information acquisition unit 35 and generates text data of the user's voice. The voice-based voice information refers to information in a digital format that can transmit, receive, and analyze voices, such as MP3 format, WAVE format, AAC format, etc. The text data generation unit 44a uses an acoustic model to decompose the voice information into basic acoustic units such as phonemes, and the language model infers the most appropriate combination of words based on the context.

[0125] (Prompt input unit 44b) The prompt input unit 44b generates a prompt based on the text data and inputs the prompt into the generative AI 13a. That is, the prompt input unit 44b transmits, through the information communication network 15, a prompt, which is an instruction and input given to the generative AI 13a based on the text data generated by the text data generation unit 44a, to the generative AI server 13 and inputs it into the generative AI 13a.

[0126] (Answer acquisition unit 44c) The answer acquisition unit 44c acquires answer data indicating the answer of the generative AI 13a. That is, the answer acquisition unit 44c accesses the generative AI server 13 through the information communication network 15 and acquires, from the generative AI 13a, answer data that is the answer to the prompt of the generative AI 13a.

[0127] (Location status acquisition unit 46) The location status acquisition unit 46 extracts location information 26 indicating the location where the user is currently located from the storage device based on the current location information, and acquires location status information 64 indicating the status of the location based on the location information 26. That is, the location status acquisition unit 46 identifies the location where the user is currently located based on the current location information acquired by the terminal information acquisition unit 35 from the user's augmented reality display terminal 11, and acquires location status information 64 indicating the status of the location based on the location information 26 indicating the location. The location status information 64 refers to the status such as whether the location where the user is currently located is a facility or an area, whether the location where the user is currently located is inside a facility, whether it is a road with a complex winding or intersecting shape, whether it is in a crowded place, or whether it is surrounded by tall buildings.

[0128] The location status acquisition unit 46 may acquire the video of the live camera installed for each location as the location status information 64 indicating the status of the location. That is, the location status acquisition unit 46 may acquire the real-time video of live cameras such as street security cameras, traffic monitoring cameras installed in the city, and monitoring cameras installed in facilities or areas through the information communication network 15 as the location status information 64 indicating the status of the location. The live camera is a monitoring camera installed for each location of the facility or area, and captures the status of the location.

[0129] (Route guidance mode determination unit 45) The route guidance mode determination unit 45 determines the mode of route guidance for the user based on the location status information 64. That is, the route guidance mode determination unit 45 may input the location status information 64 acquired by the location status acquisition unit 46 into a learning model that has previously machine-learned the correspondence between the location status information 64 and the mode of route guidance, and use the mode of route guidance output by the learning model as the determination of the route guidance mode determination unit 45.

[0130] (Route guidance mode acquisition unit 47) The road guidance mode acquisition unit 47 acquires road guidance mode information 62 associated with the mode of road guidance from the storage device based on the determined mode of road guidance. That is, the road guidance mode acquisition unit 47 acquires road guidance mode information 62 associated with the mode of road guidance from the storage device based on the mode of road guidance determined by the road guidance mode determination unit 45 based on the location state information 64.

[0131] The output unit 59 outputs the road guidance mode information 62 to the augmented reality display terminal 11. That is, the output unit 59 outputs the road guidance mode information 62 to the user's augmented reality display terminal 11 through the information communication network 15. Therefore, each time the mode of road guidance corresponding to the location state information 64 of the location where the user is currently located changes, the information presentation system 10 acquires the road guidance mode information 62 associated with the mode of road guidance from the storage device and outputs it to the user's augmented reality display terminal 11, so that the mode of road guidance can be changed according to the user's situation to provide road guidance to the user.

[0132] (Output unit 59) The output unit 59 outputs the route information, location information 26, and virtual video information 27 to the augmented reality display terminal 11. That is, the output unit 59 outputs the route information, location information 26, and virtual video information 27 extracted by the information extraction unit 36 from the storage device to the augmented reality display terminal 11 through the information communication network 15.

[0133] Also, the output unit 59 outputs the avatar information to the augmented reality display terminal 11. That is, the output unit 59 outputs the avatar information generated by the avatar information generation unit 37 to the augmented reality display terminal 11 through the information communication network 15.

[0134] Also, the output unit 59 outputs the display mode information indicating the determined display mode to the augmented reality display terminal 11. That is, the output unit 59 outputs the display mode information indicating the display mode determined according to the movement state information to the augmented reality display terminal 11 through the information communication network 15.

[0135] Further, the output unit 59 outputs, together with the route information, the recommended information acquired by the recommended information acquisition unit 39 and the location information 26 indicating the facility or area related to the related information 31 of the recommended information to the augmented reality display terminal 11. That is, the output unit 59 outputs, together with the route information extracted from the storage device by the information extraction unit 36, the recommended information acquired by the recommended information acquisition unit 39 and the location information 26 indicating the facility or area related to the related information 31 of the recommended information to the augmented reality display terminal 11 through the information communication network 15.

[0136] Further, the output unit 59 preferentially outputs the virtual video information 27 of the related information 31 regarding the facility or area existing along the route among the facilities or areas around the route indicated by the route information to the augmented reality display terminal 11. That is, the output unit 59 preferentially outputs the virtual video information 27 of the related information 31 regarding the facility or area existing along the route among the facilities or areas around the route indicated by the route information extracted from the storage device by the information extraction unit 36 to the augmented reality display terminal 11 through the information communication network 15. Since the user moves along the route, by preferentially presenting the virtual video information 27 of the related information 31 regarding the facility or area to the user passing in front of the facility or area, the user can temporarily stop moving and easily stop by at the facility or area.

[0137] Further, the output unit 59 may output the virtual video information 27 to the augmented reality display terminal 11 and output the discount information 34 to the information terminal 23 carried by the user. That is, when the user carries an information terminal 23 such as a smartphone, by transmitting the discount information 34 to the information terminal 23, the user can present the discount information 34 at a storefront or the like.

[0138] In addition, the output unit 59 outputs the virtual video information 27 acquired by the mirroring unit 42 to an extended reality display terminal 11 of another user different from one of a plurality of users. That is, when the user is moving with a companion, the mirroring unit 42 acquires the virtual video information 27 presented to one of the user and the companion, and presents the virtual video information 27 to other users, so that the user and the companion can move while viewing the same virtual video information 27 or can have a conversation.

[0139] In addition, when it is determined that the intensity of the sense of aversion exceeds a threshold value, the output unit 59 restricts the virtual video information 27 output to the extended reality display terminal 11. That is, when the intensity of the sense of aversion estimated by the sense of aversion estimation unit 43b is determined by the sense of aversion intensity determination unit 43c to exceed the threshold value, the output to the extended reality display terminal 11 of the virtual video information 27 that causes the sense of aversion is restricted. The output unit 59 can suppress the user's sense of aversion by restricting the presentation of the virtual video information 27 to a user who feels a sense of aversion with an intensity exceeding the threshold value with respect to the virtual video information 27.

[0140] In addition, the output unit 59 outputs response data to the extended reality display terminal 11. That is, the output unit 59 outputs response data indicating the response of the generation AI 13a acquired by the response acquisition unit 44c to the extended reality display terminal 11 through the information communication network 15. Thereby, the user can obtain a response from the generation AI 13a to the query to the generation AI 13a by his own voice, so that the user can have a conversation with the generation AI 13a.

[0141] (Regarding the flow of various information in the usage environment including the information presentation system 10) Referring to FIG. 10, the flow of various types of information in the usage environment including the information presentation system 10 according to this embodiment will be described. FIG. 10 is a sequence diagram for explaining an example of the flow of various types of information in the usage environment including the information presentation system 10 according to this embodiment. As shown in FIG. 10, the flow of various types of information in the usage environment including the information presentation system 10 is illustrated for the usage situations from the first scene 50 to the seventh scene 110, but is not limited thereto, and the information presentation system 10 is used under various situations.

[0142] (First scene 50) In the first scene 50, the information presentation system 10 acquires the user's destination and current location, and based on these pieces of information, extracts route information, location information 26, and virtual video information 27 from the storage device, and outputs the extracted pieces of information to the user's augmented reality display terminal 11. Therefore, the information presentation system 10 acquires "destination information and current location information" 51 from the augmented reality display terminal 11, extracts "route information, location information 26, and virtual video information 27" 52 from the storage device (storage server 12) based on "destination information and current location information" 51, and outputs "route information, location information 26, and virtual video information 27" 53 to the augmented reality display terminal 11.

[0143] (Second scene 60) In the second scene 60, the information presentation system 10 generates avatar information for guiding the user using an avatar based on the route information. That is, in the second scene 60, the information presentation system 10 generates avatar information 61 and outputs it to the augmented reality display terminal 11.

[0144] (Third scene 70) In the third scene 70, the information presentation system 10 acquires movement state information 71 indicating the state of the user during movement from the augmented reality display terminal 11, and outputs display mode information 72 indicating the display mode of the virtual video information 27 determined according to the movement state information 71 to the augmented reality display terminal 11.

[0145] (Scene 4: 80) In Scene 4: 80, the information presentation system 10 inputs the plurality of location information 26 extracted from the storage device based on the destination information and current location information 81 of the user acquired from the augmented reality display terminal 11 into the learning model 14a, and acquires, as recommended information 83, the virtual video information 27 that matches the user's preference selected by the learning model 14a from among the virtual video information 27 of the related information 31 associated with each of the plurality of location information 26. Together with the route information, the recommended information 83 and the location information 26 indicating the facility or area related to the related information 31 of the recommended information 83 are output to the augmented reality display terminal 11. Therefore, since the information presentation system 10 selects the virtual video information 27 that matches the user's preference from among the plurality of virtual video information 27 and outputs it to the user's augmented reality display terminal 11, it is possible to present the user with the virtual video information 27 personalized according to the user's preference.

[0146] (Scene 5: 90) In Scene 5: 90, the information presentation system 10 extracts the virtual video information 27 and the discount information 34 from the storage device based on the signboard image information 92 extracted from the video information captured and acquired by the camera 20b of the augmented reality display terminal 11, outputs the virtual video information 27 to the augmented reality display terminal 11, and outputs the discount information 34 to the information terminal 23.

[0147] (Scene 6: 100) In Scene 6: 100, when the information presentation system 10 acquires the pupil information 101 acquired by the pupil detection unit 20d from the augmented reality display terminal 11 and determines that the intensity of the user's aversion to the virtual video information 27 estimated based on the pupil information 101 exceeds the threshold value, the restricted virtual video information 27 is output to the augmented reality display terminal 11.

[0148] (Scene 7: 110) In the seventh scene 110, the information presentation system 10 acquires voice information 111 of the user from the augmented reality display terminal 11, inputs the prompt 112 generated based on the voice information 111 into the generation AI 13a, and outputs the obtained response data 113 to the augmented reality display terminal 11.

[0149] (Eighth scene 120) In the eighth scene 120, the information presentation system 10 acquires current position information 121 from the augmented reality display terminal 11, and specifies location information 26 indicating the location where the user is currently located based on the current position information 121. Then, the information presentation system 10 extracts route guidance mode information 62 associated with the route guidance mode determined based on the location state information 64 acquired based on the location information 26 from the storage device, and outputs it to the augmented reality display terminal 11.

[0150] (An example of the display mode of the virtual video information 27) Referring to FIG. 11, an example of the display mode of the virtual video information 27 presented by the information presentation system 10 to the user will be described. FIG. 11 is a diagram for explaining an example of the display mode of the virtual video information 27 of the information presentation system 10 according to the present embodiment. In an example of the display mode of the virtual video information 27 shown in FIG. 11, when the amount of information of the virtual video information 27 presented to the user by the augmented reality display terminal 11 becomes extremely large, it causes an adverse effect on the user's guiding experience and a sense of aversion of the user to the virtual video information 27. Therefore, the virtual video information 27 presented to the user is presented to the user in an anti-hyper-realistic manner, that is, with an amount of information and a display mode that do not become overly gaudy. Specifically, in an example of the display mode of the virtual video information 27 shown in FIG. 11, as the user approaches the target virtual video information 27 and performs an operation or action on the virtual video information 27, the stored information may be gradually developed. And at the final stage, the user can move while viewing all the developed information.

[0151] The display mode 48 of the virtual video information 27 shown in FIG. 11 changes to four display modes (the first-stage display mode 48a, the second-stage display mode 48b, the third-stage display mode 48c, and the fourth-stage display mode 48d) according to the operations or actions of the user.

[0152] As shown in FIG. 11(a), in the first-stage display mode 48a, the virtual video information 27 in the display mode 48a is fixed at a predetermined location of a facility 67 such as a park in the real world 1. The first-stage display mode 48a is adapted to the surrounding environment and is not prominent. The first-stage display mode 48a can be seen even when it is far from the user, but it does not react to the operations or actions of the user. Since the first-stage display mode 48a is adapted to the surrounding environment and is not prominent, it does not give the user an excessive impression.

[0153] As shown in FIG. 11(b), when the user approaches a certain distance, the second-stage display mode 48b becomes a prominent display mode in the surrounding environment. For example, in the second-stage display mode 48b, it changes to a more prominent color or blinks with high brightness to become a more prominent presence. The second-stage display mode 48b is a prominent state in the surrounding environment but is in the initial state of emergence. In the second-stage display mode 48b, it reacts to the operations or actions of the user.

[0154] The third-stage display mode 48c appears when the user operates or acts on the second-stage display mode 48b. In the third-stage display mode 48c, summary information is displayed. The operations or actions of the user are actions (operations or actions) for eliciting an interaction of the virtual video information 27. For example, when a button that appears in the virtual video information 27 is visually observed and a predetermined finger movement or a gesture by the finger is made to press the button, it may be performed, but it is not limited thereto, and various actions may be adopted.

[0155] The display mode 48d of the fourth stage appears when the detailed button that appeared in the display mode 48b of the third stage is pressed, and detailed information is displayed. The display mode 48d of the fourth stage appears in front of the user and follows the user's movement. When the user presses the close button that appears in the display mode 48d of the fourth stage or performs an operation or action on other virtual video information 27, the display returns to the display mode 48a of the first stage.

[0156] The display mode 48 of the virtual video information 27 shown in FIG. 11 gradually realizes the interaction with the user according to the user's action (operation or action), thereby alleviating or eliminating the adverse effects on the user's induced experience and suppressing the arousal of the user's sense of avoidance towards the virtual video information 27.

[0157] (Information Presentation Method and Information Presentation Program According to this Embodiment) Next, with reference to FIG. 12, an information presentation program according to an embodiment of the present disclosure will be described together with the information presentation method. FIG. 12 is an example of a flowchart of the information presentation program according to this embodiment. The information presentation method is executed by the processing unit 10e of the information presentation system 10 based on the information presentation program.

[0158] The information presentation program includes a terminal information acquisition step S35, an information extraction step S36, an output step S59, and the like.

[0159] The information presentation program causes the processing unit 10e of the information presentation system 10 to realize functions such as a terminal information acquisition function, an information extraction function, and an output function. These functions are executed in the order shown in the flowchart of FIG. 12, but the order can be changed appropriately as well. Since each function overlaps with the description of the various functional parts of the information presentation system 10 described above, the detailed description thereof is omitted.

[0160] The terminal information acquisition function acquires destination information indicating the user's destination and current position information indicating the current position from the augmented reality display terminal 11 (S35: terminal information acquisition step).

[0161] The information extraction function extracts route information indicating the route from the current position to the destination from the storage device based on the destination information and the current position information, extracts location information 26 indicating facilities or areas around the route from the storage device based on the route information, and extracts virtual video information 27 of related information 31 regarding the facilities or areas from the storage device based on the location information 26 (S36: information extraction step).

[0162] The output function outputs the route information, the location information 26, and the virtual video information 27 to the augmented reality display terminal 11 (S45: output step).

[0163] (Information presentation method and information presentation program according to another embodiment) With reference to FIGS. 13 and 14, an information presentation program according to another embodiment will be described together with an information presentation method. FIG. 13 is an example of a flowchart of an information presentation program according to another embodiment, and FIG. 14 is an example of a flowchart of a sub-process included in the flowchart of the information presentation program according to another embodiment.

[0164] An example of the flowchart of the information presentation program according to another embodiment shown in FIG. 13 is different from the example of the flowchart of the information presentation program shown in FIG. 12 in that an avatar information generation step S37, a display mode determination step S38, a recommended information acquisition step S39, a signboard recognition step S40, an evaluation step S41, a mirroring step S42, an avoidance feeling estimation processing step S43, and a generation AI utilization processing step S44 are added.

[0165] The information presentation method according to another embodiment is executed by the processing unit 10e of the information presentation system 10 based on the information presentation program according to another embodiment shown in FIG. 13.

[0166] The information presentation program according to another embodiment shown in FIG. 13 includes a terminal information acquisition step S35, an information extraction step S36, an avatar information generation step S37, a display mode determination step S38, a recommended information acquisition step S39, a signboard recognition step S40, an evaluation step S41, a mirroring step S42, an avoidance feeling estimation processing step S43, a generative AI utilization processing step S44, a location state acquisition step S45, a route guidance mode determination step S46, a route guidance mode acquisition step S47, and an output step S59, etc.

[0167] Note that the avoidance feeling estimation processing step S43 includes a pupil detection control step S43a, an avoidance feeling estimation step S43b, and an avoidance feeling intensity determination step S43c, which are sub - processes shown in FIG. 14(a). The generative AI utilization processing step S44 includes a text data generation step S44a, a prompt input step S44b, and an answer acquisition step S44c, which are sub - processes shown in FIG. 14(b).

[0168] The information presentation program according to another embodiment shown in FIG. 13 realizes, for the processing unit 10e of the information presentation system 10, functions such as a terminal information acquisition function, an information extraction function, an avatar information generation function, a display mode determination function, a recommended information acquisition function, a signboard recognition function, an evaluation function, a mirroring function, an avoidance feeling estimation processing function, a generative AI utilization processing function, a location state acquisition function, a route guidance mode determination function, a route guidance mode acquisition function, and an output function, etc.

[0169] Note that the avoidance feeling estimation processing function is composed of a pupil detection control function, an avoidance feeling estimation function, and an avoidance feeling intensity determination unit function. Also, the generative AI utilization processing function is composed of a text data generation function, a prompt input function, and an answer acquisition function. These functions are executed in the order shown in the flowcharts of FIGS. 13 and 14, but the order can also be changed appropriately and executed.

[0170] Hereinafter, regarding the information presentation method and the information presentation program according to another embodiment shown in FIGS. 13 and 14, only the differences from the information presentation control method and the information presentation program shown in FIG. 12 will be described. Also, since each function overlaps with the description of each functional part of the information presentation system 10 described above, its detailed description will be omitted.

[0171] The avatar information generation function generates avatar information for guiding the user using an avatar based on the route information (S37: avatar information generation step).

[0172] The display mode determination function determines the display mode of the virtual video information 27 for the user according to the movement state information (S38: display mode determination step).

[0173] The recommended information acquisition function acquires, as recommended information, the virtual video information 27 of the relevant information 31 that matches the user's preference selected by the learning model 14a from the virtual video information 27 of the relevant information 31 associated with each of the plurality of location information 26 extracted in the information extraction function, based on the plurality of location information 26 (S39: recommended information acquisition step).

[0174] The signboard recognition function analyzes the video information, recognizes the signboard shown in the video, and extracts signboard image information 92 indicating the signboard from the video information (S40: signboard recognition step).

[0175] The evaluation function uses an evaluation value obtained by evaluating the virtual video information 27 by a plurality of users in comparison with other virtual video information 27, and is represented by a mathematical model of covariance analysis that includes explanatory variables related to the preferences of each user as covariates, and suppresses the influence of the preferences of each user. The significance of the virtual video information 27 is evaluated by comparison with other virtual video information 27 (S41: evaluation step).

[0176] The mirroring function acquires the virtual video information 27 transmitted to the augmented reality display terminal 11 of one of the plurality of users when the plurality of users are moving together (S42: mirroring step).

[0177] The avoidance feeling estimation processing function is composed of a pupil detection control function, an avoidance feeling estimation function, and an avoidance feeling intensity determination function. The pupil detection control function controls the pupil detection unit 20d provided in the augmented reality display terminal 11 to detect the state of the user's pupil (S43a: pupil detection control step). The avoidance feeling estimation function estimates the intensity of the user's avoidance feeling with respect to the virtual video information 27 based on the pupil information (S43b: avoidance feeling estimation step). The avoidance feeling intensity determination function determines whether the intensity of the avoidance feeling exceeds a threshold value (S43c: avoidance feeling intensity determination step).

[0178] The generated AI utilization processing function is composed of a text data generation function, a prompt input function, and an answer acquisition function. The text data generation function analyzes the voice information and generates the text data of the user's voice (S44a: text data generation step). The prompt input function generates a prompt based on the text data and inputs the prompt into the generated AI 13a (S44b: prompt input step). The answer acquisition function acquires answer data indicating the answer of the generated AI 13a (S44c: answer acquisition step).

[0179] The location state acquisition function extracts location information 26 indicating the location where the user is currently located from the storage device based on the current location information, and acquires location state information 64 indicating the state of the location based on the location information 26 (S45: location state acquisition step).

[0180] The route guidance mode determination function determines the route guidance mode for the user based on the location state information 64 (S46: route guidance mode determination step).

[0181] The route guidance mode acquisition function acquires route guidance mode information 62 associated with the route guidance mode from the storage device based on the determined route guidance mode (S47: route guidance mode acquisition step).

[0182] The output function outputs route information, location information 26, and virtual video information 27 to the augmented reality display terminal 11 (S59: output step).

[0183] (Effects according to this embodiment) According to the information presentation system 10 according to the above-described embodiment, the destination information and the current location information are acquired from the augmented reality display terminal 11, and based on the destination information and the current location information 51, route information, location information 26, and virtual video information 27 are extracted from the storage device (storage server 12) and output to the augmented reality display terminal 11. Therefore, while ensuring the safety of the user during movement, other information can be presented visually together with the route information regarding the guidance to the user's destination.

[0184] Also, according to the information presentation system 10 according to the above-described embodiment, the information terminal 23 includes a display screen 23a, and since the discount information 34 sent from the information presentation system 10 can be displayed on the display screen 23a, it is easy to use at a storefront or the like.

[0185] Also, according to the information presentation system 10 according to the above-described embodiment, based on the route information, the user can be guided using an avatar.

[0186] Also, according to the information presentation system 10 according to the above-described embodiment, according to the movement state information 71 indicating the state of the user during movement acquired from the augmented reality display terminal 11, the display mode information 72 indicating the display mode of the virtual video information 27 can be determined.

[0187] Also, according to the information presentation system 10 according to the above-described embodiment, among the plurality of virtual video information 27, the virtual video information 27 that suits the user's preference can be selected and presented to the user. Therefore, personalized virtual video information 27 can be presented to the user according to the user's preference.

[0188] Also, according to the information presentation system 10 according to the above-described embodiment, based on the signboard image information 92 extracted from the video information captured and acquired by the camera 20b of the augmented reality display terminal 11, the virtual video information 27 and the discount information 34 are extracted from the storage device, the virtual video information 27 is presented to the user, and the discount information 34 can be displayed on the information terminal 23 and the smart watch 49.

[0189] Also, according to the information presentation system 10 according to the above-described embodiment, when the pupil information 101 of the user is acquired from the augmented reality display terminal 11 and it is determined that the intensity of the user's sense of aversion to the virtual video information 27 estimated based on the pupil information 101 exceeds the threshold value, the virtual video information 27 presented to the user can be restricted.

[0190] Also, according to the information presentation system 10 according to the above-described embodiment, the voice information 111 of the user is acquired from the augmented reality display terminal 11, the prompt 112 generated based on the voice information 111 is input to the generation AI 13a, and the obtained answer data 113 is output to the augmented reality display terminal 11, so that the user can interact with the generation AI 13a.

[0191] Also, according to the information presentation system 10 according to the above-described embodiment, when evaluating the usefulness of the virtual video information 27 in comparison with other virtual video information 27 based on the evaluation values of a plurality of users for the virtual video information 27, by using a mathematical model of covariance analysis that incorporates the user's preference as a covariate, an evaluation that removes the influence of the user's preference can be performed.

[0192] Also, according to the information presentation system 10 according to the above-described embodiment, the user can be guided using the route guidance mode information 62 associated with the route guidance mode corresponding to the state of the place where the user is currently located.

[0193] Note that the present disclosure is not limited to the information presentation system 10, information presentation method, and information presentation program according to the above-described embodiments, and can be implemented by various other modifications or application examples without departing from the gist of the present disclosure described in the claims. In the above-described embodiments, the term "data" is used, but the term "data" can be replaced with "information", and the term "information" can be replaced with "data".

Explanation of Reference Numerals

[0194] 1 Real world (outdoor urban space) 2 User 3 Guidance information 4 AR content 5a AR arrow 5b AR text 6 Stereoscopic video advertisement 7 Traffic guidance sign 8 Avatar 9 AR advertisement 10 Information presentation system 10a Communication interface 10b ROM 10c RAM 10d Storage unit 10e Processing unit 10f Input / output interface 10g Input device 10h Output device 11 Augmented reality display terminal 11a Augmented reality display terminal 11b Augmented reality display terminal 11c Augmented reality display terminal 12 Storage server (storage device) 13 Generation AI server 13a Generation AI 14 Learning model server 14a Learning model 15 Information communication network 16 User attribute information 17 Right temple 18 Left temple 19 frames 20 glasses part 20a sensor 20b camera 20c microphone 20d pupil examination part 20e directional speaker 20f display part 20g input / output interface 20h bus 20i GPS antenna 21 wired cable 22 control part 22a input / output interface 22b processing part 22c ROM 22d RAM 22e power supply part 22f storage part 22g GPS signal reception part 22h wireless LAN communication part 22i Bluetooth (registered trademark) communication part 22j mobile data communication part 22k bus 22l destination reception part 23 information terminal 23a display screen 24 wireless communication 25 map information 26 location information 27 virtual video information 28 action history information 29 situation information 30 signboard related information 31 related information 32 right glass part 33 left glass part 34 discount information 35 terminal information acquisition part 36 information extraction part 37 avatar information generation part 38 display mode determination part 39 recommended information acquisition part 40 signboard recognition part 41 evaluation part 42 Mirror Ring Part 43 Sense of Avoidance Estimation Processing Unit 43a Pupil Detection Control Unit 43b Sense of Avoidance Estimation Unit 43c Sense of Avoidance Intensity Judgment Unit 44 Generative AI Utilization Processing Unit 44a Text Data Generation Unit 44b Prompt Input Unit 44c Answer Acquisition Unit 46 Location Status Acquisition Unit 45 Route Guidance Mode Determination Unit 47 Route Guidance Mode Acquisition Unit 48 Display Mode 48a First Stage Display Mode 48b Second Stage Display Mode 48c Third Stage Display Mode 48d Fourth Stage Display Mode 49 Smartwatch 49a Display Screen 50 First Scene 51 Destination Information and Current Value Information 52 Route Information, Location Information 26, and Virtual Image Information 27 53 Route Information, Location Information 26, and Virtual Image Information 27 56 First Regression Line 57 Second Regression Line 58 Difference in the Direction Along the Vertical Axis 59 Output Unit 60 Second Scene 61 Avatar Information 62 Route Guidance Mode Information 63 Live Camera Video 64 Location Status Information 67 Facility 70 Third Scene 71 Movement Status Information 72 Display Status Information 80 Fourth Scene 81 Destination Information and Current Location Information 83 Recommended Information 84 Personalized Virtual Image Information 90 Fifth Scene 91 Video Information 92 Billboard image information 98 Arrow 100 Sixth scene 101 Pupil information 102 Restricted virtual video information 110 Seventh scene 111 Audio information 112 Prompt 113 Answer data 120 Eighth scene 121 Current position information

Claims

1. An information presentation system that presents information to a moving user using an augmented reality display terminal worn by the user, a storage device that stores map information including route information, location information indicating the location of a facility or area on the map, and virtual image information for displaying related information indicating advertisements related to the location on the augmented reality display terminal as augmented reality content; a terminal information acquisition unit that acquires, from the augmented reality display terminal, destination information indicating a destination of the user and current location information indicating a current location of the user; an information extraction unit that extracts route information indicating a route from the current location to the destination based on the destination information and the current location information from the storage device, extracts place information indicating the places in the vicinity of the route based on the route information from the storage device, and extracts virtual image information of related information indicating advertisements related to the places based on the place information from the storage device; an output unit that outputs the route information, the location information, and the virtual image information to the augmented reality display terminal; Equipped with When there are a plurality of locations, the information extraction unit extracts virtual image information of the related information for each of the plurality of locations from the storage device; An information presentation system in which the multiple virtual video information are presented to the user using the augmented reality display terminal so that the sizes of the multiple virtual video information are coordinated with each other to create an integrated visual effect, such that virtual video information for related information of locations closer to the user's current location is presented to the user larger, and the greater the distance between the user and a location, the smaller the virtual video information for related information of the location is presented to the user.

2. the information presentation system further includes an avatar information generation unit that generates avatar information for causing an avatar to appear for the user based on the route information, The information presentation system according to claim 1 , wherein the output unit outputs the avatar information to the augmented reality display terminal.

3. The augmented reality display terminal is equipped with a sensor, the terminal information acquisition unit acquires, from the augmented reality display terminal, moving state information indicating a moving state of the user detected by the sensor; The information presentation system includes: a display mode determination unit that determines a display mode of the virtual image information to the user in accordance with the moving state information; Further comprising: The information presentation system according to claim 1 , wherein the output unit outputs display mode information indicating the determined display mode to the augmented reality display terminal.

4. A learning model is prepared in advance, which is trained to learn behavioral history information indicating a plurality of behavioral histories of the user, extract preferences of the user, and select the related information matching the preferences of the user based on the extracted preferences of the user; The information presentation system includes: A recommended information acquisition unit is further provided that acquires, as recommended information, virtual video information of the related information that matches the user's preference selected by the learning model from the virtual video information of the related information based on each of the plurality of location information extracted by the information extraction unit, The information presentation system according to claim 1, characterized in that the output unit outputs, together with the route information, location information indicating locations related to the recommended information and related information of the recommended information acquired by the recommended information acquisition unit to the augmented reality display terminal.

5. The information presentation system according to claim 1, characterized in that the output unit prioritizes virtual image information of related information based on places that exist along the route among the places around the route indicated by the route information and outputs it to the augmented reality display terminal.

6. The information presentation system according to claim 1 , wherein the virtual image information includes a gamification element.

7. The augmented reality display terminal includes a camera for capturing images of the surroundings, the storage device stores sign-related information and discount information associated with the related information; the terminal information acquisition unit acquires, from the augmented reality display terminal, image information based on an image captured by the camera; The information presentation system includes: A sign recognition unit that analyzes the video information, recognizes a sign appearing in the video, and extracts sign image information showing the sign from the video information, the information extraction unit extracts, based on the signboard-related information indicating the signboard, virtual image information of related information associated with the signboard-related information and discount information associated with the related information from the storage device; 2 . The information presentation system according to claim 1 , wherein the output unit outputs the virtual image information to the augmented reality display terminal and outputs the discount information to an information terminal carried by the user.

8. The information presentation system includes: The information presentation system of claim 1, further comprising an evaluation unit that evaluates the significance of the virtual video information in comparison with other virtual video information using evaluation values ​​evaluated by multiple users in comparison with other virtual video information, the evaluation values ​​being expressed using a mathematical model of covariance analysis that has explanatory variables related to the preferences of each user as covariates, thereby suppressing the influence of the preferences of each user.

9. The information presentation system includes: a mirroring unit that acquires the virtual image information transmitted to an augmented reality display terminal of one of the plurality of users when the plurality of users are moving together; The information presentation system according to claim 1, characterized in that the output unit outputs the virtual video information acquired by the mirroring unit to an augmented reality display terminal of another user other than the one user among the plurality of users.

10. The information presentation system further includes a pupil detection control unit that controls a pupil detection unit provided in the augmented reality display terminal to detect a state of a pupil of a user, the terminal information acquisition unit acquires, from the augmented reality display terminal, pupil information acquired by the pupil detection unit detecting a state of the pupil when the user views the virtual video information; The information presentation system includes: an aversion estimation unit that estimates a strength of the user's aversion to the virtual video information based on the pupil information; an aversion intensity determination unit that determines whether the intensity of the aversion exceeds a threshold; Further comprising: The information presentation system according to claim 1, characterized in that the output unit limits the virtual image information output to the augmented reality display terminal when it is determined that the strength of the aversion exceeds a threshold value.

11. the augmented reality display terminal includes a microphone that collects the user's voice and a directional speaker that emits sound to the user; The information presentation system is accessible to a generating AI; the terminal information acquisition unit acquires, from the augmented reality display terminal, voice information based on the user's voice collected by the microphone; The information presentation system includes: a text data generating unit that analyzes the voice information and generates text data of the user's voice; a prompt input unit that generates a prompt based on the text data and inputs the prompt to the generation AI; An answer acquisition unit that acquires answer data indicating an answer of the generating AI; Further comprising: The information presentation system according to claim 1 , wherein the output unit outputs the answer data to the augmented reality display terminal.

12. the storage device further stores route guidance mode information, which is an image to be displayed on the augmented reality display terminal for each mode of route guidance for the user; the information presentation system includes a location status acquisition unit that extracts location information indicating a location where the user currently resides from the storage device based on the current position information, and acquires location status information indicating a status of the location based on the location information; a route guidance mode determination unit that determines a mode of route guidance for the user based on the location state information; a guidance mode acquisition unit that acquires, based on the determined guidance mode, the guidance mode information associated with the guidance mode from the storage device; Further comprising: The information presentation system according to claim 1 , wherein the output unit outputs the route guidance mode information to the augmented reality display terminal.

13. 13. The information presentation system according to claim 12, wherein the place status acquisition unit acquires images of a live camera installed at each of the places as place status information indicating a status of the place.

14. An information presentation method executed by an information presentation system that presents information to a moving user using an augmented reality display terminal worn by the user, comprising: the information presentation system includes a storage device that stores map information including route information, location information indicating a facility or area on the map, and virtual image information for displaying related information indicating an advertisement related to the location on the augmented reality display terminal as augmented reality content; The information presentation system includes: a terminal information acquisition step of acquiring, from the augmented reality display terminal, destination information indicating a destination of the user and current location information indicating a current location of the user; an information extraction step of extracting from the storage device route information indicating a route from the current location to the destination based on the destination information and the current location information, extracting from the storage device place information indicating the places in the vicinity of the route based on the route information, and extracting from the storage device virtual image information of related information indicating advertisements related to the places based on the place information; an output step of outputting the route information, the location information, and the virtual image information to the augmented reality display terminal; Run In the information extraction step, when there are a plurality of the locations, virtual image information of the related information is extracted from the storage device for each of the plurality of the locations; An information presentation method in which the multiple pieces of virtual video information are presented to the user using the augmented reality display terminal so that the sizes of the multiple pieces of virtual video information are linked to each other to create an integrated visual effect, such that virtual video information of related information for locations closer to the user's current location is presented to the user larger, and the greater the distance between the user and a location, the smaller the virtual video information of related information for the location is presented to the user.

15. An information presentation program executed by an information presentation system that presents information to a user using an augmented reality display terminal worn by the user while moving, comprising: the information presentation system includes a storage device that stores map information including route information, location information indicating a facility or area on the map, and virtual image information for displaying related information indicating an advertisement related to the location on the augmented reality display terminal as augmented reality content; The information presentation system includes: a terminal information acquisition function that acquires, from the augmented reality display terminal, destination information indicating a destination of the user and current location information indicating a current location of the user; an information extraction function that extracts route information indicating a route from the current location to the destination based on the destination information and the current location information from the storage device, extracts place information indicating the places in the vicinity of the route based on the route information from the storage device, and extracts virtual image information of related information indicating advertisements related to the places based on the place information from the storage device; an output function of outputting the route information, the location information, and the virtual image information to the augmented reality display terminal; Realize this, When there are a plurality of locations, the information extraction function extracts virtual image information of the related information for each of the locations from the storage device; An information presentation program in which the multiple pieces of virtual video information are presented to the user using the augmented reality display terminal so that the sizes of the multiple pieces of virtual video information are linked to each other to create an integrated visual effect, such that virtual video information of related information for locations closer to the user's current location is presented to the user larger, and the greater the distance between the user and a location, the smaller the virtual video information of related information for the location is presented to the user.

Images