Information processing device
The information processing device adjusts the display target area based on user speed and transportation mode, addressing inaccuracies in facility display by dynamically adapting the displayed area to the user's movement.
Patent Information
- Application Number
- JP2023559661
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-11-15
- Filing Date
- 2022-11-09
- Publication Date
- 2025-08-28
- Estimated Expiration
- 2042-11-09
AI Technical Summary
Existing AR technologies do not account for changing the display target area based on the user's travel speed when the user is not traveling by vehicle, leading to inaccuracies in facility location display.
An information processing device that adjusts the display target area based on the user's movement speed, direction, and mode of transportation, using an acquisition unit, calculation unit, and display control unit to dynamically set the display area accordingly.
Enables accurate display of facilities within a dynamic target area that adapts to the user's speed and mode of transportation, enhancing the relevance and usefulness of displayed information.
Smart Images

Figure 0007730919000001 
Figure 0007730919000002 
Figure 0007730919000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device. [Background technology]
[0002] In AR (Augmented Reality) technology, the real environment perceived by a user is augmented by a computer. Based on this technology, for example, information for user navigation, 3D data of virtual objects, digital content, etc. are displayed in the real world perceived by the user through AR glasses worn on the user's head. As a result, various information is added to the real world perceived by the user within the AR glasses. Using this technology, it is possible to provide various information to the user.
[0003] As a method for providing various information to a user, for example, Patent Document 1 discloses a server operation method. Specifically, Patent Document 1 discloses a technology for selecting one or more facilities located ahead of a vehicle from one or more facilities stored in a server based on the current position of the vehicle and the current direction of travel of the vehicle, and displaying the selected facilities on a map image. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-018472 Summary of the Invention [Problem to be solved by the invention]
[0005] The technology disclosed in Patent Document 1 is based on the premise that the user travels by vehicle. Furthermore, in the technology disclosed in Patent Document 1, when selecting one or more facilities located ahead of the vehicle, the selected facilities are those located at a location that has a predetermined geographical relationship to the current location. However, when the user travels by a means of transportation other than a vehicle, the locations of the one or more facilities displayed on the map image, and thus the area including the locations of the facilities, need to be changed according to the user's travel speed. This is because the user's activity radius differs depending on the user's travel speed, and the facilities the user needs change depending on the user's activity radius. However, the technology disclosed in Patent Document 1 does not anticipate changing the area according to the user's or vehicle's travel speed.
[0006] Therefore, the present invention aims to provide an information processing device that can change the display target area according to the user's movement speed when displaying information about facilities within the display target area including the user's location on a display device. [Means for solving the problem]
[0007] An information processing device according to a first preferred aspect of the present invention comprises an acquisition unit that acquires location information indicating a user's location, a calculation unit that calculates the user's movement speed based on changes in the location indicated by the location information, and a display control unit that causes a display device to display information about facilities within a display target area that includes the location indicated by the location information, wherein the display control unit sets the display target area to a first area when the movement speed is a first speed, and sets the display target area to a second area that is larger than the first area when the movement speed is a second speed that is faster than the first speed.
[0008] An information processing device according to a second preferred aspect of the present invention comprises an acquisition unit that acquires location information indicating a user's location, a calculation unit that calculates the user's movement speed and movement direction based on changes in the location indicated by the location information, and a display control unit that causes a display device to display information about facilities within a display target area that includes the location indicated by the location information, wherein the display control unit sets a first distance to the distance from the position indicated by the location information to the center of the display target area that is located in the movement direction of the user when the movement speed is a first speed, and sets a second distance that is longer than the first distance when the movement speed is a second speed that is faster than the first speed.
[0009] An information processing device according to a third preferred aspect of the present invention comprises an acquisition unit that acquires location information indicating a user's location; a calculation unit that calculates the user's moving speed, moving direction, and moving route based on changes in the location indicated by the location information; an estimation unit that estimates the user's means of transportation based on the user's moving speed and moving route; and a display control unit that causes a display device to display information about facilities within a display target area, wherein the display control unit is configured to set the display target area to an area within a predetermined distance centered on the nearest station in the user's direction of movement when the means of transportation estimated by the estimation unit is a train running on a railroad, or to set the display target area to an area within a predetermined distance centered on the nearest junction in the user's direction of movement when the means of transportation estimated by the estimation unit is a vehicle running on a highway. [Effects of the Invention]
[0010] According to the present invention, when information relating to facilities within a display target area including the user's position is displayed on a display device, the display target area can be changed in accordance with the user's moving speed. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is a diagram showing the overall configuration of an information processing system 1 according to a first embodiment. [Figure 2]1 is a perspective view showing the appearance of AR glasses 30 according to a first embodiment. [Figure 3] 1 is a schematic diagram of a virtual space VS provided to a user U1 by using the AR glasses 30 according to the first embodiment. [Figure 4] 1 is a schematic diagram of a virtual space VS provided to a user U1 by using the AR glasses 30 according to the first embodiment. [Figure 5] 1 is a schematic diagram of a virtual space VS provided to a user U1 by using the AR glasses 30 according to the first embodiment. [Figure 6] FIG. 2 is a block diagram showing an example of the configuration of AR glasses 30 according to the first embodiment. [Figure 7] FIG. 2 is a block diagram showing an example of the configuration of a terminal device 20 according to the first embodiment. [Figure 8] FIG. 2 is a block diagram showing an example of the configuration of a server 10 according to the first embodiment. [Figure 9] FIG. 3 is an explanatory diagram illustrating an example of the operation of a display control unit 113 according to the first embodiment. [Figure 10] FIG. 3 is an explanatory diagram illustrating an example of the operation of a display control unit 113 according to the first embodiment. [Figure 11] FIG. 3 is an explanatory diagram illustrating an example of the operation of a display control unit 113 according to the first embodiment. [Figure 12] FIG. 3 is an explanatory diagram illustrating an example of the operation of a display control unit 113 according to the first embodiment. [Figure 13] 4 is a flowchart showing the operation of the server 10 according to the first embodiment. [Figure 14] FIG. 10 is a block diagram showing an example of the configuration of a server 10A according to a second embodiment. [Figure 15] 10 is a flowchart showing the operation of a server 10A according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0012] 1: First embodiment Hereinafter, the configuration of an information processing system 1 including a server 10 according to a first embodiment of the present invention will be described with reference to FIGS.
[0013] 1-1: Configuration of the first embodiment 1-1-1: Overall structure 1 is a diagram showing the overall configuration of an information processing system 1 according to a first embodiment of the present invention. The information processing system 1 is a system that uses AR technology to provide a virtual space to a user U1 wearing AR glasses 30 (described later).
[0014] The information processing system 1 includes a server 10, terminal devices 20, and AR glasses 30. The server 10 is an example of an information processing device. In the information processing system 1, the server 10 and the terminal devices 20 are communicably connected to each other via a communication network NET. The terminal devices 20 and the AR glasses 30 are communicably connected to each other. Note that in FIG. 1, three pairs of terminal devices 20 and AR glasses 30 are shown: a pair of terminal device 20-1 and AR glasses 30-1, a pair of terminal device 20-2 and AR glasses 30-2, and a pair of terminal device 20-3 and AR glasses 30-3. However, this number of pairs is merely an example, and the information processing system 1 can include any number of pairs of terminal devices 20 and AR glasses 30.
[0015] The server 10 provides various data and cloud services to the terminal device 20 via the communication network NET.
[0016] The terminal device 20 displays virtual objects arranged in a virtual space on the AR glasses 30 worn on the user's head. The virtual space is, for example, a celestial sphere. Examples of the virtual objects include virtual objects representing data such as still images, videos, 3DCG models, HTML files, and text files, as well as virtual objects representing applications. Examples of text files include memos, source code, diaries, and recipes. Examples of applications include browsers, applications for using SNS, and applications for generating document files. The terminal device 20 is preferably, for example, a mobile terminal device such as a smartphone or a tablet.
[0017] The AR glasses 30 are a see-through wearable display worn on the user's head. The AR glasses 30 display virtual objects on display panels provided in each of the lenses for both eyes under the control of the terminal device 20. The AR glasses 30 are an example of a display device.
[0018] 1-1-2: AR Glasses Configuration Fig. 2 is a perspective view showing the appearance of the AR glasses 30. As shown in Fig. 2, the appearance of the AR glasses 30 is similar to that of ordinary eyeglasses, and includes temples 91 and 92, a bridge 93, body parts 94 and 95, and lenses 41L and 41R. An imaging device 36 is provided on the bridge 93. The imaging device 36 captures an image of the outside world. The imaging device 36 also outputs imaging information indicating the captured image.
[0019] Each of the lenses 41L and 41R is provided with a half mirror. The body 94 is provided with a liquid crystal panel or organic EL panel for the left eye and an optical member that guides light emitted from the display panel for the left eye to the lens 41L. The liquid crystal panel or organic EL panel will hereinafter be collectively referred to as the display panel. The half mirror provided on the lens 41L transmits external light to guide it to the left eye and reflects light guided by the optical member to make it incident on the left eye. The body 95 is provided with a display panel for the right eye and an optical member that guides light emitted from the display panel for the right eye to the lens 41R. The half mirror provided on the lens 41R transmits external light to guide it to the right eye and reflects light guided by the optical member to make it incident on the right eye.
[0020] The display 24, which will be described later, includes a lens 41L, a display panel for the left eye, and an optical member for the left eye, as well as a lens 41R, a display panel for the right eye, and an optical member for the right eye.
[0021] In the above configuration, the user can observe the image displayed on the display panel in a see-through state in which the image is superimposed on the outside world. Furthermore, in the AR glasses 30, of the binocular images with parallax, the image for the left eye is displayed on the left eye display panel and the image for the right eye is displayed on the right eye display panel, so that the user U1 can perceive the displayed image as if it has depth and a three-dimensional effect.
[0022] 3 to 5 are schematic diagrams of a virtual space VS provided to a user U1 using the AR glasses 30. As shown in FIG. 3, virtual objects VO1 to VO5 representing various types of content, such as a browser, cloud services, images, and videos, are arranged in the virtual space VS. By moving through a public space while wearing the AR glasses 30 displaying the virtual objects VO1 to VO5 arranged in the virtual space VS, the user U1 can experience the virtual space VS as a private space in the public space. Consequently, the user U1 can act in the public space while receiving the benefits provided by the virtual objects VO1 to VO5 arranged in the virtual space VS.
[0023] 4, it is also possible for multiple users U1 to U3 to share a virtual space VS. By sharing the virtual space VS among multiple users U1 to U3, the multiple users U1 to U3 can share one or more virtual objects VO, and can communicate with each other via the shared virtual objects VO.
[0024] Furthermore, as shown in FIG. 5 , particularly in this embodiment, a map showing a predetermined area and information about facilities within the predetermined area are displayed within the virtual space VS. Specifically, a virtual object VO6 is displayed as a map showing the predetermined area within the virtual space VS. The map shown by the virtual object VO6 has a center point C at the position of the user U1. For example, indication points P1 and P2 indicating the locations of the facilities are displayed on the map. Also, a virtual object VO7 showing information about the facility located at indication point P1 and a virtual object VO8 showing information about the facility located at indication point P2 are displayed in association with the indication points P1 and P2 on the map, respectively. The information displayed by the virtual objects VO7 and VO8 includes an image of the facility and text describing the facility. The text includes the distance from the center point C to the location of each facility. Note that in the example shown in FIG. 5 , the number of facilities and the number of indication points P corresponding to each facility are two: indication point P1 and indication point P2. However, the number of indication points P being two is merely an example. The map shown by the virtual object VO6 may show any number of facilities and indication points P corresponding to each facility.
[0025] 6 is a block diagram showing an example configuration of the AR glasses 30. The AR glasses 30 include a processing device 31, a storage device 32, a gaze detection device 33, a GPS device 34, a motion detection device 35, an imaging device 36, a communication device 37, and a display 38. The elements of the AR glasses 30 are connected to each other by one or more buses for communicating information.
[0026] The processing device 31 is a processor that controls the entire AR glasses 30. The processing device 31 is configured using, for example, one or more chips. The processing device 31 is also configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, a register, and the like. Note that some or all of the functions of the processing device 31 may be realized by hardware such as a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). The processing device 31 executes various processes in parallel or sequentially.
[0027] The storage device 32 is a recording medium that can be read from and written to by the processing device 31. The storage device 32 also stores a plurality of programs including a control program PR1 that the processing device 31 executes.
[0028] The gaze detection device 33 detects the gaze of the user U1. Based on the detection result, the gaze detection device 33 outputs gaze information indicating the direction of the gaze of the user U1 to the processing device 31, which will be described later. Any method may be used for detecting the gaze by the gaze detection device 33. For example, the gaze detection device 33 may detect the gaze information based on the position of the inner corner of the eye and the position of the iris.
[0029] The GPS device 34 receives radio waves from multiple satellites. The GPS device 34 also generates location information from the received radio waves. The location information indicates the location of the AR glasses 30. The location information may be in any format as long as it can identify the location. The location information indicates, for example, the latitude and longitude of the AR glasses 30. As an example, the location information is obtained from the GPS device 34. However, the AR glasses 30 may obtain the location information by any method. The obtained location information is output to the processing device 31.
[0030] The motion detection device 35 detects the motion of the AR glasses 30. The motion detection device 35 also outputs motion information related to the motion of the AR glasses 30 to the processing device 31. The motion detection device 35 includes inertial sensors such as an acceleration sensor that detects acceleration and a gyro sensor that detects angular acceleration. The acceleration sensor detects acceleration on orthogonal X-, Y-, and Z-axes. The gyro sensor detects angular acceleration around the X-, Y-, and Z-axes as central axes of rotation. The motion detection device 35 can generate attitude information indicating the attitude of the AR glasses 30 based on the output information of the gyro sensor. The motion information includes acceleration data indicating the acceleration on each of the three axes and angular acceleration data indicating the angular acceleration on each of the three axes.
[0031] The imaging device 36 captures the external world and outputs imaging information obtained. The imaging device 36 also includes, for example, a lens, an imaging element, an amplifier, and an AD converter. Light collected through the lens is converted into an analog imaging signal by the imaging element. The amplifier amplifies the imaging signal and supplies it to the AD converter. The AD converter converts the amplified analog imaging signal into imaging information, which is a digital signal. The converted imaging information is supplied to the processing device 31. The imaging information supplied to the processing device 31 is transmitted to the terminal device 20 via the communication device 37. The terminal device 20 recognizes various gestures of the user U1 based on the imaging information. The terminal device 20 controls the terminal device 20 in accordance with the recognized gestures. That is, the imaging device 36 functions as an input device for inputting instructions from the user U1, like a pointing device or touch panel.
[0032] The communication device 37 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 37 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 37 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 37 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.
[0033] The display 38 is a device that displays images. The display 38 displays various images under the control of the processing device 31. As described above, the display 38 includes the lens 41L, a display panel for the left eye, and an optical member for the left eye, as well as the lens 41R, a display panel for the right eye, and an optical member for the right eye. As the display panel, various display panels such as a liquid crystal display panel and an organic EL display panel are suitably used.
[0034] The processing device 31 functions as an acquisition unit 311 and a display control unit 312, for example, by reading out a control program PR1 from the storage device 32 and executing it.
[0035] The acquisition unit 311 acquires image information indicating an image to be displayed on the AR glasses 30 from the terminal device 20. More specifically, the acquisition unit 311 acquires, for example, image information transferred by a display control unit 214 (described later) included in the terminal device 20.
[0036] The acquisition unit 311 also acquires gaze information input from the gaze detection device 33, position information input from the GPS device 34, movement information input from the movement detection device 35, and imaging information input from the imaging device 36. Then, the acquisition unit 311 supplies the acquired gaze information, position information, movement information, and imaging information to the communication device 37.
[0037] The display control unit 312 causes the display 38 to display an image indicated by the image information, based on the image information from the terminal device 20 acquired by the acquisition unit 311.
[0038] 1-1-3: Terminal device configuration 7 is a block diagram showing an example configuration of a terminal device 20. The terminal device 20 includes a processing device 21, a storage device 22, a communication device 23, a display 24, an input device 25, and an inertial sensor 26. The elements of the terminal device 20 are connected to each other by one or more buses for communicating information. Note that the term "device" in this specification may be interpreted as other terms such as circuit, device, or unit.
[0039] The processing device 21 is a processor that controls the entire terminal device 20. The processing device 21 is configured, for example, using one or more chips. The processing device 21 is configured, for example, using a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 21 may be realized by hardware such as a DSP, an ASIC, a PLD, or an FPGA. The processing device 21 executes various processes in parallel or sequentially.
[0040] The storage device 22 is a recording medium that can be read from and written to by the processing device 21. The storage device 22 also stores a plurality of programs including a control program PR2 that the processing device 21 executes.
[0041] The communication device 23 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 23 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 23 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 23 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.
[0042] The display 24 is a device that displays images and text information. The display 24 displays various images under the control of the processing device 21. For example, various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel are suitably used as the display 24.
[0043] The input device 25 receives operations from a user U1 wearing the AR glasses 30 on their head. For example, the input device 25 includes a keyboard, a touchpad, a touch panel, or a pointing device such as a mouse. Here, if the input device 25 includes a touch panel, it may also serve as the display 24.
[0044] The inertial sensor 26 is a sensor that detects inertial force. The inertial sensor 26 includes, for example, one or more of an acceleration sensor, an angular velocity sensor, and a gyro sensor. The processing device 21 detects the attitude of the terminal device 20 based on the output information of the inertial sensor 26. Furthermore, the processing device 21 accepts the selection of a virtual object VO, the input of text, and the input of instructions in the spherical virtual space VS based on the attitude of the terminal device 20. For example, the user U1 operates the input device 25 while pointing the central axis of the terminal device 20 toward a predetermined area in the virtual space VS, thereby selecting a virtual object VO to be placed in the predetermined area. The operation by the user U1 on the input device 25 is, for example, a double tap. By operating the terminal device 20 in this way, the user U1 can select a virtual object VO without looking at the input device 25 of the terminal device 20.
[0045] The processing device 21 functions as an acquisition unit 211, an action recognition unit 212, an identification unit 213, and a display control unit 214 by reading and executing the control program PR2 from the storage device 22.
[0046] The acquisition unit 211 acquires instruction information corresponding to the movement of the user U1 wearing the AR glasses 30 on the head. Here, the movement of the user U1 is, for example, an input by the user U1 to the terminal device 20 using the input device 25. More specifically, the movement of the user U1 may be pressing a specific part of the terminal device 20 that serves as the input device 25. Alternatively, the movement of the user U1 may be an operation using the terminal device 20 as a portable controller. In these cases, the instruction information is information that specifies a specific virtual object VO.
[0047] Alternatively, the action of the user U1 may be the user U1 looking at the AR glasses 30. When the action of the user U1 is the user U1 looking at the AR glasses 30, the instruction information is the viewpoint of the user U1 on the AR glasses 30. In this case, the instruction information is transmitted from the AR glasses 30 to the terminal device 20.
[0048] Alternatively, the action of the user U1 may be a gesture of the user U1. As will be described later, the action recognition unit 212 recognizes various gestures of the user U1. The acquisition unit 211 may acquire instruction information corresponding to the various gestures of the user U1.
[0049] Furthermore, the acquisition unit 211 acquires line of sight information, position information, movement information, and imaging information from the AR glasses 30 via the communication device 23.
[0050] Furthermore, the acquisition unit 211 acquires image information from the server 10 via the communication device 23. The acquired image information is supplied to the display control unit 214.
[0051] The action recognition unit 212 recognizes various gestures of the user U1 based on the imaging information obtained from the AR glasses 30. More specifically, as described above, the imaging device 36 provided in the AR glasses 30 outputs imaging information obtained by capturing an image of the outside world. If the imaging information includes a part of the body of the user U1 wearing the AR glasses 30 on their head, the action recognition unit 212 recognizes various gestures of the user U1 based on the imaging information obtained from the AR glasses 30.
[0052] The identifying unit 213 identifies one virtual object VO from among the multiple virtual objects VO arranged in the virtual space VS, based on the instruction information acquired by the acquiring unit 211.
[0053] The display control unit 214 transfers the image information acquired from the acquisition unit 211 to the AR glasses 30 as a display device.
[0054] 7, the terminal device 20 may include a GPS device similar to the GPS device 34 included in the AR glasses 30. In this case, the AR glasses 30 do not need to include the GPS device 34.
[0055] 1-1-4: Server configuration 8 is a block diagram showing an example of the configuration of the server 10. The server 10 includes a processing device 11, a storage device 12, a communication device 13, a display 14, and an input device 15. The elements of the server 10 are connected to each other by one or more buses for communicating information.
[0056] The processing device 11 is a processor that controls the entire server 10. The processing device 11 is configured, for example, using one or more chips. The processing device 11 is configured, for example, using a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, a register, etc. Some or all of the functions of the processing device 11 may be realized by hardware such as a DSP, an ASIC, a PLD, or an FPGA. The processing device 11 executes various processes in parallel or sequentially.
[0057] The storage device 12 is a recording medium that can be read from and written to by the processing device 11. The storage device 12 also stores a plurality of programs including a control program PR3 executed by the processing device 11, map information IF1, and facility information IF2.
[0058] Map information IF1 is information about a map of an area within which user U1 can move. A virtual object VO6 serving as a map illustrated in Fig. 5 is generated based on the map information IF1. Facility information IF2 is information related to facilities included in the map illustrated by the map information IF1. Virtual objects VO7 and VO8 serving as information about facilities illustrated in Fig. 5 are generated based on the facility information IF2.
[0059] The communication device 13 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 13 is also called, for example, a network device, a network controller, a network card, or a communication module. The communication device 13 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 13 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.
[0060] The display 14 is a device that displays images and text information. The display 14 displays various images under the control of the processing device 11. For example, various display panels such as a liquid crystal display panel and an organic EL display panel are suitably used as the display 14.
[0061] The input device 15 is a device that accepts operations by an administrator of the information processing system 1. For example, the input device 15 includes a keyboard, a touchpad, a touch panel, or a pointing device such as a mouse. Here, if the input device 15 includes a touch panel, it may also serve as the display 14. In particular, the administrator of the information processing system 1 can use the input device 15 to input and edit the map information IF1 and facility information IF2.
[0062] The processing device 11 functions as an acquisition unit 111, a calculation unit 112, and a display control unit 113, for example, by reading out a control program PR3 from the storage device 12 and executing it.
[0063] The acquisition unit 111 acquires various data from the terminal device 20 via the communication device 13. The data includes, for example, data indicating the operation content for the virtual object VO, which is input to the terminal device 20 by a user U1 wearing the AR glasses 30 on his / her head.
[0064] Furthermore, the acquisition unit 111 acquires location information indicating the location of the user U1. Specifically, the acquisition unit 111 acquires location information generated by the GPS device 34 included in the AR glasses 30 from the terminal device 20 via the communication device 13. This location information indicates the location of the user. The AR glasses 30 and the terminal device 20 are carried by the user. Therefore, if the terminal device 20 includes a GPS device, the acquisition unit 111 may acquire location information generated by the GPS device included in the terminal device 20 instead of the location information generated by the GPS device 34 included in the AR glasses 30.
[0065] The calculation unit 112 calculates the moving speed and moving direction of user U1 based on the change in position indicated by the position information acquired by the acquisition unit 111. Specifically, the calculation unit 112 calculates the moving distance of user U1 from the first time point to the second time point from the difference between the position information of user U1 at the first time point and the position information of user U2 at the second time point. The calculation unit 112 also calculates the moving speed of user U1 by dividing the calculated moving distance by the time from the first time point to the second time point. Furthermore, based on the difference, the calculation unit 112 calculates the moving direction of user U1, which is the direction of the position indicated by the position information of user U1 at the second time point as viewed from the position indicated by the position information of user U1 at the first time point.
[0066] The display control unit 113 generates image information indicating an image to be displayed on the AR glasses 30. This image information is transmitted to the terminal device 20 via the communication device 13. The terminal device 20 transfers the image information received via the communication device 23 to the AR glasses 30. In this way, the display control unit 113 causes the AR glasses 30 to display an image. This image includes information about facilities within a predetermined area. Facilities include, for example, stores, parks, art museums, movie theaters, and landmarks. The information about the facilities includes the names of the facilities, the services provided at the facilities, and the fees for using the facilities. The information about the facilities is part of the facility information IF2 stored in the storage device 12.
[0067] More specifically, the display control unit 113 references map information IF1 stored in the storage device 12 to generate image information including a virtual object VO6 as a map of a predetermined area with the position of the user U1 as a center point C, as illustrated in Fig. 5. Furthermore, the display control unit 113 references facility information IF2 stored in the storage device 12 to generate image information including a virtual object VO7 and a virtual object VO8 as information related to facilities in the display target area, as illustrated in Fig. 5. When this image information is received by the AR glasses 30 via the terminal device 20, the virtual object VO6, the virtual object VO7, and the virtual object VO8 are displayed on the AR glasses 30.
[0068] The display control unit 113 may also change the display target area according to the moving speed of the user U1. For example, modes for changing the display target area include Mode 1 to Mode 4 shown below. Figures 9 to 12 are explanatory diagrams of operation examples of the display control unit 113, which correspond to Mode 1 to Mode 4, respectively.
[0069] 1-1-4-1: Mode 1 9, the display control unit 113 may increase the area S of the display target area according to the moving speed of the user U1. In the following description, when the display target area is described in general terms, it is referred to as a display target area A, and when the display target area A needs to be distinguished under some conditions, it is described by adding a subscript such as display target area A0, A1, or A3.
[0070] 9, the display target area A is a circle centered on the current position of the user U1. Therefore, the center point C of the display target area A coincides with the current position of the user U1, regardless of the movement speed V of the user U1. The display control unit 113 calculates the radius R of the display target area A according to the movement speed V of the user U1 using the following equation 1. R=R0+β×V (1) Here, R0 is the radius of the circle when the moving speed V is zero. β is a constant. Also, the moving speed V is a scalar.
[0071] The display control unit 113 specifies the display target area A based on the position information of the user U1 and the radius R calculated using Equation 1. The display control unit 113 generates image information based on the specified display target area A.
[0072] Specifically, when user U1 is stationary, i.e., when the moving speed V is zero, the display target area A0 is a circle with a center point C1 at the current position of user U1 and a radius of R0. Also, when the moving speed V is V1, the display target area A1 is a circle with a center point C1 at the current position of user U1 and a radius of R1, where R1 = R0 + β × V1.
[0073] As a result, the area of the display target area A1 is S1 = π × R1 2 The area of the display target area A0 is S0 = π × R0 2 Furthermore, the display target area A0 includes the designated point P1 and the designated point P2 shown in FIG. 5, but the display target area A1 also includes a designated point P3.
[0074] That is, when the movement speed V of the user U1 is a first speed V1, the display control unit 113 sets the above-mentioned display target area A to a first area S1, and when the movement speed V of the user U1 is a second speed V2 that is greater than the first speed V1, the display control unit 113 sets the above-mentioned display target area A to a second area S2 that is larger than the first area S1.
[0075] Note that, as described above, in the example shown in FIG. 9, when the user U1 is in a stopped state, the shape of the display target area A0 is a circle with a radius R0 centered on the current position of the user U1, which is the center point C1. Also, the shape of the changed display target area A1 is a circle with a radius R1 centered on the current position of the user U1, which is the center point C1. Since the shapes of the display target area A0 and the display target area A1 are circular, the user U1 can obtain information about the facility evenly with respect to the moving direction from the current position. Also, the larger the moving speed V of the user U1, the larger the area S1 of the display target area A1. This is because as the moving speed V of the user U1 increases, the amount of movement of the user U1 per unit time increases, and the facilities required by the user U1 increase.
[0076] 1-1-4-2: Mode 2 As shown in FIG. 10, the display control unit 113 may shift the center point of the display target area A in the moving direction of the user U1.
[0077] In the example shown in FIG. 10, the display target area is a circle centered on the current position of the user U1. Specifically, when the user U1 is in a stopped state, that is, when the moving speed V is zero, the display target area A2 has the current position of the user U1 as the center point C2 and a radius of R0. The display control unit 113 shifts the center point of the display target area A according to the moving speed V of the user U1 from the center point when the moving speed V is zero.
[0078] Here, let the center point when the moving speed V is zero be the center point C2, the center point when the moving speed V is v be the center point C3, and the distance from the center point C2 to the center point C3 be L. The distance L is calculated by the following equations (2) and (3). L = R0 (when v ≥ vk) (2) L = v × α (when 0 < v < vk) (3) Here, vk is a constant. Also, α = R0 / vk. Further, it is assumed that the moving speed v is a scalar quantity.
[0079] As a result, the display target area A2 includes the designated points P4 and P5, but the display target area A3 when the moving speed V is v includes the designated points P5 and P6.
[0080] That is, the faster the moving speed V of user U1, the longer the distance from the current position of user U1 indicated by the position information to the center of display target area A located in the moving direction. Specifically, when the moving speed V of user U1 is a first speed V1, the display control unit 113 determines the distance from the position indicated by the position information to the center of display target area A located in the moving direction as a first distance L1, and when the moving speed V of user U1 is a second speed V2 faster than the first speed V1, the display control unit 113 determines the distance as a second distance L2 longer than the first distance L1.
[0081] 10, the display control unit 113 shifts the center point of the display target area A from center point C2, which is the current position of user U1, to center point C3, which is in the moving direction of user U1. Furthermore, the distance L between center point C2 and center point C3 is determined according to the moving speed V of user U1. This is because the display control unit 113 currently displays information about facilities that user U1 will need in the future according to the moving speed V and moving direction of user U1.
[0082] 1-1-4-3: Mode 3 As shown in FIG. 11, the display control unit 113 may increase the area S of the display target area A according to the movement speed V of the user U1, as in aspect 1, and may also shift the center point of the display target area A from the center point when the movement speed V is zero, as in aspect 2.
[0083] 11, the display target area A is a circle centered on the current position of user U1. Specifically, when user U1 is stationary, that is, when the moving speed V is zero, the display target area A4 is a circle centered on the current position of user U1 and has a radius of R0. Furthermore, when the moving speed is V1, the display target area A5 is a circle with a radius of R1.
[0084] Furthermore, the display control unit 113 shifts the center point of the display target area A from the center point when the moving speed V is zero, according to the moving speed V of the user U1. Here, the center point when the moving speed V is zero is defined as center point C4, the center point when the moving speed V is V1 is defined as center point C5, and the distance from center point C4 to center point C5 is defined as L. The distance L is calculated using the following equation 4. L=R1―n (4) Here, 0≦n≦R1. For example, n=50 m and R1=500 m. This n is the distance from the center point C4 of the display target area A4 to the outer edge of the display target area A5 in the direction opposite to the movement direction of the user U1. Note that when n=0, the current position of the user U1 is located at the outer edge of the display target area A5.
[0085] That is, even after the display control unit 113 changes the display target area A4 to the display target area A5, the current location of the user U1 is included in the display target area A5. This is because the display control unit 113 also displays a predetermined amount of information about facilities in the vicinity of the user U1 at the current time.
[0086] As a result, the display target area A4 includes the designated points P7 and P8, while the display target area A5 includes the designated points P8 and P9.
[0087] Alternatively, the distance L may be calculated by the following equation 5. L=R1×m (5) Here, m is a constant greater than 0.5. For example, m=0.9. If m is 0.5 or less, the display target area A5 will encompass the display target area A4. Therefore, m must be greater than 0.5.
[0088] As described above, in the example shown in FIG. 11, the area S5 of the display target region A5 increases as the moving speed V of the user U1 increases. This is because, as the moving speed V of the user U1 increases, the moving distance of the user U1 per unit time increases, and the amount of information about facilities that the user U1 will need increases. The display control unit 113 also shifts the center point of the display target region A from a center point C4, which is the current position of the user U1, to a center point C5 in the moving direction of the user U1. The distance L between the center point C4 and the center point C5 is determined according to the moving speed V of the user U1. This is because the display control unit 113 aims to currently display information about facilities that the user U1 will need in the future according to the moving speed V and moving direction of the user U1.
[0089] 1-1-4-4: Aspect 4 As shown in FIG. 12, the display control unit 113 may change the shape of the display target area A according to the moving speed V and moving direction of the user U1.
[0090] In the example shown in FIG. 12, the display target area A before the change is a circle centered on the current position of user U1. Specifically, when user U1 is stationary, that is, when the moving speed V is zero, the display target area A6 is a circle with the current position of user U1 as its center point C6 and a radius of R0. The display target area A after the change is an ellipse with the moving direction of user U1 as its major axis. That is, when the moving speed is V1, the display target area A7 is an ellipse with the moving direction of user U1 as its major axis, with the major axis radius R2 and the minor axis radius R3. However, R2>R0. Furthermore, R3≦R0.
[0091] Furthermore, the major axis radius R2 of the display target region A7 increases as the moving speed V of the user U1 increases. In addition, the minor axis radius R3 of the display target region A7 may decrease as the moving speed V of the user U1 increases. In other words, the display target region A7 becomes an ellipse that is longer in the moving direction of the user U1 as the moving speed V increases. Furthermore, the area of the display target region A7 may increase as the moving speed V of the user U1 increases.
[0092] As a result, the display target area A6 includes the designated points P11 and P12, but the display target area A7 includes the designated points P11 and P13.
[0093] 12, the display target area A7 is an ellipse with a center point C6 at the current position of the user U1. However, the position of the display target area A7 is not limited to an ellipse with a center point C6 at the current position of the user U1. For example, the display target area A6 may be an ellipse with a focus at the current position of the user U1. As an example, the display target area A7 may be located at a position shifted in the direction of movement of the user U1 compared to the display target area A6.
[0094] As described above, in the example shown in FIG. 12, the shape of the display target area changes depending on the movement speed V and movement direction of user U1. This is because the location of facilities necessary for user U1 changes depending on the direction of movement of user U1. For example, as described above, the display control unit 113 sets the display target area A7 to an ellipse that is longer in the movement direction of user U1 depending on the movement speed V and movement direction of user U1. By setting the display target area A7 to an ellipse, the display control unit 113 can provide user U1 with more information about facilities in the direction in which user U1 is likely to move.
[0095] 1-2: Operation of the first embodiment 13 is a flowchart showing the operation of the server 10 according to the first embodiment. The operation of the server 10 will be described below with reference to FIG.
[0096] In step S11, the processing device 11 functions as the acquisition unit 111 to acquire location information indicating the location of the user U1.
[0097] In step S12, the processing device 11 functions as the calculation unit 112 to calculate the moving speed of the user U1 based on the change in position indicated by the position information acquired in step S11.
[0098] In step S13, the processing device 11 functions as the calculation unit 112 to calculate the moving direction of the user U1 based on the change in position indicated by the position information acquired in step S11.
[0099] In step S14, the processing device 11 sets the area of the display target area by functioning as the display control unit 113. As an example, the processing device 11 sets the area of the display target area by functioning as the display control unit 113 so that the area of the display target area increases as the moving speed of the user U1 increases.
[0100] In step S15, the processing device 11 sets the center position of the display target area by functioning as the display control unit 113. As an example, the processing device 11 sets the center position of the display target area by functioning as the display control unit 113 so that the faster the moving speed of the user U1, the longer the distance from the position indicated by the position information to the center position of the display target area located in the moving direction of the user U1.
[0101] In step S16, the processing device 11 functions as the display control unit 113 to cause the AR glasses 30, which serve as a display device, to display information about the facilities in the display target area.
[0102] 1-3: Effects of the First Embodiment According to the above description, the server 10 includes an acquisition unit 111, a calculation unit 112, and a display control unit 113. The acquisition unit 111 acquires position information indicating the position of the user U1. The calculation unit 112 calculates the moving speed of the user U1 based on a change in the position indicated by the position information. The display control unit 113 displays information about facilities in a display target area including the position indicated by the position information on the AR glasses 30 as a display device. Furthermore, when the moving speed is a first speed V1, the display control unit 113 sets the display target area to a first area S1, and when the moving speed is a second speed V2 that is faster than the first speed V1, the display control unit 113 sets the display target area to a second area S2 that is larger than the first area S1.
[0103] By using the above configuration, when displaying information about facilities within a display target area including the position of user U1 on the AR glasses 30 as a display device, the server 10 can change the display target area according to the movement speed of user U1. Specifically, the server 10 calculates the movement speed of user U1 based on position information indicating the position of user U1. Furthermore, the server 10 can change the area of the display target area including the position of user U1 according to the calculated movement speed, and then display information about facilities within the display target area on the AR glasses 30 worn on the head of user U1.
[0104] According to the above description, the calculation unit 112 calculates the moving speed and moving direction of the user U1 based on the change in the position indicated by the position information. When the moving speed is a first speed V1, the display control unit 113 determines that the distance L from the position indicated by the position information to the center of the display target area located in the moving direction is a first distance L1, and when the moving speed is a second speed V2 faster than the first speed V1, the display control unit 113 determines that the distance L is a second distance L2 longer than the first distance L1.
[0105] By using the above configuration, when displaying information about facilities within a display target area including the position of user U1 on the AR glasses 30 as a display device, the server 10 can change the display target area according to the movement speed of user U1. Specifically, the server 10 calculates the movement speed and movement direction of user U1 based on position information indicating the position of user U1. Furthermore, the server 10 can change the distance from the position of user U1 to the center of the display target area according to the calculated movement speed and movement direction, and then display information about facilities within the display target area on the AR glasses 30 worn on the head of user U1.
[0106] Furthermore, according to the above description, the display control unit 113 changes the shape of the display target area in accordance with the moving speed and moving direction of the user U1.
[0107] By using the above configuration, the server 10 can change the information about facilities provided to the user U1 depending on the direction of travel of the user U1.
[0108] 2: Second embodiment Hereinafter, the configuration of an information processing system 1A including a server 10A according to a second embodiment of the present invention will be described with reference to Figures 14 and 15. In the following description, for the sake of simplicity, the same reference numerals will be used for the same components as in the first embodiment, and a description of their functions may be omitted. In addition, in the following description, for the sake of simplicity, differences between the second embodiment and the first embodiment will be mainly described.
[0109] 2-1: Configuration of the second embodiment 2-1-1: Overall structure The information processing system 1 according to the second embodiment is the same as the information processing system 1 according to the first embodiment, except that the information processing system 1 according to the second embodiment includes a server 10A instead of the server 10.
[0110] 2-1-2: Terminal device configuration 14 is a block diagram showing an example of the configuration of the server 10A. The server 10A differs from the server 10 according to the first embodiment in that it includes a processing device 11A instead of the processing device 11 and a storage device 12A instead of the storage device 12.
[0111] The storage device 12A differs from the storage device 12 according to the first embodiment in that it stores a control program PR3A instead of the control program PR3 stored in the storage device 12, and in that it further stores path information IF3.
[0112] Route information IF3 is information related to roads, including railroads and expressways, included in map information IF1. More specifically, route information IF3 includes location information for the railroads and roads. This location information indicates the latitude and longitude of each point that makes up the railroads and roads. Route information IF3 also includes location information for stations located on the railroads and interchanges that serve as branching points on expressways. This location information indicates the latitude and longitude of the stations and interchanges.
[0113] The processing device 11A reads and executes the control program PR3A from the storage device 12A, thereby functioning as an acquisition unit 111, a calculation unit 112A, a display control unit 113A, and an estimation unit 114. Note that the acquisition unit 111 is the same as the acquisition unit 111 as a function possessed by the processing device 11 according to the first embodiment, and therefore a description thereof will be omitted.
[0114] The calculation unit 112A has the same functions as the calculation unit 112 according to the first embodiment. The calculation unit 112A further identifies a movement route of the user U1 based on a change in position indicated by the position information acquired by the acquisition unit 111. More specifically, the calculation unit 112A identifies a position history of the user U1 based on a change in position indicated by the position information of the user U1. The movement route indicates a position history of the user U1.
[0115] The estimation unit 114 estimates the user U1's means of transportation based on the user U1's travel speed and travel route. More specifically, the estimation unit 114 determines the type of road on which the user U1 is traveling by comparing the travel route with the route information IF3. Road types include railways, expressways, and general roads. The estimation unit 114 also estimates the user U1's means of transportation based on the road type and travel speed. Specifically, when the road type is a general road, the estimation unit 114 estimates that the means of transportation is walking, jogging, cycling, or a car, depending on the travel speed. When the road type is a highway and the travel speed is equal to or greater than a predetermined speed, the estimation unit 114 estimates that the means of transportation is a car. When the road type is a railway and the travel speed is equal to or greater than a predetermined speed, the estimation unit 114 estimates that the means of transportation is a train.
[0116] The display control unit 113A has the same functions as the display control unit 113 according to the first embodiment. Furthermore, when the travel mode estimated by the estimation unit 114 is a train traveling on a railroad or a vehicle traveling on a highway, the display control unit 113A determines the display target area as an area within a predetermined distance centered on the nearest station or interchange serving as a junction in the user U1's travel direction. Specifically, when the travel mode estimated by the estimation unit 114 is a train traveling on a railroad or a vehicle traveling on a highway, the display control unit 113A determines the user U1's current location on the route included in the route information IF3 by referring to the route information IF3 stored in the storage device 12A. Furthermore, the display control unit 113A determines the direction in which the user U1 is traveling on the route included in the route information IF3 by referring to the route information IF3 stored in the storage device 12A. Furthermore, the display control unit 113 determines the next station or interchange serving as a junction, i.e., the nearest station or interchange serving as a junction on the route in the user U1's travel direction. Finally, the display control unit 113A sets the range within a predetermined distance centered on the nearest station or interchange serving as the branch point as the display target area.
[0117] In addition, the display control unit 113A operates in the same manner as the display control unit 113 according to the first embodiment, except when the means of transportation estimated by the estimation unit 114 is a train running on a railroad or a vehicle running on a highway.
[0118] 2-2: Operation of the second embodiment 15 is a flowchart showing the operation of the server 10A according to the second embodiment. The operation of the server 10A will be described below with reference to FIG.
[0119] In step S21, the processing device 11A functions as the acquisition unit 111 to acquire location information indicating the location of the user U1.
[0120] In step S22, the processing device 11A functions as the calculation unit 112A to calculate the moving speed of the user U1 based on the change in position indicated by the position information acquired in step S21.
[0121] In step S23, the processing device 11A functions as the calculation unit 112A to calculate the moving direction of the user U1 based on the change in position indicated by the position information acquired in step S21.
[0122] In step S24, the processing device 11A functions as the calculation unit 112A to calculate the movement route of the user U1 based on the change in position indicated by the position information acquired in step S21.
[0123] In step S25, the processing device 11A functions as the estimation unit 114 to estimate the means of transportation of the user U1 based on the travel speed and travel route of the user U1. If the estimation result is the first means of transportation, that is, a train traveling on railroad tracks or a vehicle traveling on a highway, the processing device 11 performs the operation of step S26. On the other hand, if the estimation result is the second means of transportation, that is, a means other than a train traveling on railroad tracks or a vehicle traveling on a highway, the processing device 11 performs the operation of step S29.
[0124] In step S26, the processing device 11A functions as the display control unit 113A to determine the current location of the user U1 on the route.
[0125] In step S27, the processing device 11A functions as the display control unit 113A to determine in which direction the user U1 is moving on the route. Furthermore, the processing device 11A functions as the display control unit 113A to determine the next station or interchange as a branch point, that is, the nearest station or interchange as a branch point on the route in the moving direction of the user U1.
[0126] In step S28, the processing device 11A functions as the display control unit 113A to display information about facilities around the next station or interchange serving as a branch point on the AR glasses 30 serving as a display device. More specifically, the processing device 11A functions as the display control unit 113A to set an area within a predetermined distance centered on the nearest station or interchange serving as a branch point determined in step S27 as a display target area. Then, the processing device 11A functions as the display control unit 113A to display information about facilities within the display target area on the AR glasses 30 serving as a display device.
[0127] In step S29, the processing device 11A functions as the display control unit 113A to set the area of the display target area. As an example, the processing device 11A functions as the display control unit 113A to set the area of the display target area so that the area of the display target area increases as the moving speed increases.
[0128] In step S30, the processing device 11A functions as the display control unit 113A to set the center position of the display target area. As an example, the processing device 11A functions as the display control unit 113A to set the center position of the display target area so that the faster the moving speed, the longer the distance from the position indicated by the position information to the center position of the display target area located in the moving direction of the user U1.
[0129] In step S31, the processing device 11A functions as the display control unit 113A to cause the AR glasses 30, which serve as a display device, to display information about facilities within the display target area.
[0130] 2-3: Effects of the second embodiment According to the above description, the server 10A includes an acquisition unit 111, a calculation unit 112, an estimation unit 114, and a display control unit 113A. The acquisition unit 111 acquires location information indicating the location of the user U1. The calculation unit 112 calculates the moving speed of the user U1 based on a change in the location indicated by the location information. The estimation unit 114 estimates the means of transportation of the user U1 based on the moving speed and moving route of the user U1. The display control unit 113A displays information about facilities within the display target area on the AR glasses 30 as a display device. Furthermore, when the means of transportation estimated by the estimation unit 114 is a train traveling on a railroad, the display control unit 113A sets the above-mentioned display target area to an area within a predetermined distance centered on the nearest station in the moving direction of the user U1. In addition, when the means of transportation estimated by the estimation unit 114 is a vehicle traveling on a highway, the display control unit 113A sets the above-mentioned display target area to an area within a predetermined distance centered on the nearest branch point in the direction of movement of the user U1.
[0131] By using the above configuration, when displaying information about facilities within a display target area including the position of the user U1 on the AR glasses 30 as a display device, the server 10A can change the display target area according to the means of transportation of the user U1. Specifically, the server 10A can determine the display target area including the position of the user U1 according to the means of transportation of the user U1 estimated by the estimation unit 114, and then display information about facilities within the display target area on the AR glasses 30 worn on the head of the user U1.
[0132] 3: Variation The present disclosure is not limited to the above-described exemplary embodiments. Specific modified embodiments are exemplified below. Two or more embodiments selected arbitrarily from the following examples may be combined.
[0133] 3-1: Variation 1 In the information processing system 1 according to the first embodiment and the information processing system 1A according to the second embodiment, the terminal device 20 and the AR glasses 30 are realized as separate entities. However, the method for realizing the terminal device 20 and the AR glasses 30 in the embodiments of the present invention is not limited to this. For example, the terminal device 20 and the AR glasses 30 may be realized in a single housing by the AR glasses 30 having the same functions as the terminal device 20.
[0134] 3-2: Variation 2 In the server 10A according to the second embodiment, when the means of transportation estimated by the estimation unit 114 is a train traveling on railroad tracks or a vehicle traveling on a highway, the display control unit 113A sets the display target area to an area within a predetermined distance from the nearest station or interchange serving as a branch point in the direction of travel of the user U1. The display control unit 113A then displays information about facilities within the display target area on the AR glasses 30 serving as a display device. However, the display control unit 113A may further filter facilities within the display target area to those whose information is to be displayed on the AR glasses 30 based on predetermined conditions. For example, the display control unit 113A may narrow down the facilities within the display target area to those whose popularity among multiple users U is equal to or greater than a predetermined value, and then display information about the facilities on the AR glasses 30.
[0135] 3-3: Variation 3 The server 10 according to the first embodiment includes a calculation unit 112 and a display control unit 113. The calculation unit 112 calculates the moving speed of the user U1 based on a change in the position indicated by the position information. The display control unit 113 causes the AR glasses 30 serving as a display device to display information related to facilities within a display target area including the position indicated by the position information. Similarly, the server 10A according to the second embodiment includes a calculation unit 112A and a display control unit 113A. The calculation unit 112A calculates the moving speed, moving direction, and moving route of the user U1 based on a change in the position indicated by the position information. The display control unit 113A causes the AR glasses 30 serving as a display device to display information related to facilities within the display target area. However, calculating the moving speed of the user U1 and displaying information related to facilities within the display target area on the AR glasses 30 may be performed by a device other than the server 10 or the server 10A. For example, the terminal device 20 may include components similar to the calculation unit 112 and the display control unit 113, or the calculation unit 112A and the display control unit 113A, so that the terminal device 20 calculates the moving speed of the user U1 and displays information about facilities within the display target area on the AR glasses 30. In this case, the terminal device 20 is an example of an information processing device.
[0136] 3-4: Variation 4 In the server 10A according to the second embodiment, the estimation unit 114 determines the type of road along which the user U1 travels by comparing the travel route with the route information IF3. The estimation unit 114 also estimates the user U1's mode of transportation based on the type of road and the travel speed. However, the method of estimating the user U1's mode of transportation is not limited to the method of referencing the route information IF3. For example, the storage device 12A may store a learning model that has learned the relationship between the travel speed, travel route, and mode of transportation. In this case, the estimation unit 114 uses the learning model to estimate the user U1's mode of transportation. That is, the learning model is a learning model for estimating the user U1's mode of transportation based on the user U1's travel speed and travel route calculated by the calculation unit 112A.
[0137] The learning model is generated by learning training data in a learning phase. The training data used to generate the learning model includes a plurality of pairs of travel speeds, travel routes, and means of transportation.
[0138] The learning model is generated outside the server 10A. In particular, it is preferable that the learning model is generated in a server (not shown). In this case, the server 10A acquires the learning model from the server via the communication network NET.
[0139] 3-5: Variation 5 The information processing system 1 according to the first embodiment and the information processing system 1A according to the second embodiment include AR glasses 30. However, the information processing system 1 and the information processing system 1A may include any one of an HMD (Head Mounted Display) employing AR technology, MR (Mixed Reality) glasses employing MR technology, and an HMD employing MR technology, instead of the AR glasses 30. Alternatively, the information processing system 1 and the information processing system 1A may include any one of a regular smartphone and a tablet equipped with an imaging device, instead of the AR glasses 30. These HMDs, MR glasses, smartphones, and tablets are examples of display devices.
[0140] 4:Other (1) In the above-described embodiment, storage device 12, storage device 12A, storage device 22, and storage device 32 are exemplified by ROM and RAM, but may be a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory device (e.g., a card, a stick, a key drive), a CD-ROM (Compact Disc-ROM), a register, a removable disk, a hard disk, a floppy (registered trademark) disk, a magnetic strip, a database, a server, or any other suitable storage medium. The program may also be transmitted from a network via a telecommunications line. The program may also be transmitted from a communications network NET via a telecommunications line.
[0141] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
[0142] (3) In the above-described embodiment, input and output information may be stored in a specific location (for example, a memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.
[0143] (4) In the above-described embodiment, the determination may be made by a value (0 or 1) represented using one bit, by a Boolean value (true or false), or by a comparison of numerical values (e.g., comparison with a predetermined value).
[0144] (5) The order of the process procedures, sequences, flowcharts, etc. illustrated in the above-described embodiments may be rearranged unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.
[0145] (6) Each function illustrated in Figures 1 to 15 is realized by any combination of at least one of hardware and software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically coupled, or may be realized by using two or more devices that are physically or logically separated and connected directly or indirectly (for example, by wire, wirelessly, etc.). A functional block may also be realized by combining software with the one device or the multiple devices.
[0146] (7) The programs exemplified in the above-described embodiments should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, hardware description language, or by other names.
[0147] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.
[0148] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.
[0149] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values from a predetermined value, or corresponding other information.
[0150] (10) In the above-described embodiments, the server 10, the server 10A, and the terminal device 20 may be mobile stations (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, a mobile unit, a subscriber unit, a wireless unit, a remote unit, a mobile device, a wireless device, a wireless communication device, a remote device, a mobile subscriber station, an access terminal, a mobile terminal, a wireless terminal, a remote terminal, a handset, a user agent, a mobile client, a client, or some other appropriate term. In this disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.
[0151] (11) In the above-described embodiments, the terms "connected," "coupled," or any variation thereof refers to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.
[0152] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."
[0153] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judgment" or "decision." In other words, "judgment" and "decision" can include regarding some action as having been "judgment" or "decision." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.
[0154] (14) In the above embodiments, when "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive or.
[0155] (15) In this disclosure, where articles are added by translation, such as a, an, and the in English, this disclosure may include that the nouns following these articles are plural.
[0156] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."
[0157] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).
[0158] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure. [Explanation of symbols]
[0159] 1, 1A... Information processing system, 10, 10A... Server, 11, 11A... Processing device, 12, 12A... Storage device, 13... Communication device, 14... Display, 15... Input device, 20... Terminal device, 21... Processing device, 22... Storage device, 23... Communication device, 24... Display, 25... Input device, 26... Inertial sensor, 30... AR glasses, 31... Processing device, 32... Storage device, 33... Gaze detection device, 34... GPS device, 35... Motion detection device, 36... Imaging device, 37... Communication device, 38... Display, 41L, 41R... Lens, 91, 92... Balance ru, 93...bridge, 94, 95...torso, 111...acquisition unit, 112, 112A...calculation unit, 113, 113A...display control unit, 114...estimation unit, 211...acquisition unit, 212...action recognition unit, 213...identification unit, 214...display control unit, 311...acquisition unit, 312...display control unit, A1, A2...display target area, C1 to C6...center point, IF1...map information, IF2...facility information, IF3...route information, P1 to P13...indication point, PR1, PR2, PR3, PR3A...control program, R0 to R3...radius, U, U1 to U3...user, VO...virtual object
Claims
[Claim 1] an acquisition unit that acquires location information indicating a user's location; a calculation unit that calculates a moving speed, a moving direction, and a moving route of the user based on a change in the position indicated by the position information; an estimation unit that estimates the user's means of transportation based on the user's travel speed and travel route; a display control unit that causes the display device to display information about facilities within the display target area; The display control unit When the means of transportation estimated by the estimation unit is a train traveling on a railroad, the display target area is set to a range within a predetermined distance centered on the nearest station in the user's direction of travel, or When the means of transportation estimated by the estimation unit is a vehicle traveling on a highway, the display target area is an area within a predetermined distance centered on the nearest branch point in the user's direction of travel. Information processing device.
Citation Information
Patent Citations
Map display device
JP2012017983A
Head-mounted display, control method thereof, computer program for controlling head-mounted display, and recording medium with computer program recorded thereon
JP2015069362A
Display control method, display control program, and information processing apparatus
JP2016184294A
Operation method of server and software of electric communication apparatus
JP2018018472A