Information processing method and information processing device

Abstract

This information processing method provides information to a user. This information processing method includes an acquisition process for acquiring a movement means of a user, and a provision process for, when it is determined that the user is present in a prescribed location, selecting and providing to the user at least one item of content from a plurality of content having been set for the prescribed location on the basis of the movement means of the user.

Description

[Technical Field]

[0001] The present invention relates to an information processing method and an information processing device for providing information to a user. [Background technology]

[0002] Conventionally, there are technologies for displaying maps and tourist spots on a terminal carried by a user. For example, JP2020-123082A discloses a technology for displaying an augmented reality screen of the current location of a user terminal when the augmented reality screen displays a guide to tourist spots on the user terminal. Summary of the Invention

[0003] Even when an augmented reality screen of the current location of a user terminal is displayed as in the conventional technology described above, it is conceivable that unnecessary information may be displayed on the user terminal depending on the user's mode of transportation. For example, if the user is traveling by car, information intended for walking may be displayed on the user terminal. In such cases, the user may feel uncomfortable. Furthermore, unnecessary information provision processing occurs, which increases the amount of calculation required by the content providing device.

[0004] The present invention aims to provide more appropriate content depending on the user's means of transportation and to improve the efficiency of the computational load related to information processing.

[0005] One aspect of the present invention is The information processing device This information processing method provides information to a user. This information processing method acquires a means of transportation for the user. Steps and when it is determined that the user is present at the predetermined location, at least one of a plurality of contents set for the predetermined location is selected based on the user's means of transportation and provided to the user. Steps Includes: Then, in the provision step, at least one of a plurality of second predetermined locations, which is a predetermined location different from the first predetermined location, where it has been determined that the user is present, is selected based on the user's means of transportation, and content related to the selected second predetermined location is provided to the user. [Brief explanation of the drawings]

[0006] [Figure 1]FIG. 1 is a diagram illustrating an example of a system configuration of an information processing system. [Figure 2] FIG. 2 is a block diagram showing an example of the functional configuration of the content providing server and the electronic device. [Figure 3] FIG. 3 is a diagram schematically showing each piece of information stored in the device information DB. [Figure 4] FIG. 4 is a diagram showing each piece of information stored in the content DB. [Figure 5] FIG. 5 is a diagram showing an example of transition of a display screen displayed on a display unit of an electronic device. [Figure 6] FIG. 6 is a simplified diagram showing transportation means that a user may use. [Figure 7] FIG. 7 is a simplified diagram showing an example of the relationship between routes to registered locations and major means of transportation. [Figure 8] FIG. 8 is a simplified diagram showing the relationship between registered locations managed by the content providing server and users' means of transportation. [Figure 9] FIG. 9 is a diagram showing an example of output of content provided to a user by a content providing server when the user's means of transportation is walking. [Figure 10] FIG. 10 is a diagram showing an example of output of content provided to a user by a content providing server when the user's means of transportation is an automobile. [Figure 11] FIG. 11 is a diagram showing an example of content output according to the user's means of transportation. [Figure 12] FIG. 12 is a diagram showing an example of a content display screen displayed on the display unit of the electronic device. [Figure 13] FIG. 13 is a diagram showing an example of a content display screen displayed on the display unit of the electronic device. [Figure 14] FIG. 14 is a flowchart showing an example of a content output process in the electronic device. [Figure 15] FIG. 15 is a flowchart showing an example of information storage processing in the content providing server. [Figure 16]FIG. 16 is a flowchart showing an example of a content providing process in the content providing server. DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0008] [Example of information processing system configuration] FIG. 1 illustrates an example of the system configuration of an information processing system 10. The information processing system 10 is a communication system that executes a process of providing various contents to users registered in a content providing server 200. It is assumed that user U1 owns an automobile C1. It is assumed that user U1 may use various modes of transportation, such as walking, train TR1, bus BU1, motorcycle M1, bicycle BC1, boat SH1, and airplane AP1. For ease of explanation, FIG. 1 illustrates an electronic device MC1 as an example of a device owned by user U1. However, this is not limited to this, and an in-vehicle device, a device carried in a vehicle, or a device wearable by user U1 may also be used. Although train TR1, bus BU1, motorcycle M1, bicycle BC1, boat SH1, and airplane AP1 are illustrated as examples of each mode of transportation, multiple modes of transportation may be used, or other modes of transportation may also be used.

[0009] The information processing system 10 is composed of multiple devices connected via a network 20. For example, a control device 50, an information output device 100, a content providing server 200, a communication device 300, and an electronic device MC1 are connected via the network 20. Note that communication between these devices is performed using wired communication or wireless communication. Furthermore, communication between these devices may be performed directly between the devices in addition to communication via the network 20. Note that communication devices may be installed in at least one of the train TR1, bus BU1, motorcycle M1, bicycle BC1, ship SH1, airplane AP1, and object RO1. In this case, the communication devices installed therein are connected to the content providing server 200, etc. via the network 20.

[0010] The control device 50 and the information output device 100 are in-vehicle devices installed in the automobile C1. The control device 50 acquires, for example, vehicle information about the automobile C1 and user information about the occupants of the automobile C1, and transmits the acquired information to the content providing server 200. For example, the vehicle information and user information are acquired using various sensors installed in the automobile C1.

[0011] The information output device 100 is a device capable of outputting content transmitted from the content providing server 200. The information output device 100 is realized by, for example, a tablet terminal, a car navigation device, or an IVI (In-Vehicle Infotainment). An example of content output is shown in FIG.

[0012] The content providing server 200 is an information presentation device that realizes a content providing service that provides user U1 with content set for a registered location. To use this content providing service, user U1 must register to use the content providing service. A registered location is a location where predetermined content is provided by the content providing server 200, and is managed by a content DB 220 (see Figures 2 and 4). Examples of registered locations include parks, theme parks, amusement parks, shopping malls, and tourist spots. Furthermore, objects and devices for detecting the presence of user U1 are installed at the registered locations. For example, an object RO1 and a communication device 300 are installed. The configuration of the content providing server 200 will be described in detail with reference to Figure 2, etc.

[0013] The communication device 300 is a device installed at a registered location managed by the content providing server 200. The communication device 300 communicates with surrounding electronic devices using wireless or wired communication, and transmits the communication results to the content providing server 200. For example, when predetermined information is exchanged between the communication device 300 and the electronic device MC1 using wireless or wired communication, the communication device 300 determines that predetermined communication has been established between the electronic device MC1 and the communication device 300, and transmits the determination result to the content providing server 200. This enables the content providing server 200 to determine that a user U1 who owns the electronic device MC1 is present in the vicinity of the registered location where the communication device 300 is installed.

[0014] The object RO1 is an object installed in a registered location managed by the content providing server 200. Furthermore, a characteristic portion FP1 is provided in at least a part of the exterior of the object RO1. For example, if the registered location is a park, the entrance gate to the park can be the object RO1. Furthermore, if the registered location is a parking lot equipped with charging facilities for electric vehicles, a charging stand can be the object RO1. Examples of this are shown in FIGS. 8 to 10.

[0015] The characteristic portion FP1 is a portion having identification information capable of identifying the registered location, the object RO1 installed at the registered location, and other objects or buildings installed around the registered location. This identification information can be identified, for example, from a captured image captured by the electronic device MC1. Examples of the identification information include a QR code (registered trademark) and a specific marker. The specific marker is a marker from which specific information, such as a registered location ID (see FIG. 4), can be acquired through object recognition processing. For example, the electronic device MC1 captures an image of the object RO1 so that the characteristic portion FP1 is included in the image capture range, thereby acquiring an image including the characteristic portion FP1. Next, the electronic device MC1 acquires identification information based on the characteristic portion FP1 included in the captured image. A known acquisition method can be used to acquire this identification information. Next, the electronic device MC1 transmits the acquired identification information to the content providing server 200. This enables the content providing server 200 to determine that the user U1 carrying the electronic device MC1 is present around the registered location where the object RO1 is installed.

[0016] The electronic device MC1 is a portable information processing device owned by the user U1, such as a smartphone, a tablet terminal, a portable personal computer, etc. The electronic device MC1 is also capable of outputting content transmitted from the content providing server 200. The configuration of the electronic device MC1 will be described in detail with reference to FIG. 2 etc.

[0017] [Configuration example of content providing server and electronic device] FIG. 2 is a block diagram showing an example of the functional configuration of the content providing server 200 and the electronic device MC1.

[0018] The content providing server 200 includes a communication unit 201, a control unit 202, a storage unit 203, a determination unit 204, an estimation unit 205, and a content providing processing unit 206. The control unit 202, the determination unit 204, the estimation unit 205, and the content providing processing unit 206 are realized by a controller capable of executing a process of providing information to the user U1.

[0019] The communication unit 201, under the control of the control unit 202, exchanges various types of information with other devices using wired or wireless communication.

[0020] The control unit 202 controls each unit based on various programs stored in the storage unit 203. The control unit 202 is realized by a processing device such as a CPU (Central Processing Unit).

[0021] The storage unit 203 is a storage medium that stores various types of information. For example, the storage unit 203 stores various types of information (e.g., a control program, a map information DB, a device information DB 210, and a content DB 220) required for the control unit 202 to perform various processes. The storage unit 203 also stores various types of information acquired via the communication unit 201. For example, the storage unit 203 can be a read-only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), a solid state drive (SSD), or a combination thereof. The device information DB 210 and the content DB 220 will be described in detail with reference to FIGS. 3 and 4.

[0022] The determination unit 204 determines, under the control of the control unit 202, whether a user using the content provision service is present at a registered location and outputs the determination result to the estimation unit 205. For example, the determination unit 204 determines whether the user U1 is present at the registered location based on the establishment of a proximity condition between the communication device 300 installed at the registered location and the electronic device MC1 associated with the user U1. Furthermore, for example, the determination unit 204 determines whether the user U1 is present at the registered location based on the establishment of a proximity condition between the object RO1 installed at the registered location and the electronic device MC1 associated with the user U1. For example, if the current location of the electronic device MC1 is within a predetermined range based on the registered location, the determination unit 204 determines that the proximity condition is established and determines that the user U1 is present at the registered location. Furthermore, for example, if the captured image acquired by the electronic device MC1 includes feature information about the registered location, such as the feature portion FP1, the determination unit 204 determines that the proximity condition is established and determines that the user U1 is present at the registered location. Furthermore, for example, when predetermined information is exchanged between electronic device MC1 and communication device 300 using wireless or wired communication, determination unit 204 determines that the proximity condition is met and determines that user U1 is present at the registered location. Note that determination unit 204 is realized by a processing device such as a CPU, for example. These determination methods will be described in detail with reference to Figs. 4, 7, etc.

[0023] The estimation unit 205, under the control of the control unit 202, estimates the means of transportation of a user determined by the determination unit 204 to be present in a registered location, and outputs the estimation result to the content provision processing unit 206. For example, the estimation unit 205 estimates the means of transportation of the user U1 based on device information regarding at least one of the electronic device MC1 associated with the user U1 and the installed device installed in the means of transportation used by the user U1. The device information can estimate the means of transportation of the user U1 based on at least one of the attributes of the electronic device MC1 or the installed device, and information regarding the movement history of the electronic device MC1 or the installed device. The estimation unit 205 is realized by a processing device such as a CPU. These estimation methods will be described in detail with reference to FIGS. 5, 6, etc.

[0024] The content providing processing unit 206 uses the device information DB 210 and the content DB 220 to perform processing to provide content according to the means of transportation estimated by the estimation unit 205 to a user who is determined by the determination unit 204 to be present at a registered location. The content providing processing unit 206 is realized by a processing device such as a CPU. The content providing processing will be described in detail with reference to Figs. 8 to 13, etc.

[0025] The electronic device MC1 includes a communication unit 301, a control unit 302, a memory unit 303, a location information acquisition unit 304, a sound acquisition unit 305, an image acquisition unit 306, an operation reception unit 307, a display unit 308, and a sound output unit 309.

[0026] The communication unit 301 exchanges various types of information with other devices using wired or wireless communication under the control of the control unit 302 .

[0027] The control unit 302 controls each unit based on various programs stored in the storage unit 303. The control unit 302 is realized by a processing unit such as a CPU.

[0028] The storage unit 303 is a storage medium that stores various types of information. For example, the storage unit 303 stores various types of information (e.g., control programs) required for the control unit 302 to perform various processes. The storage unit 303 also stores various types of information acquired via the communication unit 301. The storage unit 303 can be, for example, a ROM, a RAM, an HDD, an SSD, or a combination thereof.

[0029] The location information acquisition unit 304 acquires location information relating to the location where the electronic device MC1 is located, and outputs the acquired location information to the control unit 302. For example, it can be realized by a GNSS receiver that acquires location information using a GNSS (Global Navigation Satellite System). The location information includes data relating to the location, such as latitude, longitude, and altitude, at the time of receiving the GNSS signal. The location information may also be acquired by other methods of acquiring location information. For example, the location information may be derived using information from nearby access points or base stations. The location information may also be acquired using a beacon.

[0030] The sound acquisition unit 305 acquires sounds around the electronic device MC1 under the control of the control unit 302, and outputs information about the acquired sounds to the control unit 302. As the sound acquisition unit 305, for example, one or more microphones or sound acquisition sensors can be used.

[0031] The image acquisition unit 306 captures an image of a subject and generates an image (image data) based on the control of the control unit 302, and outputs information about the generated image to the control unit 302. The image acquisition unit 306 is configured by, for example, one or more camera devices or image sensors capable of capturing an image of a subject.

[0032] The operation receiving unit 307 receives an operation from the user and outputs the received operation content to the control unit 302 .

[0033] The display unit 308 displays various images under the control of the control unit 302. The display unit 308 may be, for example, a display panel such as an organic EL (Electro Luminescence) panel or an LCD (Liquid Crystal Display) panel. The operation reception unit 307 and the display unit 308 may be configured as a touch panel that allows a user to input operations by touching or bringing their finger close to the display surface, or may be configured as a separate user interface. FIGS. 5, 9, 11 to 13 show examples in which the operation reception unit 307 and the display unit 308 are touch panels.

[0034] The sound output unit 309 outputs sound to the outside of the electronic device MC1 based on the control of the control unit 302. For example, one or more speakers can be used as the sound output unit 309. Note that the operation reception unit 307, the display unit 308, and the sound output unit 309 are examples of user interfaces, and some of them may be omitted, or other user interfaces may be used.

[0035] [Example of device information DB content] 3 is a diagram schematically showing each piece of information stored in the device information DB 210. The device information DB 210 is a database for managing device information related to devices (including electronic devices MC1, control devices 50, and information output devices 100) owned by users (including user U1) who use the content providing service.

[0036] The device information DB 210 stores location information 212, attribute information 213, movement history 214, vehicle information 215, image information 216, connection information 217, and payment information 218 in association with a user ID 211. Note that some of this information is sequentially transmitted from the electronic device MC1 or the control device 50 or information output device 100 installed in the automobile C1 to the content providing server 200 and stored therein. Information transmitted from devices installed in other means of transportation may also be sequentially stored in the content providing server 200.

[0037] The user ID 211 is identification information for identifying a user who uses the content providing service. For example, "U01" is stored in the user ID 211 as the user ID of user U1.

[0038] The location information 212 is information indicating the location of the user corresponding to the user ID 211. For example, the current location of each user is acquired using various sensors, such as a location information acquisition unit, installed in electronic devices carried by each user, and information associating the latitude and longitude of this current location with the time of acquisition is transmitted to the content providing server 200 and stored in the location information 212. The current location of each user can be identified based on the location information 212.

[0039] The attribute information 213 is information indicating the attributes of devices managed by the device information DB 210. For example, if a device managed by the device information DB 210 is a smartphone, this fact is stored, and if a device managed by the device information DB 210 is an in-vehicle device, this fact is stored.

[0040] The movement history 214 is information indicating the movement trajectory of the user corresponding to the user ID 211. For example, information in which the position stored in the position information 212 is associated with the acquisition time of this position information is stored in the movement history 214 as the movement trajectory.

[0041] The vehicle information 215 is information stored when the device managed by the device information DB 210 is an on-vehicle device, and includes various information related to the vehicle. For example, the history of detection information from each sensor installed in the automobile C1, such as an acceleration sensor, is stored. Also, for example, if the automobile C1 is an electric automobile, information on the amount of charge or remaining electricity of the automobile C1 is stored. Also, for example, if the automobile C1 is an engine vehicle, information on the remaining fuel in the automobile C1 is stored.

[0042] The image information 216 is information about images acquired by an image acquisition unit, for example, a camera, installed in the device corresponding to the user ID 211. For example, a captured image acquired by the image acquisition unit is transmitted to the content providing server 200 and stored in the image information 216. For example, a history of captured images acquired within a predetermined time period is stored in the image information 216. Based on the image information 216, it is possible to identify the situation around the electronic device MC1, the situation inside each means of transportation, the situation outside each means of transportation, etc.

[0043] The connection information 217 is information indicating a communication history when communication is established between a device managed by the device information DB 210 and another communication device. That is, by referring to the connection information 217, it is possible to identify a communication device to which a device managed by the device information DB 210 is connected.

[0044] The payment information 218 is information related to the settlement of an electronic payment when the payment is made by a device managed by the device information DB 210. For example, the history of each payment information acquired within a predetermined period of time is stored in the payment information 218. In other words, by referring to the payment information 218, it is possible to identify the timing when a device managed by the device information DB 210 made a payment and the device that made the payment.

[0045] [Example of content in the content database] 4 is a diagram schematically showing each piece of information stored in the content DB 220. The content DB 220 is a database for managing content to be provided to users who are present around a registered location managed by the content providing server 200.

[0046] The content DB 220 stores location information 222, content output range 223, means of transportation 224, and content 225 in association with a registration location ID 221.

[0047] The registered location ID 221 is identification information for identifying a registered location where content is provided to a user who uses the content providing service. For example, "PL01" is stored in the registered location ID 221 as the registered location ID of objects RO1 to RO3 (see FIG. 8). Also, for example, "PL02" is stored in the registered location ID 221 as the registered location ID of building B1 (see FIG. 8).

[0048] The location information 222 is information indicating the location of a registered location to which content is to be provided. For example, the latitude and longitude of the registered location are stored in the location information 222. The location of the registered location can be identified based on the location information 222. Note that one piece of location information may be set for one registered location, or multiple pieces of location information may be set for one registered location.

[0049] The content output range 223 is information indicating the range within which content corresponding to the registered location is provided. For example, the content output range 223 can be a predetermined range based on the location of the registered location. This predetermined range may be, for example, a circular range with a predetermined radius centered on the location of the registered location, or an area related to the registered location, such as the park itself.

[0050] The transportation means 224 is information indicating the transportation means of the user who uses the content providing service. For example, each transportation means that each user is expected to use is stored in the transportation means 224.

[0051] The content 225 is content provided to users who use the content providing service. Specifically, for one registered location ID 221, content corresponding to a plurality of means of transportation 224 is stored in the content 225.

[0052] [Example of determining whether proximity conditions are met] Here, an example of determining whether user U1 is present at a registered location whose registered location ID is stored in the registered location ID 221, i.e., an example of determining whether a proximity condition is satisfied, will be described. For example, an example is shown in which it is determined that user U1 is present at a registered location when a proximity condition is satisfied between the location of the registered location or a device installed at the registered location and an electronic device MC1 equipped by user U1. Note that this example shows an example of determining whether user U1 is present at the registered location RL1 based on the satisfaction of the proximity condition of the electronic device MC1 equipped by user U1, but it is equally applicable to cases where a device other than the electronic device MC1 is used. Note that the device installed at the registered location may be, for example, a communication device capable of communicating with the electronic device MC1 using wired or wireless communication, or an object equipped with a characteristic part installed at the registered location. Note that the object equipped with a characteristic part is, for example, an object RO1 equipped with a characteristic part FP1 (see FIGS. 1, 8 to 10).

[0053] [Example of determination using location information] First, an example of determining whether a user is present at a registered location using location information will be described.

[0054] Specifically, the determination unit 204 (see FIG. 2) of the content providing server 200 extracts user IDs 211 whose location information 212 in the device information DB 210 is present within a predetermined range based on location information 222 in the content DB 220. That is, the determination unit 204 extracts devices present around the registered location. Then, if the location information 212 in the device information DB 210 contains location information that is present within the predetermined range, the determination unit 204 determines that the user with the user ID 211 corresponding to the location information is present around the registered location. Note that the determination process using the location information may be performed by the electronic device MC1. In this case, the electronic device MC1 transmits a content request to the content providing server 200 based on the establishment of the proximity condition.

[0055] [Example of determination using communication] Next, an example of determining whether a user is present at a registered location using communication will be described.

[0056] Specifically, the determination unit 204 (see FIG. 2) of the content providing server 200 identifies an electronic device connected to a communication device installed at a registration location corresponding to the registration location ID 221 of the content DB 220 using wireless or wired communication, based on connection information from the communication device. For example, when device identification information or a user ID for identifying the connected device is exchanged through communication between devices, the connection information can include the device identification information or the user ID for identifying the connected electronic device. Note that the connection information may be transmitted to the content providing server 200 from the electronic device that has exchanged with the communication device. Note that the determination process using communication may be performed by the electronic device MC1. In this case, the electronic device MC1 transmits a content request to the content providing server 200 based on the establishment of the proximity condition.

[0057] For example, assume that a router capable of using Wi-Fi for wireless communication is installed in a registered location. In this case, after a predetermined exchange takes place between the router and an electronic device possessed by a user, the electronic device is connected to the router. When the electronic device is connected to the router in this manner, the router transmits connection information regarding the connected electronic device to the content providing server 200. Alternatively, the electronic device transmits connection information regarding the router to the content providing server 200. This allows the content providing server 200 to know that the user possessing the electronic device is present in the vicinity of the registered location where the router is installed.

[0058] Also, for example, assume that a communication device capable of using Bluetooth (registered trademark) for wireless communication is installed at a registered location. This communication device is capable of, for example, transmitting a beacon signal including registration location information regarding the registration location. In this case, when an electronic device carried by a user receives the beacon signal transmitted by the communication device, the electronic device can acquire the registration location information included in the beacon signal. In this way, when the electronic device receives the beacon signal, the electronic device transmits the registration location information included in the beacon signal to the content providing server 200. This allows the content providing server 200 to know that the user carrying the electronic device is present in the vicinity of the registered location where the communication device is installed.

[0059] Furthermore, for example, if a communication device capable of wirelessly using visible light communication is installed at a registered location, the user's presence around the registered location where the communication device is installed can be determined using visible light communication. Visible light communication is a wireless communication method that uses electromagnetic waves in the visible light band visible to the human eye. Furthermore, information can be output from the vehicle C1 by controlling the wavelength and frequency of the vehicle's LEDs and headlights, and the vehicle C1 can acquire information from the communication device at the registered location using the vehicle's onboard camera. This allows the content providing server 200 to determine that the user U1 in the vehicle C1 is located around the registered location where the communication device is installed. For example, while QR codes are displayed on the exterior of objects, there may be registered locations where QR codes should not be displayed in order to preserve the aesthetic appearance of the object. Even in such cases, visible light communication can be performed using streetlights, etc.

[0060] [Example of judgment using feature information] Next, an example of determining whether a user is present at a registered location using feature information will be described.

[0061] Specifically, user U1 acquires feature information of an object installed at a registered location using the image acquisition unit 306 of electronic device MC1. For example, user U1 acquires an image of feature portion FP1 of object RO1 using the image acquisition unit 306 of electronic device MC1. Next, the control unit 302 of electronic device MC1 acquires access information to the content providing server 200 and identification information related to the registered location where object RO1 is installed, based on the image of feature portion FP1. Next, the control unit 302 of electronic device MC1 accesses the content providing server 200 based on the access information and transmits the identification information related to the registered location where object RO1 is installed. This allows the content providing server 200 to determine that user U1, who is carrying electronic device MC1, is present near the registered location where object RO1 is installed.

[0062] While this example illustrates a case in which the object RO1 has a characteristic portion FP1 on its exterior, the characteristic information may instead be the shape of an object installed at a registered location, or the scenery of the registered location. In this case, determination information for determining each piece of characteristic information may be stored in the electronic device MC1 or the content providing server 200, and the determination information may be used to acquire each piece of characteristic information. For example, location information and the shape of an object may be associated and registered in advance as determination information. For example, the ABC region may be associated with a Buddhist statue at a temple (registered location) within the region and registered in advance. In this case, it is possible to determine that the electronic device MC1 is located in the ABC region based on the location information of the electronic device MC1. Furthermore, if a captured image acquired by the image acquisition unit 306 of the electronic device MC1 while the electronic device MC1 is located in the ABC region includes a Buddhist statue, the Buddhist statue registered in association with the ABC region and the Buddhist statue included in the captured image are compared to determine whether they match. If they match, it is possible to determine that the electronic device MC1 is located in the temple.

[0063] Furthermore, while this example illustrates an example in which an image is used as the feature information, a specific sound may also be used as the feature information. This specific sound is sound information from which specific information can be obtained. For example, a specific sound is output as feature information from a sound-generating device installed at a registered location, and the specific sound is acquired by the sound acquisition unit 305 of the electronic device MC1. Next, the control unit 302 of the electronic device MC1 acquires access information to the content providing server 200 and identification information regarding the registered location where the object RO1 is installed based on the specific sound. Next, the control unit 302 of the electronic device MC1 accesses the content providing server 200 based on the access information and transmits the identification information regarding the registered location where the object RO1 is installed. This allows the content providing server 200 to determine that the user U1, who owns the electronic device MC1, is present around the registered location where the object RO1 is installed.

[0064] The above-described determination example is merely an example, and other determination methods may be used. Furthermore, the above-described determination methods may be combined for determination. For example, by using two or more determination methods, it is possible to improve the accuracy of determination.

[0065] [Example of obtaining transportation means] Next, an example of acquiring the user's transportation means will be described. First, an example of acquiring the user's transportation means based on a user operation will be shown.

[0066] [Example of choosing transportation means using electronic devices] 5 shows an example of transition of the display screen displayed on the display unit 308 of the electronic device MC1. In FIG. 5, an example is shown in which the user U1 moves to the registered location on foot.

[0067] 5 shows an example of a selection screen 310 for selecting a means of transportation for user U1. The selection screen 310 is displayed when a proximity condition between the electronic device MC1 and the registered location is met. Note that this example shows an example in which the means of transportation for user U1 is selected by manual operation, but if the means of transportation for user U1 is estimated automatically, the display of the selection screen 310 is omitted.

[0068] The selection screen 310 displays selection buttons 311 to 319 for selecting the user U1's means of transportation. The user U1 performs a pressing operation of pressing a selection button corresponding to the user's means of transportation from among the selection buttons 311 to 319. In the example shown in FIG. 5, the user U1 travels to the registered location on foot, so the user U1 performs a pressing operation of pressing the selection button 311. When this pressing operation is performed, the control unit 302 transmits transportation information indicating the transportation corresponding to the selection button 311 to the content providing server 200. By receiving this transportation information, the content providing server 200 can acquire the transportation of the user U1. The content providing server 200 then provides the electronic device MC1 with content corresponding to the transportation of the user U1. The electronic device MC1 outputs the content provided by the content providing server 200. For example, a content display screen 320 shown on the right side of FIG. 5 is displayed on the display unit 308.

[0069] On the right side of FIG. 5, an example of a content display screen 320 that displays content according to the means of transportation selected in response to the selection operation of the selection buttons 311 to 319 on the selection screen 310 is shown.

[0070] The content display screen 320 is provided with an image display area 321, a message display area 324, and a means of transportation display area 325. In the image display area 321, a captured image acquired by the image acquisition unit 306 is superimposed with a human figure image 322 corresponding to the means of transportation selected using the selection screen 310, and a guide image 323 that guides the user to the registered location that is the display target for the next content related to the current registered location.

[0071] In the message display area 324, information about the current registered location, information about the position and direction of the registered location where the next content related to the current registered location will be displayed, and the like are displayed as messages.

[0072] The transportation display area 325 displays information indicating the transportation selected using the selection screen 310. FIG. 5 shows an example in which the words "for pedestrians" 326 and a sign image 327 indicating a pedestrian are displayed in the transportation display area 325. By looking at the display in the transportation display area 325, the user U1 can easily understand that the content displayed on the electronic device MC1 is "for pedestrians." In this way, by notifying the user during or before content output which transportation mode the content output is for, the user U1 can easily understand whether the content is suitable for their transportation mode, even if the transportation mode cannot be correctly estimated.

[0073] [Example of travel mode estimation using location information, etc.] Next, an example of estimating the means of transportation of the user U1 using the position information etc. acquired by the position information acquisition unit 304 of the electronic device MC1 will be described.

[0074] Figure 6 is a simplified diagram showing transportation means that user U1 may use. Figure 6 shows examples of transportation means: an airplane AP1 flying in the sky, a train TR1 running on a railway line RP1, a car C1, a bus BU1, a motorbike M1, and a bicycle BC1 running on roadway RD1, user U1 walking on sidewalk SW1 installed along roadway RD1, and a boat SH1 traveling on river RV1.

[0075] [Example of estimation using movement history] The estimation unit 205 (see FIG. 2) can acquire the movement history of the electronic device MC1 using the location information 212 and movement history 214 in the device information DB 210. Based on the movement history of the electronic device MC1 and the map information stored in the map information DB of the storage unit 203, the estimation unit 205 selects a route on the map that matches the movement history of the electronic device MC1. For example, if the movement history of the electronic device MC1 matches a railroad RP1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is a train. Furthermore, if the movement history of the electronic device MC1 matches a river RV1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is a boat. Furthermore, if the movement history of the electronic device MC1 matches a sidewalk SW1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is walking. Furthermore, if the movement history of the electronic device MC1 matches the roadway RD1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is some kind of vehicle traveling on the roadway RD1. In this case, the type of vehicle traveling on the roadway RD1 can be estimated using the following speed and the like.

[0076] [Example of estimation using travel distance or travel speed] The estimation unit 205 (see FIG. 2) can calculate the movement speed of the electronic device MC1 based on the location information 212 and movement history 214 in the device information DB 210. For example, the estimation unit 205 can use location information acquired at predetermined intervals, for example, one-minute intervals, to calculate the movement distance per unit time between the location information, for example, one minute. Furthermore, for example, the estimation unit 205 can use the location information acquired at predetermined intervals to calculate the movement distance between the location information, and calculate the movement speed by dividing the movement distance by the interval. Therefore, the estimation unit 205 uses the location information of the electronic device MC1 to calculate at least one of the movement distance and movement speed of the user U1 who owns the electronic device MC1, and estimates the means of transportation of the user U1 based on the movement distance or movement speed.

[0077] For example, when the moving distance per minute is less than TH1m, the estimation unit 205 estimates that the moving means of the user U1 is walking. Also, when the moving distance per minute is TH1m or more and less than TH2m, the estimation unit 205 estimates that the user's moving means is a bicycle. Further, when the moving distance per minute is TH2m or more and less than TH3m, the estimation unit 205 estimates that the user's moving means is at least one of a car, a motorcycle, and a bus. Additionally, when the moving distance per minute is TH3m or more, the estimation unit 205 estimates that the user's moving means is a train. Moreover, when the moving distance per minute is TH4m or more, the estimation unit 205 estimates that the user's moving means is an airplane. Note that the estimation unit 205 may estimate the moving means based on the average value (average moving distance) of the calculated moving distance (moving distance per minute). Here, TH1 to TH4 are thresholds for estimating the user's moving means, and values that can be appropriately set based on experimental data and the like. For example, a value of about several tens of meters can be set as TH1, and values of about several hundreds of meters can be set as TH2 to TH4 (where TH2 < TH3 < TH4).

[0078] Also, the moving means may be estimated based on the maximum speed. For example, when the maximum speed is less than TH11km / h, it can be determined as walking, and when the maximum speed is TH11km / h or more and less than TH12km / h, it can be determined as a bicycle. Further, for example, when the maximum speed is TH12km / h or more and less than TH13km / h, it can be determined as a bus, and when the maximum speed is TH13km / h or more, it can be determined as a train. Moreover, for example, when the maximum speed is TH14km / h or more, it can be determined as an airplane. Here, TH11 to TH14 are thresholds for estimating the user's moving means, and values that can be appropriately set based on experimental data and the like. For example, a value of about several km / h can be set as TH11, and values of about several tens of km / h can be set as TH12 to TH14 (where TH12 < TH13 < TH14).

[0079] The estimation unit 205 can calculate the acceleration of the user U1 who owns the electronic device MC1 by using the location information of the electronic device MC1. It is also possible to acquire the acquisition history of the acceleration sensor installed in the electronic device MC1. For example, if the vehicle information 215 in the device information DB 210 includes acceleration sensor information, the information from the acceleration sensor can be used. Therefore, the characteristics of each mode of transportation, such as walking, bicycle, bus, and train, may be set in advance, and the estimation unit 205 may estimate the mode of transportation of the user U1 based on the acceleration characteristics of the electronic device MC1, for example, the acceleration history.

[0080] [Example of estimation using communication] The estimation unit 205 (see FIG. 2) can estimate the means of transportation of the user U1 who owns the electronic device MC1 based on communication between the electronic device MC1 and a communication device installed in the means of transportation.

[0081] For example, when user U1 is in automobile C1, it is assumed that the electronic device MC1 connects to a communication device of automobile C1, such as the control device 50 or the information output device 100, using wireless communication, such as Wi-Fi or Bluetooth. In this case, the control unit 302 of the electronic device MC1 stores a connection history indicating that the electronic device MC1 has been connected to the communication device of automobile C1 using wireless communication in the storage unit 303, and transmits the connection history to the content providing server 200 at a predetermined timing. Alternatively, the communication device of automobile C1 may store a connection history indicating that the electronic device MC1 has been connected to the electronic device MC1 using wireless communication in the storage unit, and transmit the connection history to the content providing server 200 at a predetermined timing. These connection histories are stored in the connection information 217 of the device information DB 210. Furthermore, the type of automobile C1 can be determined based on the attribute information 213 of the device information DB 210. This allows the content providing server 200 to determine that user U1's means of transportation is automobile C1.

[0082] Furthermore, for example, when user U1 is on a means of transportation equipped with a communication device connectable to electronic device MC1 via wireless communication, such as a train TR1, an airplane AP1, a bus BU1, or a ship SH1, it is assumed that electronic device MC1 will be connected to that communication device. Similarly, in this case, the control unit 302 of electronic device MC1 stores in the storage unit 303 that it has been connected to the communication device of each means of transportation via wireless communication, and transmits this information to the content providing server 200 at a predetermined timing. Alternatively, the communication device of each means of transportation may store in its storage unit that it has been connected to electronic device MC1 via wireless communication, and transmit this information to the content providing server 200 at a predetermined timing.

[0083] [Example of estimation using payment systems and payment methods] When user U1 uses the payment function of electronic device MC1 to board public transportation, the estimation unit 205 (see FIG. 2) can estimate the transportation mode of user U1 who owns electronic device MC1 based on the payment information. This payment function corresponds to, for example, an IC card ticket equipped with an electronic money function provided by a railway operator or bus operator, and can be installed as, for example, a smartphone application. For example, the ID of the railway operator or bus operator may be associated with the user ID of user U1, and the content providing server 200 may acquire the user U1's transportation information based on the user ID of user U1. Alternatively, each time user U1 boards a transportation mode provided by a railway operator or bus operator, the electronic device MC1 may store the transportation information regarding the transportation mode used and transmit it to the content providing server 200 at a predetermined timing. Each of these pieces of information is stored in the payment information 218 of the device information DB 210. This allows the content providing server 200 to identify the transportation modes used by user U1 in the past.

[0084] The payment function corresponds to a payment method provided by, for example, a credit card company or an online payment service company, and can be installed as, for example, a smartphone application. For example, the ID of the credit card company or the online payment service company may be associated with the user ID of user U1, and the content providing server 200 may acquire the riding information of user U1 based on the user ID of user U1.

[0085] [Example of estimation using images and sounds] The estimation unit 205 (see FIG. 2) can estimate the mode of transportation of the user U1 who owns the electronic device MC1 based on an image acquired by the image acquisition unit 306 of the electronic device MC1. For example, when an image of the user U1's surroundings is acquired by the image acquisition unit 306 of the electronic device MC1, the image information is stored in the storage unit 303 and transmitted to the content providing server 200 at a predetermined timing. This image information is stored in the image information 216 of the device information DB 210. The content providing server 200 can identify the route taken by the user U1 based on the image of the user U1's surroundings, and can estimate the user U1's mode of transportation based on that route. For example, if the image of the user U1's surroundings shows the sidewalk SW1, it can estimate that the user U1's mode of transportation is walking. Furthermore, if the image of the user U1's surroundings shows the sea or a river, it can estimate that the user U1's mode of transportation is a boat. Furthermore, if the image of the user U1's surroundings shows the area along the railway RR1, it can estimate that the user U1's mode of transportation is a train.

[0086] Furthermore, if the image acquired by the image acquisition unit 306 includes a steering wheel, it is possible to estimate the means of transportation, such as a car, motorcycle, or bicycle, based on the shape of the steering wheel. Furthermore, if the image acquired by the image acquisition unit 306 includes objects inside the vehicle, such as the windshield or dashboard, it is possible to estimate that the means of transportation is a car.

[0087] The estimation unit 205 can estimate the means of transportation of the user U1 who owns the electronic device MC1 based on the sound acquired by the sound acquisition unit 305 of the electronic device MC1. For example, when the sound around the user U1 is acquired by the sound acquisition unit 305 of the electronic device MC1, the sound information is stored in the storage unit 303 and transmitted to the content providing server 200 at a predetermined timing. This sound information is stored in the device information DB 210. The content providing server 200 can identify the environment in which the user U1 traveled based on the sound around the user U1, and can estimate the means of transportation of the user U1 based on that environment. For example, if the sound around the user U1 is quiet, it can be estimated that the user U1's means of transportation is walking. Furthermore, if the sound around the user U1 is the sound of a specific vehicle, it can be estimated that the user U1's means of transportation is that vehicle.

[0088] [Other estimated examples] Here, we will explain other estimation methods. For example, a communication device can be installed at the entrance / exit of the registered location or the facility where the user enters and exits. The means of transportation of user U1 can be estimated using communication between this communication device and electronic device MC1.

[0089] Furthermore, various information is notified to or displayed on the electronic device MC1 of the user U1 depending on the means of transportation. For example, if the user U1 uses a bus or train, a timetable is often displayed on the display unit 308 of the electronic device MC1. If the user U1 uses a car C1, traffic conditions on the way home in the car C1 are often displayed on the display unit 308 of the electronic device MC1. If the user U1 uses a bicycle or motorcycle, weather information is often displayed on the display unit 308 of the electronic device MC1. If the user U1 uses a taxi, a ride-hailing app or the like is often launched on the electronic device MC1. Therefore, the means of transportation of the user U1 can be estimated using the display history and app launch history of the electronic device MC1.

[0090] Furthermore, as described above, a communication device installed at the entrance or exit of a registered location or facility may be configured to execute entry and exit processing. For example, when user U1 performs an entry or exit operation using the communication device, appropriate information can be displayed on user U1's electronic device MC1 according to the means of transportation.

[0091] Furthermore, for example, a communication device can be installed at the entrance of a restaurant that serves as a registration location. The means of transportation of user U1 can be estimated using communication between this communication device and electronic device MC1. This communication device is also used when user U1 makes an electronic payment using electronic device MC1 after eating at the restaurant. For example, if user U1's means of transportation is walking, only the cost of user U1's meal is displayed on electronic device MC1 and charged. On the other hand, if user U1's means of transportation is a car C1 and the car C1 is parked in a parking lot, the cost of the parking lot can be added to the cost of user U1's meal, and the resulting amount can be displayed on electronic device MC1 and charged.

[0092] Note that the above-described method for estimating the mode of transportation is an example, and other estimation methods may be used. Furthermore, the above-described estimation methods may be combined to estimate the mode of transportation. For example, the user's mode of transportation may be determined on the condition that the modes of transportation estimated by two or more estimation methods match. This makes it possible to improve the accuracy of estimating the mode of transportation.

[0093] [Example of estimated main means of transportation] FIG. 7 is a simplified diagram illustrating an example of the relationship between routes R1 to R5 to a registered location RL1 and the primary means of transportation. Routes to the registered location RL1 include route R1 from the nearest airport APP1, route R2 from the nearest train station ST1, route R3 from the nearest wharf SP1, route R4 from the nearest bus stop BT1, and route R5 from a parking lot P1. In FIG. 7, each of routes R1 to R5 is assumed to be accessible only by walking. In this case, it is possible to estimate that the primary means of transportation used by user U1 upon arriving at the registered location RL1 is all walking. However, the primary means of transportation used by user U1 may be estimated by taking into account the means of transportation used by user U1 prior to each of routes R1 to R5. For example, the primary means of transportation used by user U1 may be estimated depending on the content.

[0094] For example, the primary means of transportation for user U1 can be selected based on the travel distance of user U1, and content can be determined based on this primary means of transportation. For example, the means of transportation with the longest travel distance from the home of user U1 to the registered location RL1 can be selected as the primary means of transportation. For example, if the distance from the home of user U1 to the registered location RL1 is 10 km, walking is 1 km and train is 9 km, then train is selected as the primary means of transportation.

[0095] For example, the main means of transportation for user U1 can be selected based on the travel time of user U1, and content can be determined based on this main means of transportation. For example, the means of transportation with the longest travel time among the travel times from user U1's home to registered location RL1 can be selected as the main means of transportation. For example, if the travel time from user U1's home to registered location RL1 is one hour, and walking takes 10 minutes, bus takes 40 minutes, and train takes 10 minutes, then the bus is selected as the main means of transportation.

[0096] For example, the main means of transportation for user U1 can be selected based on the travel cost of user U1, and content can be determined based on this main means of transportation. For example, the means of transportation with the highest travel cost among the travel costs from user U1's home to registered location RL1 can be selected as the main means of transportation. For example, if the travel cost from user U1's home to registered location RL1 is 1,000 yen, walking is 0 yen, bus is 800 yen, and train is 200 yen, then the bus is selected as the main means of transportation.

[0097] The method for selecting the main means of transportation is merely an example, and the user's means of transportation may be selected by other methods. Furthermore, the method for selecting the means of transportation may be changed depending on the content provided to the user.

[0098] Furthermore, the priority of transportation means may be set in advance, and the user's transportation means may be selected according to this priority. For example, assume that the priority of transportation means is set as follows: 1st place train, 2nd place car, 3rd place bus, and 4th place walking. In this case, if the user arrives at the registered location by walking, bus, and train, the train, which is ranked 1st, is selected as the user's transportation means according to the priority. Note that if the transportation means selected in this way is canceled by the user's operation, another transportation means for the user is selected according to the priority.

[0099] [Example of the relationship between registered locations and user transportation methods] FIG. 8 is a simplified diagram showing the relationship between registered locations managed by the content providing server 200 and the means of transportation of user U1. FIG. 8 shows an example in which objects RO1 to RO3 and a building B1 are registered locations. FIG. 8 also shows a case in which user U1 walks to parking lot P11 where objects RO1 to RO3 are located, and a case in which user U1 gets into car C1 and heads there. Furthermore, parking lot P11 is assumed to be a parking lot provided to users who use building B1. Building B1 is, for example, a facility where people gather, such as a museum or an exhibition hall.

[0100] Objects RO1 to RO3 are charging stations for charging electric vehicles using charging cables. Objects RO1 to RO3 are also facilities installed at registered locations managed by the content providing server 200. Vehicle C2 is a vehicle being charged using charging facility RO2, and vehicles C3 and C4 are vehicles parked in parking lot P11.

[0101] Furthermore, when the user U1 gets into the car C1 and heads to the parking lot P11, the user drives along the roadway R11, and when the user U1 walks to the parking lot P11, the user walks along the sidewalk R12. In this case, the content providing server 200 can estimate the means of transportation of the user U1 based on the movement history of the user U1 up to the time of heading to the parking lot P11. The movement history of the user U1 can be acquired from the movement history 214 of the device information DB 210.

[0102] [Example of content output when the means of transportation is walking] 9 is a diagram showing an example of output of content provided to the user U1 by the content providing server 200 when the user U1's means of transportation is walking. Here, the description will be made assuming that the user U1 has an electronic device MC1.

[0103] Assume that user U1, who has been walking along sidewalk R12 shown in Fig. 8, has moved to the vicinity of object RO1 in order to use building B1. After user U1 has moved to the vicinity of object RO1, user U1 uses the image acquisition unit 306 of electronic device MC1 to capture an image of characteristic portion FP1 of object RO1. In this case, an image of characteristic portion FP1 is captured by the image acquisition unit 306 of electronic device MC1, and this image of characteristic portion FP1 is output to control unit 302 of electronic device MC1. Control unit 302 can acquire various information based on characteristic portion FP1 by performing predetermined image processing on the image of characteristic portion FP1.

[0104] For example, if the characteristic portion FP1 is configured as a QR code, the control unit 302 can acquire access information to the content providing server 200 and identification information for identifying the object RO1 based on the QR code acquired by the image acquisition unit 306 of the electronic device MC1. In this case, the control unit 302 accesses the content providing server 200 based on the acquired access information and transmits identification information of the object RO1, such as a registered location ID. This allows the content providing server 200 to determine that the electronic device MC1 is located near the object RO1. In this case, the content providing server 200 can determine that the means of transportation is walking based on the movement history 214 of the electronic device MC1 (see FIG. 3). Alternatively, the content providing server 200 may infer that the means of transportation is walking based on the information transmitted from the electronic device MC1.

[0105] Next, the content providing server 200 extracts the registered place ID 221 that matches the identification information of the object RO1 from the registered place IDs 221 in the content DB 220. Then, the content providing server 200 extracts the content 225 related to walking from the means of transportation 224 in the content DB 220 associated with the registered place ID 221 that matches the identification information of the object RO1.

[0106] The content providing server 200 transmits the extracted content to the electronic device MC1. When the content is received from the content providing server 200, the control unit 302 of the electronic device MC1 outputs the content from an output unit, such as the display unit 308 and the sound output unit 309. For example, as shown in FIG. 9, a human figure AB1 can be displayed superimposed on an image acquired by the image acquisition unit 306. In this example, the display unit 308 can display the human figure AB1, which appears to be sitting on top of a building B1. The human figure AB1 may also explain the object RO1 and the building B1, and output sound information S1 guiding the user to proceed to the building B1. Furthermore, video content, such as the time required to reach nearby tourist attractions and local specialties, may also be output. In this case, since it is known that the user U1 has arrived on foot, it is possible to guide the user to nearby registered locations that are within walking distance, for example, within a range of approximately 3 km.

[0107] 9, since user U1 is in a parking lot, a message such as "It's dangerous because a car is coming" or a message such as "Next time, please come by car" may be output. Also, content guiding shortcuts to other registered locations, content guiding other registered locations within walking distance of user U1, etc. may be output.

[0108] [Content output example when the means of transportation is a vehicle] FIG. 10 is a diagram showing an example of content output provided to user U1 by the content providing server 200 when the user U1's means of transportation is an automobile C1. Here, the explanation will be given assuming that the automobile C1 is an electric automobile. FIG. 10 also shows a simplified example of the configuration of the interior of the automobile C1 as viewed from the rear in the longitudinal direction of the automobile C1. To facilitate explanation, FIG. 10 omits illustrations of components other than the dashboard 2, steering wheel 3, windshield 4, and information output device 100.

[0109] A user U1 who has been driving a car C1 on a roadway R11 shown in Fig. 8 parks the car C1 near the object RO1 to charge the car. When the car C1 is parked near the object RO1 in this way, the object RO1, a building B1, etc. become visible through the windshield 4, as shown in Fig. 10.

[0110] 1, the object RO1 has a characteristic portion FP1 on its exterior. When the characteristic portion FP1 is included in the imaging range of an image acquisition unit installed in the automobile C1, for example, an exterior camera, an image of the characteristic portion FP1 is acquired by the image acquisition unit of the automobile C1, and this image of the characteristic portion FP1 is output to the information output device 100. The information output device 100 can acquire various pieces of information based on the characteristic portion FP1 by performing predetermined image processing on the image of the characteristic portion FP1.

[0111] Note that the access by the information output device 100 to the content providing server 200 and the transmission of the identification information of the object RO1 are the same as in the example shown in FIG. 9. This allows the content providing server 200 to know that an automobile C1 is present around the object RO1. In this case, the content providing server 200 can know that the means of transportation is an automobile based on the movement history 214 of the information output device 100 (see FIG. 3). Alternatively, the content providing server 200 may infer that the means of transportation is an automobile based on the fact that the information is transmitted from the information output device 100.

[0112] Next, the content providing server 200 extracts the registered place ID 221 that matches the identification information of the object RO1 from the registered place IDs 221 in the content DB 220. Then, the content providing server 200 extracts the automobile-related content 225 from the means of transportation 224 in the content DB 220 that is associated with the registered place ID 221 that matches the identification information of the object RO1.

[0113] The content providing server 200 transmits the extracted content to the information output device 100. When content is received from the content providing server 200, the control unit of the information output device 100 controls the output unit, such as the display unit 110 and sound output unit, to output the content. For example, as shown in FIG. 10, a human figure AB2 can be displayed superimposed on an image acquired by the image acquisition unit. In this example, the human figure AB2, appearing to be sitting on top of the object RO1, can be displayed on the display unit 110. Furthermore, the human figure AB2 may explain the object RO1 and the building B1, and sound information S2 providing guidance to charging facilities may be output. Furthermore, assuming that the user U1 will not leave the car C1, video content providing tourist information about the surrounding area may be output. For example, video content showing the time required to reach nearby tourist spots, local specialties, etc. may be output. In this case, since it is known that the user U1 has arrived by car C1, it is possible to guide the user to registered locations that are far away and cannot be reached by foot or bicycle, for example, within a range of approximately 20 km. Furthermore, the content providing server 200 can ascertain the amount of charge of the automobile C1 based on the vehicle information 215 in the device information DB 210. Therefore, content may be output that takes into account the amount of charge of the automobile C1. For example, it may be possible to guide the user to places that can be reached with the current amount of charge, or to introduce the next charging spot that takes into account the current amount of charge.

[0114] The content providing server 200 can also acquire congestion information around the registered location via the network 20. Based on the congestion information around the registered location, the content providing server 200 can guide or introduce less crowded locations around the registered location that can only be reached by car. Furthermore, by providing attractive content only to people who have used the charging facility, it is possible to promote the use of the charging facility.

[0115] 10 illustrates an example in which the characteristic portion FP1 is used to determine whether the proximity condition is met, but other methods may be used to determine whether the proximity condition is met. For example, when the charging cable of the object RO1 is connected to the vehicle C1, the fulfillment of the proximity condition for the vehicle C1 may be determined based on communication between the object RO1 and the vehicle C1 via the charging cable. That is, when the charging cable of the object RO1 is connected to the vehicle C1, communication is performed between the object RO1, i.e., the charging equipment, and the vehicle C1 to determine whether charging is permitted. Therefore, it is possible to determine whether direct communication between the object RO1 and the vehicle C1 has been established using this communication.

[0116] Content may be provided using virtual reality (VR) or augmented reality (AR). Content related to the registered location may be used as the content to be provided. For example, local content for the area related to the registered location, content introducing local products, local avatars, local mascot characters, etc. may be used. Local content is, for example, an image of a specific character depicted in a graphical format. These may also be displayed in AR or augmented reality, or output as audio. In this way, by changing the local content to be provided depending on the mode of transportation, users who want to see all the local content will frequently visit the registered location, thereby revitalizing the registered location. Furthermore, by using each mode of transportation, it is possible to promote the use of each mode of transportation.

[0117] Here, we will explain the differences in content when the means of transportation is a car or on foot. Whether the means of transportation is a car or on foot, the display format can be the same except for characteristic features, such as the human-shaped images AB1 and AB2. However, when the means of transportation is a car, it is expected that the user will spend a long time inside the car. Therefore, when the means of transportation is a car, it is also possible to provide local content that can be completed while the user is inside the car. For example, it is possible to display a predetermined image superimposed on a landscape that can be seen from the car. For example, if the user's line of sight can be detected, a predetermined image related to the landscape can be superimposed on the landscape corresponding to the line of sight. Furthermore, if the electronic device MC1 can be viewed from inside the car, a predetermined image can be superimposed on an image acquired by the image acquisition unit 306 of the electronic device MC1. Here, the predetermined image can be an explanatory image of a building, mountain, or the like that can be seen from the registered location.

[0118] Furthermore, if the means of transportation is a car, the driving range varies depending on the remaining fuel or remaining charge. Therefore, it is possible to provide content that introduces the remaining fuel or remaining electricity. It is also possible to change the next registration location candidate depending on the remaining fuel or remaining electricity, making it possible to provide information that suits the user's situation.

[0119] Furthermore, if the user's means of transportation is walking or car, it is easy for the user to move several tens of meters, so it is also possible to introduce an object several tens of meters away. In this case, when the user approaches the object and the image acquisition unit 306 of the electronic device MC1 acquires an image of the object, a predetermined image can be superimposed on the object and displayed. This predetermined image can be an explanatory image related to the object.

[0120] In this way, different content can be provided depending on the mode of transportation, so that local information suited to the mode of transportation can be provided to the user. For example, the information provider can appropriately introduce information taking the mode of transportation into consideration. In this case, it is possible to convey local information broadly and shallowly, or narrowly and deeply. Note that although FIGS. 9 and 10 show examples in which both audio information and image information are output, it is also possible to output either audio information or image information.

[0121] [Example of content output according to transportation mode] Fig. 11 shows examples of content output according to the transportation means of user U1. Fig. 11(A) shows an example of content output when user U1's transportation means is bus BU1, Fig. 11(B) shows an example of content output when user U1's transportation means is train TR1, Fig. 11(C) shows an example of content output when user U1's transportation means is motorcycle M1, Fig. 11(D) shows an example of content output when user U1's transportation means is ship SH1, and Fig. 11(E) shows an example of content output when user U1's transportation means is airplane AP1.

[0122] 11(A) to 11(E), on the content display screen, in image display areas 401 to 405, human figures 411 to 415 corresponding to the user U1's means of transportation are displayed superimposed on the captured image. Furthermore, in transportation display areas 421 to 425, characters and signs corresponding to the user U1's means of transportation are displayed. For example, content guiding the user U1 to a registered location can be output using the human figures 411 to 415.

[0123] 11 is an example, and other content may be output depending on the mode of transportation of user U1. For example, the pose or clothes of the same human figure image may be changed depending on the mode of transportation of user U1. Furthermore, if the registered location is a store, the products introduced may be changed depending on the mode of transportation of user U1.

[0124] Furthermore, the number of times a user has visited the same registered location may be stored for each means of transportation in association with the user ID 211 in the device information DB 210, and the output content may be changed as the number of times increases. For example, when a user first visits a charging facility that is registered location A by car C1, text indicating "It will take 30 minutes to charge, so kill time by going to the park behind," and a human-shaped image representing this may be displayed. Also, when a user visits registered location A for the third time by car C1, text indicating "I see you've come by car again," and a human-shaped image representing this may be displayed. These may also be output as audio.

[0125] Furthermore, the registered location to be guided after the current registered location may be changed depending on the mode of transportation used by user U1. For example, consider a case where there are multiple registered locations A to E located within a relatively close range, with registered location A being the entrance. In this case, for example, if the mode of transportation is a car, the user may be guided through registered locations A → C → E, and if the mode of transportation is walking, the user may be guided through registered locations A → B → D. In this way, priorities are set in advance for the next candidates for registered locations such as A according to the mode of transportation, and the next candidates are provided to the user based on the priorities and the mode of transportation. These next candidates can be set appropriately based on, for example, distance, time, the state of the travel route, etc. Note that if the next candidate is canceled by a user operation, other next candidates are provided according to the priority order.

[0126] For example, if the means of transportation is a car, a registered location with a wide road leading from the current registered location and a parking lot can be introduced as the next candidate. In this case, it is possible to introduce a location even if it is far from the current registered location.

[0127] Also, for example, if the means of transportation is walking, registered locations within walking distance (for example, less than a few kilometers) can be introduced as the next candidate. In this case, it is possible to introduce the next candidate even if the road leading from the current registered location is narrow.

[0128] For example, if the means of transportation is a motorcycle, the system can introduce a registered location as the next candidate even if the road leading from the current registered location is narrow and there is no parking lot.It can also introduce locations even if they are far from the current registered location.

[0129] For example, if the means of transportation is a bicycle, the next candidate can be a registered location that is located on a flat road from the current registered location and within a bicycle travel distance (for example, less than 10 km). In this case, it is possible to introduce a location that is farther away than the locations that can be introduced on foot.

[0130] Also, assume that there are multiple registered locations A to E located within a relatively close range, with registered location A being the entrance. In this case, for example, if the user moves from one registered location to another without following guidance appropriate to the means of transportation (for example, in the case of a car: registered locations A → C → E), the system may be configured not to output predetermined content appropriate to the means of transportation. In this case, the enjoyment of traveling according to the guidance increases. This allows user U1 to easily enjoy the travel route appropriate to the means of transportation and the content appropriate to the means of transportation.

[0131] [Example of content output outside the registered location] The above describes an example of content output when user U1 is present in the vicinity of a registered location. However, it is also possible that content for the registered location is not output because the proximity condition is not met even though user U1 has moved close to the registered location. It is also possible that user U1 wants to know the status of the registered location when he or she plans to go to the registered location. Therefore, FIGS. 12 and 13 show an example of content output when user U1 is not present in the vicinity of the registered location.

[0132] [Example of content output at a location close to the registration location] FIG. 12 is a diagram showing an example of a content display screen 500 displayed on the display unit 308 of the electronic device MC1. The content display screen 500 is an example of content that is displayed when the user U1 is near a registered location and the proximity condition is not met. The example shown in FIG. 12 shows a case where objects R01 to R03 and a building B1 are installed at the registered location, similar to the example shown in FIG. 8. It is also assumed that the user U1 is walking along the sidewalk R12 (see FIG. 8). The content display screen 500 may be displayed automatically when it is expected that the user U1 will go to the registered location, or may be displayed by manual operation by the user U1.

[0133] A back button 501, a map display area 510, and a message display area 520 are displayed on the content display screen 500. The back button 501 is a button that is pressed to return to the previous display screen.

[0134] The map display area 510 displays a current location indicator PL1 indicating the current location of the user U1, device indicators O1-O5, H1-H5 indicating the locations of other devices around the user U1, registered location indicators 511-514 indicating the locations of registered locations, and travel routes R21 and R22 to the registered locations, all superimposed on a map of the user U1's surroundings. The content providing processing unit 206 of the content providing server 200 can display the map of the user U1's surroundings and the travel routes R21 and R22 based on the location information 212 in the device information DB 210. The content providing processing unit 206 of the content providing server 200 can also display the current location indicator PL1 and device indicators O1-O5, H1-H5 based on the location information 212 in the device information DB 210. The content providing processing unit 206 of the content providing server 200 can also display the registered location indicators 511-514 based on the location information 222 in the content DB 220.

[0135] In this way, by displaying device signs O1 to O5, H1 to H3, registered location signs 511 to 514, and travel routes R21 and R22 on a map around the registered location where user U1 is expected to go, user U1 can easily understand the registered location, the route to get there, and congestion on that route, etc.

[0136] Furthermore, if the user U1's means of transportation can be estimated, only the travel route corresponding to the user U1's means of transportation among the travel routes to the registered location may be displayed. In Fig. 12, since the user U1's means of transportation is walking, an example is shown in which, of the travel routes R21 and R22 to the registered location, the travel route R22 corresponding to the user U1's means of transportation (walking) is displayed in bold, the travel route R21 is displayed in dotted, and the travel route R22 corresponding to the user U1's means of transportation (walking) is highlighted. This allows the user U1 to easily understand the route to the registered location.

[0137] [Example of content output related to the registered location specified by the user] Fig. 13 is a diagram showing an example of a content display screen 550 displayed on the display unit 308 of the electronic device MC1. The content display screen 550 is an example of content that displays a map specified by a manual operation by the user U1. Note that the example shown in Fig. 13 is a partial modification of Fig. 12, and therefore the following description will focus on the differences from Fig. 12. Furthermore, parts that are common to Fig. 12 are assigned the same reference numerals, and their description will be omitted.

[0138] The content display screen 550 displays a map display area 560, a message display area 570, and a transportation means selection area 580. In the map display area 560, device markers O1 to O5, H1 to H5, registered location markers 511 to 514, and travel routes R21 and R22 are displayed superimposed on a map specified by a manual operation by the user U1. That is, Fig. 13 differs from Fig. 12 in that a current location marker PL1 is not displayed.

[0139] The transportation means selection area 580 is an area for the user U1 to select the transportation means to be used when traveling to the registered location displayed in the map display area 560. When the user U1 selects the transportation means in the transportation means selection area 580, it becomes possible to output content corresponding to the selected transportation means.

[0140] Furthermore, at least one of the plurality of contents set for the registered location may be displayed on the content display screen 550 or on another display screen. At least one of the plurality of contents may be output as audio. Furthermore, a travel range or a travel route corresponding to a mode of transportation associated with the registered location may be displayed on the content display screen 550 or on another display screen. The travel range corresponding to a mode of transportation associated with the registered location is a range in which a user who arrives at the registered location included in the map specified by manual operation of the user U1 is expected to travel. For example, if the user U1's mode of transportation is walking, a relatively narrow range is set, and if the user U1's mode of transportation is a car, a relatively wide range is set. Furthermore, the travel route corresponding to a mode of transportation associated with the registered location is a route in which a user who arrives at the registered location included in the map specified by manual operation of the user U1 is expected to travel. For example, if the user U1's mode of transportation is walking, a route that can be traveled by foot is set, and if the user U1's mode of transportation is a car, a route that can be traveled by car is set.

[0141] In this way, even if the user U1 is not near a registered location, the device signs O1 to O5, H1 to H5, the registered location signs 511 to 514, and the travel routes R21 and R22 can be displayed on the map specified by the user U1. This allows the user U1 to easily understand the registered location, the route to get there, and congestion on the route, etc.

[0142] Furthermore, when the user U1's means of transportation is specified, only the travel route corresponding to the user U1's means of transportation among the travel routes to the registered location may be displayed. For example, when the user U1's means of transportation is a car, only the travel route R21 corresponding to the user U1's means of transportation (car) among the travel routes R21 and R22 to the registered location can be displayed. This allows the user U1 to easily understand the route to the registered location.

[0143] [Example of electronic device operation] Fig. 14 is a flowchart showing an example of content output processing in electronic device MC1. This content output processing is executed by control unit 302 based on a program stored in storage unit 303. This content output processing is constantly executed at each control cycle. This content output processing will be explained with appropriate reference to Figs. 1 to 13. Note that Fig. 14 shows an example of the operation of electronic device MC1, but the same applies to the operation of other devices, such as information output device 100.

[0144] In step S601, the control unit 302 determines whether or not a setting is made to output content using the content providing service provided by the content providing server 200. This setting for content output is made by user operation or automatically. For example, content output can be turned on or off by user operation. Also, for example, a condition can be that a predetermined condition is met, for example, that the user has entered a predetermined location, for example, outside a predetermined range based on the home, during daytime hours. If a setting for content output is made, the process proceeds to step S602. On the other hand, if a setting for content output is not made, the operation of the content output process is terminated.

[0145] In step S602, the control unit 302 transmits predetermined information including the location information acquired by the location information acquisition unit 304 to the content providing server 200. The location information included in this predetermined information is sequentially stored in the location information 212 of the device information DB 210. Furthermore, the location information stored in the location information 212 of the device information DB 210 is associated with the acquisition time and stored in the movement history 214. This enables the content providing server 200 to acquire the movement history of the electronic device MC1. Furthermore, the predetermined information is transmitted with each piece of information stored in the device information DB 210 included as necessary.

[0146] In step S603, the control unit 302 determines whether a proximity condition based on a user operation is met. For example, if a content acquisition operation such as a QR code reading operation or an image acquisition operation of an object having a characteristic part is performed and predetermined information is acquired based on the content acquisition operation, it is determined that the proximity condition based on the user operation is met. If the proximity condition based on the user operation is met, the process proceeds to step S604. On the other hand, if the proximity condition based on the user operation is not met, the process proceeds to step S605.

[0147] In step S604, the control unit 302 transmits a content request to the content providing server 200 based on the user operation performed in step S604. For example, the control unit 302 executes access processing to the content providing server 200 based on access information to the content providing server 200 acquired in response to the reading operation or the image acquisition operation. Next, the control unit 302 transmits to the content providing server 200 a content request including the registration location ID and the user ID acquired in response to the reading operation or the operation image acquisition operation.

[0148] In step S605, the control unit 302 determines whether a proximity condition based on location information or communication is met. This proximity condition is determined, for example, using wireless or wired communication with another communication device. Furthermore, this proximity condition is determined, for example, using the relationship between the location of the registered location and the location of the electronic device MC1. If the proximity condition based on location information or communication is met, the process proceeds to step S606. On the other hand, if the proximity condition based on location information or communication is not met, the content output process ends.

[0149] In step S606, the control unit 302 transmits a content request to the content providing server 200 based on the proximity condition established in step S605. For example, the control unit 302 transmits a content request including a registration location ID and a user ID acquired using wireless communication or location information to the content providing server 200. Note that if the proximity condition determination process is executed in the content providing server 200, the processes of steps S603 to S606 may be omitted and the process may proceed to step S607.

[0150] In step S607, the control unit 302 determines whether or not content transmitted from the content providing server 200 in response to the content request has been received. If content has been received from the content providing server 200, the process proceeds to step S608. On the other hand, if content has not been received from the content providing server 200, monitoring continues. Note that if content has not been received from the content providing server 200 even after a predetermined time has elapsed, the content request may be transmitted to the content providing server 200 again. In addition, the content providing server 200 transmits information on the content output range 223 of the content DB 220 to the electronic device MC1 along with providing the content.

[0151] In step S608, the control unit 302 executes an output process to output the content received in step S607. For example, the control unit 302 causes the display unit 308 to display the content received in step S607. For example, as shown on the right side of FIG. 5 and in FIG. 9, the content is displayed on the display unit 308. Also, for example, the control unit 302 causes the sound output unit 309 to output the content received in step S607 as sound. For example, as shown in FIG. 9, sound information S1 is output from the sound output unit 309.

[0152] In step S609, the control unit 302 transmits predetermined information including the location information to the content providing server 200. This predetermined information is the same as the predetermined information shown in step S602.

[0153] In step S610, the control unit 302 determines whether a content stop operation has been performed. If a content stop operation has been performed, the control unit 302 stops the content output process, transmits a content stop instruction to the content providing server 200, and ends the content providing process. On the other hand, if a content stop operation has not been performed, the control unit 302 proceeds to step S611. A content stop operation is, for example, pressing an end button. Alternatively, it may be determined that a content stop operation has been performed when the electronic device MC1 passes an end post installed outside the range of the registered location. Alternatively, it may be determined that a content stop operation has been performed when the radio wave strength of the electronic device MC1 falls below a predetermined value.

[0154] In step S611, the control unit 302 determines whether the content that was the target of the output process in step S608 has fallen outside the output range. That is, if the location falls outside the range of the registered location for which the content acquisition operation was performed in step S603 or the registered location for which the proximity condition was met in step S605, the control unit 302 stops outputting the content for that registered location. Specifically, the control unit 302 determines whether the location information acquired by the location information acquisition unit 304 is within the content output range 223 of the content DB 220 received in step S607. If the location information acquired by the location information acquisition unit 304 is within the content output range 223, the control unit 302 returns to step S607. On the other hand, if the location information acquired by the location information acquisition unit 304 is outside the content output range 223, the control unit 302 ends the content output process.

[0155] [Example of content provider server operation] 15 is a flowchart showing an example of information storage processing in the content providing server 200. This information storage processing is executed by the control unit 202 based on a program stored in the storage unit 203. This information storage processing is constantly executed for each control cycle. This information storage processing will be explained with appropriate reference to FIGS. 1 to 13.

[0156] In step S621, the control unit 202 determines whether or not predetermined information has been received from each device registered for use of the content providing service. If predetermined information has been received, the process proceeds to step S622. On the other hand, if predetermined information has not been received, the operation of the information storage process ends.

[0157] In step S622, the control unit 202 stores the predetermined information received in step S621 in the device information DB 210. Specifically, the control unit 202 stores each piece of information included in the predetermined information in the device information DB 210 in association with the user ID 211 corresponding to the device that transmitted the predetermined information.

[0158] [Example of content provider server operation] 16 is a flowchart showing an example of a content providing process in the content providing server 200. This content providing process is executed by the control unit 202 and the like based on a program stored in the storage unit 203. This content providing process is constantly executed at each control cycle. This content providing process will be explained with appropriate reference to FIGS. 1 to 13.

[0159] In step S631, the determination unit 204 determines whether or not a device for which the proximity condition is met has been detected at the registered location. The process of detecting a device for which the proximity condition is met at the registered location may be executed by the content providing server 200, or may be executed based on receipt of a content request (see FIG. 14) from the electronic device MC1. If a device for which the proximity condition is met has been detected, the process proceeds to step S632. On the other hand, if a device for which the proximity condition is met has not been detected, the operation of the content providing process ends. Note that in FIG. 16, the device detected in step S631 as a device for which the proximity condition is met will be described as a target device.

[0160] In step S632, the estimation unit 205 estimates the means of transportation of the target device detected in step S631. This estimation of the means of transportation can be performed by any of the estimation methods described above.

[0161] In step S633, the content provision processing unit 206 determines the content to be output to the target device based on the transportation means estimated in step S632. Specifically, the content 225 associated with the transportation means estimated in step S632 is extracted from the transportation means 224 associated with the registered location ID 221 of the registered location where the target device detected in step S631 is located. Then, the extracted content is determined as the content to be output to the target device.

[0162] In step S634, the content provision processing unit 206 transmits the content determined in step S633 to the target device.

[0163] In step S635, the determination unit 204 determines whether the target device has moved. If the target device has moved, the process proceeds to step S636. On the other hand, if the target device has not moved, the process proceeds to step S637.

[0164] In step S636, content provision processing unit 206 determines the content to be output by the target device based on the position information of the target device after it has moved and the means of transportation estimated in step S632. For example, even if the target device is within the content output range, the content to be output can be changed in response to the movement of the target device. Note that if the target device is within the content output range and the content to be output does not change regardless of the movement of the target device, the processes of steps S635 and S636 can be omitted.

[0165] In step S637, the content providing processing unit 206 determines whether a content stop instruction has been sent from the target device. If a content stop instruction has been sent from the target device, the content transmission processing is stopped and the content providing processing operation is terminated. On the other hand, if a content stop instruction has not been sent from the target device, the process proceeds to step S638.

[0166] In step S638, determination unit 204 determines whether the target device is outside the content output range. Specifically, determination unit 204 determines whether location information 222 in device information DB 210 corresponding to the target device is within content output range 223 in content DB 220. If location information 222 in device information DB 210 corresponding to the target device is within content output range 223, the process returns to step S634. On the other hand, if location information 222 in device information DB 210 corresponding to the target device is outside content output range 223, the operation of the content providing process ends.

[0167] In this manner, in this embodiment, for example, when user U1 is traveling on foot, content for walking can be provided to user U1, and when user U1 is traveling by car C1, content for car can be provided to user U1. This makes it possible to more appropriately provide content according to each mode of transportation. Furthermore, providing content according to different modes of transportation can cause a sense of discomfort to the user, but this embodiment can reduce this sense of discomfort. Furthermore, for example, for a user traveling by car, the value of the user experience of traveling by car can be increased.

[0168] Furthermore, in this embodiment, the content to be output can be selected based on the user's means of transportation, and only the necessary content can be output, thereby reducing the load and time required for sending and receiving content from the content providing server 200 to each device, thereby improving the efficiency of the calculation load related to information processing.

[0169] In addition, the next destination provided to users can be changed depending on the means of transportation of various users gathered at one registered location, so users' movements to the next location can be dispersed. This makes it possible to avoid congestion at the registered location and also to reduce waiting times at the registered location.

[0170] In the above, an example has been shown in which the process of determining the presence of a user at a registered location, the process of estimating the user's means of transportation, and the process of providing content are executed by the content providing server 200, but all or part of each of these processes may be executed by other devices. In this case, an information processing system is configured by the devices that execute part of each of these processes. For example, at least part of each process may be executed by the electronic device MC1 used by the user U1, various information processing devices such as servers connectable via a predetermined network such as the Internet, and various electronic devices.

[0171] In addition, in this embodiment, an example is shown in which the device information DB 210 (see FIG. 3) and the content DB 220 (see FIG. 4) are managed by the content providing server 200. However, all or part of each DB may be managed by one or more devices other than the content providing server 200, and information of each DB managed by the other devices may be acquired and used for each process.

[0172] Furthermore, a part (or all) of the information processing system capable of executing the functions of the content providing server 200 may be provided by an application that can be provided via a predetermined network such as the Internet. This application is, for example, SaaS (Software as a Service).

[0173] [Configuration and Effects of This Embodiment] The information processing method according to this embodiment is an information processing method for providing information to a user U1. This information processing method includes an acquisition process (step S632) for acquiring the user U1's mode of transportation, and a provision process (steps S633 and S634) for selecting at least one of a plurality of contents set for the registered location based on the user U1's mode of transportation and providing the selected content to the user U1 when it is determined that the user U1 is present at the registered location (an example of a predetermined location).

[0174] This configuration makes it possible to provide more appropriate content suited to each mode of transportation. Furthermore, since the content to be output can be selected based on the user's mode of transportation and only the necessary content can be output, the load and time required for sending and receiving content from the content providing server 200 to each device can be reduced. This allows for more efficient computational load related to information processing.

[0175] In addition, the information processing method of this embodiment further includes a determination process (step S631) for determining whether user U1 is present at the registered location based on the establishment of a proximity condition between the registered location and the electronic device MC1 associated with user U1.

[0176] According to this configuration, it is possible to provide the content set for the registered location where the proximity condition is met, so that more appropriate content can be provided to the user.

[0177] Furthermore, in the information processing method according to this embodiment, the judgment process (step S631) judges that the proximity condition is met and determines that user U1 is present at the registered location when either the current location of electronic device MC1 is within a predetermined range based on the registered location, when the captured image acquired by electronic device MC1 contains characteristic information (e.g., characteristic part FP1) related to the registered location, or when predetermined information is exchanged between electronic device MC1 and communication device 300 installed at the registered location using wireless or wired communication.

[0178] This configuration allows for more accurate detection of the presence of user U1 at the registered location by setting more appropriate proximity conditions. Also, by setting multiple proximity conditions, it is possible to minimize environmental dependency.

[0179] Furthermore, in the information processing method according to this embodiment, in the judgment process (step S631), when the captured image contains a characteristic part FP1 of an object RO1 installed at a registered location, or when the captured image contains predetermined identification information (for example, a specific marker, an object having a characteristic part), it is judged that the captured image contains characteristic information.

[0180] According to this configuration, by using the characteristic portion FP1 or predetermined identification information of the object RO1 to determine the proximity condition, it is possible to improve the accuracy of determining the presence of the user U1.

[0181] Furthermore, in the information processing method according to this embodiment, in the acquisition process (step S632), the means of transportation of user U1 is estimated based on equipment information (for example, each piece of information in the equipment information DB210) relating to at least one of the electronic device MC1 associated with user U1 and the installed equipment installed in the means of transportation used by user U1.

[0182] According to this configuration, the means of transportation can be estimated using device information related to the electronic device MC1 or the installed device, and therefore the accuracy of estimating the means of transportation of the user U1 can be improved.

[0183] Furthermore, in the information processing method according to this embodiment, in the acquisition process (step S632), the means of transportation of user U1 is estimated based on at least one of the following equipment information: the attributes of electronic device MC1 or the installed equipment (e.g., attribute information 213) and information relating to the movement history of electronic device MC1 or the installed equipment.

[0184] According to this configuration, the means of transportation can be estimated using the attributes of the electronic device MC1 or the installed equipment, or information regarding the movement history of the electronic device MC1 or the installed equipment, thereby further improving the accuracy of estimating the means of transportation of the user U1.

[0185] Furthermore, in the information processing method according to this embodiment, the acquisition process (step S632) uses, as information relating to movement history, at least one of the following: a history of location information of the electronic device MC1 or the installed equipment (e.g., movement history 214), a history of information relating to the acceleration of the electronic device MC1 or the installed equipment (e.g., vehicle information 215), a history of captured images acquired by the electronic device MC1 or the installed equipment (e.g., image information 216), and a history relating to communication between the electronic device MC1 and the installed equipment (e.g., connection information 217).

[0186] According to this configuration, the means of transportation can be estimated using location information history, etc., as information regarding the movement history of the electronic device MC1 or the installed equipment, thereby further improving the accuracy of estimating the means of transportation of the user U1.

[0187] Furthermore, in the information processing method according to this embodiment, the plurality of contents include information about the position or direction of another registered location (second predetermined location) different from the registered location (first predetermined location) where it has been determined that user U1 is present. For example, as shown in Fig. 5, a guide image 323 can be displayed as information about the position or direction of another registered location (where building B1 is installed) different from the registered location where RO1 to RO3 are installed.

[0188] According to this configuration, it is possible to provide the user U1 who is present at the first predetermined location with information about the position or direction of the second predetermined location in an easy-to-understand manner.

[0189] Furthermore, in the information processing method according to this embodiment, in the provision process (steps S634 to S636), when it is determined that user U1 has moved to a second predetermined location, at least one of a plurality of contents set for the second predetermined location is selected and provided to user U1 based on user U1's means of transportation and the first predetermined location. For example, assume that there are multiple registered locations A to E located within a relatively close range, and registered location A is the entrance. Furthermore, assume that, for example, if the means of transportation is a car, guidance is provided from registered locations A to C to E, and if the means of transportation is walking, guidance is provided from registered locations A to B to D. In this case, for example, for a user who moves according to guidance corresponding to their means of transportation (e.g., in the case of a car: registered locations A to C to E), at least one of a plurality of contents set for the registered location after the move is selected and provided, and for a user who moves without following guidance corresponding to their means of transportation (e.g., in the case of a car: registered locations A to C to E), content other than the content set for the registered location after the move can be provided.

[0190] This configuration makes it possible to provide more appropriate content according to the movement of the user U1.

[0191] Furthermore, in the information processing method according to this embodiment, in the provision process (step S634), at least one of a plurality of second predetermined locations is selected based on the transportation means of user U1, and content related to the selected second predetermined location is provided to user U1. For example, assume that there are a plurality of registered locations A to E located within a relatively close range, and registered location A is the entrance. In this case, for example, if the transportation means is a car, guidance can be provided from registered locations A to C to E, and if the transportation means is walking, guidance can be provided from registered locations A to B to D.

[0192] According to this configuration, it is possible to provide a more appropriate second predetermined location according to the means of transportation of the user U1.

[0193] In the information processing method according to this embodiment, in the provision process (step S634), the content selected based on the transportation means of the user U1 is provided to the user U1 along with information indicating the transportation means used for the selection. For example, as shown in Fig. 5, the information indicating the transportation means is displayed in the transportation means display area 325.

[0194] According to this configuration, even if the actual means of transportation of the user U1 does not match the estimation result, the user U1 can easily understand this, and therefore, the sense of discomfort felt by the content can be reduced.

[0195] In the information processing method according to the present embodiment, the content is at least one of audio information and image information. For example, as shown in Figures 9 and 10, both audio information and image information can be output.

[0196] According to this configuration, at least one of audio information and image information can be provided to the user U1 as content at the registration location, thereby realizing information transmission that is easy for the user to understand.

[0197] Furthermore, in the information processing method according to this embodiment, in the provision process (see FIG. 12), even when the proximity condition is not met in the determination process, at least one of the location information of other devices present around user U1, the location information of the registered location, and the travel route to the registered location corresponding to user U1's means of transportation is provided to user U1 based on the location information of user U1.

[0198] According to this configuration, when the user U1 heads to a registered location, the user U1 can easily grasp each piece of information related to the registered location.

[0199] Furthermore, in the information processing method according to this embodiment, in the provision process (see FIG. 13), when user U1 is not present at the registered location and performs a designation operation to specify the registered location, at least one of the following is provided to user U1: at least one of the multiple contents set for the registered location, the travel range or travel route according to the means of transportation associated with the registered location, location information of other devices present around the registered location, location information of the registered location, and the travel route to the registered location corresponding to user U1's means of transportation.

[0200] According to this configuration, even when the user U1 is not at the registered location, the user U1 can easily grasp each piece of information related to the registered location.

[0201] Furthermore, the content providing server 200 (an example of an information processing device) according to this embodiment is an information processing device that provides information to the user U1. The content providing server 200 includes an estimation unit 205 (an example of an acquisition unit) that acquires the transportation means of the user U1, and a content providing processing unit 206 (an example of a provision unit) that, when it is determined that the user U1 is present at a registered location (an example of a predetermined location), selects at least one of a plurality of contents set for the registered location based on the transportation means of the user U1 and provides the selected content to the user U1.

[0202] This configuration makes it possible to provide appropriate content suited to each mode of transportation. Furthermore, since the content to be output can be selected based on the user's mode of transportation and only the necessary content can be output, the load and time required for sending and receiving content from the content providing server 200 to each device can be reduced. This allows for more efficient computational load related to information processing.

[0203] Note that each processing procedure shown in this embodiment is an example for realizing this embodiment, and the order of some of the processing procedures may be changed within the scope that makes it possible to realize this embodiment, and some of the processing procedures may be omitted or other processing procedures may be added.

[0204] Note that each process described in this embodiment is executed based on a program that causes a computer to execute each processing procedure. Therefore, this embodiment can also be understood as an embodiment of a program that realizes the function of executing each process and a recording medium that stores the program. For example, an update process for adding a new function to the contact determination device can store the program in the storage device of the contact determination device. This makes it possible to cause the updated contact determination device to perform each process described in this embodiment.

[0205] Although the embodiments of the present invention have been described above, the above embodiments merely illustrate some of the application examples of the present invention, and it is not intended that the technical scope of the present invention be limited to the specific configurations of the above embodiments.

Claims

1. An information processing method in which an information processing device provides information to a user, an acquisition step of acquiring a means of transportation of the user; a providing step of selecting at least one of a plurality of contents set for the predetermined place based on the user's means of transportation when it is determined that the user is present at the predetermined place, and providing the selected content to the user; In the providing step, at least one of a plurality of second predetermined locations, which is the predetermined location different from the first predetermined location, where it is determined that the user is present, is selected based on the user's means of transportation, and content related to the selected second predetermined location is provided to the user. Information processing methods.

2. 2. The information processing method according to claim 1, In the providing step, when it is determined that the user has moved to the second predetermined location, at least one of a plurality of contents set for the second predetermined location is selected based on the user's means of transportation and the first predetermined location, and the selected content is provided to the user. Information processing methods.

3. 2. The information processing method according to claim 1, the plurality of contents includes information regarding a position or a direction of the second predetermined location; Information processing methods.

4. 2. The information processing method according to claim 1, and determining whether the user is present at the predetermined location based on whether a proximity condition is satisfied between the predetermined location and an electronic device associated with the user. Information processing methods.

5. 5. The information processing method according to claim 4, In the determination step, it is determined that the proximity condition is met and that the user is present at the predetermined location when any of the following cases occurs: the current location of the electronic device is within a predetermined range based on the predetermined location; the captured image acquired by the electronic device includes feature information about the predetermined location; or predetermined information is exchanged between the electronic device and a communication device installed at the predetermined location using wireless communication or wired communication. Information processing methods.

6. 6. The information processing method according to claim 5, In the determining step, When a characteristic part of an object installed at the predetermined location is included in the captured image, or when predetermined identification information is included in the captured image, it is determined that the characteristic information is included in the captured image. Information processing methods.

7. 2. The information processing method according to claim 1, In the obtaining step, the transportation means of the user is estimated based on device information related to at least one of an electronic device associated with the user and an installed device installed in the transportation means used by the user. Information processing methods.

8. 8. The information processing method according to claim 7, In the obtaining step, the means of transportation of the user is estimated based on at least one of attributes of the electronic device or the installed device and information on a movement history of the electronic device or the installed device, as the device information. Information processing methods.

9. 9. The information processing method according to claim 8, In the acquiring step, at least one of a history of location information of the electronic device or the installed device, a history of information on acceleration of the electronic device or the installed device, a history of captured images acquired by the electronic device or the installed device, and a history of communication between the electronic device and the installed device is used as the information on the movement history. Information processing methods.

10. 10. An information processing method according to claim 1, In the providing step, information indicating the means of transportation used for the selection is provided to the user together with the content selected based on the means of transportation of the user. Information processing methods.

11. 10. An information processing method according to claim 1, The content is at least one of audio information and image information. Information processing methods.

12. 7. An information processing method according to claim 4, further comprising: In the providing step, when the proximity condition is not established in the determining step, at least one of location information of other devices present around the user, location information of the predetermined location, and a travel route to the predetermined location corresponding to the user's means of transportation is provided to the user based on location information of the user. Information processing methods.

13. 10. An information processing method according to claim 1, In the providing step, when the user is not present at the predetermined location and a designation operation for designating the predetermined location is performed by the user, at least one of the plurality of contents set for the predetermined location, a travel range or a travel route corresponding to a means of transportation related to the predetermined location, location information of other devices present around the predetermined location, location information of the predetermined location, and a travel route to the predetermined location corresponding to the means of transportation of the user is provided to the user. Information processing methods.

14. An information processing device including a controller capable of executing a process of providing information to a user, The controller an acquisition unit that acquires the user's means of transportation; a providing unit that, when it is determined that the user is present at a predetermined location, selects at least one of a plurality of contents set for the predetermined location based on the user's means of transportation and provides the selected content to the user; the providing unit selects, based on the user's means of transportation, at least one of a plurality of second predetermined locations that are other predetermined locations different from the first predetermined location that is the predetermined location where it has been determined that the user is present, and provides the user with content related to the selected second predetermined location. Information processing device.

Images