Information processing method and information processing device

Abstract

This information processing method provides information to a user. This information processing method includes an acquisition process for acquiring a movement means of a user, and a provision process for, when it is determined that the user is present in a prescribed location, selecting and providing to the user at least one item of content from a plurality of content having been set for the prescribed location on the basis of the movement means of the user.

Description

Information processing method and information processing device

[0001] The present invention relates to an information processing method and an information processing device for providing information to a user.

[0002] Conventionally, there are technologies for displaying maps and tourist spots on a terminal carried by a user. For example, JP2020-123082A discloses a technology for displaying an augmented reality screen of the current location of a user terminal when the augmented reality screen displays a guide to tourist spots on the user terminal.

[0003] Even when an augmented reality screen of the current location of a user terminal is displayed as in the conventional technology described above, it is conceivable that unnecessary information may be displayed on the user terminal depending on the user's mode of transportation. For example, if the user is traveling by car, information intended for walking may be displayed on the user terminal. In such cases, the user may feel uncomfortable. Furthermore, unnecessary information provision processing occurs, which increases the amount of calculation required by the content providing device.

[0004] The present invention aims to provide more appropriate content depending on the user's means of transportation and to improve the efficiency of the computational load related to information processing.

[0005] One aspect of the present invention is an information processing method for providing information to a user, the information processing method including: an acquisition process for acquiring a mode of transportation of the user; and a provision process for selecting at least one of a plurality of contents set for the predetermined location based on the mode of transportation of the user when it is determined that the user is present at the predetermined location, and providing the selected content to the user.

[0006] FIG. 1 is a diagram illustrating an example of the system configuration of an information processing system. FIG. 2 is a block diagram illustrating an example of the functional configuration of a content providing server and an electronic device. FIG. 3 is a diagram schematically illustrating each piece of information stored in a device information DB. FIG. 4 is a diagram schematically illustrating each piece of information stored in a content DB. FIG. 5 is a diagram illustrating an example of transitions of display screens displayed on a display unit of an electronic device. FIG. 6 is a diagram illustrating, in a simplified form, means of transportation that a user may use. FIG. 7 is a diagram illustrating, in a simplified form, an example of the relationship between a route to a registered location and major means of transportation. FIG. 8 is a diagram illustrating, in a simplified form, the relationship between registered locations managed by a content providing server and a user's means of transportation. FIG. 9 is a diagram illustrating an example of output of content provided to a user by a content providing server when the user's means of transportation is walking. FIG. 10 is a diagram illustrating an example of output of content provided to a user by a content providing server when the user's means of transportation is a car. FIG. 11 is a diagram illustrating an example of output of content according to the user's means of transportation. FIG. 12 is a diagram illustrating an example of a content display screen displayed on a display unit of an electronic device. FIG. 13 is a diagram illustrating an example of a content display screen displayed on a display unit of an electronic device. Fig. 14 is a flowchart showing an example of a content output process in an electronic device, Fig. 15 is a flowchart showing an example of an information storage process in a content providing server, and Fig. 16 is a flowchart showing an example of a content providing process in a content providing server.

[0007] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0008] [Configuration Example of Information Processing System] FIG. 1 is a diagram illustrating an example of the system configuration of an information processing system 10. The information processing system 10 is a communication system that executes a process of providing various content to users registered in a content providing server 200. It is assumed that user U1 owns a car C1. It is also assumed that user U1 may use various modes of transportation, such as walking, train TR1, bus BU1, motorcycle M1, bicycle BC1, boat SH1, and airplane AP1. For ease of explanation, FIG. 1 illustrates an electronic device MC1 as an example of a device owned by user U1. However, this is not limited to this, and an in-vehicle device, a device carried in a vehicle, or a device wearable by user U1 may also be used. It is also assumed that train TR1, bus BU1, motorcycle M1, bicycle BC1, boat SH1, and airplane AP1 are illustrated as examples of each mode of transportation, but multiple modes of transportation may be used, or other modes of transportation may also be used.

[0009] The information processing system 10 is composed of multiple devices connected via a network 20. For example, a control device 50, an information output device 100, a content providing server 200, a communication device 300, and an electronic device MC1 are connected via the network 20. Note that communication between these devices is performed using wired communication or wireless communication. Furthermore, communication between these devices may be performed directly between the devices in addition to communication via the network 20. Note that communication devices may be installed in at least one of the train TR1, bus BU1, motorcycle M1, bicycle BC1, ship SH1, airplane AP1, and object RO1. In this case, the communication devices installed therein are connected to the content providing server 200, etc. via the network 20.

[0010] The control device 50 and the information output device 100 are in-vehicle devices installed in the automobile C1. The control device 50 acquires, for example, vehicle information about the automobile C1 and user information about the occupants of the automobile C1, and transmits the acquired information to the content providing server 200. For example, the vehicle information and user information are acquired using various sensors installed in the automobile C1.

[0011] The information output device 100 is a device capable of outputting content transmitted from the content providing server 200. The information output device 100 is realized by, for example, a tablet terminal, a car navigation device, or an IVI (In-Vehicle Infotainment). An example of content output is shown in FIG. 10 .

[0012] The content providing server 200 is an information presentation device that provides a content providing service to the user U1 that provides content set for a registered location. To use this content providing service, the user U1 must register to use the content providing service. The registered location is a location where predetermined content is provided by the content providing server 200, and is managed by the content DB 220 (see Figures 2 and 4). The registered location may be, for example, a park, a theme park, an amusement park, a shopping mall, a tourist spot, etc. Furthermore, an object or device for detecting the presence of the user U1 is installed at the registered location. For example, an object RO1 or a communication device 300 is installed. The configuration of the content providing server 200 will be described in detail with reference to Figure 2, etc.

[0013] The communication device 300 is a device installed at a registered location managed by the content providing server 200. The communication device 300 communicates with surrounding electronic devices using wireless or wired communication, and transmits the communication results to the content providing server 200. For example, when predetermined information is exchanged between the communication device 300 and the electronic device MC1 using wireless or wired communication, the communication device 300 determines that predetermined communication has been established between the electronic device MC1 and the communication device 300, and transmits the determination result to the content providing server 200. This enables the content providing server 200 to determine that a user U1 carrying the electronic device MC1 is present in the vicinity of the registered location where the communication device 300 is installed.

[0014] The object RO1 is an object installed in a registered location managed by the content providing server 200. Furthermore, a characteristic portion FP1 is provided in at least a part of the exterior of the object RO1. For example, if the registered location is a park, the park's entrance gate or the like can be the object RO1. Furthermore, if the registered location is a parking lot equipped with charging facilities for electric vehicles, a charging stand or the like can be the object RO1. Examples of this are shown in FIGS. 8 to 10 .

[0015] The characteristic portion FP1 is a portion having identification information capable of identifying the registered location, the object RO1 installed at the registered location, and other objects or buildings installed around the registered location. This identification information can be identified, for example, from a captured image captured by the electronic device MC1. Examples of the identification information include a QR code (registered trademark) or a specific marker. The specific marker is a marker from which specific information, such as a registered location ID (see FIG. 4), can be obtained through object recognition processing. For example, the electronic device MC1 captures an image of the object RO1 so that the characteristic portion FP1 is included in the captured image, thereby acquiring the captured image including the characteristic portion FP1. Next, the electronic device MC1 acquires the identification information based on the characteristic portion FP1 included in the captured image. A known acquisition method can be used to acquire this identification information. Next, the electronic device MC1 transmits the acquired identification information to the content providing server 200. This enables the content providing server 200 to determine that the user U1 carrying the electronic device MC1 is present around the registered location where the object RO1 is installed.

[0016] The electronic device MC1 is a portable information processing device owned by the user U1, such as a smartphone, a tablet terminal, a portable personal computer, etc. The electronic device MC1 is also capable of outputting content transmitted from the content providing server 200. The configuration of the electronic device MC1 will be described in detail with reference to FIG. 2 etc.

[0017] [Configuration Example of Content Providing Server and Electronic Device] FIG. 2 is a block diagram showing a functional configuration example of the content providing server 200 and the electronic device MC1.

[0018] The content providing server 200 includes a communication unit 201, a control unit 202, a storage unit 203, a determination unit 204, an estimation unit 205, and a content providing processing unit 206. The control unit 202, the determination unit 204, the estimation unit 205, and the content providing processing unit 206 are realized by a controller capable of executing a process of providing information to the user U1.

[0019] The communication unit 201 exchanges various types of information with other devices using wired or wireless communication under the control of the control unit 202 .

[0020] The control unit 202 controls each unit based on various programs stored in the storage unit 203. The control unit 202 is realized by a processing device such as a CPU (Central Processing Unit).

[0021] The storage unit 203 is a storage medium that stores various types of information. For example, the storage unit 203 stores various types of information (e.g., a control program, a map information DB, a device information DB 210, and a content DB 220) required for the control unit 202 to perform various processes. The storage unit 203 also stores various types of information acquired via the communication unit 201. The storage unit 203 may be, for example, a read-only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), a solid state drive (SSD), or a combination thereof. The device information DB 210 and the content DB 220 will be described in detail with reference to FIGS. 3 and 4.

[0022] The determination unit 204 determines, under the control of the control unit 202, whether a user using the content provision service is present at a registered location and outputs the determination result to the estimation unit 205. For example, the determination unit 204 determines whether the user U1 is present at the registered location based on the establishment of a proximity condition between the communication device 300 installed at the registered location and the electronic device MC1 associated with the user U1. Furthermore, for example, the determination unit 204 determines whether the user U1 is present at the registered location based on the establishment of a proximity condition between the object RO1 installed at the registered location and the electronic device MC1 associated with the user U1. For example, the determination unit 204 determines whether the proximity condition is established and whether the user U1 is present at the registered location if the current location of the electronic device MC1 is within a predetermined range based on the registered location. Furthermore, for example, the determination unit 204 determines whether the proximity condition is established and whether the user U1 is present at the registered location if the captured image acquired by the electronic device MC1 includes feature information about the registered location, such as the feature portion FP1. Furthermore, for example, when predetermined information is exchanged between the electronic device MC1 and the communication device 300 using wireless or wired communication, the determination unit 204 determines that the proximity condition is met and determines that the user U1 is present at the registered location. The determination unit 204 is realized by a processing device such as a CPU. These determination methods will be described in detail with reference to FIGS. 4, 7, etc.

[0023] The estimation unit 205, under the control of the control unit 202, estimates the mode of transportation of a user determined by the determination unit 204 to be present at a registered location, and outputs the estimation result to the content provision processing unit 206. For example, the estimation unit 205 estimates the mode of transportation of user U1 based on device information regarding at least one of the electronic device MC1 associated with user U1 and the installed device installed in the mode of transportation used by user U1. This device information can estimate the mode of transportation of user U1 based on at least one of the attributes of the electronic device MC1 or the installed device and information regarding the travel history of the electronic device MC1 or the installed device. The estimation unit 205 is realized by a processing device such as a CPU. These estimation methods will be described in detail with reference to Figures 5, 6, etc.

[0024] The content providing processing unit 206 uses the device information DB 210 and the content DB 220 to perform processing to provide content according to the means of transportation estimated by the estimation unit 205 to a user who is determined by the determination unit 204 to be present at a registered location. The content providing processing unit 206 is realized by a processing device such as a CPU. The content providing processing will be described in detail with reference to Figures 8 to 13, etc.

[0025] The electronic device MC1 includes a communication unit 301, a control unit 302, a memory unit 303, a location information acquisition unit 304, a sound acquisition unit 305, an image acquisition unit 306, an operation reception unit 307, a display unit 308, and a sound output unit 309.

[0026] The communication unit 301 exchanges various types of information with other devices using wired or wireless communication under the control of the control unit 302 .

[0027] The control unit 302 controls each unit based on various programs stored in the storage unit 303. The control unit 302 is realized by a processing device such as a CPU.

[0028] The storage unit 303 is a storage medium that stores various types of information. For example, the storage unit 303 stores various types of information (e.g., control programs) required for the control unit 302 to perform various processes. The storage unit 303 also stores various types of information acquired via the communication unit 301. The storage unit 303 can be, for example, a ROM, a RAM, an HDD, an SSD, or a combination thereof.

[0029] The location information acquisition unit 304 acquires location information regarding the location of the electronic device MC1 and outputs the acquired location information to the control unit 302. For example, it can be realized by a GNSS receiver that acquires location information using a Global Navigation Satellite System (GNSS). The location information includes data regarding the location, such as latitude, longitude, and altitude, at the time of receiving the GNSS signal. The location information may also be acquired using other location information acquisition methods. For example, the location information may be derived using information from nearby access points or base stations. The location information may also be acquired using a beacon.

[0030] The sound acquisition unit 305 acquires sounds around the electronic device MC1 under the control of the control unit 302, and outputs information about the acquired sounds to the control unit 302. As the sound acquisition unit 305, for example, one or more microphones or sound acquisition sensors can be used.

[0031] The image acquisition unit 306 captures an image of a subject and generates an image (image data) based on the control of the control unit 302, and outputs information about the generated image to the control unit 302. The image acquisition unit 306 is configured by, for example, one or more camera devices or image sensors capable of capturing an image of a subject.

[0032] The operation receiving unit 307 receives operations from the user and outputs the received operation contents to the control unit 302 .

[0033] The display unit 308 displays various images based on the control of the control unit 302. The display unit 308 may be, for example, a display panel such as an organic EL (Electro Luminescence) panel or an LCD (Liquid Crystal Display) panel. The operation reception unit 307 and the display unit 308 may be configured as a touch panel that allows a user to input operations by touching or approaching the display surface with their finger, or may be configured as a separate user interface. FIGS. 5 , 9 , 11 to 13 show examples in which the operation reception unit 307 and the display unit 308 are touch panels.

[0034] The sound output unit 309 outputs sound to the outside of the electronic device MC1 based on the control of the control unit 302. For example, one or more speakers can be used as the sound output unit 309. Note that the operation reception unit 307, the display unit 308, and the sound output unit 309 are examples of user interfaces, and some of these may be omitted, or other user interfaces may be used.

[0035] [Example of Device Information DB Contents] Fig. 3 is a diagram schematically showing each piece of information stored in the device information DB 210. The device information DB 210 is a database for managing device information related to devices (including electronic device MC1, control device 50, and information output device 100) owned by users (including user U1) who use the content providing service.

[0036] The device information DB 210 stores location information 212, attribute information 213, movement history 214, vehicle information 215, image information 216, connection information 217, and payment information 218 in association with a user ID 211. Note that some of this information is sequentially transmitted from the control device 50 or information output device 100 installed in the electronic device MC1 or the automobile C1 to the content providing server 200 and stored therein. Information transmitted from devices installed in other means of transportation may also be sequentially stored in the content providing server 200.

[0037] The user ID 211 is identification information for identifying a user who uses the content providing service. For example, "U01" is stored in the user ID 211 as the user ID of user U1.

[0038] The location information 212 is information indicating the location of the user corresponding to the user ID 211. For example, the current location of each user is acquired using various sensors, such as a location information acquisition unit, installed in the electronic device carried by each user, and information associating the latitude and longitude of this current location with the time of acquisition is transmitted to the content providing server 200 and stored in the location information 212. The current location of each user can be identified based on the location information 212.

[0039] The attribute information 213 is information indicating the attributes of devices managed by the device information DB 210. For example, if a device managed by the device information DB 210 is a smartphone, this fact is stored, and if a device managed by the device information DB 210 is an in-vehicle device, this fact is stored.

[0040] The movement history 214 is information indicating the movement trajectory of the user corresponding to the user ID 211. For example, information associating the position stored in the position information 212 with the acquisition time of this position information is stored in the movement history 214 as the movement trajectory.

[0041] The vehicle information 215 is information stored when the device managed by the device information DB 210 is an on-board device, and includes various information related to the vehicle. For example, the history of detection information from each sensor installed in the vehicle C1, such as an acceleration sensor, is stored. Also, for example, if the vehicle C1 is an electric vehicle, information on the amount of charge or remaining electricity of the vehicle C1 is stored. Also, for example, if the vehicle C1 is an engine vehicle, information on the remaining fuel in the vehicle C1 is stored.

[0042] The image information 216 is information about images captured by an image capture unit, such as a camera, installed in the device corresponding to the user ID 211. For example, captured images captured by the image capture unit are transmitted to the content providing server 200 and stored in the image information 216. For example, a history of captured images captured within a predetermined period of time is stored in the image information 216. Based on the image information 216, it is possible to identify the situation around the electronic device MC1, the situation inside each means of transportation, the situation outside each means of transportation, etc.

[0043] The connection information 217 is information that indicates a communication history when communication is established between a device managed by the device information DB 210 and another communication device. In other words, by referring to the connection information 217, it is possible to identify a communication device to which a device managed by the device information DB 210 is connected.

[0044] The payment information 218 is information related to the settlement of an electronic payment when the payment is made by a device managed by the device information DB 210. For example, the history of each payment information acquired within a predetermined period of time is stored in the payment information 218. In other words, by referring to the payment information 218, it is possible to identify the timing when a payment was made by a device managed by the device information DB 210 and the device that made the payment.

[0045] 4 is a diagram showing a schematic diagram of each piece of information stored in the content DB 220. The content DB 220 is a database for managing content to be provided to users who are present around a registered location managed by the content providing server 200.

[0046] The content DB 220 stores location information 222 , content output range 223 , transportation means 224 , and content 225 in association with a registration location ID 221 .

[0047] The registered location ID 221 is identification information for identifying a registered location where content is provided to a user who uses the content providing service. For example, "PL01" is stored in the registered location ID 221 as the registered location ID of objects RO1 to RO3 (see FIG. 8). Also, for example, "PL02" is stored in the registered location ID 221 as the registered location ID of building B1 (see FIG. 8).

[0048] The location information 222 is information indicating the location of a registered location to which content is to be provided. For example, the latitude and longitude of the registered location are stored in the location information 222. The location of the registered location can be identified based on the location information 222. Note that one piece of location information may be set for one registered location, or multiple pieces of location information may be set for one registered location.

[0049] The content output range 223 is information indicating the range within which content corresponding to the registered location is provided. For example, the content output range 223 may be a predetermined range based on the location of the registered location. This predetermined range may be, for example, a circular range with a predetermined radius centered on the location of the registered location, or may be an area related to the registered location, such as the park itself.

[0050] The means of transportation 224 is information indicating the means of transportation of users who use the content providing service. For example, the means of transportation that each user is expected to use is stored in the means of transportation 224.

[0051] The content 225 is content provided to users who use the content providing service. Specifically, for one registered location ID 221, content corresponding to a plurality of means of transportation 224 is stored in the content 225.

[0052] [Example of Proximity Condition Establishment Determination] Here, an example of determining whether user U1 is present at a registered location whose registered location ID is stored in the registered location ID 221, i.e., an example of determining whether the proximity condition is established, is described. For example, an example is shown in which user U1 is determined to be present at a registered location when a proximity condition is established between the location of the registered location or a device installed at the registered location and the electronic device MC1 owned by user U1. Note that this example illustrates an example of determining whether user U1 is present at the registered location RL1 based on the establishment of a proximity condition for the electronic device MC1 owned by user U1, but the same is applicable to cases where devices other than the electronic device MC1 are used. Note that the device installed at the registered location may be, for example, a communication device capable of communicating with the electronic device MC1 via wired or wireless communication, or an object installed at the registered location that has a characteristic portion. Note that the object that has a characteristic portion is, for example, an object RO1 that has a characteristic portion FP1 (see FIGS. 1, 8 to 10).

[0053] [Example of Determination Using Location Information] First, an example of determination using location information to determine whether a user is present at a registered location will be described.

[0054] Specifically, the determination unit 204 (see FIG. 2 ) of the content providing server 200 extracts user IDs 211 whose location information 212 in the device information DB 210 is present within a predetermined range based on location information 222 in the content DB 220. That is, the determination unit 204 extracts devices present around the registered location. Then, if the location information 212 in the device information DB 210 contains location information that is present within the predetermined range, the determination unit 204 determines that the user with the user ID 211 corresponding to that location information is present around the registered location. Note that the determination process using the location information may be performed by the electronic device MC1. In this case, the electronic device MC1 transmits a content request to the content providing server 200 based on the establishment of the proximity condition.

[0055] [Example of Determination Using Communication] Next, an example of determination using communication to determine whether a user is present at a registered location will be described.

[0056] Specifically, the determination unit 204 (see FIG. 2 ) of the content providing server 200 identifies electronic devices connected to a communication device installed at a registration location corresponding to the registration location ID 221 of the content DB 220 using wireless or wired communication, based on connection information from the communication device. For example, when device identification information or a user ID for identifying the connected device is exchanged through communication between devices, the connection information can include the device identification information or the user ID for identifying the connected electronic device. Note that the connection information may be sent to the content providing server 200 from the electronic device that has exchanged with the communication device. Note that the determination process using communication may be performed by the electronic device MC1. In this case, the electronic device MC1 sends a content request to the content providing server 200 based on the establishment of the proximity condition.

[0057] For example, assume that a router capable of using Wi-Fi for wireless communication is installed in a registered location. In this case, after a predetermined exchange takes place between the router and an electronic device owned by a user, the electronic device is connected to the router. In this way, when the electronic device is connected to the router, the router transmits connection information regarding the connected electronic device to the content providing server 200. Alternatively, the electronic device transmits connection information regarding the router to the content providing server 200. This allows the content providing server 200 to know that the user who owns the electronic device is located near the registered location where the router is installed.

[0058] Also, for example, assume that a communication device capable of using Bluetooth (registered trademark) for wireless communication is installed at a registered location. This communication device is capable of, for example, transmitting a beacon signal including registration location information regarding the registration location. In this case, when an electronic device carried by a user receives the beacon signal transmitted by the communication device, the electronic device can acquire the registration location information included in the beacon signal. In this way, when the electronic device receives the beacon signal, the electronic device transmits the registration location information included in the beacon signal to the content providing server 200. This allows the content providing server 200 to know that the user carrying the electronic device is present in the vicinity of the registered location where the communication device is installed.

[0059] Furthermore, for example, if a communication device capable of wirelessly using visible light communication is installed at a registered location, the user's presence around the registered location where the communication device is installed can be determined using visible light communication. Visible light communication is a wireless communication method that uses electromagnetic waves in the visible light band visible to the human eye. Furthermore, information can be output from the vehicle C1 by controlling the wavelength and frequency of the vehicle's LEDs and headlights, and the vehicle C1 can acquire information from the communication device at the registered location using the vehicle's onboard camera. This allows the content providing server 200 to determine that the user U1 in the vehicle C1 is located around the registered location where the communication device is installed. For example, while QR codes are displayed on the exterior of objects, there may be registered locations where QR codes should not be displayed in order to preserve the aesthetic appearance of the object. Even in such cases, visible light communication can be performed using streetlights, etc.

[0060] [Example of Determination Using Feature Information] Next, an example of determination using feature information to determine whether a user is present at a registered location will be described.

[0061] Specifically, the user U1 acquires feature information of an object installed at a registered location using the image acquisition unit 306 of the electronic device MC1. For example, the user U1 acquires an image of the feature portion FP1 of the object RO1 using the image acquisition unit 306 of the electronic device MC1. Next, the control unit 302 of the electronic device MC1 acquires access information to the content providing server 200 and identification information related to the registered location where the object RO1 is installed based on the image of the feature portion FP1. Next, the control unit 302 of the electronic device MC1 accesses the content providing server 200 based on the access information and transmits the identification information related to the registered location where the object RO1 is installed. This allows the content providing server 200 to determine that the user U1, who is carrying the electronic device MC1, is located near the registered location where the object RO1 is installed.

[0062] While this example illustrates a case in which the object RO1 has a feature portion FP1 on its exterior, the feature information may instead be the shape of an object installed at a registered location, or the scenery of the registered location. In this case, determination information for determining each piece of feature information may be stored in the electronic device MC1 or the content providing server 200, and the determination information may be used to acquire each piece of feature information. For example, location information and the shape of an object may be associated and registered in advance as determination information. For example, an ABC region may be associated with a Buddhist statue at a temple (registered location) within the region and registered in advance. In this case, it is possible to determine that the electronic device MC1 is located in the ABC region based on the location information of the electronic device MC1. Furthermore, if a captured image acquired by the image acquisition unit 306 of the electronic device MC1 while the electronic device MC1 is located in the ABC region includes a Buddhist statue, the Buddhist statue registered in association with the ABC region and the Buddhist statue included in the captured image are compared to determine whether they match. If they match, it is possible to determine that the electronic device MC1 is located at the temple.

[0063] Furthermore, while this example illustrates an example in which an image is used as the feature information, a specific sound may also be used as the feature information. This specific sound is sound information from which specific information can be obtained. For example, a sound-generating device installed at the registered location outputs a specific sound as feature information, and the sound acquisition unit 305 of the electronic device MC1 acquires this specific sound. Next, the control unit 302 of the electronic device MC1 acquires access information to the content providing server 200 and identification information regarding the registered location where the object RO1 is installed based on the specific sound. Next, the control unit 302 of the electronic device MC1 accesses the content providing server 200 based on the access information and transmits the identification information regarding the registered location where the object RO1 is installed. This allows the content providing server 200 to determine that the user U1 carrying the electronic device MC1 is present around the registered location where the object RO1 is installed.

[0064] The above-described determination example is merely an example, and other determination methods may be used. Furthermore, the above-described determination methods may be combined. For example, the accuracy of determination can be improved by using two or more determination methods.

[0065] [Example of Acquiring Transportation Mode] Next, an example of acquiring the user's transportation mode will be described. First, an example of acquiring the user's transportation mode based on a user operation will be shown.

[0066] [Example of Selection of Transportation Means Using Electronic Device] Fig. 5 is a diagram showing an example of transition of a display screen displayed on the display unit 308 of the electronic device MC1. Fig. 5 shows an example in which the user U1 travels to the registered location on foot.

[0067] 5 shows an example of a selection screen 310 for selecting a mode of transportation for user U1. The selection screen 310 is displayed when a proximity condition between the electronic device MC1 and the registered location is met. Note that this example shows an example in which the mode of transportation for user U1 is selected by manual operation, but if the mode of transportation for user U1 is to be estimated automatically, the display of the selection screen 310 is omitted.

[0068] The selection screen 310 displays selection buttons 311 to 319 for selecting the user U1's mode of transportation. The user U1 performs a pressing operation of pressing a selection button corresponding to the user's mode of transportation from among the selection buttons 311 to 319. In the example shown in FIG. 5 , the user U1 travels to the registered location on foot, so the user U1 performs a pressing operation of pressing the selection button 311. When this pressing operation is performed, the control unit 302 transmits to the content providing server 200 mode of transportation information indicating the mode of transportation corresponding to the selection button 311. By receiving this mode of transportation information, the content providing server 200 can acquire the mode of transportation of the user U1. The content providing server 200 then provides the electronic device MC1 with content corresponding to the mode of transportation of the user U1. The electronic device MC1 outputs the content provided by the content providing server 200. For example, a content display screen 320 shown on the right side of FIG. 5 is displayed on the display unit 308.

[0069] On the right side of FIG. 5, an example of a content display screen 320 is shown that displays content according to the means of transportation selected in response to the selection operation of the selection buttons 311 to 319 on the selection screen 310 .

[0070] The content display screen 320 is provided with an image display area 321, a message display area 324, and a means of transportation display area 325. In the image display area 321, a captured image acquired by the image acquisition unit 306 is superimposed with a human figure image 322 corresponding to the means of transportation selected using the selection screen 310, and a guide image 323 that guides the user to the registered location that is the display target for the next content related to the current registered location.

[0071] The message display area 324 displays messages such as information about the current registered location, information about the position and direction of the registered location where the next content related to the current registered location will be displayed, and the like.

[0072] The transportation mode display area 325 displays information indicating the transportation mode selected using the selection screen 310. FIG. 5 shows an example in which the words "for pedestrians" 326 and a sign image 327 indicating a pedestrian are displayed in the transportation mode display area 325. By viewing the display in the transportation mode display area 325, the user U1 can easily understand that the content displayed on the electronic device MC1 is "for pedestrians." In this way, by notifying the user during or before content output which transportation mode the content output is intended for, the user U1 can easily understand whether the content is suitable for their transportation mode, even if the transportation mode cannot be correctly estimated.

[0073] [Example of Estimating Transportation Means Using Location Information, etc.] Next, an example of estimating the transportation means of the user U1 using the location information, etc. acquired by the location information acquisition unit 304 of the electronic device MC1 will be described.

[0074] 6 is a simplified diagram showing possible modes of transportation that user U1 may use. Examples of modes of transportation shown in Fig. 6 include an airplane AP1 flying in the sky, a train TR1 running on a railway line RP1, a car C1, a bus BU1, a motorcycle M1, and a bicycle BC1 running on roadway RD1, user U1 walking on sidewalk SW1 installed along roadway RD1, and a boat SH1 traveling on river RV1.

[0075] [Example of Estimation Using Movement History] The estimation unit 205 (see FIG. 2) can acquire the movement history of the electronic device MC1 using the location information 212 and movement history 214 in the device information DB 210. Based on the movement history of the electronic device MC1 and the map information stored in the map information DB of the storage unit 203, the estimation unit 205 selects a route on the map that matches the movement history of the electronic device MC1. For example, if the movement history of the electronic device MC1 matches a railroad RP1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is a train. Furthermore, if the movement history of the electronic device MC1 matches a river RV1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is a boat. Furthermore, if the movement history of the electronic device MC1 matches a sidewalk SW1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is walking. Furthermore, if the movement history of the electronic device MC1 matches the roadway RD1, the estimation unit 205 estimates that the means of transportation of the user U1 who owns the electronic device MC1 is some kind of vehicle traveling on the roadway RD1. In this case, the type of vehicle traveling on the roadway RD1 can be estimated using the following speed and other factors.

[0076] [Example of Estimation Using Travel Distance or Travel Speed] The estimation unit 205 (see FIG. 2) can calculate the travel speed of the electronic device MC1 based on the location information 212 and travel history 214 in the device information DB 210. For example, the estimation unit 205 can use location information acquired at predetermined intervals, for example, one-minute intervals, to calculate the travel distance per unit time between the location information, for example, one minute. Furthermore, for example, the estimation unit 205 can use the location information acquired at predetermined intervals to calculate the travel distance between the location information and calculate the travel speed by dividing the travel distance by the interval. Therefore, the estimation unit 205 uses the location information of the electronic device MC1 to calculate at least one of the travel distance and travel speed of the user U1 who owns the electronic device MC1, and estimates the user U1's means of transportation based on the travel distance or travel speed.

[0077] For example, if the travel distance per minute is less than TH1 m, the estimation unit 205 estimates that the user U1's mode of transportation is walking. Furthermore, if the travel distance per minute is equal to or greater than TH1 m and less than TH2 m, the estimation unit 205 estimates that the user's mode of transportation is a bicycle. Furthermore, if the travel distance per minute is equal to or greater than TH2 m and less than TH3 m, the estimation unit 205 estimates that the user's mode of transportation is at least one of a car, a motorcycle, and a bus. Furthermore, if the travel distance per minute is equal to or greater than TH3 m, the estimation unit 205 estimates that the user's mode of transportation is a train. Furthermore, if the travel distance per minute is equal to or greater than TH4 m, the estimation unit 205 estimates that the user's mode of transportation is an airplane. The estimation unit 205 may estimate the mode of transportation based on the average value (average travel distance) of the calculated travel distances (travel distances per minute). TH1 to TH4 are thresholds for estimating the user's means of transportation, and can be set as appropriate based on experimental data, etc. For example, TH1 can be set to a value of about several tens of meters, and TH2 to TH4 (where TH2<TH3<TH4) can be set to values ​​of about several hundreds of meters.

[0078] The mode of transportation may also be estimated based on the maximum speed. For example, if the maximum speed is less than TH11 km / h, it may be determined to be walking, and if the maximum speed is equal to or greater than TH11 km / h and less than TH12 km / h, it may be determined to be a bicycle. For example, if the maximum speed is equal to or greater than TH12 km / h and less than TH13 km / h, it may be determined to be a bus, and if the maximum speed is equal to or greater than TH13 km / h, it may be determined to be a train. For example, if the maximum speed is equal to or greater than TH14 km / h, it may be determined to be an airplane. Note that TH11 to TH14 are thresholds for estimating the user's mode of transportation and are values ​​that can be appropriately set based on experimental data, etc. For example, TH11 may be set to a value of several km / h, and TH12 to TH14 (where TH12<TH13<TH14) may be set to values ​​of several tens of km / h.

[0079] The estimation unit 205 can calculate the acceleration of the user U1 who owns the electronic device MC1 using the location information of the electronic device MC1. It can also acquire the acquisition history of the acceleration sensor installed in the electronic device MC1. For example, if the vehicle information 215 in the device information DB 210 includes acceleration sensor information, the acceleration sensor information can be used. Therefore, the characteristics of each mode of transportation, such as walking, bicycle, bus, and train, can be set in advance, and the estimation unit 205 can estimate the mode of transportation of the user U1 based on the acceleration characteristics of the electronic device MC1, for example, the acceleration history.

[0080] [Example of estimation using communication] The estimation unit 205 (see FIG. 2) can estimate the means of transportation of the user U1 who owns the electronic device MC1 based on communication between the electronic device MC1 and a communication device installed in the means of transportation.

[0081] For example, when user U1 is in automobile C1, it is assumed that the electronic device MC1 connects to the automobile C1's communication device, such as the control device 50 or the information output device 100, using wireless communication, such as Wi-Fi or Bluetooth. In this case, the control unit 302 of the electronic device MC1 stores a connection history indicating that the electronic device MC1 has connected to the automobile C1's communication device using wireless communication in the storage unit 303, and transmits the connection history to the content providing server 200 at a predetermined timing. Alternatively, the communication device of automobile C1 may store a connection history indicating that the electronic device MC1 has connected to the electronic device MC1 using wireless communication in the storage unit, and transmit the connection history to the content providing server 200 at a predetermined timing. These connection histories are stored in the connection information 217 of the device information DB 210. Furthermore, the type of automobile C1 can be determined based on the attribute information 213 of the device information DB 210. This allows the content providing server 200 to determine that user U1's means of transportation is automobile C1.

[0082] Furthermore, for example, if user U1 is on a means of transportation equipped with a communication device that can be connected to electronic device MC1 via wireless communication, such as a train TR1, an airplane AP1, a bus BU1, or a ship SH1, it is assumed that electronic device MC1 will be connected to that communication device. Similarly, in this case, the control unit 302 of electronic device MC1 stores in the memory unit 303 that it has been connected to the communication device of each means of transportation via wireless communication, and transmits this information to the content providing server 200 at a predetermined timing. Alternatively, the communication device of each means of transportation may store in its memory that it has been connected to electronic device MC1 via wireless communication, and transmit this information to the content providing server 200 at a predetermined timing.

[0083] [Example of Estimation Using a Payment System and Payment Method] When user U1 uses the payment function of electronic device MC1 to ride public transportation, the estimation unit 205 (see FIG. 2) can estimate the transportation method of user U1, who owns electronic device MC1, based on the payment information. This payment function is equivalent to an IC card ticket with an electronic money function provided by a railway or bus operator, and can be installed as a smartphone application, for example. For example, the ID of the railway or bus operator may be associated with user U1's user ID, and the content providing server 200 may acquire user U1's transportation information based on user U1's user ID. Alternatively, each time user U1 rides a transportation method provided by a railway or bus operator, the electronic device MC1 may store the transportation information regarding the transportation method used and transmit it to the content providing server 200 at a predetermined timing. Each of these pieces of information is stored in the payment information 218 of the device information DB 210. This allows the content providing server 200 to identify the transportation methods used by user U1 in the past.

[0084] The payment function corresponds to a payment method provided by, for example, a credit card company or an online payment service company, and can be installed as, for example, a smartphone application. For example, the ID of the credit card company or the online payment service company may be associated with the user ID of user U1, and the content providing server 200 may acquire the riding information of user U1 based on the user ID of user U1.

[0085] [Example of Estimation Using Images and Sound] The estimation unit 205 (see FIG. 2) can estimate the mode of transportation of a user U1 carrying the electronic device MC1 based on an image acquired by the image acquisition unit 306 of the electronic device MC1. For example, when an image of the user U1's surroundings is acquired by the image acquisition unit 306 of the electronic device MC1, the image information is stored in the storage unit 303 and transmitted to the content providing server 200 at a predetermined timing. This image information is stored in the image information 216 of the device information DB 210. The content providing server 200 can identify the route taken by the user U1 based on the image of the user U1's surroundings, and can estimate the user U1's mode of transportation based on that route. For example, if the image of the user U1's surroundings shows a sidewalk SW1, it can estimate that the user U1's mode of transportation is walking. Furthermore, if the image of the user U1's surroundings shows the sea or a river, it can estimate that the user U1's mode of transportation is a boat. Furthermore, if the image of the user U1's surroundings is along the railroad tracks RR1, it can be estimated that the user U1's means of transportation is a train.

[0086] Furthermore, if the image acquired by the image acquisition unit 306 includes a steering wheel, it is possible to estimate the mode of transportation, such as a car, motorcycle, bicycle, etc., based on the shape of the steering wheel. Furthermore, if the image acquired by the image acquisition unit 306 includes objects inside the vehicle, such as the windshield or dashboard, it is possible to estimate that the mode of transportation is a car.

[0087] The estimation unit 205 can estimate the mode of transportation of the user U1 who owns the electronic device MC1 based on the sound acquired by the sound acquisition unit 305 of the electronic device MC1. For example, when the sound acquisition unit 305 of the electronic device MC1 acquires sounds around the user U1, the sound information is stored in the storage unit 303 and transmitted to the content providing server 200 at a predetermined timing. This sound information is stored in the device information DB 210. The content providing server 200 can identify the environment in which the user U1 traveled based on the sounds around the user U1, and can estimate the mode of transportation of the user U1 based on that environment. For example, if the sounds around the user U1 are quiet, it can be estimated that the user U1's mode of transportation is walking. Furthermore, if the sounds around the user U1 are sounds emitted by a specific vehicle, it can be estimated that the user U1's mode of transportation is that vehicle.

[0088] [Other Estimation Examples] Here, other estimation methods will be described. For example, a communication device can be installed at the entrance / exit of a registered location or facility through which users enter and exit the facility. The means of transportation of user U1 can be estimated using communication between this communication device and electronic device MC1.

[0089] Furthermore, various information is notified or displayed on the electronic device MC1 of the user U1 depending on the means of transportation. For example, if the user U1 uses a bus or train, a timetable is often displayed on the display unit 308 of the electronic device MC1. If the user U1 uses a car C1, traffic conditions on the way home in the car C1 are often displayed on the display unit 308 of the electronic device MC1. If the user U1 uses a bicycle or motorcycle, weather information is often displayed on the display unit 308 of the electronic device MC1. If the user U1 uses a taxi, a ride-hailing app or the like is often launched on the electronic device MC1. Therefore, the means of transportation of the user U1 can be estimated using the display history and app launch history of the electronic device MC1.

[0090] Furthermore, as described above, a communication device installed at the entrance or exit of a registered location or facility may be configured to execute entry and exit processing. For example, when user U1 performs an entry or exit operation using the communication device, appropriate information can be displayed on user U1's electronic device MC1 according to the means of transportation.

[0091] Furthermore, for example, a communication device can be installed at the entrance or exit of a restaurant that serves as a registration location. The user U1's mode of transportation can be estimated using communication between this communication device and the electronic device MC1. This communication device is also used when the user U1 makes an electronic payment using the electronic device MC1 after eating at the restaurant. For example, if the user U1's mode of transportation is walking, only the cost of the user U1's meal is displayed on the electronic device MC1 and charged. On the other hand, if the user U1's mode of transportation is a car C1 and the car C1 is parked in a parking lot, the parking fee can be added to the cost of the user U1's meal, and the resulting amount can be displayed on the electronic device MC1 and charged.

[0092] The above-described method for estimating the mode of transportation is merely an example, and other estimation methods may be used. Furthermore, the above-described estimation methods may be combined to estimate the mode of transportation. For example, the user's mode of transportation may be determined on the condition that the modes of transportation estimated by two or more estimation methods match. This makes it possible to improve the accuracy of estimating the mode of transportation.

[0093] [Example of Estimation of Main Means of Transportation] FIG. 7 is a simplified diagram illustrating an example of the relationship between routes R1 to R5 to the registered location RL1 and the main means of transportation. Routes leading to the registered location RL1 include route R1 from the nearest airport APP1, route R2 from the nearest train station ST1, route R3 from the nearest wharf SP1, route R4 from the nearest bus stop BT1, and route R5 from the parking lot P1. In FIG. 7 , each of routes R1 to R5 is assumed to be accessible only by walking. In this case, it is possible to estimate that the means of transportation used by user U1 upon arriving at the registered location RL1 is all walking. However, user U1's main means of transportation may be estimated by taking into account the means of transportation used by user U1 prior to each of routes R1 to R5. For example, user U1's means of transportation can be estimated depending on the content.

[0094] For example, the primary means of transportation for user U1 can be selected based on the distance traveled by user U1, and content can be determined based on this primary means of transportation. For example, the primary means of transportation can be selected based on the distance from user U1's home to registered location RL1, with the longest distance traveled. For example, if the distance from user U1's home to registered location RL1 is 10 km, and walking is 1 km and train is 9 km, then train is selected as the primary means of transportation.

[0095] For example, the main means of transportation for user U1 can be selected based on the travel time of user U1, and content can be determined based on this main means of transportation. For example, the main means of transportation can be selected as the main means of transportation, based on the travel time from user U1's home to registered location RL1, with the longest travel time. For example, if the travel time from user U1's home to registered location RL1 is one hour, but walking takes 10 minutes, bus takes 40 minutes, and train takes 10 minutes, then the bus is selected as the main means of transportation.

[0096] For example, a primary means of transportation for user U1 can be selected based on the travel cost of user U1, and content can be determined based on this primary means of transportation. For example, the primary means of transportation with the highest travel cost among the travel costs from user U1's home to registered location RL1 can be selected as the primary means of transportation. For example, if the travel cost from user U1's home to registered location RL1 is 1,000 yen, walking is 0 yen, bus is 800 yen, and train is 200 yen, then the bus is selected as the primary means of transportation.

[0097] The method for selecting the main means of transportation is merely an example, and the user's means of transportation may be selected by other methods. Furthermore, the method for selecting the means of transportation may be changed depending on the content provided to the user.

[0098] Furthermore, the priority of transportation means may be set in advance, and the user's transportation means may be selected according to this priority. For example, assume that the priority of transportation means is set as follows: first, train, second, car, third, bus, and fourth, walking. In this case, if the user arrives at the registered location by walking, bus, and train, the train, which is first, is selected as the user's transportation means according to the priority. Note that if the transportation means selected in this way is canceled by the user's operation, another transportation means for the user is selected according to the priority.

[0099] [Example of Relationship Between Registered Locations and User's Transportation Means] Figure 8 is a simplified diagram showing the relationship between registered locations managed by the content providing server 200 and user U1's transportation means. Figure 8 shows an example in which objects RO1 to RO3 and a building B1 are registered locations. Figure 8 also shows a case in which user U1 walks to parking lot P11 where objects RO1 to RO3 are installed, and a case in which user U1 travels there by car C1. Furthermore, parking lot P11 is assumed to be a parking lot provided for users who use building B1. Building B1 is, for example, a facility where people gather, such as a museum or an exhibition hall.

[0100] The objects RO1 to RO3 are charging stations for charging electric vehicles using charging cables. The objects RO1 to RO3 are also facilities installed at registered locations managed by the content providing server 200. The vehicle C2 is a vehicle being charged using the charging facility RO2, and the vehicles C3 and C4 are vehicles parked in the parking lot P11.

[0101] Furthermore, when user U1 gets into car C1 and heads to parking lot P11, he / she drives along roadway R11, and when user U1 walks to parking lot P11, he / she walks along sidewalk R12. In this case, the content providing server 200 can estimate the means of transportation of user U1 based on the movement history of user U1 up to the time of heading to parking lot P11. The movement history of user U1 can be acquired from the movement history 214 of the device information DB 210.

[0102] 9 is a diagram showing an example of content output provided to user U1 by the content providing server 200 when user U1's means of transportation is walking. Here, the description will be given assuming that user U1 is carrying electronic device MC1.

[0103] Assume that user U1, walking along sidewalk R12 shown in Figure 8, moves to the vicinity of object RO1 to use building B1. After user U1 moves to the vicinity of object RO1, user U1 uses the image acquisition unit 306 of electronic device MC1 to capture an image of characteristic portion FP1 of object RO1. In this case, an image of characteristic portion FP1 is acquired by the image acquisition unit 306 of electronic device MC1, and this image of characteristic portion FP1 is output to the control unit 302 of electronic device MC1. The control unit 302 can acquire various information based on characteristic portion FP1 by performing predetermined image processing on the image of characteristic portion FP1.

[0104] For example, if the characteristic portion FP1 is configured as a QR code, the control unit 302 can acquire access information to the content providing server 200 and identification information for identifying the object RO1 based on the QR code acquired by the image acquisition unit 306 of the electronic device MC1. In this case, the control unit 302 accesses the content providing server 200 based on the acquired access information and transmits identification information for the object RO1, such as a registered location ID. This allows the content providing server 200 to determine that the electronic device MC1 is located near the object RO1. In this case, the content providing server 200 can determine that the mode of transportation is walking based on the movement history 214 of the electronic device MC1 (see FIG. 3 ). Alternatively, the content providing server 200 may infer that the mode of transportation is walking based on the information transmitted from the electronic device MC1.

[0105] Next, the content providing server 200 extracts a registered place ID 221 that matches the identification information of the object RO1 from among the registered place IDs 221 in the content DB 220. Then, the content providing server 200 extracts content 225 related to walking from among the means of transportation 224 in the content DB 220 that are associated with the registered place ID 221 that matches the identification information of the object RO1.

[0106] The content providing server 200 transmits the extracted content to the electronic device MC1. When content is received from the content providing server 200, the control unit 302 of the electronic device MC1 outputs the content from an output unit, for example, the display unit 308 and the sound output unit 309. For example, as shown in FIG. 9 , a human figure AB1 can be displayed superimposed on an image acquired by the image acquisition unit 306. In this example, the display unit 308 can display the human figure AB1, which appears to be sitting on top of a building B1. Furthermore, the human figure AB1 may explain the object RO1 and the building B1, and sound information S1 may be output to guide the user to proceed to the building B1. Furthermore, video content, such as the time required to reach nearby tourist attractions and local specialties, may be output. In this case, since it is known that the user U1 arrived on foot, it is also possible to guide the user to nearby registered locations that are within walking distance, for example, within a range of approximately 3 km.

[0107] 9, since user U1 is in a parking lot, a message such as "It's dangerous because a car is coming" or a message such as "Next time, please come by car" may be output. Also, content guiding shortcuts to other registered locations, content guiding other registered locations within walking distance of user U1, etc. may be output.

[0108] [Example of Content Output When Transportation is a Vehicle] Figure 10 is a diagram showing an example of content output provided to user U1 by the content providing server 200 when the transportation of user U1 is an automobile C1. Here, the explanation will be given assuming that the automobile C1 is an electric automobile. Also, Figure 10 shows a simplified example of the configuration of the interior of the automobile C1 as viewed from the rear in the longitudinal direction of the automobile C1. Also, to facilitate explanation, Figure 10 omits illustrations other than the dashboard 2, steering wheel 3, windshield 4, and information output device 100.

[0109] A user U1 traveling in a car C1 on a roadway R11 shown in Fig. 8 parks the car C1 near the object RO1 to charge the car. When the car C1 is parked near the object RO1 in this manner, the object RO1, a building B1, etc. become visible through the windshield 4, as shown in Fig. 10.

[0110] 1 , the object RO1 has a characteristic portion FP1 on its exterior. When the characteristic portion FP1 is included in the imaging range of an image acquisition unit installed in the automobile C1, for example, an exterior camera, an image of the characteristic portion FP1 is acquired by the image acquisition unit of the automobile C1, and this image of the characteristic portion FP1 is output to the information output device 100. The information output device 100 can acquire various information based on the characteristic portion FP1 by performing predetermined image processing on the image of the characteristic portion FP1.

[0111] Note that the access by the information output device 100 to the content providing server 200 and the transmission of the identification information of the object RO1 are similar to the example shown in Fig. 9 . This allows the content providing server 200 to know that an automobile C1 is present around the object RO1. In this case, the content providing server 200 can know that the means of transportation is an automobile based on the movement history 214 of the information output device 100 (see Fig. 3 ). Alternatively, the content providing server 200 may infer that the means of transportation is an automobile based on the information being transmitted from the information output device 100.

[0112] Next, the content providing server 200 extracts a registered place ID 221 that matches the identification information of the object RO1 from among the registered place IDs 221 in the content DB 220. Then, the content providing server 200 extracts automobile-related content 225 from among the means of transportation 224 in the content DB 220 that are associated with the registered place ID 221 that matches the identification information of the object RO1.

[0113] The content providing server 200 transmits the extracted content to the information output device 100. When content is received from the content providing server 200, the control unit of the information output device 100 outputs the content from an output unit, such as the display unit 110 or sound output unit. For example, as shown in FIG. 10 , a human figure AB2 can be displayed superimposed on an image acquired by the image acquisition unit. In this example, the human figure AB2, appearing to be sitting on top of the object RO1, can be displayed on the display unit 110. Furthermore, the human figure AB2 may explain the object RO1 and the building B1, and sound information S2 providing guidance to charging facilities may be output. Furthermore, assuming that the user U1 will not leave the car C1, video content providing tourist information about the surrounding area may be output. For example, video content showing the time required to reach nearby tourist attractions, local specialties, etc. may be output. In this case, since it is known that the user U1 has arrived by car C1, it is also possible to guide the user U1 to registered locations far away, such as within a 20-kilometer radius, that are inaccessible by foot or bicycle. Furthermore, the content providing server 200 can grasp the charge amount of the automobile C1 based on the vehicle information 215 in the device information DB 210. Therefore, content may be output that takes into account the charge amount of the automobile C1. For example, it is possible to guide the automobile C1 to places that can be reached with the current charge amount, or to introduce the next charging spot that takes into account the current charge amount.

[0114] The content providing server 200 can also acquire congestion information around the registered location via the network 20. Based on the congestion information around the registered location, the content providing server 200 can guide or introduce uncrowded locations around the registered location that can only be reached by car. Furthermore, by providing attractive content only to people who have used the charging facility, it is possible to promote the use of the charging facility.

[0115] 10 illustrates an example in which the characteristic portion FP1 is used to determine whether the proximity condition is met, but other methods may be used to determine whether the proximity condition is met. For example, when the charging cable of the object RO1 is connected to the vehicle C1, the fulfillment of the proximity condition for the vehicle C1 may be determined based on communication between the object RO1 and the vehicle C1 via the charging cable. That is, when the charging cable of the object RO1 is connected to the vehicle C1, communication is performed between the object RO1, i.e., the charging equipment, and the vehicle C1 to determine whether charging is permitted. Therefore, it is possible to determine whether direct communication between the object RO1 and the vehicle C1 is established using this communication.

[0116] Content may be provided using virtual reality (VR) or augmented reality (AR). Content related to the registered location may be used as the content to be provided. For example, local content for the area related to the registered location, content introducing local products, local avatars, local mascot characters, etc. may be used. Local content is, for example, an image of a specific character in graphic form. These may also be displayed in AR or augmented reality, or output as audio. In this way, by changing the local content to be provided depending on the mode of transportation, users who want to see all the local content will frequently visit the registered location, thereby revitalizing the registered location. Furthermore, by using each mode of transportation, it is possible to promote the use of each mode of transportation.

[0117] Here, we will explain the differences in content when the means of transportation is a car or on foot. Whether the means of transportation is a car or on foot, the display format can be the same except for characteristic features, such as the human-shaped images AB1 and AB2. However, when the means of transportation is a car, it is expected that the user will spend a long time inside the car. Therefore, when the means of transportation is a car, it is also possible to provide local content that can be completed while the user is inside the car. For example, it is possible to display a predetermined image superimposed on a landscape that can be seen from the car. For example, if the user's line of sight can be detected, a predetermined image related to the landscape can be superimposed on a landscape corresponding to the line of sight. Furthermore, if the electronic device MC1 can be viewed from inside the car, a predetermined image can be superimposed on an image acquired by the image acquisition unit 306 of the electronic device MC1. Here, the predetermined image can be an explanatory image of a building, mountain, or the like that can be seen from the registered location.

[0118] Furthermore, if the means of transportation is a car, the driving range varies depending on the remaining fuel or remaining charge. Therefore, it is possible to provide content that introduces the remaining fuel or remaining electricity. It is also possible to change the next registration location candidate depending on the remaining fuel or remaining electricity, making it possible to provide information that suits the user's situation.

[0119] Furthermore, if the user is traveling by foot or car, it is easy for the user to travel several tens of meters, so it is also possible to introduce an object several tens of meters away. In this case, when the user approaches the object and the image acquisition unit 306 of the electronic device MC1 acquires an image of the object, a predetermined image can be superimposed on the object and displayed. This predetermined image can be an explanatory image related to the object.

[0120] In this way, different content can be provided depending on the mode of transportation, so that local information suited to the mode of transportation can be provided to the user. For example, the information provider can appropriately introduce information taking the mode of transportation into consideration. In this case, it is possible to convey local information broadly and superficially, or narrowly and deeply. Note that while Figures 9 and 10 show examples in which both audio information and image information are output, it is also possible to output either audio information or image information.

[0121] [Content Output Examples According to Transportation Mode] Figure 11 shows examples of content output according to the transportation mode of user U1. Figure 11(A) shows an example of content output when user U1's transportation mode is bus BU1, Figure 11(B) shows an example of content output when user U1's transportation mode is train TR1, Figure 11(C) shows an example of content output when user U1's transportation mode is motorcycle M1, Figure 11(D) shows an example of content output when user U1's transportation mode is ship SH1, and Figure 11(E) shows an example of content output when user U1's transportation mode is airplane AP1.

[0122] 11A to 11E, on the content display screen, in image display areas 401 to 405, human figures 411 to 415 corresponding to the user U1's means of transportation are displayed superimposed on the captured image. Furthermore, in transportation display areas 421 to 425, characters and signs corresponding to the user U1's means of transportation are displayed. For example, content guiding the user U1 to a registered location can be output using the human figures 411 to 415.

[0123] 11 is an example, and other content may be output depending on the mode of transportation of user U1. For example, the pose or clothing of the same human figure may be changed depending on the mode of transportation of user U1. Furthermore, if the registered location is a store, the products introduced may be changed depending on the mode of transportation of user U1.

[0124] Furthermore, the number of times a user has visited the same registered location may be stored for each mode of transportation in association with the user ID 211 in the device information DB 210, and the output content may be changed as the number of times increases. For example, when a user first visits a charging facility that is registered location A in a car C1, text indicating "It will take 30 minutes to charge, so please kill time by going to the park behind," and a human-shaped image representing this may be displayed. Also, when a user visits registered location A for the third time in a car C1, text indicating "I see you came by car again," and a human-shaped image representing this may be displayed. These may also be output by voice.

[0125] Furthermore, the registered location to be guided after the current registered location may be changed depending on the mode of transportation used by user U1. For example, assume that there are multiple registered locations A to E located within a relatively close range, with registered location A being the entrance. In this case, if the mode of transportation is a car, the user may be guided from registered locations A to C to E, whereas if the mode of transportation is walking, the user may be guided from registered locations A to D. In this way, priorities are set in advance for the next candidate for a registered location such as A according to the mode of transportation, and the next candidate is provided to the user based on the priorities and the mode of transportation. These next candidates can be set appropriately based on, for example, distance, time, the state of the travel route, etc. Note that if the next candidate is canceled by a user operation, other next candidates are provided according to the priority order.

[0126] For example, if the means of transportation is a car, a registered location with a wide road leading from the current registered location and a parking lot can be introduced as the next candidate. In this case, it is possible to introduce a location even if it is far from the current registered location.

[0127] Also, for example, if the means of transportation is walking, registered locations within walking distance (for example, less than a few kilometers) can be introduced as next candidates. In this case, it is possible to introduce the next candidate even if the road leading from the current registered location is narrow.

[0128] For example, if the means of transportation is a motorcycle, the system can introduce a registered location as the next candidate even if the road leading from the current registered location is narrow and there is no parking lot.It can also introduce a location even if it is far from the current registered location.

[0129] For example, if the means of transportation is a bicycle, the next candidate can be a registered location that is located on a flat road from the current registered location and within a bicycle travel distance (for example, less than 10 km). In this case, it is possible to introduce a location that is farther away than the locations that can be introduced on foot.

[0130] Also, assume that there are multiple registered locations A to E located within a relatively close range, with registered location A being the entrance. In this case, for example, if the user moves from one registered location to another without following the guidance corresponding to the means of transportation (e.g., in the case of a car: registered locations A → C → E), the system may be configured not to output the predetermined content corresponding to the means of transportation. In this case, the enjoyment of traveling according to the guidance increases. This allows user U1 to easily enjoy the travel route corresponding to the means of transportation and the content corresponding to the means of transportation.

[0131] [Example of Content Output Outside a Registered Location] The above describes an example of content output when user U1 is located near a registered location. It is also possible that user U1 moves close to the registered location, but the proximity condition is not met and the content for the registered location is not output. It is also possible that user U1 wants to know the status of the registered location when he or she plans to visit the registered location. Therefore, FIGS. 12 and 13 show an example of content output when user U1 is not located near the registered location.

[0132] [Example of Content Output at a Location Near a Registered Location] FIG. 12 is a diagram showing an example of a content display screen 500 displayed on the display unit 308 of the electronic device MC1. The content display screen 500 is an example of content displayed when the user U1 is near the registered location and the proximity condition is not met. The example shown in FIG. 12 shows a case where objects R01 to R03 and a building B1 are installed at the registered location, similar to the example shown in FIG. 8. It is also assumed that the user U1 is walking along the sidewalk R12 (see FIG. 8). The content display screen 500 may be displayed automatically when the user U1 is expected to go to the registered location, or may be displayed by manual operation by the user U1.

[0133] The content display screen 500 displays a back button 501, a map display area 510, and a message display area 520. The back button 501 is a button that is pressed to return to the previous display screen.

[0134] The map display area 510 displays a current location indicator PL1 indicating the current location of user U1, device indicators O1-O5, H1-H5 indicating the locations of other devices around user U1, registered location indicators 511-514 indicating the locations of registered locations, and travel routes R21 and R22 to the registered locations, all superimposed on a map of the user U1's surroundings. The content providing processing unit 206 of the content providing server 200 can display the map of the user U1's surroundings and the travel routes R21 and R22 based on the location information 212 of the device information DB 210. The content providing processing unit 206 of the content providing server 200 can also display the current location indicator PL1 and device indicators O1-O5, H1-H5 based on the location information 212 of the device information DB 210. The content providing processing unit 206 of the content providing server 200 can also display the registered location indicators 511-514 based on the location information 222 of the content DB 220.

[0135] In this way, by displaying device indicators O1 to O5, H1 to H3, registered location indicators 511 to 514, and travel routes R21 and R22 on a map around the registered location where user U1 is expected to go, user U1 can easily understand the registered location, the route to get there, and congestion on that route, etc.

[0136] Furthermore, if the user U1's mode of transportation can be estimated, only the travel route corresponding to the user U1's mode of transportation may be displayed among the travel routes to the registered location. In Figure 12, since the user U1's mode of transportation is walking, an example is shown in which, of the travel routes R21 and R22 to the registered location, the travel route R22 corresponding to the user U1's mode of transportation (walking) is displayed in bold, the travel route R21 is displayed in dotted, and the travel route R22 corresponding to the user U1's mode of transportation (walking) is highlighted. This allows the user U1 to easily understand the route to the registered location.

[0137] [Example of Content Output Related to a Registered Location Specified by User Operation] Figure 13 is a diagram showing an example of a content display screen 550 displayed on the display unit 308 of the electronic device MC1. The content display screen 550 is an example of content that displays a map specified by manual operation by the user U1. Note that the example shown in Figure 13 is a partial modification of Figure 12, and therefore the following description will focus on the differences from Figure 12. Furthermore, parts that are common to Figure 12 are assigned the same reference numerals, and their description will be omitted.

[0138] The content display screen 550 displays a map display area 560, a message display area 570, and a transportation means selection area 580. In the map display area 560, device indicators O1 to O5, H1 to H5, registered location indicators 511 to 514, and travel routes R21 and R22 are displayed superimposed on a map manually specified by the user U1. That is, Fig. 13 differs from Fig. 12 in that a current location indicator PL1 is not displayed.

[0139] The transportation means selection area 580 is an area for the user U1 to select the transportation means to be used when traveling to the registered location displayed in the map display area 560. When the user U1 selects the transportation means in the transportation means selection area 580, content corresponding to the selected transportation means can be output.

[0140] Furthermore, at least one of the plurality of contents set for the registered location may be displayed on the content display screen 550 or on another display screen. Furthermore, at least one of the plurality of contents may be output as audio. Furthermore, a travel range or a travel route corresponding to a mode of transportation associated with the registered location may be displayed on the content display screen 550 or on another display screen. The travel range corresponding to a mode of transportation associated with the registered location is a range expected to be traveled by a user who has arrived at the registered location included in the map specified by manual operation of the user U1. For example, if the mode of transportation of the user U1 is walking, a relatively narrow range is set, whereas if the mode of transportation of the user U1 is a car, a relatively wide range is set. Furthermore, the travel route corresponding to a mode of transportation associated with the registered location is a route expected to be traveled by a user who has arrived at the registered location included in the map specified by manual operation of the user U1. For example, if the mode of transportation of the user U1 is walking, a route that can be traveled by foot is set, whereas if the mode of transportation of the user U1 is a car, a route that can be traveled by car is set.

[0141] In this way, even if the user U1 is not near a registered location, the device indicators O1 to O5, H1 to H5, the registered location indicators 511 to 514, and the travel routes R21 and R22 can be displayed on the map specified by the user U1, allowing the user U1 to easily understand the registered location, the route to the location, and congestion on the route.

[0142] Furthermore, when the user U1's means of transportation is specified, only the route to the registered location that corresponds to the user U1's means of transportation may be displayed. For example, when the user U1's means of transportation is a car, only the route R21 that corresponds to the user U1's means of transportation (car) may be displayed among the routes R21 and R22 to the registered location. This allows the user U1 to easily understand the route to the registered location.

[0143] [Example of Operation of Electronic Device] Figure 14 is a flowchart showing an example of content output processing in the electronic device MC1. This content output processing is executed by the control unit 302 based on a program stored in the storage unit 303. This content output processing is constantly executed at each control cycle. This content output processing will be explained with appropriate reference to Figures 1 to 13. Note that while Figure 14 shows an example of operation of the electronic device MC1, the same applies to the operation of other devices, such as the information output device 100.

[0144] In step S601, the control unit 302 determines whether or not a setting is made to output content using the content providing service provided by the content providing server 200. This content output setting is made by user operation or automatically. For example, the content output can be turned on or off by user operation. Furthermore, for example, a condition can be that a predetermined condition is met, for example, that the user has entered a predetermined location, such as a predetermined range around the home, during daytime hours. If a setting is made to output content, the process proceeds to step S602. On the other hand, if a setting is not made to output content, the content output process ends.

[0145] In step S602, the control unit 302 transmits predetermined information including the location information acquired by the location information acquisition unit 304 to the content providing server 200. The location information included in this predetermined information is sequentially stored in the location information 212 of the device information DB 210. Furthermore, the location information stored in the location information 212 of the device information DB 210 is associated with the acquisition time and stored in the movement history 214. This enables the content providing server 200 to acquire the movement history of the electronic device MC1. Furthermore, the predetermined information is transmitted including each piece of information stored in the device information DB 210 as necessary.

[0146] In step S603, the control unit 302 determines whether a proximity condition based on a user operation is met. For example, if a content acquisition operation such as a QR code reading operation or an image acquisition operation of an object having a characteristic part is performed and predetermined information is acquired based on the content acquisition operation, it is determined that the proximity condition based on the user operation is met. If the proximity condition based on the user operation is met, the process proceeds to step S604. On the other hand, if the proximity condition based on the user operation is not met, the process proceeds to step S605.

[0147] In step S604, the control unit 302 transmits a content request to the content providing server 200 based on the user operation performed in step S604. For example, the control unit 302 executes access processing to the content providing server 200 based on access information to the content providing server 200 acquired in response to the reading operation or the image acquisition operation. Next, the control unit 302 transmits to the content providing server 200 a content request including the registration location ID and the user ID acquired in response to the reading operation or the operation image acquisition operation.

[0148] In step S605, the control unit 302 determines whether a proximity condition based on location information or communication is met. This proximity condition is determined, for example, using wireless or wired communication with another communication device. Furthermore, this proximity condition is determined, for example, using the relationship between the location of the registered location and the location of the electronic device MC1. If the proximity condition based on location information or communication is met, the process proceeds to step S606. On the other hand, if the proximity condition based on location information or communication is not met, the content output process ends.

[0149] In step S606, the control unit 302 transmits a content request to the content providing server 200 based on the proximity condition established in step S605. For example, the control unit 302 transmits a content request including a registration location ID and a user ID acquired using wireless communication or location information to the content providing server 200. Note that if the proximity condition determination process is executed in the content providing server 200, the processes of steps S603 to S606 may be omitted and the process may proceed to step S607.

[0150] In step S607, the control unit 302 determines whether or not content transmitted from the content providing server 200 in response to the content request has been received. If content has been received from the content providing server 200, the process proceeds to step S608. On the other hand, if content has not been received from the content providing server 200, monitoring continues. Note that if content has not been received from the content providing server 200 even after a predetermined time has elapsed, the content request may be transmitted to the content providing server 200 again. In addition, the content providing server 200 transmits information on the content output range 223 of the content DB 220 to the electronic device MC1 along with providing the content.

[0151] In step S608, the control unit 302 executes an output process to output the content received in step S607. For example, the control unit 302 causes the display unit 308 to display the content received in step S607. For example, as shown on the right side of FIG. 5 and in FIG. 9, the content is displayed on the display unit 308. Also, for example, the control unit 302 causes the sound output unit 309 to output the content received in step S607 as sound. For example, as shown in FIG. 9, sound information S1 is output from the sound output unit 309.

[0152] In step S609, the control unit 302 transmits predetermined information including the location information to the content providing server 200. This predetermined information is the same as the predetermined information shown in step S602.

[0153] In step S610, the control unit 302 determines whether a content stop operation has been performed. If a content stop operation has been performed, the control unit 302 stops the content output process, transmits a content stop instruction to the content providing server 200, and terminates the content providing process. On the other hand, if a content stop operation has not been performed, the control unit 302 proceeds to step S611. A content stop operation is, for example, pressing an end button. Alternatively, the control unit 302 may determine that a content stop operation has been performed when the electronic device MC1 passes an end post installed outside the range of the registered location. Alternatively, the control unit 302 may determine that a content stop operation has been performed when the radio wave strength of the electronic device MC1 falls below a predetermined value.

[0154] In step S611, the control unit 302 determines whether the content that was the target of the output process in step S608 has fallen outside the output range. That is, if the location falls outside the range of the registered location where the content acquisition operation was performed in step S603 or the registered location where the proximity condition was met in step S605, the control unit 302 stops outputting the content for that registered location. Specifically, the control unit 302 determines whether the location information acquired by the location information acquisition unit 304 is within the content output range 223 of the content DB 220 received in step S607. If the location information acquired by the location information acquisition unit 304 is within the content output range 223, the control unit 302 returns to step S607. On the other hand, if the location information acquired by the location information acquisition unit 304 is outside the content output range 223, the control unit 302 terminates the content output process.

[0155] [Example of Operation of Content Providing Server] Figure 15 is a flowchart showing an example of information storage processing in the content providing server 200. This information storage processing is executed by the control unit 202 based on a program stored in the storage unit 203. This information storage processing is also executed continuously for each control cycle. This information storage processing will be explained with appropriate reference to Figures 1 to 13.

[0156] In step S621, the control unit 202 determines whether or not predetermined information has been received from each device registered for use of the content providing service. If predetermined information has been received, the process proceeds to step S622. On the other hand, if predetermined information has not been received, the operation of the information storage process ends.

[0157] In step S622, the control unit 202 stores the predetermined information received in step S621 in the device information DB 210. Specifically, the control unit 202 stores each piece of information included in the predetermined information in the device information DB 210 in association with the user ID 211 corresponding to the device that transmitted the predetermined information.

[0158] [Example of Operation of Content Providing Server] Figure 16 is a flowchart showing an example of content providing processing in the content providing server 200. This content providing processing is executed by the control unit 202 and the like based on a program stored in the storage unit 203. This content providing processing is also executed constantly at each control cycle. This content providing processing will be explained with appropriate reference to Figures 1 to 13.

[0159] In step S631, the determination unit 204 determines whether a device for which the proximity condition is met has been detected at the registered location. The process of detecting a device for which the proximity condition is met at the registered location may be executed by the content providing server 200, or may be executed based on receipt of a content request (see FIG. 14) from the electronic device MC1. If a device for which the proximity condition is met has been detected, the process proceeds to step S632. On the other hand, if a device for which the proximity condition is met has not been detected, the content providing process ends. Note that in FIG. 16, the device detected in step S631 as a device for which the proximity condition is met will be referred to as the target device.

[0160] In step S632, the estimation unit 205 estimates the means of transportation of the target device detected in step S631. This estimation of the means of transportation can be performed using any of the estimation methods described above.

[0161] In step S633, the content providing processing unit 206 determines the content to be output to the target device based on the means of transportation estimated in step S632. Specifically, the content 225 associated with the means of transportation estimated in step S632 is extracted from the means of transportation 224 associated with the registered location ID 221 of the registered location where the target device detected in step S631 is located. The extracted content is then determined as the content to be output to the target device.

[0162] In step S634, the content provision processing unit 206 transmits the content determined in step S633 to the target device.

[0163] In step S635, the determination unit 204 determines whether the target device has moved. If the target device has moved, the process proceeds to step S636. On the other hand, if the target device has not moved, the process proceeds to step S637.

[0164] In step S636, the content providing processing unit 206 determines the content to be output by the target device based on the position information of the target device after it has moved and the means of transportation estimated in step S632. For example, even if the target device is within the content output range, the content to be output can be changed in response to the movement of the target device. Note that if the target device is within the content output range and the content to be output does not change regardless of the movement of the target device, the processes of steps S635 and S636 can be omitted.

[0165] In step S637, the content providing processing unit 206 determines whether a content stop instruction has been sent from the target device. If a content stop instruction has been sent from the target device, the content transmission processing is stopped and the content providing processing operation is terminated. On the other hand, if a content stop instruction has not been sent from the target device, the process proceeds to step S638.

[0166] In step S638, the determination unit 204 determines whether the target device is outside the content output range. Specifically, the determination unit 204 determines whether the location information 222 in the device information DB 210 corresponding to the target device is within the content output range 223 of the content DB 220. If the location information 222 in the device information DB 210 corresponding to the target device is within the content output range 223, the process returns to step S634. On the other hand, if the location information 222 in the device information DB 210 corresponding to the target device is outside the content output range 223, the content providing process ends.

[0167] In this manner, in this embodiment, for example, when user U1 is traveling on foot, content for walking can be provided to user U1, and when user U1 is traveling by car C1, content for car can be provided to user U1. This makes it possible to more appropriately provide content according to each mode of transportation. Furthermore, while providing content according to different modes of transportation can cause a sense of discomfort to the user, this embodiment can reduce this sense of discomfort. Furthermore, for example, for a user traveling by car, the value of the user experience of traveling by car can be increased.

[0168] Furthermore, in this embodiment, the content to be output can be selected based on the user's means of transportation, and only the necessary content can be output, thereby reducing the load and time required to send and receive content from the content providing server 200 to each device, thereby improving the efficiency of the calculation load related to information processing.

[0169] In addition, the next destination provided to users can be changed depending on the means of transportation of various users gathered at one registered location, so users' movements to the next location can be dispersed. This makes it possible to avoid congestion at the registered location and also to reduce waiting times at the registered location.

[0170] In the above, an example has been shown in which the process of determining the presence of a user at a registered location, the process of estimating the user's means of transportation, and the process of providing content are performed by the content providing server 200. However, all or part of each of these processes may be performed by other devices. In this case, an information processing system is configured by the devices that perform part of each of these processes. For example, at least part of each process may be performed by the electronic device MC1 used by the user U1, various information processing devices such as servers that can be connected via a predetermined network such as the Internet, and various electronic devices.

[0171] In addition, in this embodiment, an example is shown in which the device information DB 210 (see FIG. 3) and the content DB 220 (see FIG. 4) are managed by the content providing server 200. However, all or part of each DB may be managed by one or more devices other than the content providing server 200, and information of each DB managed by the other devices may be acquired and used for each process.

[0172] Furthermore, a part (or all) of the information processing system capable of executing the functions of the content providing server 200 may be provided by an application that can be provided via a predetermined network such as the Internet. This application is, for example, SaaS (Software as a Service).

[0173] [Configuration and Effects of the Present Embodiment] The information processing method according to the present embodiment is an information processing method for providing information to a user U1. This information processing method includes an acquisition process (step S632) for acquiring the transportation mode of the user U1, and a provision process (steps S633 and S634) for selecting at least one of a plurality of contents set for the registered location based on the transportation mode of the user U1 and providing the selected content to the user U1 when it is determined that the user U1 is present at the registered location (an example of a predetermined location).

[0174] This configuration allows for more appropriate content provision according to each mode of transportation. Furthermore, since the content to be output can be selected based on the user's mode of transportation and only the necessary content can be output, the load and time required for sending and receiving content from the content providing server 200 to each device can be reduced. This allows for more efficient computational load related to information processing.

[0175] In addition, the information processing method according to this embodiment further includes a determination process (step S631) for determining whether user U1 is present at the registered location based on the establishment of a proximity condition between the registered location and the electronic device MC1 associated with user U1.

[0176] According to this configuration, it is possible to provide the content set for the registered location where the proximity condition is met, so that more appropriate content can be provided to the user.

[0177] Furthermore, in the information processing method according to this embodiment, the judgment process (step S631) judges that the proximity condition is met and determines that user U1 is present at the registered location when either the current location of electronic device MC1 is within a predetermined range based on the registered location, when the captured image acquired by electronic device MC1 contains characteristic information (e.g., characteristic part FP1) related to the registered location, or when predetermined information is exchanged between electronic device MC1 and communication device 300 installed at the registered location using wireless or wired communication.

[0178] This configuration allows for more accurate determination of the presence of user U1 at the registered location by setting more appropriate proximity conditions. Furthermore, by setting multiple proximity conditions, it is possible to minimize environmental dependency.

[0179] Furthermore, in the information processing method according to this embodiment, in the determination process (step S631), when the captured image contains a characteristic part FP1 of the object RO1 installed at the registered location, or when the captured image contains predetermined identification information (for example, a specific marker, an object having a characteristic part), it is determined that the captured image contains characteristic information.

[0180] According to this configuration, by using the characteristic portion FP1 of the object RO1 or predetermined identification information to determine the proximity condition, it is possible to improve the accuracy of determining the presence of the user U1.

[0181] Furthermore, in the information processing method according to this embodiment, the acquisition process (step S632) estimates the means of transportation of user U1 based on device information (e.g., each piece of information in device information DB210) relating to at least one of the electronic device MC1 associated with user U1 and the installed device installed in the means of transportation used by user U1.

[0182] According to this configuration, the means of transportation can be estimated using device information related to the electronic device MC1 or the installed device, thereby improving the accuracy of estimating the means of transportation of the user U1.

[0183] Furthermore, in the information processing method according to this embodiment, in the acquisition process (step S632), the means of transportation of user U1 is estimated based on at least one of the following device information: the attributes of electronic device MC1 or the installed device (e.g., attribute information 213) and information relating to the movement history of electronic device MC1 or the installed device.

[0184] According to this configuration, the means of transportation can be estimated using the attributes of the electronic device MC1 or the installed equipment, or information regarding the movement history of the electronic device MC1 or the installed equipment, thereby further improving the accuracy of estimating the means of transportation of user U1.

[0185] Furthermore, in the information processing method according to this embodiment, the acquisition process (step S632) uses, as information relating to movement history, at least one of the following: a history of location information of the electronic device MC1 or the installed equipment (e.g., movement history 214), a history of information relating to the acceleration of the electronic device MC1 or the installed equipment (e.g., vehicle information 215), a history of captured images acquired by the electronic device MC1 or the installed equipment (e.g., image information 216), and a history relating to communication between the electronic device MC1 and the installed equipment (e.g., connection information 217).

[0186] According to this configuration, the means of transportation can be estimated using location information history, etc., as information regarding the movement history of the electronic device MC1 or the installed equipment, thereby further improving the accuracy of estimating the means of transportation of user U1.

[0187] Furthermore, in the information processing method according to the present embodiment, the plurality of contents include information about the position or direction of another registered location (second predetermined location) different from the registered location (first predetermined location) where it has been determined that user U1 is present. For example, as shown in FIG. 5 , a guide image 323 can be displayed as information about the position or direction of another registered location (where building B1 is installed) different from the registered location where RO1 to RO3 are installed.

[0188] According to this configuration, it is possible to provide the user U1 who is present at the first predetermined location with information about the position or direction of the second predetermined location in an easy-to-understand manner.

[0189] Furthermore, in the information processing method according to this embodiment, in the provision process (steps S634 to S636), when it is determined that user U1 has moved to a second predetermined location, at least one of a plurality of contents set for the second predetermined location is selected and provided to user U1 based on user U1's means of transportation and the first predetermined location. For example, assume that there are multiple registered locations A to E located within a relatively close range, with registered location A being the entrance. Furthermore, assume that, for example, if the means of transportation is a car, guidance is provided from registered locations A to C to E, and if the means of transportation is walking, guidance is provided from registered locations A to B to D. In this case, for example, if a user moves according to guidance based on their means of transportation (e.g., if they move by car: registered locations A to C to E), at least one of the plurality of contents set for the registered location after the move is selected and provided, and if a user moves without following guidance based on their means of transportation (e.g., if they move by car: registered locations A to C to E), content other than the content set for the registered location after the move can be provided.

[0190] This configuration makes it possible to provide more appropriate content according to the movement of the user U1.

[0191] Furthermore, in the information processing method according to this embodiment, in the provision process (step S634), at least one of a plurality of second predetermined locations is selected based on the user U1's mode of transportation, and content related to the selected second predetermined location is provided to the user U1. For example, assume that there are a plurality of registered locations A to E located within a relatively close range, and registered location A is the entrance. In this case, for example, if the mode of transportation is a car, guidance can be provided from registered locations A to C to E, and if the mode of transportation is walking, guidance can be provided from registered locations A to B to D.

[0192] This configuration makes it possible to provide a more appropriate second predetermined location according to the means of transportation of the user U1.

[0193] In the information processing method according to this embodiment, in the provision process (step S634), the content selected based on the transportation means of the user U1 is provided to the user U1 along with information indicating the transportation means used for the selection. For example, as shown in FIG. 5 , the information indicating the transportation means is displayed in the transportation means display area 325.

[0194] With this configuration, even if the actual means of transportation of user U1 does not match the estimated result, user U1 can easily understand this, thereby reducing the sense of discomfort felt by the content.

[0195] In the information processing method according to the present embodiment, the content is at least one of audio information and image information. For example, as shown in Figures 9 and 10, it is possible to output both audio information and image information.

[0196] According to this configuration, at least one of audio information and image information can be provided to the user U1 as content at the registration location, thereby realizing information transmission that is easy for the user to understand.

[0197] Furthermore, in the information processing method according to this embodiment, in the provision process (see FIG. 12), even when the proximity condition is not met in the judgment process, at least one of the location information of other devices present around user U1, the location information of the registered location, and the travel route to the registered location corresponding to user U1's means of transportation is provided to user U1 based on the location information of user U1.

[0198] According to this configuration, when the user U1 is heading to a registered location, the user U1 can easily grasp each piece of information related to the registered location.

[0199] Furthermore, in the information processing method according to this embodiment, in the provision process (see FIG. 13), when user U1 is not present at the registered location and performs a designation operation to specify the registered location, at least one of the following is provided to user U1: at least one of the multiple contents set for the registered location, the travel range or travel route corresponding to the means of transportation associated with the registered location, location information of other devices present around the registered location, location information of the registered location, and the travel route to the registered location corresponding to user U1's means of transportation.

[0200] According to this configuration, even if the user U1 is not at the registered location, the user U1 can easily grasp each piece of information related to the registered location.

[0201] Furthermore, the content providing server 200 (an example of an information processing device) according to this embodiment is an information processing device that provides information to the user U1. The content providing server 200 includes an estimation unit 205 (an example of an acquisition unit) that acquires the transportation means of the user U1, and a content providing processing unit 206 (an example of a provision unit) that, when it is determined that the user U1 is present at a registered location (an example of a predetermined location), selects at least one of a plurality of contents set for the registered location based on the transportation means of the user U1 and provides the content to the user U1.

[0202] This configuration allows appropriate content to be provided according to each mode of transportation. Furthermore, since the content to be output can be selected based on the user's mode of transportation and only the necessary content can be output, the load and time required for sending and receiving content from the content providing server 200 to each device can be reduced. This allows for more efficient computational load related to information processing.

[0203] Note that each processing procedure shown in this embodiment is an example for realizing this embodiment, and the order of some of the processing procedures may be changed within the scope that makes it possible to realize this embodiment, and some of the processing procedures may be omitted or other processing procedures may be added.

[0204] Note that each process described in this embodiment is executed based on a program that causes a computer to execute each processing procedure. Therefore, this embodiment can also be understood as an embodiment of a program that realizes the function of executing each process and a recording medium that stores the program. For example, an update process for adding a new function to the contact determination device can store the program in the storage device of the contact determination device. This makes it possible to cause the updated contact determination device to perform each process described in this embodiment.

[0205] Although the embodiments of the present invention have been described above, the above embodiments merely illustrate some of the application examples of the present invention, and it is not intended that the technical scope of the present invention be limited to the specific configurations of the above embodiments.

Claims

1. An information processing method for providing information to a user, comprising: An acquisition process for acquiring a means of transportation of the user; and a providing process for selecting at least one of a plurality of contents set for the predetermined location based on a means of transportation of the user when it is determined that the user is present at the predetermined location, and providing the selected content to the user, In the providing process, at least one of a plurality of second predetermined locations, which is a predetermined location different from a first predetermined location, which is the predetermined location where it is determined that the user is present, is selected based on a transportation means of the user, and content related to the selected second predetermined location is provided to the user. Information processing methods.

2. 2. The information processing method according to claim 1, In the providing process, when it is determined that the user has moved to the second predetermined location, at least one of a plurality of contents set for the second predetermined location is selected based on a means of transportation of the user and the first predetermined location, and the selected content is provided to the user. Information processing methods.

3. 2. The information processing device according to claim 1, The plurality of contents includes information regarding a position or a direction of the second predetermined location. Information processing device.

4. 2. The information processing method according to claim 1, and determining whether the user is present at the predetermined location based on the establishment of a proximity condition between the predetermined location and an electronic device associated with the user. Information processing methods.

5. 5. The information processing method according to claim 4, In the determination process, it is determined that the proximity condition is met and that the user is present at the predetermined location when any one of the following cases is true: when the current location of the electronic device is within a predetermined range based on the predetermined location; when an image captured by the electronic device contains feature information related to the predetermined location; and when predetermined information is exchanged between the electronic device and a communication device installed at the predetermined location using wireless communication or wired communication. Information processing methods.

6. 6. The information processing method according to claim 5, In the determination process, When a characteristic part of an object installed at the predetermined location is included in the captured image, or when the captured image includes predetermined identification information, it is determined that the captured image includes the characteristic information. Information processing methods.

7. 2. The information processing method according to claim 1, In the acquisition process, the transportation means of the user is estimated based on device information on at least one of an electronic device associated with the user and an installed device installed in the transportation means used by the user. Information processing methods.

8. 8. An information processing method according to claim 7, In the acquisition process, a means of transportation of the user is estimated based on at least one of attributes of the electronic device or the installed device and information on a movement history of the electronic device or the installed device, as the device information. Information processing methods.

9. 9. The information processing method according to claim 8, In the acquisition process, at least one of a history of location information of the electronic device or the installed device, a history of information on the acceleration of the electronic device or the installed device, a history of captured images acquired by the electronic device or the installed device, and a history of communication between the electronic device and the installed device is used as the information on the movement history. Information processing methods.

10. 10. An information processing method according to claim 1, further comprising: In the providing process, information indicating the means of transportation used for the selection is provided to the user together with the content selected based on the means of transportation of the user. Information processing methods.

11. 10. An information processing method according to claim 1, further comprising: The content is at least one of audio information and image information. Information processing methods.

12. 7. An information processing method according to claim 4, further comprising: In the providing process, when the proximity condition is not established in the determining process, at least one of location information of other devices existing around the user, location information of the predetermined location, and a travel route to the predetermined location corresponding to the user's means of transportation is provided to the user based on location information of the user. Information processing methods.

13. 10. An information processing method according to claim 1, further comprising: In the providing process, when the user is not present at the predetermined location and a designation operation for designating the predetermined location is performed by the user, at least one of the following is provided to the user: at least one of the plurality of contents set for the predetermined location, a travel range or travel route corresponding to a means of travel related to the predetermined location, location information of other devices present around the predetermined location, location information of the predetermined location, and a travel route to the predetermined location corresponding to the means of travel of the user. Information processing methods.

14. An information processing device including a controller capable of executing a process of providing information to a user, The controller: An acquisition unit that acquires a means of transportation of the user; a providing unit that, when it is determined that the user is present at a predetermined location, selects at least one of a plurality of contents set for the predetermined location based on a means of transportation of the user, and provides the selected content to the user; The providing unit selects at least one from among a plurality of second predetermined locations, which is a predetermined location different from a first predetermined location, which is the predetermined location where it has been determined that the user is present, based on a transportation means of the user, and provides the user with content related to the selected second predetermined location. Information processing device.