Information processing device, information processing method, and information processing program

Abstract

To properly estimate a user's entry to and exit from a store.SOLUTION: An information processing device concerning the present application comprises: an acquisition unit; and an estimation unit. The acquisition unit acquires sensor information detected by a sensor from a terminal used by a target user subject to estimation. The estimation unit estimates the target user's entry to and exit from a target store subject to estimation according to context estimated by context estimation processing for estimating the context on the basis of the sensor information acquired by the acquisition unit.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and an information processing program.

Background Art

[0002] Conventionally, various techniques for capturing the entry and exit of a person (user) to and from a store have been provided. For example, a technique for capturing a person entering a store using a plurality of cameras for taking an authentication image including at least a part of the head of a customer entering the store has been provided.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, there is room for improvement in the above conventional techniques. For example, in the above conventional techniques, a specific configuration for capturing a person entering a store is required, such as installing a plurality of cameras at different heights. Therefore, it is desired to capture the entry and exit to and from the store by estimating the entry and exit of the user to the store.

[0005] The present application has been made in view of the above, and an object thereof is to provide an information processing apparatus, an information processing method, and an information processing program that appropriately estimate the entry and exit of a user to and from a store.

Means for Solving the Problems

[0006] The information processing device according to the present invention is characterized by comprising: an acquisition unit that acquires sensor information detected by a sensor from a terminal device used by a target user who is to be estimated; and an estimation unit that estimates the entry and exit of the target user to a target store who is to be estimated, according to the context estimated by a context estimation process that estimates the context based on the sensor information acquired by the acquisition unit. [Effects of the Invention]

[0007] According to one embodiment, the system has the effect of being able to appropriately estimate when a user enters or leaves a store. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 shows an example of information processing according to the embodiment. [Figure 2] Figure 2 shows an example of information processing according to the present invention. [Figure 3] Figure 3 shows an example of the configuration of an information processing system according to the embodiment. [Figure 4] Figure 4 shows an example of the configuration of an information processing device according to the present invention. [Figure 5] Figure 5 shows an example of a user information storage unit according to the embodiment. [Figure 6] Figure 6 shows an example of a store information storage unit according to the embodiment. [Figure 7] Figure 7 shows an example of a registration information storage unit according to the embodiment. [Figure 8] Figure 8 is a flowchart showing an example of information processing according to the embodiment. [Figure 9] Figure 9 is a flowchart showing an example of information processing according to the embodiment. [Figure 10] Figure 10 is a hardware configuration diagram showing an example of a computer that implements the functions of an information processing device. [Modes for carrying out the invention]

[0009] The following describes in detail, with reference to the drawings, the embodiments for implementing the information processing apparatus, information processing method, and information processing program according to the present application (hereinafter referred to as "embodiments"). Note that these embodiments do not limit the information processing apparatus, information processing method, and information processing program according to the present application. Furthermore, the same parts are denoted by the same reference numerals in each of the following embodiments, and redundant descriptions are omitted.

[0010] (Embodiment) [1. Information Processing] [1-1. Overall overview] First, an example of information processing according to the embodiment will be described using Figures 1 and 2. Figures 1 and 2 are diagrams showing an example of information processing according to the embodiment.

[0011] Specifically, Figure 1 shows an example of information processing related to information registration. In Figure 1, the information processing device 100 acquires sensor information detected by the sensor from the terminal device 10 used by the user, and registers the acquired sensor information in the sensor database (hereinafter referred to as "sensor data DB") by associating it with the context at the time of detection by the sensor. The sensor information includes various information detected by the sensor regarding the state of the terminal device 10 or the environment around the terminal device 10. For example, the sensor information may be information about various objects such as temperature, atmospheric pressure, sound, vibration, acceleration, illuminance (brightness), and position. Note that the above is merely an example, and the sensor information may be information about any object that can be detected by the sensor. For example, sound is not limited to sounds of audible frequency, but may also be ultrasound, and even if it is audible frequency sound, it is not limited to voice such as speech of the user (person), but may also be ambient sound, noise, etc. Also, for example, the sensor information may be biometric information such as blood glucose information showing the user's blood glucose level, or heart rate information showing the heart rate.

[0012] In the example shown below, an example of a context for registering the state of a user who uses the terminal device 10 in association with sensor information will be described. For example, in FIG. 1, states related to a user's entry into and exit from a store, such as a state where the user has entered the store, a state where the user has exited the store, and a state where the user is located outside the store, are described as an example of a context.

[0013] Note that the above is merely an example, and the context registered in association with the sensor information may be any information as long as it is a context at the time of detection by the sensor. For example, the context may be various situations of the user estimated based on the situation of the user or the terminal device 10 and the environment (background) of the user or the terminal device 10. Also, the context may be the physical environment where the user is placed, the social environment where the user is placed, the movement state of the user, and the estimated emotion of the user, etc. Further, the context may be the psychological state of the user estimated based on the situation of the user or the terminal device 10 and the environment (background) of the user or the terminal device 10.

[0014] Also, FIG. 2 is a diagram showing an example of information processing related to the estimation of information. In FIG. 2, the information processing device 100 acquires sensor information detected by a sensor from the terminal device 10 used by the user to be estimated (also referred to as the "target user"), and estimates the entry into and exit from the target store (also referred to as the "target store") of the target user based on the acquired sensor information (also referred to as the "target sensor information"). For example, in FIG. 2, a case where the information processing device 100 estimates the entry into and exit from the store of the user U5 with the user U5 as the target user is described as an example.

[0015] [1-1-1. Configuration of Information Processing System] The following will first describe the configuration of the information processing system 1 using Figure 3, and then explain the details of the processing shown in Figures 1 and 2. Figure 3 is a diagram showing an example configuration of an information processing system according to an embodiment. As shown in Figure 3, the information processing system 1 includes a terminal device 10, a store device 20, a data provision device 50, and an information processing device 100. The terminal device 10, the store device 20, the data provision device 50, and the information processing device 100 are connected to each other via a predetermined network N, either by wired or wireless communication. Note that the information processing system 1 shown in Figure 3 may include multiple terminal devices 10, multiple store devices 20, multiple data provision devices 50, and multiple information processing devices 100.

[0016] Terminal device 10 is a computer used by a user. Terminal device 10 can be implemented as, for example, a smartphone, a tablet, a notebook PC (Personal Computer), a desktop PC, a mobile phone, or a PDA (Personal Digital Assistant). Figure 1 shows the case where terminal device 10 is a smartphone. In the following, terminal device 10 may be referred to as the user. That is, in the following, the user can be read as terminal device 10.

[0017] The terminal device 10 has various sensors that detect various sensor information. The terminal device 10 detects sensor information by means of the various sensors. The terminal device 10 transmits the sensor information detected by the sensors to the information processing device 100. The terminal device 10 has a temperature sensor and detects the temperature information (sensor information) of the environment around the user. The terminal device 10 has a barometric pressure sensor and detects the barometric pressure information (sensor information) of the environment around the user. The terminal device 10 has a sound sensor such as a microphone and detects the voice information (sensor information) of the environment around the user. The terminal device 10 has a vibration sensor and detects the vibration information (sensor information) regarding the terminal device 10. The terminal device 10 has an acceleration sensor and detects the acceleration information (sensor information) regarding the terminal device 10. The terminal device 10 has an illuminance sensor and detects the illuminance information (sensor information) of the environment around the user. Further, the terminal device 10 may have an image sensor such as an image sensor and detect the image information (sensor information) of the environment around the user.

[0018] Also, the terminal device 10 has a position sensor and detects the position information (sensor information) of the user. For example, the terminal device 10 has a GPS (Global Positioning System) sensor. Also, the terminal device 10 may detect and acquire the position information (sensor information) of the user by using a predetermined wireless communication function such as Wi-Fi (registered trademark) (Wireless-Fidelity) or Bluetooth (registered trademark), a function such as a beacon, the position information of the base station with which communication is being performed, and the like. Note that hereinafter, the position information may sometimes be simply described as "position". For example, the terminal device 10 may improve the estimation accuracy of the user's position by combining GPS and the information such as the wireless communication function and beacon as described above. Also, the terminal device 10 transmits the position of the user to the information processing device 100.

[0019] In addition, the terminal device 10 collects various types of information other than sensor information and transmits them to the information processing device 100. The terminal device 10 transmits behavioral information indicating the user's actions using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information related to payments using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information related to payments at stores using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information indicating user operations to the information processing device 100. The terminal device 10 transmits behavioral information indicating the user's actions on the internet to the information processing device 100. For example, the terminal device 10 transmits behavioral information including posting information (input information) such as posts made by the user to SNS (Social Networking Service) to the information processing device 100. For example, the terminal device 10 transmits behavioral information including posting information made by the user to Twitter®, Facebook®, Instagram®, etc. to the information processing device 100.

[0020] In the following, a user identified by user ID "U1" may be referred to as "User U1". Thus, in the following, when "User U* (* is any number)" is written, it indicates that the user is identified by user ID "U*". For example, when "User U2" is written, the user is identified by user ID "U2". In addition, in the examples shown in Figures 1 and 2, terminal devices 10 will be described as terminal devices 10-1 to 10-3, 10-5, etc., depending on the user using the terminal device 10. For example, terminal device 10-1 is terminal device 10 used by the user identified by user ID "U1" (User U1). Also, for example, terminal device 10-5 is terminal device 10 used by the user identified by user ID "U5" (User U5). Furthermore, in the following, when terminal devices 10-1 to 10-3, 10-5, etc. are described without particular distinction, they will be referred to as terminal device 10.

[0021] The store device 20 is a computer used by the manager of each store. For example, the manager of restaurant A uses the store device 20 to send and receive information with the information processing device 100. For example, the store device 20 can be implemented as a smartphone, tablet, notebook PC, desktop PC, mobile phone, PDA, etc. The store device 20 transmits various information about the store to the information processing device 100. The store device 20 transmits information requested by the information processing device 100 to the information processing device 100. The store device 20 transmits store information to the information processing device 100, including various information such as the store's location and the type of entrance and exit of the store.

[0022] The data provider 50 is a server that provides various types of data to the information processing device 100. For example, the data provider 50 may provide weather-related data such as weather and temperature to the information processing device 100. The data provider 50 may also provide weather-related event information for the area where each store is located to the information processing device 100. For example, the data provider 50 provides open data, which is data that is permitted to be widely used, to the information processing device 100. For example, the data provider 50 may be an information processing device that manages and provides data owned by each local government to external parties as data. The data provider 50 may provide various types of data, not limited to those mentioned above, as long as the data (information) is permitted to be used, such as road information and other traffic-related data, geospatial information, disaster prevention and mitigation information, procurement information, and statistical information.

[0023] The information processing device 100 is a computer that performs processing related to information registration and processing related to information estimation. The information processing device 100 is an information processing device that can communicate with various devices via a predetermined network N such as the Internet, and is implemented, for example, by a server device or a cloud system. For example, the information processing device 100 is connected to various other devices via the network N in a way that allows communication.

[0024] The information processing device 100 performs a registration process to register sensor information detected by the sensor in the sensor data database, associating it with other information. The information processing device 100 performs a process to estimate the context based on the sensor information (also called "context estimation process"). The information processing device 100 registers the estimated context and the sensor information used for the estimation in the sensor data database, associating them. For example, the information processing device 100 registers the estimated context indicating entry and exit from a store, information indicating that store, and the sensor information used for the estimation in the sensor data database, associating them. The information processing device 100 provides services using the sensor data database.

[0025] Furthermore, the information processing device 100 performs an entry / exit estimation process (also simply called "estimation process") to estimate the entry and exit of a target user to a target store based on the target sensor information detected by the sensor. The information processing device 100 performs the estimation process using a sensor data DB in which history information associating sensor information acquired when a user enters or leaves a target store with the target store is registered. The information processing device 100 estimates the entry and exit of a target user to a target store based on a comparison between the history information registered in the sensor data DB and the target sensor information. The information processing device 100 provides information to the target user according to their entry and exit to the target store.

[0026] [1-2. Information processing related to information registration] From here, the flow of information processing will be explained using Figure 1. In Figure 1, the locations of users U1 to U3 are schematically shown using map MP1, etc. The information processing device 100 acquires sensor information SD11 from terminal device 10-1 used by user U1 (step S11-1). In Figure 1, terminal device 10-1 performs sensor detection when user U1 enters store SP11. Terminal device 10-1 transmits sensor information SD11 based on sensor detection to the information processing device 100. The information processing device 100 receives sensor information SD11 from terminal device 10-1. In Figure 1, the information processing device 100 receives sensor information SD11 corresponding to user U1 entering store SP11 from terminal device 10-1. As described above, sensor information such as sensor information SD11 may be information about various objects such as temperature, atmospheric pressure, sound, acceleration, illuminance (brightness), and location.

[0027] Then, the information processing device 100 acquires information indicating the context corresponding to the sensor information SD11 (step S12-1). In Figure 1, the information processing device 100 acquires information indicating that the context of user U1 at the time of detection, corresponding to the sensor information SD11, is entering store SP11. For example, the information processing device 100 acquires context information CD11 which includes information indicating that the context corresponding to the sensor information SD11 is the context CN11 of entering a store, and information indicating that the store is store SP11.

[0028] The information processing device 100 may acquire context information CD11 by any method as long as it is possible to acquire context information CD11. For example, the information processing device 100 may acquire context information CD11 from terminal device 10-1. In this case, terminal device 10-1 transmits context information CD11 to the information processing device 100 in response to the operation of user U1. The information processing device 100 receives context information CD11 from terminal device 10-1.

[0029] The above is merely an example, and the information processing device 100 may estimate the context information CD11 using various information. For example, the information processing device 100 may use various information acquired from the terminal device 10-1 to estimate that user U1 entered store SP11 at the time of detection corresponding to sensor information SD11. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to sensor information SD11 is context CN11 based on user U1's behavior information acquired from the terminal device 10-1. The information processing device 100 may also estimate that the context at the time of detection corresponding to sensor information SD11 is context CN11 based on behavior information indicating that user U1 opened the door of store SP11.

[0030] Then, the information processing device 100 registers the sensor information SD11 in the sensor data DB (step S13-1). In Figure 1, as shown in the registration information group DT, the information processing device 100 associates the context information corresponding to the sensor information SD11 with the information indicating the context and registers it in the sensor data DB. The information processing device 100 associates the context information CD11 with the sensor information SD11 and registers it in the sensor data DB. In this way, the information processing device 100 associates the context information CD11, which indicates that the detection context corresponding to the sensor information SD11 is context CN11 and the store is store SP11, with the sensor information SD11 and registers it in the sensor data DB.

[0031] In other words, the information processing device 100 registers information in the sensor data DB that indicates the context of user U1 at the time of detection, corresponding to the sensor information SD11, is entry into store SP11, associating it with the sensor information SD11. The information processing device 100 also registers history information in the sensor data DB that associates the sensor information SD11 acquired when user U1 enters store SP11 with store SP11. In this way, the information processing device 100 manages history information that associates sensor information acquired when a user enters or leaves a store with that store. The registered information group DT in the sensor data DB includes sensor information acquired when a user enters a store.

[0032] Furthermore, the information processing device 100 acquires sensor information SD21 from the terminal device 10-2 used by user U2 (step S11-2). In Figure 1, the terminal device 10-2 performs sensor detection when user U2 moves on foot in the area corresponding to map MP1. The terminal device 10-2 transmits sensor information SD21 based on the sensor detection to the information processing device 100. The information processing device 100 receives sensor information SD21 from the terminal device 10-2. In Figure 1, the information processing device 100 receives sensor information SD21 corresponding to user U2's movement from the terminal device 10-2.

[0033] Then, the information processing device 100 acquires information indicating the context corresponding to the sensor information SD21 (step S12-2). In Figure 1, the information processing device 100 acquires information indicating that the context of user U2 at the time of detection, corresponding to the sensor information SD21, is moving on foot. For example, the information processing device 100 acquires context information CD21 which includes information indicating that the context corresponding to the sensor information SD21 is the context CN21 of moving on foot.

[0034] The information processing device 100 may acquire context information CD21 by any method as long as it is possible to acquire context information CD21. For example, the information processing device 100 may acquire context information CD21 from terminal device 10-2. In this case, terminal device 10-2 transmits context information CD21 to the information processing device 100 in response to user U2's operation. The information processing device 100 receives context information CD21 from terminal device 10-2.

[0035] The above is merely an example, and the information processing device 100 may estimate the context information CD21 using various information. For example, the information processing device 100 may estimate that user U2 is moving on foot at the time of detection corresponding to sensor information SD21 using various information acquired from terminal device 10-2. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to sensor information SD21 is context CN21 based on user U2's behavior information acquired from terminal device 10-2. For example, the information processing device 100 may estimate that the context at the time of detection corresponding to sensor information SD21 is context CN21 based on behavior information indicating the content posted by user U2 using terminal device 10-2. Alternatively, the information processing device 100 may estimate that user U2 is moving on foot based on acceleration information included in sensor information SD21.

[0036] Then, the information processing device 100 registers the sensor information SD21 in the sensor data DB (step S13-2). In Figure 1, as shown in the registration information group DT, the information processing device 100 associates the sensor information SD21 with context information CD21 and registers it in the sensor data DB. The information processing device 100 associates the sensor information SD21 with context information CD21 and registers it in the sensor data DB. In this way, the information processing device 100 associates the sensor information SD21 with context information CD21, which indicates that the context at the time of detection corresponding to the sensor information SD21 is context CN21 and that there is no corresponding store, and registers it in the sensor data DB. In other words, the information processing device 100 associates the sensor information SD21 with information indicating that the context of user U2 at the time of detection corresponding to the sensor information SD21 is moving on foot and registers it in the sensor data DB.

[0037] Furthermore, the information processing device 100 acquires sensor information SD31 from the terminal device 10-3 used by user U3 (step S11-3). In Figure 1, the terminal device 10-3 detects when user U3 leaves the store SP22 using its sensor. The terminal device 10-3 transmits sensor information SD31 based on the sensor detection to the information processing device 100. The information processing device 100 receives sensor information SD31 from the terminal device 10-3. In Figure 1, the information processing device 100 receives sensor information SD31 corresponding to when user U3 leaves the store SP22 from the terminal device 10-3.

[0038] Then, the information processing device 100 acquires information indicating the context corresponding to the sensor information SD31 (step S12-3). In Figure 1, the information processing device 100 acquires information indicating that the context of user U3 at the time of detection, corresponding to the sensor information SD31, is leaving store SP22. For example, the information processing device 100 acquires context information CD31 which includes information indicating that the context corresponding to the sensor information SD31 is the context CN31 of leaving a store, and information indicating that the store is store SP22.

[0039] The information processing device 100 may acquire context information CD31 by any method as long as it is possible to acquire context information CD31. For example, the information processing device 100 may acquire context information CD31 from terminal device 10-3. In this case, terminal device 10-3 transmits context information CD31 to the information processing device 100 in response to the operation of user U3. The information processing device 100 receives context information CD31 from terminal device 10-3.

[0040] The above is merely an example, and the information processing device 100 may estimate the context information CD31 using various information. For example, the information processing device 100 may use various information acquired from the terminal device 10-3 to estimate that user U3 has left the store SP22 at the time of detection corresponding to sensor information SD31. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to sensor information SD31 is context CN31 based on user U3's behavior information acquired from the terminal device 10-3. For example, the information processing device 100 may estimate that the context at the time of detection corresponding to sensor information SD31 is context CN31 based on user U3's behavior information indicating electronic payment using the terminal device 10-3.

[0041] Then, the information processing device 100 registers the sensor information SD31 in the sensor data DB (step S13-3). In Figure 1, as shown in the registration information group DT, the information processing device 100 associates the context information corresponding to the sensor information SD31 with the information indicating the context and registers it in the sensor data DB. The information processing device 100 associates the context information CD31 with the sensor information SD31 and registers it in the sensor data DB. In this way, the information processing device 100 associates the context CN31, which is the context at the time of detection corresponding to the sensor information SD31, with the context information CD31, which indicates that the store is store SP22, and registers it in the sensor data DB.

[0042] In other words, the information processing device 100 registers information in the sensor data DB that indicates the context of user U3 at the time of detection, corresponding to the sensor information SD31, is leaving store SP22, associating it with the sensor information SD31. The information processing device 100 also registers history information in the sensor data DB that associates the sensor information SD31 acquired when user U3 leaves store SP22 with store SP22. In this way, the information processing device 100 manages history information that associates sensor information acquired when a user enters or leaves a store with that store. The registered information group DT in the sensor data DB includes sensor information acquired when a user leaves a store.

[0043] Although Figure 1 illustrates three users U1 to U3, the information processing device 100 acquires sensor information not only from users U1 to U3, but also from a large number of other users, such as user U4 (for example, 1 million users or 10 million users). The information processing device 100 then associates the sensor information acquired for the large number of users with the context and store information at the time of detection by the sensor and registers it in the sensor data database.

[0044] In this way, the information processing device 100 registers sensor information detected by the sensor and the context in which the sensor detected that sensor information in the database. In Figure 1, the information processing device 100 stores the sensor information in association with information indicating the context corresponding to that sensor information. Furthermore, if there is a store corresponding to the sensor information, the information processing device 100 registers the sensor information in association with information indicating the context corresponding to that sensor information and information indicating the store corresponding to that sensor information in the database. As a result, when new sensor information is acquired, the information processing device 100 can use the database to appropriately estimate (identify) the context and store corresponding to the newly acquired sensor information. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

[0045] [1-3. Information Processing Regarding Information Estimation] Next, using Figure 2, we will explain an example of the process by which the information processing device 100 estimates the entry and exit of a target user to a target store based on sensor information detected by the sensor. Specifically, in the following explanation, we will describe an example in which the information processing device 100 uses the sensor data DB to estimate the entry and exit of the store of the user corresponding to the newly acquired sensor information when new sensor information is acquired. Note that explanations of points similar to those in Figure 1 will be omitted as appropriate.

[0046] Figure 2 shows the case where the information processing device 100 performs estimation processing with user U5 as the target user. The information processing device 100 acquires sensor information SD51 from the terminal device 10-5 used by user U5 (step S21). In Figure 2, the terminal device 10-5 performs sensor detection when user U5 enters the store SP11. The terminal device 10-5 transmits sensor information SD51 based on the sensor detection to the information processing device 100. The information processing device 100 receives sensor information SD51 from the terminal device 10-5. In Figure 2, the information processing device 100 receives sensor information SD51 corresponding to user U5 entering the store SP11 from the terminal device 10-5. As a result, the information processing device 100 acquires sensor information SD51 about user U5, who is the target user, as shown in the target information TG. As mentioned above, the sensor information SD51 may be information about various targets such as temperature, atmospheric pressure, sound, acceleration, illuminance (brightness), and location.

[0047] Then, the information processing device 100 estimates user U5's entry and exit from the store based on the sensor information SD51 (step S22). In Figure 2, the information processing device 100 estimates user U5's entry and exit from the store using the registration information group DT, which is history information registered in the sensor data DB. In this way, the information processing device 100 estimates user U5's entry and exit from the store using the registration information group DT, which includes sensor information acquired when the user enters the store and sensor information acquired when the user leaves the store.

[0048] For example, the information processing device 100 estimates user U5's entry into and exit from a store based on a comparison between the registered information group DT in the sensor data DB and the sensor information SD51. The information processing device 100 estimates user U5's entry into and exit from a store based on a comparison between each sensor information included in the registered information group DT and the sensor information SD51. For example, the information processing device 100 estimates that the context corresponding to the sensor information SD51 is similar to the context of user U5 at the time of detection of the sensor information SD51 among the sensor information included in the registered information group DT is the context of user U5 at the time of detection.

[0049] For example, the information processing device 100 estimates that the context corresponding to the sensor information with the highest similarity to sensor information SD51 among the sensor information included in the registration information group DT is the context of user U5 at the time sensor information SD51 is detected. In Figure 2, the information processing device 100 compares the registration information group DT in the sensor data DB with sensor information SD51 and determines that sensor information SD51 is similar to sensor information SD11 among the sensor information included in the registration information group DT. The information processing device 100 then estimates that the context of user U5 at the time sensor information SD51 is detected is the context associated with sensor information SD11. For example, the information processing device 100 estimates that the context of user U5 at the time sensor information SD51 is detected is the context CN11 of entering a store, and that store is store SP11. That is, as shown in the estimation result RS, the information processing device 100 estimates that user U5 entered store SP11 at the time sensor information SD51 was detected.

[0050] The information processing device 100 uses a database that associates stores with sensor information that may be acquired when entering or leaving a store, and estimates whether a person has entered or left a store if the corresponding sensor information is obtained. For example, the information processing device 100 may use a sensor data DB, which contains sensor information for each action taken within the store, to estimate whether a person has entered or left a store. The sensor data DB may also contain sensor information corresponding to each entry route into the store.

[0051] Furthermore, when the information processing device 100 estimates the entry and exit of user U5 to store SP11, with store SP11 as the target store, it may process the data using only the sensor information associated with store SP11 from the information in the sensor data DB. In this case, for example, the information processing device 100 may extract the sensor information associated with store SP11 from the registered information group DT in the sensor data DB, and estimate the entry and exit of user U5 to store SP11 based on a comparison of the extracted information with the sensor information SD51.

[0052] Furthermore, if the sensor information SD51 is similar to the sensor information SD31, the information processing device 100 estimates that user U5 has left the store SP22 at the time of detection of sensor information SD51. The process for estimating a user's departure from the store is the same as the process for estimating entry into the store described above, so a detailed explanation is omitted.

[0053] In this way, the information processing device 100 estimates a user's entry into and exit from a store based on sensor information detected by the sensor. For example, the information processing device 100 compares the sensor information detected by the sensor with historical information and estimates that the context corresponding to a history similar to the sensor information is the context at the time the sensor information was detected. The information processing device 100 refers to a database in which sensor information that may be acquired when entering or leaving a store is registered, and estimates a user's entry into and exit from the store based on the acquired sensor information.

[0054] Specifically, the information processing device 100 estimates that the user entered the target store at the time the sensor information was detected if the sensor information detected by the sensor is similar to the history detected when the user entered the target store in the past. Furthermore, the information processing device 100 estimates that the user left the target store at the time the sensor information was detected if the sensor information detected by the sensor is similar to the history detected when the user left the target store in the past. Therefore, the information processing device 100 can appropriately estimate a user's entry and exit from a store based on the information detected by the sensor.

[0055] [1-4. Other Processing Examples] The above-described process is merely an example, and the information processing device 100 may perform various processes using various types of information. Examples of this are listed below.

[0056] [1-4-1.Position] For example, when the terminal device 10 detects the location using GPS or the like, the accuracy of location detection decreases when the user enters a building, making it difficult to estimate the user's entry or exit from the store based on location alone. For example, when the user enters a building, the location detection result may not indicate a specific point such as a predetermined range. For example, when the user enters a building, the location detection result may indicate information such as a range within a predetermined distance (e.g., a radius of 100m) centered on a predetermined point, or a predetermined area. In such cases, it is difficult for the information processing device 100 to appropriately estimate the user's entry or exit from the store based on location alone.

[0057] Therefore, the information processing device 100 estimates the user's entry and exit from a store using sensor information other than location, in addition to the location detection result. In this case, for example, the information processing device 100 extracts target stores based on the location detection result. For example, the information processing device 100 extracts stores located within the range indicated by the location detection result as candidate stores (also called "candidate stores") for which entry and exit will be estimated.

[0058] The information processing device 100 then performs a process to estimate store entry and exit using only the sensor information associated with candidate stores from the information in the sensor data DB. In this case, for example, the information processing device 100 may extract the sensor information associated with candidate stores from the registered information group DT in the sensor data DB, and estimate the entry and exit of the target user to the store based on a comparison of the extracted information with the target sensor information.

[0059] In Figure 2, the information processing device 100 may extract sensor information associated with candidate stores from the registered information group DT in the sensor data DB, and estimate the entry and exit of user U5 to the stores based on a comparison of the extracted information with the sensor information SD51. For example, the information processing device 100 may extract sensor information associated with candidate stores from the registered information group DT in the sensor data DB, and estimate which of the candidate stores user U5 entered and exited based on a comparison of the extracted information with the sensor information SD51.

[0060] [1-4-2. Features] The example described above explains the case where sensor information detected by a sensor is used, but the information processing device 100 may also perform processing using, for example, feature quantities generated based on the sensor information. For example, the information processing device 100 may perform processing using feature quantities extracted from each sensor information.

[0061] For example, the process of generating features from sensor information is carried out using various techniques such as feature extraction from sensor information, but a detailed explanation is omitted. Note that any process is acceptable as long as it can generate features from sensor information. Furthermore, the process of generating features from sensor information may be performed by the information processing device 100 or by the terminal device 10. Also, when using features in the above example, the process is the same except that sensor information is replaced by features, so a detailed explanation is omitted.

[0062] For example, terminal device 10 generates feature quantities from sensor information before and after entering and leaving the store and transmits them to information processing device 100. Information processing device 100 links the feature quantities to stores and registers them in the sensor data DB. The information processing device 100 may then generate common feature quantities (common feature quantities) for each store based on the average or commonality of the feature quantities. The information processing device 100 may also generate feature quantities for each action associated with a store, such as entering, leaving, and staying in the store.

[0063] For example, terminal device 10 transmits the feature quantities of sensor information detected by the sensor to information processing device 100. The information processing device 100 estimates entry and exit based on the feature quantities.

[0064] [1-4-3. Examples of various estimations] For example, the information processing device 100 may estimate entry into and exit from a store in accordance with changes in atmospheric pressure. For example, the information processing device 100 may estimate the context in accordance with the payment order, such as post-payment or pre-payment. For example, if the store is post-payment, the information processing device 100 may estimate that the customer left the store at the time the payment action was taken. For example, if the store is pre-payment, the information processing device 100 may estimate that the customer entered the store at the time the payment action was taken.

[0065] Furthermore, the information processing device 100 may estimate various contexts, not limited to contexts related to entering and leaving a store. For example, the information processing device 100 may estimate contexts related to the store, such as contexts related to actions within the store, such as eating or drinking inside the store. The information processing device 100 may also estimate contexts related to the use of the store, such as staying in the store. For example, the information processing device 100 may estimate contexts related to user movements, such as jumping rope, running, sitting, or eating. In addition, for example, the information processing device 100 may estimate changes in the store context based on changes in information registered in the sensor data DB.

[0066] [1-4-4. Context Switching] For example, the information processing device 100 may estimate a context change and perform processing according to the estimated context change. For example, the information processing device 100 may estimate a context change related to entering and leaving a store by estimating the context based on sensor information.

[0067] The information processing device 100 may estimate that entry or exit has occurred at a store if a change in context related to entering or leaving the store is estimated. For example, the information processing device 100 may estimate that entry or exit has occurred when the user's terminal device 10 acquires sensor information, estimates the user's context from the sensor information, and detects a change in the estimated context. In this case, the information processing device 100 may associate the sensor information before and after entry / exit with the store and register it in the sensor data DB.

[0068] The information processing device 100 estimates the context based on sensor information and estimates the user's entry into and exit from the store according to the estimated context. The information processing device 100 estimates the user's entry into and exit from the store in response to the switch from the first context before the context estimation process to the second context estimated by the context estimation process.

[0069] For example, the information processing device 100 estimates that a user has entered a store when the user's context switches from a first context indicating that the user is located outside the store to a second context indicating that the user is located inside the store. In Figure 2, the information processing device 100 estimates that user U5 has entered store SP11 when the user's context switches from context CN51 indicating that the user is located outside store SP11 to context CN52 indicating that the user is located inside store SP11.

[0070] For example, the information processing device 100 estimates that a user has left a store when the user's context switches from a first context indicating that the user is located inside the store to a second context indicating that the user is located outside the store. In Figure 2, the information processing device 100 estimates that user U5 has left store SP11 when the user's context switches from context CN52 indicating that the user is located inside store SP11 to context CN51 indicating that the user is located outside store SP11.

[0071] Furthermore, the information processing device 100 may estimate a context change, and if it estimates that a context change has occurred, it may associate the sensor information with the context and register it in the database.

[0072] For example, when the information processing device 100 switches from a first context indicating that the user is located outside the store to a second context indicating that the user is located inside the store, it registers the second context and the sensor information used to estimate the second context in the database. In Figure 1, when the context of user U1 switches from context CN51 indicating that the user is located outside the store SP11 to context CN52 indicating that the user is located inside the store SP11, the information processing device 100 registers context CN52 and the sensor information used to estimate context CN52 in the sensor data DB. In this case, the information processing device 100 may also register other sensor information, which is the sensor information used to estimate the previous context CN51, in the sensor data DB along with context CN52.

[0073] For example, when the information processing device 100 switches from a first context indicating that the user is located inside the store to a second context indicating that the user is located outside the store, it registers the second context and the sensor information used to estimate the second context in the database. In Figure 1, when the context of user U1 switches from context CN52 indicating that the user is located inside the store SP11 to context CN51 indicating that the user is located outside the store SP11, the information processing device 100 registers context CN51 and the sensor information used to estimate context CN51 in the sensor data DB. In this case, the information processing device 100 may also register other sensor information, which is the sensor information used to estimate the previous context CN52, in the sensor data DB along with context CN51.

[0074] [1-4-5. Examples of Service Provision] The information processing device 100 may provide various services using the various types of information described above. For example, the information processing device 100 may provide information in response to store entry and exit, such as distributing advertisements or coupons. For example, if the information processing device 100 estimates that a user has entered a store, it distributes a coupon related to that store to the terminal device 10 used by that user. In Figure 2, if the information processing device 100 estimates that user U5 has entered store SP11, it distributes a discount coupon for products offered by store SP11 to the terminal device 10-5 used by user U5.

[0075] Furthermore, for example, if the information processing device 100 estimates that a user has left a store, it distributes coupons for stores located within a predetermined range (e.g., within a radius of 100m) from that store to the terminal device 10 used by that user. In Figure 2, if the information processing device 100 estimates that user U5 has left store SP11, it distributes discount coupons for products offered by stores located within a predetermined range (e.g., store SP22) from store SP11 to the terminal device 10-5 used by user U5.

[0076] [1-4-6. Example of database update] The registration (updating) of the database (sensor database, etc.) described above is merely one example, and the information processing device 100 may update the database using various types of information. For example, the information processing device 100 may register a new link between a store and a context based on reliable data such as purchase information from a payment application. Also, for example, if the detected context differs significantly from any of the existing store data, the information processing device 100 may consider it to be a new store and request the user to provide information. In this case, the information processing device 100 may associate the detected sensor information and context with the store information provided by the user and register it in the database.

[0077] Furthermore, for example, if a part of the context associated with a store changes discontinuously at a certain point in time, the information processing device 100 may detect this change and update the model to improve future estimation accuracy. For example, if a part of the context associated with a store changes discontinuously at a certain point in time due to a change in air pressure caused by a change in ventilation equipment, or a change in illumination due to the addition of a roof, the information processing device 100 may detect this change and update the model to improve future estimation accuracy.

[0078] [1-4-7. Other estimated store closures] In the example described above, processing using a sensor data database was explained as an example, but the information processing device 100 may perform processing without using a sensor data database. For example, the information processing device 100 may determine whether a target user has left the store by checking whether the reaction value of a sensor that has been identified as having left the store before the target user is close to the reaction value of the sensor corresponding to the target user.

[0079] For example, the information processing device 100 may compare sensor data corresponding to the target user with sensor data from other users when they leave the store, and if the similarity of the data is above a predetermined threshold, it may estimate that the target user has left the store. For example, the information processing device 100 may temporarily store the reaction values ​​of a previously leaving user in local memory using BLE (Bluetooth Low Energy), and based on the change data of that sensor, it may estimate that the target user has left the store when the waveform of the change data of that sensor becomes similar to that waveform.

[0080] [1-4-8. Example of rule-based processing] In the example described above, the process of estimating a user's entry and exit based on changes in sensor data was explained as an example, but the information processing device 100 may also estimate a user's entry and exit based on rules. For example, the information processing device 100 may estimate a user's entry and exit using rule information that indicates rules for determining entry and exit. For example, the information processing device 100 may estimate a user's entry and exit using rule information that defines arbitrary rule bases such as "enter when an entrance beacon is detected," "exit 20 seconds after payment," or "exit 15 seconds before reacting to a parking sensor." For example, if the sensor data matches a rule included in the rule information, the information processing device 100 may estimate that the user corresponding to that sensor data performed an action corresponding to that rule.

[0081] [2. Configuration of the Information Processing Device] Next, the configuration of the information processing device 100 according to the embodiment will be described using Figure 4. Figure 4 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Figure 4, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. The information processing device 100 may also have an input unit (for example, a keyboard or mouse) that receives various operations from an administrator of the information processing device 100, and a display unit (for example, a liquid crystal display) for displaying various information.

[0082] (Communications Department 110) The communication unit 110 is implemented, for example, by a NIC (Network Interface Card). The communication unit 110 is connected to the network by wire or wireless connection and transmits and receives information with the terminal device 10.

[0083] (Storage unit 120) The storage unit 120 is implemented by, for example, semiconductor memory elements such as RAM (Random Access Memory) and flash memory, or by storage devices such as hard disks and optical discs. As shown in Figure 4, the storage unit 120 according to this embodiment includes a user information storage unit 121, a store information storage unit 122, and a registration information storage unit 123.

[0084] (User information storage unit 121) The user information storage unit 121 according to this embodiment stores various information about the user. For example, the user information storage unit 121 stores various information about the user's attributes. Figure 5 shows an example of the user information storage unit according to this embodiment. The user information storage unit 121 shown in Figure 5 includes items such as "User ID," "Age," "Gender," "Home," "Workplace," "Location," and "Context."

[0085] "User ID" indicates identification information used to identify a user. For example, the user identified by User ID "U1" corresponds to User U1 shown in the example in Figure 1. "Age" indicates the user's age. Note that "Age" may be a specific age, such as 35 years old. "Gender" indicates the user's gender.

[0086] Furthermore, "Home" indicates the location information of the user's home. In Figure 5, "Home" is illustrated with an abstract code such as "LC11," but it may also be information indicating latitude and longitude, or information indicating an address such as "X Prefecture, Y City, Z Town." It may also be latitude and longitude information, etc. Also, for example, "Home" may be a regional name or address.

[0087] Furthermore, "Work Location" indicates the location information of the user's workplace. In Figure 5, "Work Location" is shown as an abstract code such as "LC12," but it may also be information indicating latitude and longitude, or information indicating an address such as "X Prefecture, Y City, Z Town." For example, "Work Location" may also be a regional name or address.

[0088] "Location" indicates the location acquired (detected) for the user. In Figure 5, "Location" indicates the last acquired location (latest location) for the user. Note that "Location" may store multiple locations for the user. For example, "Location" may store a history of acquired locations for the user, i.e., information showing the changes in the user's location. Also, in Figure 5, "Location" is illustrated with an abstract code such as "LC1," but it may also be information indicating an area such as City X, Town Y, Area A, information indicating latitude and longitude, or information indicating an address such as "City X, Town Y, Town Z." For example, "Location" may be information indicating a target area such as a store where the user is located.

[0089] Furthermore, "Context" indicates the context obtained (estimated) about the user. In Figure 5, "Context" shows the last context obtained about the user (latest context). Note that "Context" may store multiple contexts about the user. For example, "Context" may store a history of contexts obtained about the user, i.e., information showing the changes in the user's context. Also, in Figure 5, "Context" is illustrated with an abstract code such as "CN11," but concrete information indicating the user's context is stored. For example, "Context" may store information such as "Entered store SP11," "Leaving store SP12," "Traveling on foot," etc.

[0090] For example, the user identified by user ID "U1" (user U1) is in their 20s and is male. User U1's home is "LC11". User U1's workplace is "LC12". User U1's most recent location is "LC1". User U1's context is "CN11".

[0091] The user information storage unit 121 is not limited to the above and may store various types of information depending on the purpose. For example, the user information storage unit 121 may store information about the user's demographic attributes and psychographic attributes. For example, the user information storage unit 121 may store information such as name, family structure, income, interests, and lifestyle. The user information storage unit 121 may store the date and time each location was acquired in association with each location. The user information storage unit 121 may store the date and time each context was acquired in association with each context.

[0092] (Store information storage unit 122) The store information storage unit 122 according to this embodiment stores various information about a store. Figure 6 shows an example of the store information storage unit according to this embodiment. For example, the store information storage unit 122 stores information about various stores. The store information storage unit 122 shown in Figure 6 includes items such as "store ID", "name", "category", and "store information".

[0093] The "Store ID" indicates identification information used to identify the store. The "Name" indicates the specific name of the store. For example, the "Name" may be a combination of the store's name and location, such as "○○ Restaurant X Town Branch". The "Category" indicates the category to which the store belongs.

[0094] Furthermore, "Store Information" displays various information about the store. "Store Information" stores various information such as the store's location and the type of store entrance. For example, the type of store entrance includes the location of the entrance, the type of entrance door, and the type of entrance stairs. For example, the type of entrance door includes whether there is a door, whether the door is automatic or manual, and the weight of the door. For example, the type of entrance stairs includes the number of stairs and the height of the stairs.

[0095] In Figure 6, "Store Information" is represented by abstract symbols such as "Store Information #11" and "Store Information #12," but Store Information #11, Store Information #12, etc., contain various information about each store. For example, Store Information #11 indicates the location of Restaurant A. Store Information #11 also includes information such as the appearance of Restaurant A's entrance and the appearance of the stairs leading to the entrance.

[0096] For example, in the example in Figure 6, the store identified by store ID "SP11" (store SP11) is named "Restaurant A" and belongs to the category "Food and Drink". Also, for example in the example in Figure 6, store SP11, which is Restaurant A, indicates that the store information is store information #11.

[0097] Furthermore, the store information storage unit 122 may store various types of information depending on the purpose, not limited to the above. The store information storage unit 122 may store not only store information, but also various types of information such as facilities and areas other than stores.

[0098] (Registration information storage unit 123) The registration information storage unit 123 according to this embodiment stores various information related to registration. The registration information storage unit 123 stores various information related to sensing (detection) by the sensor. Figure 7 is a diagram showing an example of the registration information storage unit according to this embodiment. The registration information storage unit 123 shown in Figure 7 includes items such as "registration ID", "date and time", "sensor information", "context", and "store".

[0099] The "Registration ID" indicates identification information used to identify the acquired sensor information. The "Date and Time" indicates the date and time corresponding to each Registration ID. For example, the "Date and Time" indicates the date and time when the sensor information corresponding to each Registration ID was acquired. In the example in Figure 7, the "Date and Time" is shown abstractly as "DA11," but a specific date and time such as "April 21, 2022, 16:47:28" may also be stored.

[0100] "Sensor information" refers to the detected sensor information. Various types of information are stored in "sensor information" depending on the type of information detected. For example, "sensor information" may store audio information, acceleration information, temperature information, humidity information, illuminance information, location information such as the range of area A, etc.

[0101] "Context" refers to the context at the time the sensor information was detected. For example, "Context" refers to the context estimated from the sensor information. For example, "Context" may store the context detected by the sensor information as the second context, the context immediately preceding it as the first context, and information indicating changes in context.

[0102] The "Store" field indicates the store corresponding to the context. If there is no store corresponding to the context, the store field will be left blank ("-" (hyphen)).

[0103] In the example in Figure 7, the registration information identified by the registration ID "DL11" (registration information DL11) indicates that it is information corresponding to the sensing (detection) at the date and time DA11. The registration information DL11 indicates that the sensor information SD11 was acquired (detected) at the date and time DA11, the context corresponding to the sensor information SD11 is context CN11, and the store corresponding to context CN11 is store SP11.

[0104] The registration information storage unit 123 is not limited to the above and may store various types of information depending on the purpose. For example, the registration information storage unit 123 may store information that identifies the terminal device 10 corresponding to each piece of registration information.

[0105] (Control unit 130) Returning to the explanation of Figure 4, the control unit 130 is a controller, and is realized by various programs (corresponding to an example of an information processing program) stored in the memory device inside the information processing device 100 being executed using RAM as the working area by a CPU (Central Processing Unit) or MPU (Micro Processing Unit), etc. Furthermore, the control unit 130 is a controller, and is realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array), for example.

[0106] As shown in Figure 4, the control unit 130 includes an acquisition unit 131, an estimation unit 132, a registration unit 133, a processing unit 134, and a provision unit 135, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in Figure 4, and other configurations are also acceptable as long as they perform the information processing described later.

[0107] (Acquisition part 131) The acquisition unit 131 acquires various types of information. The acquisition unit 131 acquires various types of information from the storage unit 120. In addition, the acquisition unit 131 acquires various types of information from the user information storage unit 121, the store information storage unit 122, the registration information storage unit 123, etc.

[0108] The acquisition unit 131 acquires various information from external devices. The acquisition unit 131 acquires information from the terminal device 10. The acquisition unit 131 acquires information from the store device 20. The acquisition unit 131 acquires information from the data provision device 50. The acquisition unit 131 acquires information from the store device 20. The acquisition unit 131 receives various information from external information processing devices via the communication unit 110. The acquisition unit 131 receives various information from the terminal device 10, the store device 20, the data provision device 50, etc.

[0109] The acquisition unit 131 acquires the user's location information from the terminal device 10 used by the user. The acquisition unit 131 acquires store information from the store information storage unit 122. The acquisition unit 131 acquires information estimated by the estimation unit 132.

[0110] The acquisition unit 131 acquires sensor information detected by the sensor from the terminal device 10 used by the user. The acquisition unit 131 acquires sensor information detected by the sensor when the user enters or leaves the store. The acquisition unit 131 acquires sensor information detected by the sensor when the user enters the store. The acquisition unit 131 acquires sensor information detected by the sensor when the user leaves the store.

[0111] The acquisition unit 131 acquires sensor information detected by the sensor from the terminal device 10 used by the target user who is the estimated target user. The acquisition unit 131 acquires history information that associates the sensor information acquired when the user enters and leaves the target store with the target store. The acquisition unit 131 acquires history information that includes entry sensor information that associates the sensor information acquired when the user enters the target store with the target store. The acquisition unit 131 acquires history information that includes exit sensor information that associates the sensor information acquired when the user leaves the target store with the target store.

[0112] (Estimation part 132) The estimation unit 132 performs estimation processing to estimate various types of information. The estimation unit 132 stores the estimated information in the storage unit 120. The estimation unit 132 estimates various types of information based on information from external information processing devices and information stored in the storage unit 120. The estimation unit 132 estimates various types of information from the storage unit 120. The estimation unit 132 estimates various types of information from the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123. The estimation unit 132 identifies various types of information. The estimation unit 132 estimates various types of information. The estimation unit 132 performs estimation processing based on sensor information acquired by the acquisition unit 131.

[0113] The estimation unit 132 performs a context estimation process to estimate the context based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates a context switch based on the first context before the context estimation process and the second context estimated by the context estimation process.

[0114] The estimation unit 132 estimates a context switch from a first context corresponding to a context in which the user is located outside the store to a second context corresponding to a context in which the user is located inside the store. The estimation unit 132 estimates a context switch from a first context corresponding to a context in which the user is located inside the store to a second context corresponding to a context in which the user is located outside the store.

[0115] The estimation unit 132 estimates the entry and exit of a target user to a target store, which is the store to be estimated, based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates the entry and exit of a target user to a target store based on the history information. The estimation unit 132 estimates the entry and exit of a target user to a target store based on a comparison of the history information and the sensor information.

[0116] The estimation unit 132 estimates the entry of a target user into a target store based on historical information. The estimation unit 132 estimates the entry of a target user into a target store based on a comparison of entry sensor information and sensor information. The estimation unit 132 estimates the departure of a target user from a target store based on historical information. The estimation unit 132 estimates the departure of a target user from a target store based on a comparison of exit sensor information and sensor information.

[0117] The estimation unit 132 estimates the entry and exit of target users to target stores according to the context estimated by a context estimation process, which estimates the context based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates the entry and exit of target users to target stores in accordance with the switch from the first context before the context estimation process to the second context estimated by the context estimation process.

[0118] The estimation unit 132 estimates the entry of the target user into the target store in response to a switch from a first context corresponding to a context in which the target user is located outside the target store to a second context corresponding to a context in which the target user is located inside the target store. The estimation unit 132 also estimates the departure of the target user from the target store in response to a switch from a first context corresponding to a context in which the target user is located inside the target store to a second context corresponding to a context in which the target user is located outside the target store.

[0119] (Registration Section 133) The registration unit 133 performs a registration process to register various types of information. The registration unit 133 performs the registration process by storing the information in the storage unit 120. The registration unit 133 registers various types of information acquired from external devices. For example, the registration unit 133 associates sensor information with information indicating context and store and registers it in the registration information storage unit 123.

[0120] The registration unit 133 registers the sensor information acquired by the acquisition unit 131 in the database, associating it with the context of the sensor's detection. The registration unit 133 also registers the sensor information acquired when a user enters or leaves a store in the database, associating it with the context indicating entry or exit to the store.

[0121] The registration unit 133 associates sensor information acquired when a user enters a store with an entry context indicating entry into the store and registers it in the database. The registration unit 133 also associates sensor information acquired when a user leaves a store with an exit context indicating departure from the store and registers it in the database.

[0122] The registration unit 133 registers the sensor information acquired by the acquisition unit 131 in the database, associating it with the context estimated by the context estimation process. If the estimation unit 132 estimates that a context switch has occurred, the registration unit 133 registers the sensor information acquired by the acquisition unit in the database, associating it with the second context. The registration unit 133 also registers other sensor information detected by the sensor at the time corresponding to the first context in the database, associating it with the second context.

[0123] (Processing Unit 134) The processing unit 134 executes various processes. The processing unit 134 executes various processes based on information from external information processing devices and information stored in the storage unit 120. The processing unit 134 executes various processes based on information from other information processing devices such as the terminal device 10, the store device 20, and the data provision device 50. The processing unit 134 executes various processes based on information stored in the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123.

[0124] The processing unit 134 executes various information based on the various information acquired by the acquisition unit 131. The processing unit 134 executes various information based on the various information estimated by the estimation unit 132. The processing unit 134 executes various information based on the various information registered by the registration unit 133.

[0125] The processing unit 134 determines various information. The processing unit 134 determines various information based on the various information acquired by the acquisition unit 131. The processing unit 134 determines various information based on the various information estimated by the estimation unit 132. The processing unit 134 determines various information based on the various information registered by the registration unit 133.

[0126] The processing unit 134 generates content. The processing unit 134 generates content that includes coupons showing incentives. For example, the processing unit 134 generates a screen (content) to be provided to the terminal device 10 using various technologies such as Java (registered trademark) as appropriate. The processing unit 134 may also generate a screen (content) to be provided to the terminal device 10 based on CSS, JavaScript (registered trademark), or HTML format. Furthermore, for example, the processing unit 134 may generate a screen (content) in various formats such as JPEG (Joint Photographic Experts Group), GIF (Graphics Interchange Format), or PNG (Portable Network Graphics).

[0127] (Provider 135) The service provider 135 provides various services. The service provider 135 provides various information. The service provider 135 provides various information to external information processing devices. The service provider 135 transmits various information to terminal devices 10, store devices 20, and data provision devices 50.

[0128] The information provision unit 135 provides various information based on information from other information processing devices such as the terminal device 10, the store device 20, and the data provision device 50. The information provision unit 135 provides various information based on information stored in the storage unit 120. The information provision unit 135 provides various information based on information stored in the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123.

[0129] The providing unit 135 transmits various information based on the various information acquired by the acquisition unit 131. The providing unit 135 transmits various information based on the various information estimated by the estimation unit 132. The providing unit 135 transmits various information based on the various information registered by the registration unit 133. The providing unit 135 transmits various information based on the various information processed by the processing unit 134.

[0130] The service provider 135 provides a service using a database. The service provider 135 provides information to the terminal device 10 used by the target user in accordance with the target user's entry into and exit from the target store, which is estimated using the database.

[0131] The provisioning unit 135 provides information to the target user in accordance with the target user's entry into and exit from the target store, as estimated by the estimation unit 132. The provisioning unit 135 also transmits information to the terminal device 10 used by the target user in accordance with the target user's entry into and exit from the target store, as estimated by the estimation unit 132.

[0132] [3. Information Processing Flow] Next, the information processing procedure by the information processing system 1 according to the embodiment will be described using Figures 8 and 9.

[0133] First, let's explain the process shown in Figure 8. Figure 8 is a flowchart of an example of information processing according to the embodiment. Specifically, Figure 8 is a flowchart of an example of information processing related to information registration.

[0134] As shown in Figure 8, the information processing device 100 acquires sensor information detected by the sensor from a terminal device used by the user (step S101). For example, the information processing device 100 receives sensor information detected by the sensor from a terminal device 10 used by the user.

[0135] Then, the information processing device 100 registers the sensor information and the context of the sensor detection in the database (step S102). For example, the information processing device 100 registers the sensor information received from the terminal device 10 and the context of the sensor detection in the database in the registration information storage unit 123.

[0136] Next, the process shown in Figure 9 will be explained. Figure 9 is a flowchart of an example of information processing according to the embodiment. Specifically, Figure 9 is a flowchart of an example of information processing related to information estimation.

[0137] As shown in Figure 9, the information processing device 100 acquires sensor information detected by the sensor from a terminal device used by the target user who is to be estimated (step S201). For example, the information processing device 100 receives sensor information detected by the sensor from a terminal device 10 used by the target user who is to be estimated.

[0138] Then, the information processing device 100 estimates the entry and exit of the target user to the target store, which is the store to be estimated, based on the sensor information (step S202). For example, the information processing device 100 estimates the entry and exit of the target user to the target store, which is the store to be estimated, based on the sensor information received from the terminal device 10.

[0139] [4. Effects] As described above, the information processing device 100 according to the embodiment includes an acquisition unit 131 and an estimation unit 132. The acquisition unit 131 acquires sensor information detected by the sensor from a terminal device 10 used by a target user who is to be estimated. Based on the sensor information acquired by the acquisition unit 131, the estimation unit 132 estimates the entry and exit of the target user to a target store who is to be estimated.

[0140] Thus, the information processing device 100 according to this embodiment can appropriately estimate a user's entry into and exit from a store by estimating the entry and exit of the target user to the store based on sensor information acquired from the terminal device 10 used by the target user.

[0141] Furthermore, in the information processing device 100 according to the embodiment, the acquisition unit 131 acquires history information that associates sensor information acquired when a user enters or leaves a target store with the target store. The estimation unit 132 estimates the entry and exit of the target user to the target store based on the history information.

[0142] Thus, the information processing device 100 according to this embodiment can estimate the entry and exit of a target user to a target store based on sensor information acquired when a user enters and exits a target store and historical information associated with the target store. Therefore, it can estimate the entry and exit of a target user to a target store based on past trends in entry and exit to the target store. Consequently, the information processing device 100 can appropriately estimate the entry and exit of a user to a store.

[0143] Furthermore, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entry and exit of a target user to a target store based on a comparison of historical information and sensor information.

[0144] Thus, the information processing device 100 according to this embodiment can estimate the entry and exit of a target user to a target store based on a comparison of historical information and sensor information, thereby estimating the entry and exit of a target user to a target store based on past trends in entry and exit to the target store. Therefore, the information processing device 100 can appropriately estimate the entry and exit of a user to a store.

[0145] Furthermore, in the information processing device 100 according to the embodiment, the acquisition unit 131 acquires history information including sensor information acquired when a user enters a target store and entry sensor information associated with the target store. The estimation unit 132 estimates the entry of the target user into the target store based on the history information.

[0146] Thus, the information processing device 100 according to this embodiment can estimate a target user's entry into a target store based on sensor information acquired when a user enters the target store and historical information including entry sensor information associated with the target store. This allows the information processing device 100 to estimate a target user's entry into a target store based on past trends in entry into the target store. Therefore, the information processing device 100 can appropriately estimate a user's entry into and exit from a store.

[0147] Furthermore, in the information processing device 100 according to this embodiment, the estimation unit 132 estimates the entry of a target user into a target store based on a comparison of the entry sensor information with the sensor information.

[0148] Thus, the information processing device 100 according to this embodiment can estimate a target user's entry into a target store based on a comparison of entry sensor information with other sensor information, thereby estimating the target user's entry into the target store based on past trends in entry into the target store. Therefore, the information processing device 100 can appropriately estimate a user's entry into and exit from a store.

[0149] Furthermore, in the information processing device 100 according to this embodiment, the acquisition unit 131 acquires history information including sensor information acquired when a user leaves a target store and exit sensor information associated with the target store. The estimation unit 132 estimates the departure of the target user from the target store based on the history information.

[0150] Thus, the information processing device 100 according to this embodiment can estimate a target user's departure from a target store based on sensor information acquired when a user leaves a target store and historical information including departure sensor information associated with the target store. This allows the information processing device 100 to estimate a target user's departure based on past trends in departures from target stores. Therefore, the information processing device 100 can appropriately estimate a user's entry and exit from a store.

[0151] Furthermore, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the departure of a target user from a target store based on a comparison of the departure sensor information with the sensor information.

[0152] Thus, the information processing device 100 according to this embodiment can estimate a target user's departure from a target store based on a comparison of exit sensor information with other sensor information, thereby estimating the target user's departure based on past trends in leaving the target store. Therefore, the information processing device 100 can appropriately estimate the entry and exit of users to and from a store.

[0153] Furthermore, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entry and exit of a target user to a target store according to the context estimated by a context estimation process that estimates the context based on the sensor information acquired by the acquisition unit 131.

[0154] Thus, the information processing device 100 according to the embodiment can appropriately estimate the entry and exit of a target user to a target store by estimating the entry and exit of the target user to the target store according to the context estimated based on sensor information.

[0155] Furthermore, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entry and exit of a target user to a target store in accordance with the switch from the first context before the context estimation process to the second context estimated by the context estimation process.

[0156] Thus, the information processing device 100 according to the embodiment can appropriately estimate the entry and exit of a target user to a target store by estimating the entry and exit of the target user to the target store in accordance with the switch from the first context before the context estimation process to the second context estimated by the context estimation process.

[0157] Furthermore, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entry of the target user into the target store in response to a switch from a first context corresponding to a context in which the target user is located outside the target store to a second context corresponding to a context in which the target user is located inside the target store.

[0158] Thus, the information processing device 100 according to this embodiment can estimate the entry of a target user into a target store by estimating the entry of the target user into the target store in response to a change in context from outside the target store to inside the target store. Therefore, the information processing device 100 can appropriately estimate the entry and exit of a user into a store.

[0159] Furthermore, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the departure of the target user from the target store in response to a switch from a first context corresponding to a context in which the target user is located inside the target store to a second context corresponding to a context in which the target user is located outside the target store.

[0160] Thus, the information processing device 100 according to this embodiment can estimate the departure of a target user from a target store by estimating the departure of the target user from the target store in response to a change in context from inside the target store to outside the target store. Therefore, the information processing device 100 can appropriately estimate the entry and exit of users to and from a store.

[0161] Furthermore, the information processing device 100 according to this embodiment has a providing unit 135. The providing unit 135 provides information to the target user in accordance with the target user's entry into and exit from the target store estimated by the estimation unit 132.

[0162] Thus, the information processing device 100 according to this embodiment can provide appropriate information to a target user by providing information to the target user in accordance with the estimated target user's entry into and exit from the target store.

[0163] Furthermore, in the information processing device 100 according to the embodiment, the provisioning unit 135 transmits information to the terminal device 10 used by the target user in response to the target user's entry into or exit from the target store estimated by the estimation unit 132.

[0164] In this way, the information processing device 100 according to the embodiment can provide appropriate information to the target user by transmitting information to the terminal device 10 used by the target user in response to the estimated target user entering or leaving the target store.

[0165] [5. Hardware Configuration] The information processing device 100 according to the above-described embodiment is realized by a computer 1000 having a configuration such as that shown in Figure 10. Figure 10 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device. The computer 1000 has a CPU 1100, RAM 1200, ROM 1300, HDD (Hard Disk Drive) 1400, communication interface (I / F) 1500, input / output interface (I / F) 1600, and media interface (I / F) 1700.

[0166] The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400, controlling various components. The ROM 1300 stores boot programs executed by the CPU 1100 when the computer 1000 starts up, as well as programs that depend on the computer 1000's hardware.

[0167] The HDD1400 stores programs executed by the CPU1100, as well as data used by such programs. The communication interface1500 receives data from other devices via the network N and sends it to the CPU1100, and transmits data generated by the CPU1100 to other devices via the network N.

[0168] The CPU 1100 controls output devices such as displays and printers, and input devices such as keyboards and mice, via the input / output interface 1600. The CPU 1100 acquires data from input devices via the input / output interface 1600. The CPU 1100 also outputs the generated data to output devices via the input / output interface 1600.

[0169] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0170] For example, when computer 1000 functions as an information processing device 100 according to the embodiment, the CPU 1100 of computer 1000 realizes the functions of the control unit 130 by executing a program loaded on RAM 1200. The CPU 1100 of computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be obtained from other devices via a network N.

[0171] Although some embodiments and modifications of the present invention have been described in detail above with reference to the drawings, these are illustrative examples, and the present invention can be implemented in various other forms with modifications and improvements based on the knowledge of those skilled in the art, starting with the embodiments described in the disclosure lines of the invention.

[0172] [6. Other] Furthermore, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above document and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0173] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.

[0174] Furthermore, the embodiments and modifications described above can be combined as appropriate, provided that the processing content is not inconsistent.

[0175] Furthermore, the terms "section, module, unit" mentioned above can be replaced with "means" or "circuit," etc. For example, the acquisition unit can be replaced with acquisition means or acquisition circuit. [Explanation of Symbols]

[0176] 1. Information Processing System 100 Information Processing Devices 121 User Information Storage Unit 122 Store Information Storage Unit 123 Registration Information Storage Unit 130 Control Unit 131 Acquisition Department 132 Estimation Department 133 Registration Department 134 Processing Unit 135 Provision Department 10 Terminal devices 20 Store Equipment 50 Data provision device N Network

Claims

1. An acquisition unit acquires from a storage unit a group of registered information which includes: first sensor information, which is sensor information detected by a sensor, from a terminal device used by a target user who is to be estimated as a user; second sensor information, which is sensor information other than the first sensor information; context information, which corresponds to the second sensor information and indicates a context such as entering, leaving, walking, inside or outside the store; and store information, which indicates the store corresponding to the context. An estimation unit estimates the entry and exit of the target user to the target store by comparing the first sensor information acquired by the acquisition unit with the second sensor information included in the registered information group, estimating that the context associated with the second sensor information that is similar to the first sensor information is the context of the target user, and if the context of the target user is entering or leaving the store, estimating that the store associated with the second sensor information is the target store to which the target user enters or leaves the store, If the estimation unit estimates that the target user has left the target store, the provision unit provides the target user with a coupon that can be used at a store located within a predetermined range from the target store. An information processing device characterized by comprising:

2. The aforementioned supply unit is, Based on the estimated entry and exit of the target user to the target store by the estimation unit, information is transmitted to the terminal device used by the target user. The information processing apparatus according to feature 1.

3. A method of information processing performed by a computer, The acquisition process involves acquiring first sensor information, which is sensor information detected by a sensor, from a terminal device used by the target user who is to be estimated as the target user; acquiring a group of registered information from a storage unit, which is a set of registered information that is associated with second sensor information, which is sensor information other than the first sensor information; context information, which corresponds to the second sensor information and indicates a context such as entering the store, leaving the store, moving on foot, inside the store, or outside the store; and store information, which indicates the store corresponding to the context. An estimation step to estimate the entry and exit of the target user to the target store, based on the comparison result between the first sensor information obtained in the acquisition step and the second sensor information included in the registration information group, estimates that the context associated with the second sensor information that is similar to the first sensor information is the context of the target user, and if the context of the target user is entering or leaving the store, estimates that the store associated with the second sensor information is the target store to which the target user enters or leaves, If the estimation step determines that the target user has left the target store, the provision step includes providing the target user with a coupon that can be used at a store located within a predetermined range from the target store. An information processing method characterized by including

4. An acquisition procedure for acquiring first sensor information, which is sensor information detected by a sensor, from a terminal device used by the target user who is to be estimated as the target user; second sensor information, which is sensor information other than the first sensor information; context information, which corresponds to the second sensor information and indicates a context such as entering, leaving, walking, inside or outside the store; and store information, which indicates the store corresponding to the context, by acquiring a group of registered information from the storage unit. An estimation procedure for estimating the entry and exit of the target user to the target store, based on the comparison result between the first sensor information obtained by the acquisition procedure and the second sensor information included in the registered information group, by estimating that the context associated with the second sensor information that is similar to the first sensor information is the context of the target user, and if the context of the target user is entering or leaving the store, by estimating that the store associated with the second sensor information is the target store to which the target user enters or leaves, If the estimation procedure estimates that the target user has left the target store, the procedure provides the target user with a coupon that can be used at a store located within a predetermined range from the target store. An information processing program characterized by causing a computer to execute it.

Images