Information processing device, information processing method, and information processing program

Abstract

To properly estimate whether a user has entered / exited a store.SOLUTION: An information processing apparatus includes an acquisition unit and an estimation unit. The acquisition unit acquires sensor information detected by a sensor from a terminal device used by a target user who is a user of an estimation target. The estimation unit estimates whether the target user has entered / exited a target store which is a store of an estimation target, on the basis of the sensor information acquired by the acquisition unit.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, various techniques have been provided for capturing people (users) entering and leaving a store. For example, a technique has been provided for capturing people entering a store using multiple cameras for capturing authentication images including at least a part of the head of a customer entering the store. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-157377 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is room for improvement in the above conventional technology. For example, the above conventional technology requires a specific configuration to capture people entering a store, such as installing multiple cameras at different heights. Therefore, it is desirable to capture the entrance and exit of users to a store by estimating the entrance and exit of users to the store.

[0005] The present application has been made in consideration of the above, and has an object to provide an information processing device, an information processing method, and an information processing program that appropriately estimate a user's entry and exit into a store. [Means for solving the problem]

[0006] The information processing device of the present application is characterized by comprising an acquisition unit that acquires sensor information detected by a sensor from a terminal device used by a target user who is to be estimated, and an estimation unit that estimates the entry and exit of the target user into and from a target store which is to be estimated based on the sensor information acquired by the acquisition unit. Effect of the Invention

[0007] According to one aspect of the embodiment, it is possible to appropriately estimate the entry and exit of a user into a store. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of information processing according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of a user information storage unit according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a store information storage unit according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a registration information storage unit according to the embodiment. [Figure 8] FIG. 8 is a flowchart illustrating an example of information processing according to the embodiment. [Figure 9] FIG. 9 is a flowchart illustrating an example of information processing according to the embodiment. [Figure 10] FIG. 10 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to the embodiments. In addition, the same parts in the following embodiments are denoted by the same reference numerals, and duplicated descriptions are omitted.

[0010] (Embodiment) [1. Information Processing] [1-1. Overall overview] First, an example of information processing according to the embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 and Fig. 2 are diagrams showing an example of information processing according to the embodiment.

[0011] Specifically, FIG. 1 is a diagram showing an example of information processing for registering information. In FIG. 1, the information processing device 100 acquires sensor information detected by a sensor from a terminal device 10 used by a user, and registers the acquired sensor information in a sensor database (hereinafter referred to as "sensor data DB") in association with a context at the time of detection by the sensor of the sensor information. The sensor information includes various information detected by a sensor regarding the state of the terminal device 10 or the environment around the terminal device 10. For example, the sensor information may be information regarding various objects such as temperature, air pressure, sound, vibration, acceleration, illuminance (brightness), and position. Note that the above is only an example, and the sensor information may be information regarding any object as long as it is detected by a sensor. For example, the sound is not limited to an audible frequency sound, but may be an ultrasonic wave, and the audible frequency sound is not limited to a voice such as a user's (person's) speech, but may be an environmental sound, noise, or the like. In addition, for example, the sensor information may be biological information such as blood glucose level information indicating the user's blood glucose level and heart rate information indicating the heart rate.

[0012] In the following example, the state of the user using the terminal device 10 will be described as an example of a context registered in association with sensor information. For example, in FIG. 1, states related to the user's entry and exit from a store, such as a state where the user has entered a store, a state where the user has left the store, and a state where the user is outside the store, will be described as examples of context.

[0013] Note that the above is merely an example, and the context registered in association with the sensor information may be any information as long as it is a context at the time of detection by the sensor. For example, the context may be various situations of the user estimated based on the situation of the user or the terminal device 10 or the environment (background) of the user or the terminal device 10. The context may also be the physical environment in which the user is placed, the social environment in which the user is placed, the motion state of the user, and the estimated emotion of the user. The context may also be the psychological state of the user estimated based on the situation of the user or the terminal device 10 or the environment (background) of the user or the terminal device 10.

[0014] Moreover, Fig. 2 is a diagram showing an example of information processing related to information estimation. In Fig. 2, the information processing device 100 acquires sensor information detected by a sensor from a terminal device 10 used by a user (also referred to as a "target user") who is the subject of estimation, and estimates the entrance and exit of the target user to a store (also referred to as a "target store") that is the subject of estimation based on the acquired sensor information (also referred to as "target sensor information"). For example, in Fig. 2, a case where a user U5 is the target user and the information processing device 100 estimates the entrance and exit of the user U5 to and from a store will be described as an example.

[0015] [1-1-1. Configuration of information processing system] In the following, the configuration of the information processing system 1 will be described first with reference to FIG. 3, and then the details of the processing in FIG. 1 and FIG. 2 will be described. FIG. 3 is a diagram showing an example of the configuration of the information processing system according to the embodiment. As shown in FIG. 3, the information processing system 1 includes a terminal device 10, a store device 20, a data providing device 50, and an information processing device 100. The terminal device 10, the store device 20, the data providing device 50, and the information processing device 100 are connected to each other via a predetermined network N so as to be able to communicate with each other by wire or wirelessly. Note that the information processing system 1 shown in FIG. 3 may include a plurality of terminal devices 10, a plurality of store devices 20, a plurality of data providing devices 50, and a plurality of information processing devices 100.

[0016] The terminal device 10 is a computer used by a user. The terminal device 10 is realized, for example, by a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like. FIG. 1 shows a case where the terminal device 10 is a smartphone. Note that, hereinafter, the terminal device 10 may be referred to as a user. That is, hereinafter, the user may be read as the terminal device 10.

[0017] The terminal device 10 has various sensors that detect various sensor information. The terminal device 10 detects sensor information by various sensors. The terminal device 10 transmits the sensor information detected by the sensors to the information processing device 100. The terminal device 10 has a temperature sensor and detects temperature information (sensor information) of the environment around the user. The terminal device 10 has an air pressure sensor and detects air pressure information (sensor information) of the environment around the user. The terminal device 10 has a sound sensor such as a microphone and detects audio information (sensor information) of the environment around the user. The terminal device 10 has a vibration sensor and detects vibration information (sensor information) related to the terminal device 10. The terminal device 10 has an acceleration sensor and detects acceleration information (sensor information) related to the terminal device 10. The terminal device 10 has an illuminance sensor and detects illuminance information (sensor information) of the environment around the user. The terminal device 10 may also have an image sensor such as an image sensor and detect image information (sensor information) of the environment around the user.

[0018] The terminal device 10 also has a position sensor and detects user position information (sensor information). For example, the terminal device 10 has a GPS (Global Positioning System) sensor. The terminal device 10 may also detect and acquire user position information (sensor information) using a predetermined wireless communication function such as Wi-Fi (registered trademark) (Wireless-Fidelity) or Bluetooth (registered trademark), a function such as a beacon, position information of a base station with which the terminal device 10 is communicating, and the like. Note that, hereinafter, position information may be simply referred to as "position". For example, the terminal device 10 may improve the estimation accuracy of the user's position by combining information such as GPS, the above-mentioned wireless communication function, and a beacon. The terminal device 10 also transmits the user's position to the information processing device 100.

[0019] In addition, the terminal device 10 collects various information other than the sensor information and transmits it to the information processing device 100. The terminal device 10 transmits behavioral information indicating the behavior of the user using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information related to payment using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information related to payment (settlement) at a store using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information indicating an operation by the user to the information processing device 100. The terminal device 10 transmits behavioral information indicating the behavior of the user on the Internet to the information processing device 100. For example, the terminal device 10 transmits behavioral information including posted information (input information) such as posts by the user to a social networking service (SNS) to the information processing device 100. For example, the terminal device 10 transmits behavioral information including posted information posted by the user to Twitter (registered trademark), Facebook (registered trademark), Instagram (registered trademark), etc. to the information processing device 100.

[0020] In the following, a user identified by a user ID "U1" may be referred to as "user U1". In this manner, in the following, when "user U* (* is an arbitrary numerical value)" is written, it indicates that the user is identified by the user ID "U*". For example, when "user U2" is written, the user is identified by the user ID "U2". In addition, in the example shown in FIG. 1 and FIG. 2, the terminal device 10 will be described as terminal devices 10-1 to 10-3, 10-5, etc. according to the user who uses the terminal device 10. For example, the terminal device 10-1 is a terminal device 10 used by a user (user U1) identified by a user ID "U1". In addition, for example, the terminal device 10-5 is a terminal device 10 used by a user (user U5) identified by a user ID "U5". In addition, in the following, when the terminal devices 10-1 to 10-3, 10-5, etc. are described without any particular distinction, they will be described as terminal devices 10.

[0021] The in-store device 20 is a computer used by a manager of each store. For example, the manager of restaurant A uses the in-store device 20 to transmit and receive information to and from the information processing device 100. For example, the in-store device 20 is realized by a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, a PDA, or the like. The in-store device 20 transmits various information related to the store to the information processing device 100. The in-store device 20 transmits information requested by the information processing device 100 to the information processing device 100. The in-store device 20 transmits store information including various information such as the location of the store and the state of the store's entrance and exit to the information processing device 100.

[0022] The data providing device 50 is a server that provides various data to the information processing device 100. For example, the data providing device 50 may provide data related to weather, such as weather and temperature, to the information processing device 100. The data providing device 50 may provide event information related to the weather in the area where each store is located to the information processing device 100. For example, the data providing device 50 provides open data, which is data that is permitted for so-called wide-open use, to the information processing device 100. For example, the data providing device 50 may be an information processing device that is managed by each local government and provides data held by the local government to the outside as data. The data providing device 50 may provide various data, such as data related to traffic, such as road information, geospatial information, disaster prevention and mitigation information, procurement information, and statistical information, as long as the data (information) is permitted for use.

[0023] The information processing device 100 is a computer that executes processes related to the registration of information and processes related to the estimation of information. The information processing device 100 is an information processing device that can communicate with various devices via a predetermined network N such as the Internet, and is realized by, for example, a server device or a cloud system. For example, the information processing device 100 is connected to various other devices via the network N so as to be able to communicate with them.

[0024] The information processing device 100 executes a registration process of registering sensor information detected by a sensor in a sensor data DB in association with other information. The information processing device 100 executes a process of estimating a context based on the sensor information (also referred to as a "context estimation process"). The information processing device 100 associates the estimated context with the sensor information used for the estimation and registers them in the sensor data DB. For example, the information processing device 100 associates the estimated context indicating entry and exit into a store, information indicating the store, and the sensor information used for the estimation and registers them in the sensor data DB. The information processing device 100 provides a service using the sensor data DB.

[0025] Furthermore, the information processing device 100 executes an entry / exit estimation process (also simply referred to as an "estimation process") for estimating the entry / exit of the target user from the target store based on the target sensor information detected by the sensor. The information processing device 100 executes the estimation process using a sensor data DB in which sensor information acquired when the user enters and leaves the target store and history information correlating the target store with the sensor information are registered. The information processing device 100 estimates the entry / exit of the target user from the target store based on a comparison between the history information registered in the sensor data DB and the target sensor information. The information processing device 100 provides information to the target user according to the entry / exit of the target user from the target store.

[0026] [1-2. Information processing regarding information registration] From now, the flow of information processing will be described with reference to FIG. 1. In FIG. 1, the positions of users U1 to U3 are shown in a map MP1 or the like. The information processing device 100 acquires sensor information SD11 from the terminal device 10-1 used by the user U1 (step S11-1). In FIG. 1, the terminal device 10-1 performs sensor detection when the user U1 enters the store SP11. The terminal device 10-1 transmits the sensor information SD11 based on the sensor detection to the information processing device 100. The information processing device 100 receives the sensor information SD11 from the terminal device 10-1. In FIG. 1, the information processing device 100 receives the sensor information SD11 corresponding to the user U1's entry into the store SP11 from the terminal device 10-1. As described above, the sensor information such as the sensor information SD11 may be information on various targets such as temperature, air pressure, sound, acceleration, illuminance (brightness), and position.

[0027] Then, the information processing device 100 acquires information indicating a context corresponding to the sensor information SD11 (step S12-1). In Fig. 1, the information processing device 100 acquires information indicating that the context of the user U1 at the time of detection corresponding to the sensor information SD11 is entry into a store SP11. For example, the information processing device 100 acquires context information CD11 including information indicating that the context corresponding to the sensor information SD11 is a context CN11 of entry into a store and information indicating that the store is the store SP11.

[0028] The information processing device 100 may acquire the context information CD11 by any method as long as the information processing device 100 can acquire the context information CD11. For example, the information processing device 100 may acquire the context information CD11 from the terminal device 10-1. In this case, the terminal device 10-1 transmits the context information CD11 to the information processing device 100 in response to an operation of the user U1. The information processing device 100 receives the context information CD11 from the terminal device 10-1.

[0029] Note that the above is merely an example, and the information processing device 100 may estimate the context information CD11 using various information. For example, the information processing device 100 may estimate that the user U1 has entered the store SP11 at the time of detection corresponding to the sensor information SD11, using various information acquired from the terminal device 10-1. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD11 is the context CN11 based on behavioral information of the user U1 acquired from the terminal device 10-1, etc. The information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD11 is the context CN11 based on behavioral information indicating that the user U1 has opened the door of the store SP11.

[0030] Then, the information processing device 100 registers the sensor information SD11 in the sensor data DB (step S13-1). In FIG. 1, the information processing device 100 registers information indicating a context corresponding to the sensor information SD11 in the sensor data DB in association with the information, as shown in the registration information group DT. The information processing device 100 registers the sensor information SD11 in the sensor data DB in association with the context information CD11. In this manner, the information processing device 100 registers the context information CD11 indicating that the context at the time of detection corresponding to the sensor information SD11 is the context CN11 and the store is the store SP11 in association with the sensor information SD11 in the sensor data DB.

[0031] That is, the information processing device 100 registers information indicating that the context of the user U1 at the time of detection corresponding to the sensor information SD11 is entry into the store SP11 in the sensor data DB in association with the sensor information SD11. The information processing device 100 registers history information in which the sensor information SD11 acquired when the user U1 enters the store SP11 is associated with the store SP11 in the sensor data DB. In this way, the information processing device 100 manages history information in which the sensor information acquired when the user enters and leaves the store is associated with the store. The registration information group DT in the sensor data DB includes the sensor information acquired when the user enters the store.

[0032] Furthermore, the information processing device 100 acquires sensor information SD21 from the terminal device 10-2 used by the user U2 (step S11-2). In FIG. 1, the terminal device 10-2 performs sensor detection when the user U2 moves on foot in an area corresponding to the map MP1. The terminal device 10-2 transmits sensor information SD21 based on the sensor detection to the information processing device 100. The information processing device 100 receives the sensor information SD21 from the terminal device 10-2. In FIG. 1, the information processing device 100 receives sensor information SD21 corresponding to the movement of the user U2 from the terminal device 10-2.

[0033] Then, the information processing device 100 acquires information indicating a context corresponding to the sensor information SD21 (step S12-2). In Fig. 1, the information processing device 100 acquires information indicating that the context of the user U2 at the time of detection corresponding to the sensor information SD21 is moving on foot. For example, the information processing device 100 acquires context information CD21 including information indicating that the context corresponding to the sensor information SD21 is a context CN21 of moving on foot.

[0034] The information processing device 100 may acquire the context information CD21 by any method as long as the information processing device 100 can acquire the context information CD21. For example, the information processing device 100 may acquire the context information CD21 from the terminal device 10-2. In this case, the terminal device 10-2 transmits the context information CD21 to the information processing device 100 in response to an operation of the user U2. The information processing device 100 receives the context information CD21 from the terminal device 10-2.

[0035] Note that the above is merely an example, and the information processing device 100 may estimate the context information CD21 using various information. For example, the information processing device 100 may estimate that the user U2 is moving on foot at the time of detection corresponding to the sensor information SD21 using various information acquired from the terminal device 10-2. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD21 is the context CN21 based on behavior information of the user U2 acquired from the terminal device 10-2, etc. For example, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD21 is the context CN21 based on behavior information indicating the content posted by the user U2 using the terminal device 10-2. In addition, the information processing device 100 may estimate that the user U2 is moving on foot based on acceleration information included in the sensor information SD21, etc.

[0036] Then, the information processing device 100 registers the sensor information SD21 in the sensor data DB (step S13-2). In FIG. 1, as shown in the registration information group DT, the information processing device 100 associates information indicating a context corresponding to the sensor information SD21 and registers it in the sensor data DB. The information processing device 100 associates the context information CD21 with the sensor information SD21 and registers it in the sensor data DB. In this way, the information processing device 100 registers the context information CD21 indicating that the context at the time of detection corresponding to the sensor information SD21 is the context CN21 and there is no corresponding store in the sensor data DB in association with the sensor information SD21. That is, the information processing device 100 registers information indicating that the context of the user U2 at the time of detection corresponding to the sensor information SD21 is moving on foot in association with the sensor information SD21 in the sensor data DB.

[0037] Furthermore, the information processing device 100 acquires sensor information SD31 from the terminal device 10-3 used by the user U3 (step S11-3). In FIG. 1, the terminal device 10-3 performs sensor detection when the user U3 leaves the store SP22. The terminal device 10-3 transmits sensor information SD31 based on the sensor detection to the information processing device 100. The information processing device 100 receives the sensor information SD31 from the terminal device 10-3. In FIG. 1, the information processing device 100 receives sensor information SD31 corresponding to the time when the user U3 leaves the store SP22 from the terminal device 10-3.

[0038] Then, the information processing device 100 acquires information indicating a context corresponding to the sensor information SD31 (step S12-3). In Fig. 1, the information processing device 100 acquires information indicating that the context of the user U3 at the time of detection corresponding to the sensor information SD31 is leaving the store SP22. For example, the information processing device 100 acquires context information CD31 including information indicating that the context corresponding to the sensor information SD31 is the context CN31 of leaving a store and information indicating that the store is the store SP22.

[0039] The information processing device 100 may acquire the context information CD31 by any method as long as the context information CD31 can be acquired. For example, the information processing device 100 may acquire the context information CD31 from the terminal device 10-3. In this case, the terminal device 10-3 transmits the context information CD31 to the information processing device 100 in response to an operation of the user U3. The information processing device 100 receives the context information CD31 from the terminal device 10-3.

[0040] Note that the above is merely an example, and the information processing device 100 may estimate the context information CD31 using various information. For example, the information processing device 100 may estimate that the user U3 has left the store SP22 at the time of detection corresponding to the sensor information SD31, using various information acquired from the terminal device 10-3. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD31 is the context CN31 based on behavioral information of the user U3 acquired from the terminal device 10-3, etc. For example, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD31 is the context CN31 based on behavioral information indicating electronic settlement (payment) or the like using the terminal device 10-3 of the user U3.

[0041] Then, the information processing device 100 registers the sensor information SD31 in the sensor data DB (step S13-3). In FIG. 1, the information processing device 100 registers information indicating a context corresponding to the sensor information SD31 in the sensor data DB in association with the information, as shown in the registration information group DT. The information processing device 100 registers the sensor information SD31 in the sensor data DB in association with the context information CD31. In this way, the information processing device 100 registers the context information CD31 indicating that the context at the time of detection corresponding to the sensor information SD31 is the context CN31 and the store is the store SP22 in association with the sensor information SD31 in the sensor data DB.

[0042] That is, the information processing device 100 registers information indicating that the context of the user U3 at the time of detection corresponding to the sensor information SD31 is leaving the store SP22 in association with the sensor information SD31 in the sensor data DB. The information processing device 100 registers history information in which the sensor information SD31 acquired when the user U3 leaves the store SP22 is associated with the store SP22 in the sensor data DB. In this way, the information processing device 100 manages history information in which the sensor information acquired when the user enters and leaves a store is associated with the store. The registration information group DT in the sensor data DB includes the sensor information acquired when the user leaves the store.

[0043] 1 illustrates three users U1 to U3, the information processing device 100 acquires sensor information from a large number of users (e.g., 1 million users or 10 million users) such as user U4, in addition to the users U1 to U3. The information processing device 100 then registers the acquired sensor information for the large number of users in the sensor data DB in association with the context at the time of detection by the sensor of the sensor information, stores, etc.

[0044] In this way, the information processing device 100 registers in the database the sensor information detected by the sensor and the context at the time of the sensor information detection by the sensor in association with each other. In FIG. 1, the information processing device 100 stores the sensor information in association with information indicating the context corresponding to the sensor information. Furthermore, when there is a store corresponding to the sensor information, the information processing device 100 registers in the database the sensor information in association with information indicating the context corresponding to the sensor information and information indicating the store corresponding to the sensor information. As a result, when new sensor information is acquired, the information processing device 100 can use the database to appropriately estimate (identify) the context and store to which the newly acquired sensor information corresponds. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

[0045] [1-3. Information processing related to information estimation] Next, an example of a process in which the information processing device 100 estimates the entrance and exit of a target user to a target store based on sensor information detected by a sensor will be described with reference to Fig. 2. Specifically, in the following, a case will be described in which, when new sensor information is acquired, the information processing device 100 uses the sensor data DB to estimate the entrance and exit of a user to a store corresponding to the newly acquired sensor information. Note that the description of the same points as in Fig. 1 will be omitted as appropriate.

[0046] FIG. 2 shows a case where the information processing device 100 performs estimation processing with the user U5 as the target user. The information processing device 100 acquires sensor information SD51 from the terminal device 10-5 used by the user U5 (step S21). In FIG. 2, the terminal device 10-5 performs sensor detection when the user U5 enters the store SP11. The terminal device 10-5 transmits the sensor information SD51 based on the sensor detection to the information processing device 100. The information processing device 100 receives the sensor information SD51 from the terminal device 10-5. In FIG. 2, the information processing device 100 receives the sensor information SD51 corresponding to the time when the user U5 enters the store SP11 from the terminal device 10-5. As a result, the information processing device 100 acquires the sensor information SD51 about the user U5 who is the target user, as shown in the target information TG. As described above, the sensor information SD51 may be information about various targets such as temperature, air pressure, sound, acceleration, illuminance (brightness), and position.

[0047] Then, the information processing device 100 estimates whether the user U5 will enter or leave the store based on the sensor information SD51 (step S22). In Fig. 2, the information processing device 100 estimates whether the user U5 will enter or leave the store using a registered information group DT, which is history information registered in the sensor data DB. In this way, the information processing device 100 estimates whether the user U5 will enter or leave the store using a registered information group DT that includes sensor information acquired when the user enters the store and sensor information acquired when the user leaves the store.

[0048] For example, the information processing device 100 estimates whether the user U5 has entered or left the store based on a comparison between the registration information group DT in the sensor data DB and the sensor information SD51. The information processing device 100 estimates whether the user U5 has entered or left the store based on a comparison between each piece of sensor information included in the registration information group DT and the sensor information SD51. For example, the information processing device 100 estimates that the context corresponding to the sensor information similar to the sensor information SD51 among the pieces of sensor information included in the registration information group DT is the context of the user U5 at the time of detection of the sensor information SD51.

[0049] For example, the information processing device 100 estimates that the context corresponding to the sensor information having the highest similarity to the sensor information SD51 among the sensor information included in the registration information group DT is the context of the user U5 at the time of detection of the sensor information SD51. In FIG. 2, the information processing device 100 compares the registration information group DT in the sensor data DB with the sensor information SD51, and determines that the sensor information SD51 is similar to the sensor information SD11 among the sensor information included in the registration information group DT. Then, the information processing device 100 estimates that the context of the user U5 at the time of detection of the sensor information SD51 is the context associated with the sensor information SD11. For example, the information processing device 100 estimates that the context of the user U5 at the time of detection of the sensor information SD51 is the context CN11 of entering a store, and that the store is the store SP11. That is, the information processing device 100 estimates that the user U5 has entered the store SP11 at the time of detection of the sensor information SD51, as shown in the estimation result RS.

[0050] The information processing device 100 uses a database that associates a store with sensor information that may be acquired when entering or leaving the store, and when corresponding sensor information is acquired, estimates that the user has entered or left the store. For example, the information processing device 100 may estimate whether the user has entered or left the store using a sensor data DB in which sensor information for each behavior in the store is registered. The sensor data DB may also include sensor information corresponding to each of the entrance paths to the store.

[0051] When the information processing device 100 estimates the entrance and exit of the user U5 to the store SP11 as a target store, the information processing device 100 may perform processing using only the sensor information associated with the store SP11 among the information in the sensor data DB. In this case, for example, the information processing device 100 may extract the sensor information associated with the store SP11 from the registered information group DT in the sensor data DB, and estimate the entrance and exit of the user U5 to the store SP11 based on a comparison between the extracted information and the sensor information SD51.

[0052] Furthermore, when the sensor information SD51 is similar to the sensor information SD31, the information processing device 100 estimates that the user U5 has left the store SP22 at the time of detection of the sensor information SD51. Note that the process of estimating the user's leaving the store is similar to the process of estimating the user's entry into the store described above, and therefore a detailed description thereof will be omitted.

[0053] In this way, the information processing device 100 estimates whether a user will enter or leave a store based on the sensor information detected by the sensor. For example, the information processing device 100 compares the sensor information detected by the sensor with history information, and estimates that a context corresponding to a history with similar sensor information is the context at the time when the sensor information was detected. The information processing device 100 refers to a database in which sensor information that may be acquired when entering or leaving a store is registered, and estimates whether a user will enter or leave a store based on the acquired sensor information.

[0054] Specifically, when the sensor information detected by the sensor is similar to a history detected when the user entered the target store in the past, the information processing device 100 estimates that the target user entered the target store at the time when the sensor information was detected. Also, when the sensor information detected by the sensor is similar to a history detected when the user left the target store in the past, the information processing device 100 estimates that the target user left the target store at the time when the sensor information was detected. Therefore, the information processing device 100 can appropriately estimate the user's entry and exit into the store based on the information detected by the sensor.

[0055] [1-4. Other processing examples] The above-described process is merely an example, and the information processing device 100 may perform various processes using various information. In this regard, examples are listed below.

[0056] [1-4-1.Position] For example, when the terminal device 10 detects a position using GPS or the like, if the user enters indoors, the position detection accuracy decreases, and it may be difficult to estimate the user's entry and exit from the position alone. For example, when the user enters indoors, the position detection result may not indicate a specific point such as a predetermined range. For example, when the user enters indoors, the position detection result may be information indicating a range within a predetermined distance (radius of 100 m, etc.) centered on a predetermined point, or a predetermined area, etc. In such cases, it is difficult for the information processing device 100 to appropriately estimate the user's entry and exit from the store from the position alone.

[0057] Therefore, the information processing device 100 estimates the entrance and exit of a user to a store using sensor information of targets other than the location in addition to the location detection result. In this case, for example, the information processing device 100 extracts a target store based on the location detection result. For example, the information processing device 100 extracts stores located within a range indicated by the location detection result as candidates (also called "candidate stores") for the store to be estimated for entrance and exit.

[0058] Then, the information processing device 100 performs a process of estimating the entrance and exit of the target user to the store using only the sensor information associated with the candidate store among the information in the sensor data DB. In this case, for example, the information processing device 100 may extract the sensor information associated with the candidate store from the registered information group DT in the sensor data DB, and estimate the entrance and exit of the target user to the store based on a comparison between the extracted information and the target sensor information.

[0059] 2, the information processing device 100 may extract sensor information associated with a candidate store from the registration information group DT in the sensor data DB, and estimate the entry and exit of the user U5 to and from the store based on a comparison between the extracted information and the sensor information SD51. For example, the information processing device 100 may extract sensor information associated with a candidate store from the registration information group DT in the sensor data DB, and estimate which of the candidate stores the user U5 has entered and left based on a comparison between the extracted information and the sensor information SD51.

[0060] [1-4-2. Features] In the above example, the case where sensor information detected by a sensor is used has been described, but the information processing device 100 may perform processing using, for example, feature amounts generated based on the sensor information. For example, the information processing device 100 may perform processing using feature amounts extracted from each piece of sensor information.

[0061] For example, the process of generating a feature from sensor information is performed by appropriately using various techniques such as feature extraction from sensor information, but detailed description will be omitted. Note that the feature may be generated by any process as long as the feature can be generated from the sensor information. The process of generating a feature from the sensor information may be performed by the information processing device 100 or the terminal device 10. In addition, when a feature is used in the above example, the process is the same except that the sensor information is substituted for the feature, and therefore detailed description will be omitted.

[0062] For example, the terminal device 10 generates features contained in sensor information before and after entering and leaving a store, and transmits them to the information processing device 100. The information processing device 100 links the features with the store and registers them in the sensor data DB. Then, the information processing device 100 may generate a common feature (common feature) based on the average or commonality of the features for each store. The information processing device 100 may generate a feature for each action related to a store, such as entering, leaving, and staying.

[0063] For example, the terminal device 10 transmits a feature amount of sensor information detected by a sensor to the information processing device 100. The information processing device 100 estimates entrance and exit of a store based on the feature amount.

[0064] [1-4-3. Examples of various estimates] For example, the information processing device 100 may estimate whether a customer has entered or left a store depending on a change in atmospheric pressure. For example, the information processing device 100 may estimate a context depending on the order of payment, such as deferred payment or advance payment. For example, in the case of a store that accepts deferred payment, the information processing device 100 may estimate that a customer has left the store at the timing when the payment action is made. For example, in the case of a store that accepts advance payment, the information processing device 100 may estimate that a customer has entered the store at the timing when the payment action is made.

[0065] The information processing device 100 may estimate various contexts, not limited to contexts related to entering and leaving a store. For example, the information processing device 100 may estimate a context related to a store, such as a context related to an action in the store, such as eating and drinking in the store. The information processing device 100 may estimate a context related to the use of the store, such as a stay in the store. For example, the information processing device 100 may estimate a context related to a user's movement, such as jumping rope, running, sitting, eating, etc. Also, for example, the information processing device 100 may estimate a context change related to the store, based on a change in information registered in the sensor data DB.

[0066] [1-4-4. Context switching] For example, the information processing device 100 may estimate a context change and perform processing according to the estimated context change. For example, the information processing device 100 may estimate a context change related to entering or leaving a store by estimating a context based on sensor information.

[0067] When a context change related to entering or leaving a store is estimated, the information processing device 100 may estimate that the user has entered or left the store. For example, the information processing device 100 estimates that the user's terminal device 10 acquires sensor information, estimates the user's context from the sensor information, and detects a change in the estimated context, estimating that the user has entered or left the store. In this case, the information processing device 100 may register the sensor information before and after entering or leaving the store in association with the store in the sensor data DB.

[0068] The information processing device 100 estimates a context based on sensor information and estimates whether the user will enter or leave the store in accordance with the estimated context. The information processing device 100 estimates whether the user will enter or leave the store in accordance with a switch from a first context before the context estimation process to a second context estimated by the context estimation process.

[0069] For example, when the context of a user switches from a first context indicating that the user is located outside a store to a second context indicating that the user is located inside the store, the information processing device 100 presumes that the user has entered the store. In Fig. 2, when the context of user U5 switches from a context CN51 indicating that the user is located outside the store SP11 to a context CN52 indicating that the user is located inside the store SP11, the information processing device 100 presumes that user U5 has entered the store SP11.

[0070] For example, when the user's context is switched from a first context indicating that the user is located inside a store to a second context indicating that the user is located outside the store, the information processing device 100 presumes that the user has left the store. In FIG. 2, when the user's context is switched from a context CN52 indicating that the user is located inside the store SP11 to a context CN51 indicating that the user is located outside the store SP11, the information processing device 100 presumes that the user U5 has left the store SP11.

[0071] Furthermore, the information processing device 100 may estimate a context switch, and when it is estimated that a context switch has occurred, may register the sensor information and the context in a database in association with each other.

[0072] For example, when the information processing device 100 switches from a first context indicating a location outside a store to a second context indicating a location inside the store, the information processing device 100 registers the second context and the sensor information used to estimate the second context in the database in association with each other. In FIG. 1, when the context of the user U1 switches from a context CN51 indicating a location outside the store SP11 to a context CN52 indicating a location inside the store SP11, the information processing device 100 registers the context CN52 and the sensor information used to estimate the context CN52 in association with each other in the sensor data DB. In this case, the information processing device 100 may also register other sensor information, which is the sensor information used to estimate the immediately preceding context CN51, in association with the context CN52 in the sensor data DB.

[0073] For example, when the information processing device 100 switches from a first context indicating that the user U1 is located inside a store to a second context indicating that the user U1 is located outside the store, the information processing device 100 registers the second context and the sensor information used to estimate the second context in the database in association with each other. In FIG. 1, when the context of the user U1 switches from a context CN52 indicating that the user U1 is located inside the store SP11 to a context CN51 indicating that the user U1 is located outside the store SP11, the information processing device 100 registers the context CN51 and the sensor information used to estimate the context CN51 in association with each other in the sensor data DB. In this case, the information processing device 100 may also register other sensor information, which is the sensor information used to estimate the immediately preceding context CN52, in association with the context CN51 in the sensor data DB.

[0074] [1-4-5. Examples of services provided] The information processing device 100 may provide various services using the various types of information described above. For example, the information processing device 100 may provide information according to entering and leaving a store, such as delivering advertisements or coupons. For example, when it is estimated that a user has entered a store, the information processing device 100 delivers a coupon related to the store to the terminal device 10 used by the user. In FIG. 2, when it is estimated that a user U5 has entered a store SP11, the information processing device 100 delivers a discount coupon for a product provided by the store SP11 to the terminal device 10-5 used by the user U5.

[0075] Also, for example, when it is estimated that a user has left a store, the information processing device 100 distributes coupons for stores located within a predetermined range from the store (for example, within a radius of 100 m) to the terminal device 10 used by the user. In Fig. 2, when it is estimated that a user U5 has left store SP11, the information processing device 100 distributes discount coupons for products provided by a store located within a predetermined range from store SP11 (for example, store SP22, etc.) to the terminal device 10-5 used by the user U5.

[0076] [1-4-6. Example of database update] The above-mentioned registration (update) of the database (sensor database, etc.) is merely an example, and the information processing device 100 may update the database using various information. For example, the information processing device 100 may register a new association between a store and a context based on reliable data such as purchase information from a payment application. Also, for example, if the detected context is significantly different from any of the existing store data, the information processing device 100 may consider that it may be a new store and request the user to provide information. In this case, the information processing device 100 may associate the detected sensor information and context with the store information provided by the user and register them in the database.

[0077] Furthermore, for example, when a part of the context associated with a store changes discontinuously over a certain period of time, the information processing device 100 may detect this change and update the model to improve future estimation accuracy. For example, when a part of the context associated with a store changes discontinuously over a certain period of time due to a change in air pressure caused by changing ventilation equipment or a change in illuminance caused by the addition of a roof, the information processing device 100 may detect this change and update the model to improve future estimation accuracy.

[0078] [1-4-7. Other estimated store closures] In the above example, the processing using the sensor data DB has been described as an example, but the information processing device 100 may perform processing without using the sensor data DB. For example, the information processing device 100 may determine whether the target user has left the store based on whether the reaction value of a sensor corresponding to the target user is close to the reaction value of a sensor that has been identified as having left the store before the target user.

[0079] For example, the information processing device 100 may compare sensor data corresponding to the target user with sensor data of other users when they left the store, and may infer that the target user has left the store if the similarity of the data is equal to or greater than a predetermined threshold. For example, the information processing device 100 may temporarily store the reaction value of a user who previously left the store in a local memory using BLE (Bluetooth Low Energy) or the like, and may infer that the target user has left the store based on the change data of the sensor when the waveform of the change data of the sensor becomes similar to that of the change data of the sensor.

[0080] [1-4-8. Example of rule-based processing] In the above example, the process of estimating the user's entrance and exit based on the change in sensor data has been described as an example, but the information processing device 100 may estimate the user's entrance and exit based on a rule base. For example, the information processing device 100 may estimate the user's entrance and exit using rule information indicating a rule for determining whether the user has entered or left the store. For example, the information processing device 100 may estimate the user's entrance and exit using rule information that defines an arbitrary rule base such as "enter the store when the beacon at the entrance is detected," "leave the store 20 seconds after payment," or "leave the store 15 seconds before reacting to the parking lot sensor." For example, when the sensor data corresponds to a rule included in the rule information, the information processing device 100 may estimate that the user corresponding to the sensor data has performed an action corresponding to the rule.

[0081] 2. Configuration of Information Processing Device Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 4, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

[0082] (Communication unit 110) The communication unit 110 is realized by, for example, a network interface card (NIC) etc. The communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information to and from the terminal device 10.

[0083] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 4, the storage unit 120 according to the embodiment includes a user information storage unit 121, a store information storage unit 122, and a registration information storage unit 123.

[0084] (User information storage unit 121) The user information storage unit 121 according to the embodiment stores various information related to a user. For example, the user information storage unit 121 stores various information related to user attributes. FIG. 5 is a diagram illustrating an example of the user information storage unit according to the embodiment. The user information storage unit 121 illustrated in FIG. 5 includes items such as "user ID," "age," "gender," "home," "workplace," "location," and "context."

[0085] "User ID" indicates identification information for identifying a user. For example, a user identified by user ID "U1" corresponds to user U1 shown in the example of FIG. 1. "Age" indicates the age of the user. Note that "age" may be the specific age of the user, such as 35 years old. "Gender" indicates the gender of the user.

[0086] Furthermore, "home" indicates location information of the user's home. In FIG. 5, "home" is illustrated as an abstract code such as "LC11", but it may be information indicating latitude and longitude, or information indicating an address such as "Z town, Y city, X prefecture". It may also be latitude and longitude information. Furthermore, for example, "home" may be a region name or an address.

[0087] Furthermore, "workplace" indicates location information of the user's workplace. In Fig. 5, "workplace" is illustrated as an abstract code such as "LC12", but it may be information indicating latitude and longitude, or information indicating an address such as "Z town, Y city, X prefecture". For example, "workplace" may be a region name or an address.

[0088] "Location" indicates a location acquired (detected) for a user. In FIG. 5, "Location" indicates the location last acquired for the user (latest location). Note that "Location" may store multiple locations for a user, and for example, "Location" may store a history of locations acquired for the user, that is, information indicating changes in the user's location. Also, in FIG. 5, "Location" is illustrated as an abstract code such as "LC1", but it may also be information indicating a range such as X City Y Town, A Area, information indicating latitude and longitude, or information indicating an address such as "X Prefecture Y City Z Town". For example, "Location" may be information indicating a target area such as a store where the user is located.

[0089] Furthermore, "context" indicates a context acquired (estimated) for a user. In FIG. 5, "context" indicates the last context acquired for a user (latest context). Note that multiple contexts for a user may be stored in "context", and for example, "context" may store a history of contexts acquired for a user, that is, information indicating changes in the user's context. Furthermore, in FIG. 5, "context" is illustrated with an abstract symbol such as "CN11", but concrete information indicating the user's context is stored. For example, "context" stores information such as "entered store SP11", "left store SP12", "moving on foot", etc.

[0090] For example, the age of a user (user U1) identified by user ID "U1" is "20s" and the gender is "male." User U1's home address is "LC11." User U1's workplace is "LC12." User U1's latest location is "LC1." User U1's context is "CN11."

[0091] The user information storage unit 121 may store various information according to the purpose, not limited to the above. For example, the user information storage unit 121 may store information on demographic attributes and psychographic attributes of the user. For example, the user information storage unit 121 may store information such as name, family structure, income, interests, and lifestyle. The user information storage unit 121 may store the date and time when each position was acquired in association with each position. The user information storage unit 121 may store the date and time when each context was acquired in association with each context.

[0092] (Store information storage unit 122) The store information storage unit 122 according to the embodiment stores various information related to stores. FIG. 6 is a diagram illustrating an example of the store information storage unit according to the embodiment. For example, the store information storage unit 122 stores information related to various stores. The store information storage unit 122 illustrated in FIG. 6 includes items such as "store ID," "name," "category," and "store information."

[0093] "Store ID" indicates identification information for identifying a store. "Name" indicates the specific name of the store. For example, "Name" may be a combination of the store name, such as "XX Restaurant X Town Branch," and information indicating the store's location. "Category" indicates the category to which the store belongs.

[0094] Furthermore, "store information" indicates various information related to a store (store information). Various information such as the location of the store and the appearance of the store's entrance / exit is stored in the "store information". For example, the appearance of a store's entrance / exit includes the location of the entrance / exit, the appearance of the entrance / exit door, the appearance of the entrance / exit stairs, etc. For example, the appearance of the entrance / exit door includes whether there is a door, whether the door is automatic or manual, the weight of the door, etc. For example, the appearance of the entrance / exit stairs includes the number of stairs, the height of the stairs, etc.

[0095] In FIG. 6, "store information" is illustrated with abstract symbols such as "store information #11" and "store information #12", but store information #11, store information #12, etc. include various information related to each store. For example, store information #11 indicates the location where restaurant A is located. Store information #11 also includes information indicating the appearance of restaurant A's entrance and exit, the appearance of the stairs at the entrance, etc.

[0096] For example, in the example of Fig. 6, the store (store SP11) identified by the store ID "SP11" is named "Restaurant A" and belongs to the category "Dining". Also, for example, in the example of Fig. 6, store SP11, which is Restaurant A, has store information #11.

[0097] The store information storage unit 122 may store various information according to the purpose, not limited to the above. The store information storage unit 122 may store various information such as facilities and areas other than the store, not limited to the store information.

[0098] (Registration information storage unit 123) The registration information storage unit 123 according to the embodiment stores various information related to registration. The registration information storage unit 123 stores various information related to sensing (detection) by a sensor. FIG. 7 is a diagram showing an example of the registration information storage unit according to the embodiment. The registration information storage unit 123 shown in FIG. 7 includes items such as "registration ID," "date and time," "sensor information," "context," and "store."

[0099] The "registration ID" indicates identification information for identifying the acquired sensor information. Furthermore, the "date and time" indicates the date and time corresponding to each registration ID. For example, the "date and time" indicates the date and time when the sensor information corresponding to each registration ID was acquired. In the example of FIG. 7, the "date and time" is illustrated abstractly as "DA11", but a specific date and time such as "April 21, 2022, 16:47:28" may also be stored.

[0100] "Sensor information" indicates detected sensor information. Various information is stored in the "sensor information" according to the type of detected information. For example, the "sensor information" stores voice information, acceleration information, temperature information, humidity information, illuminance information, position information indicating the range of the position of area A, etc.

[0101] The "context" indicates a context at the time when the sensor information is detected. For example, the "context" indicates a context estimated from the sensor information. For example, the "context" may store information indicating a change in context, with the context detected by the sensor information being stored as a second context and the context immediately before that being stored as a first context.

[0102] "Store" indicates the store corresponding to the context. If there is no store corresponding to the context, the store item will be blank ("-" (hyphen)).

[0103] 7, the registration information identified by the registration ID "DL11" (registration information DL11) indicates that it is information corresponding to sensing (detection) at date and time DA11. The registration information DL11 indicates that the sensor information SD11 was acquired (detected) at date and time DA11, that the context corresponding to the sensor information SD11 is context CN11, and that the store corresponding to the context CN11 is store SP11.

[0104] The registration information storage unit 123 may store various kinds of information according to the purpose, not limited to the above. For example, the registration information storage unit 123 may store information for identifying the terminal device 10 corresponding to each piece of registration information.

[0105] (Control unit 130) Returning to the explanation of Fig. 4, the control unit 130 is a controller, and is realized, for example, by a CPU (Central Processing Unit), MPU (Micro Processing Unit), etc., executing various programs (corresponding to an example of an information processing program) stored in a storage device inside the information processing device 100 using a RAM as a working area. The control unit 130 is also a controller, and is realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0106] 4, the control unit 130 has an acquisition unit 131, an estimation unit 132, a registration unit 133, a processing unit 134, and a provision unit 135, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 4, and may be other configurations as long as they perform the information processing described below.

[0107] (Acquisition part 131) The acquisition unit 131 acquires various pieces of information. The acquisition unit 131 acquires various pieces of information from the storage unit 120. In addition, the acquisition unit 131 acquires various pieces of information from the user information storage unit 121, the store information storage unit 122, the registration information storage unit 123, and the like.

[0108] The acquisition unit 131 acquires various information from an external device. The acquisition unit 131 acquires information from the terminal device 10. The acquisition unit 131 acquires information from the store device 20. The acquisition unit 131 acquires information from the data providing device 50. The acquisition unit 131 acquires information from the store device 20. The acquisition unit 131 receives various information from an external information processing device via the communication unit 110. The acquisition unit 131 receives various information from the terminal device 10, the store device 20, the data providing device 50, etc.

[0109] The acquisition unit 131 acquires user location information from the terminal device 10 used by the user. The acquisition unit 131 acquires store information from the store information storage unit 122. The acquisition unit 131 acquires information estimated by the estimation unit 132.

[0110] The acquisition unit 131 acquires sensor information detected by a sensor from the terminal device 10 used by the user. The acquisition unit 131 acquires sensor information detected by a sensor when the user enters and leaves a store. The acquisition unit 131 acquires sensor information detected by a sensor when the user enters a store. The acquisition unit 131 acquires sensor information detected by a sensor when the user leaves the store.

[0111] The acquisition unit 131 acquires sensor information detected by a sensor from the terminal device 10 used by a target user who is a user to be estimated. The acquisition unit 131 acquires history information that associates sensor information acquired when the user enters and leaves a target store with the target store. The acquisition unit 131 acquires history information including store entry sensor information that associates sensor information acquired when the user enters the target store with the target store. The acquisition unit 131 acquires history information including store exit sensor information that associates sensor information acquired when the user leaves the target store with the target store.

[0112] (Estimation part 132) The estimation unit 132 executes an estimation process to estimate various information. The estimation unit 132 stores the estimated information in the memory unit 120. The estimation unit 132 estimates various information based on information from an external information processing device and information stored in the memory unit 120. The estimation unit 132 estimates various information from the memory unit 120. The estimation unit 132 estimates various information from the user information memory unit 121, the store information memory unit 122, and the registration information memory unit 123. The estimation unit 132 identifies various information. The estimation unit 132 estimates various information. The estimation unit 132 executes an estimation process based on sensor information acquired by the acquisition unit 131.

[0113] The estimation unit 132 executes a context estimation process to estimate a context, based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates a context switch, based on a first context before the context estimation process and a second context estimated by the context estimation process.

[0114] The estimation unit 132 estimates a context switch from a first context corresponding to a context in which the user is located outside the store to a second context corresponding to a context in which the user is located inside the store. The estimation unit 132 estimates a context switch from the first context corresponding to a context in which the user is located inside the store to the second context corresponding to a context in which the user is located outside the store.

[0115] The estimation unit 132 estimates the target user's entry and exit from a target store that is a store to be estimated, based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates the target user's entry and exit from the target store, based on history information. The estimation unit 132 estimates the target user's entry and exit from the target store, based on a comparison between the history information and the sensor information.

[0116] The estimation unit 132 estimates the target user's entry into the target store based on the history information. The estimation unit 132 estimates the target user's entry into the target store based on a comparison between the entry sensor information and the sensor information. The estimation unit 132 estimates the target user's exit from the target store based on the history information. The estimation unit 132 estimates the target user's exit from the target store based on a comparison between the exit sensor information and the sensor information.

[0117] The estimation unit 132 estimates the target user's entry and exit from the target store in accordance with the context estimated by a context estimation process that estimates a context based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates the target user's entry and exit from the target store in accordance with a switch from a first context before the context estimation process to a second context estimated by the context estimation process.

[0118] The estimation unit 132 estimates the target user's entry into the target store in response to a switch from a first context corresponding to a context in which the target user is located outside the target store to a second context corresponding to a context in which the target user is located inside the target store. The estimation unit 132 estimates the target user's exit from the target store in response to a switch from the first context corresponding to a context in which the target user is located inside the target store to the second context corresponding to a context in which the target user is located outside the target store.

[0119] (Registration Section 133) The registration unit 133 executes a registration process for registering various pieces of information. The registration unit 133 executes the registration process by storing information in the storage unit 120. The registration unit 133 registers various pieces of information acquired from an external device. For example, the registration unit 133 associates the sensor information with information indicating a context or a store, and registers the information in the registration information storage unit 123.

[0120] The registration unit 133 associates the sensor information acquired by the acquisition unit 131 with a context at the time of detection by the sensor of the sensor information, and registers them in a database. The registration unit 133 associates the sensor information acquired when a user enters or leaves a store with a context indicating the entry or exit of the store, and registers them in a database.

[0121] The registration unit 133 associates the sensor information acquired when the user enters a store with a store entry context indicating the user's entry into the store and registers the associated information in the database. The registration unit 133 associates the sensor information acquired when the user leaves the store with a store exit context indicating the user's exit from the store and registers the associated information in the database.

[0122] The registration unit 133 registers the sensor information acquired by the acquisition unit 131 and the context estimated by the context estimation process in a database in association with each other. When the estimation unit 132 estimates that a context switch has occurred, the registration unit 133 registers the sensor information acquired by the acquisition unit in association with a second context in a database. The registration unit 133 registers other sensor information detected by the sensor at a time corresponding to the first context in the database in association with the second context.

[0123] (Processing section 134) The processing unit 134 executes various processes. The processing unit 134 executes various processes based on information from an external information processing device or information stored in the storage unit 120. The processing unit 134 executes various processes based on information from other information processing devices such as the terminal device 10, the store device 20, and the data providing device 50. The processing unit 134 executes various processes based on information stored in the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123.

[0124] The processing unit 134 executes various information based on the various information acquired by the acquisition unit 131. The processing unit 134 executes various information based on the various information estimated by the estimation unit 132. The processing unit 134 executes various information based on the various information registered by the registration unit 133.

[0125] The processing unit 134 determines various pieces of information. The processing unit 134 determines various pieces of information based on the various pieces of information acquired by the acquisition unit 131. The processing unit 134 determines various pieces of information based on the various pieces of information estimated by the estimation unit 132. The processing unit 134 determines various pieces of information based on the various pieces of information registered by the registration unit 133.

[0126] The processing unit 134 generates content. The processing unit 134 generates content including a coupon indicating an incentive. For example, the processing unit 134 generates a screen (content) to be provided to the terminal device 10 by appropriately using various technologies such as Java (registered trademark). The processing unit 134 may generate the screen (content) to be provided to the terminal device 10 based on the format of CSS, JavaScript (registered trademark), or HTML. Also, for example, the processing unit 134 may generate the screen (content) in various formats such as JPEG (Joint Photographic Experts Group), GIF (Graphics Interchange Format), and PNG (Portable Network Graphics).

[0127] (Provider 135) The providing unit 135 provides various services. The providing unit 135 provides various information. The providing unit 135 provides various information to an external information processing device. The providing unit 135 transmits various information to the terminal device 10, the store device 20, and the data providing device 50.

[0128] The providing unit 135 provides various information based on information from other information processing devices such as the terminal device 10, the store device 20, and the data providing device 50. The providing unit 135 provides various information based on information stored in the storage unit 120. The providing unit 135 provides various information based on information stored in the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123.

[0129] The providing unit 135 transmits various information based on the various information acquired by the acquiring unit 131. The providing unit 135 transmits various information based on the various information estimated by the estimating unit 132. The providing unit 135 transmits various information based on the various information registered by the registering unit 133. The providing unit 135 transmits various information based on the various information executed by the processing unit 134.

[0130] The providing unit 135 provides a service using a database. The providing unit 135 provides information to the terminal device 10 used by the target user according to the entry and exit of the target user into and from the target store estimated using the database.

[0131] The providing unit 135 provides information to the target user in accordance with the target user's entry into and exit from the target store estimated by the estimation unit 132. The providing unit 135 transmits information to the terminal device 10 used by the target user in accordance with the target user's entry into and exit from the target store estimated by the estimation unit 132.

[0132] [3. Information processing flow] Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to FIGS.

[0133] First, the process shown in Fig. 8 will be described. Fig. 8 is a flowchart showing an example of information processing according to the embodiment. Specifically, Fig. 8 is a flowchart showing an example of information processing related to the registration of information.

[0134] 8, the information processing device 100 acquires sensor information detected by a sensor from a terminal device used by a user (step S101). For example, the information processing device 100 receives the sensor information detected by a sensor from the terminal device 10 used by the user.

[0135] Then, the information processing device 100 registers the sensor information and the context at the time of detection by the sensor of the sensor information in a database in association with each other (step S102). For example, the information processing device 100 registers the sensor information received from the terminal device 10 in the registration information storage unit 123 in association with the context at the time of detection by the sensor of the sensor information.

[0136] Next, a process shown in Fig. 9 will be described. Fig. 9 is a flowchart showing an example of information processing according to the embodiment. Specifically, Fig. 9 is a flowchart showing an example of information processing related to information estimation.

[0137] 9, the information processing device 100 acquires sensor information detected by a sensor from a terminal device used by a target user who is to be an estimated user (step S201). For example, the information processing device 100 receives the sensor information detected by a sensor from the terminal device 10 used by the target user who is to be an estimated user.

[0138] Then, the information processing device 100 estimates the target user's entry and exit to the target store that is the estimation target store based on the sensor information (step S202). For example, the information processing device 100 estimates the target user's entry and exit to the target store that is the estimation target store based on the sensor information received from the terminal device 10.

[0139] [4. Effects] As described above, the information processing device 100 according to the embodiment includes the acquisition unit 131 and the estimation unit 132. The acquisition unit 131 acquires sensor information detected by a sensor from the terminal device 10 used by a target user who is to be an estimation target user. The estimation unit 132 estimates the entrance and exit of the target user to a target store that is to be an estimation target store, based on the sensor information acquired by the acquisition unit 131.

[0140] In this way, the information processing device 100 according to the embodiment can appropriately estimate the entry and exit of a user into a store by estimating the entry and exit of the target user into a target store based on sensor information acquired from the terminal device 10 used by the target user.

[0141] In the information processing device 100 according to the embodiment, the acquisition unit 131 acquires history information that associates sensor information acquired when a user enters and leaves a target store with the target store. The estimation unit 132 estimates the entrance and exit of the target user to and from the target store based on the history information.

[0142] In this way, the information processing device 100 according to the embodiment can estimate the target user's entry and exit to the target store based on the sensor information acquired when the user enters and leaves the target store and the history information that associates the target store with the target store, thereby estimating the target user's entry and exit to the target store based on the past tendency of entering and leaving the target store. Therefore, the information processing device 100 can appropriately estimate the user's entry and exit to the store.

[0143] Moreover, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entrance and exit of the target user to the target store based on a comparison between the history information and the sensor information.

[0144] In this way, the information processing device 100 according to the embodiment can estimate the target user's entrance and exit to the target store based on the past tendency of entering and exiting the target store by estimating the target user's entrance and exit to the target store based on the comparison between the history information and the sensor information. Therefore, the information processing device 100 can appropriately estimate the user's entrance and exit to the store.

[0145] In the information processing device 100 according to the embodiment, the acquisition unit 131 acquires history information including sensor information acquired when the user enters a target store and store entry sensor information associated with the target store. The estimation unit 132 estimates the target user's entry into the target store based on the history information.

[0146] In this way, the information processing device 100 according to the embodiment can estimate the target user's entry into the target store based on the sensor information acquired when the user enters the target store and the history information including the store entry sensor information associated with the target store, thereby estimating the target user's entry into the target store based on the past tendency of entering the target store. Therefore, the information processing device 100 can appropriately estimate the user's entry into and exit from the store.

[0147] Moreover, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entrance of the target user into the target store based on a comparison between the store entrance sensor information and the sensor information.

[0148] In this way, the information processing device 100 according to the embodiment can estimate the target user's entry into the target store based on the past trends of entering the target store by estimating the target user's entry into the target store based on the comparison between the entry sensor information and the sensor information. Therefore, the information processing device 100 can appropriately estimate the user's entry into and exit from the store.

[0149] In the information processing device 100 according to the embodiment, the acquisition unit 131 acquires history information including sensor information acquired when the user leaves the target store and store exit sensor information associated with the target store. The estimation unit 132 estimates the target user's exit from the target store based on the history information.

[0150] In this way, the information processing device 100 according to the embodiment can estimate the target user's exit from the target store based on the sensor information acquired when the user exits the target store and the history information including the store exit sensor information associated with the target store, thereby estimating the target user's exit from the target store based on the tendency of the target user to exit from the target store in the past. Therefore, the information processing device 100 can appropriately estimate the user's entry and exit from the store.

[0151] Moreover, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the exit of the target user from the target store based on a comparison between the store exit sensor information and the sensor information.

[0152] In this way, the information processing device 100 according to the embodiment can estimate the target user's exit from the target store based on the past tendency of exiting the target store by estimating the target user's exit from the target store based on the comparison between the store exit sensor information and the sensor information. Therefore, the information processing device 100 can appropriately estimate the user's entry and exit from the store.

[0153] In addition, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entry and exit of the target user into and from the target store according to the context estimated by a context estimation process that estimates the context based on the sensor information acquired by the acquisition unit 131.

[0154] In this way, the information processing device 100 according to the embodiment can appropriately estimate the entry and exit of a user into and from a store by estimating the entry and exit of a target user into and from a target store in accordance with the context estimated based on sensor information.

[0155] Furthermore, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the entry and exit of the target user into and from the target store in response to a switch from a first context before the context estimation process to a second context estimated by the context estimation process.

[0156] In this way, the information processing device 100 according to the embodiment can appropriately estimate the user's entry and exit into a store by estimating the target user's entry and exit into a target store in response to a switch from the first context before the context estimation process to the second context estimated by the context estimation process.

[0157] In addition, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates the target user's entry into the target store in response to a switch from a first context corresponding to a context in which the target user is located outside the target store to a second context corresponding to a context in which the target user is located inside the target store.

[0158] In this way, the information processing device 100 according to the embodiment can estimate the target user's entry into the target store by estimating the target user's entry into the target store in response to a context switch from outside the target store to inside the target store. Therefore, the information processing device 100 can appropriately estimate the user's entry into and exit from the store.

[0159] In addition, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates that the target user will leave the target store in response to a switch from a first context corresponding to a context in which the target user is located within the target store to a second context corresponding to a context in which the target user is located outside the target store.

[0160] In this way, the information processing device 100 according to the embodiment can estimate the target user's exit from the target store by estimating the target user's exit from the target store in response to a context switch from inside the target store to outside the target store. Therefore, the information processing device 100 can appropriately estimate the user's entry and exit from the store.

[0161] Moreover, the information processing device 100 according to the embodiment includes a providing unit 135. The providing unit 135 provides information to the target user in accordance with the entry and exit of the target user into and from the target store estimated by the estimation unit 132.

[0162] In this manner, the information processing device 100 according to the embodiment can provide the target user with appropriate information by providing the target user with information in accordance with the estimated target user's entry into and exit from the target store.

[0163] Furthermore, in the information processing device 100 according to the embodiment, the providing unit 135 transmits information to the terminal device 10 used by the target user in response to the entry and exit of the target user into and from the target store estimated by the estimation unit 132.

[0164] In this way, the information processing device 100 according to the embodiment can provide the target user with appropriate information by transmitting information to the terminal device 10 used by the target user in accordance with the estimated target user's entry and exit into the target store.

[0165] [5. Hardware Configuration] The information processing device 100 according to the embodiment described above is realized by a computer 1000 having a configuration as shown in Fig. 10. Fig. 10 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD (Hard Disk Drive) 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0166] The CPU 1100 operates and controls each unit based on a program stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, programs that depend on the hardware of the computer 1000, and the like.

[0167] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 receives data from other devices via the network N and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the network N.

[0168] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0169] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0170] For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via the network N.

[0171] Although some of the embodiments and variants of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the lines of the disclosure of the invention.

[0172] [6. Other] Furthermore, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0173] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0174] Furthermore, the above-described embodiments and modifications can be appropriately combined as long as the processing contents are not contradictory.

[0175] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0176] 1. Information Processing Systems 100 Information processing device 121 User information storage unit 122 Store information storage unit 123 Registration information storage unit 130 Control section 131 Acquisition Department 132 Estimation Department 133 Registration Department 134 Processing section 135 Provision Department 10 Terminal Equipment 20 Store equipment 50 Data providing device N Network

Claims

1. An acquisition unit that acquires target sensor information including first type sensor information, which is location information detected by a location sensor, and second type sensor information detected by a sensor other than the location sensor, from a terminal device used by a target user who is to be an estimated user, and acquires from a memory unit history information in which sensor information including the first type sensor information and the second type sensor information detected in the past is associated with a store corresponding to the sensor information and a context indicating entry / exit or leaving the store; an estimation unit that compares the target sensor information including the first type sensor information and the second type sensor information acquired by the acquisition unit with each piece of sensor information including the first type sensor information and the second type sensor information included in the history information, and estimates the entry and exit of the target user into and from the target store based on a target store that is a store associated with sensor information similar to the target sensor information among the pieces of sensor information included in the history information, and a context associated with the sensor information; a providing unit that provides the target user with a coupon that can be used in a store located within a predetermined range from the target store when the estimating unit estimates that the target user has left the target store; An information processing device comprising:

2. The providing unit is Transmitting information to a terminal device used by the target user according to the entry and exit of the target user from the target store estimated by the estimation unit.

2. The information processing apparatus according to claim 1,

3. 1. A computer-implemented information processing method, comprising: an acquisition process of acquiring target sensor information including first type sensor information, which is position information detected by a position sensor, and second type sensor information detected by a sensor other than the position sensor, from a terminal device used by a target user who is to be an estimated user, and acquiring from a storage unit history information in which the sensor information including the first type sensor information and the second type sensor information detected in the past is associated with a store corresponding to the sensor information and a context indicating entry / exit or exit from the store; an estimation process of comparing the target sensor information including the first type sensor information and the second type sensor information acquired by the acquisition process with each piece of sensor information including the first type sensor information and the second type sensor information included in the history information, and estimating the entry and exit of the target user into and from the target store based on a target store that is a store associated with sensor information similar to the target sensor information among the pieces of sensor information included in the history information and a context associated with the sensor information; a providing step of providing the target user with a coupon that can be used in a store located within a predetermined range from the target store when the estimating step estimates that the target user has left the target store; 13. An information processing method comprising:

4. An acquisition step of acquiring target sensor information including first type sensor information, which is location information detected by a location sensor, and second type sensor information detected by a sensor other than the location sensor, from a terminal device used by a target user who is to be the estimated user, and acquiring from a memory unit historical information in which sensor information including the first type sensor information and the second type sensor information detected in the past is associated with a store corresponding to the sensor information and a context indicating entry / exit or leaving the store; an estimation step of comparing the target sensor information including the first type sensor information and the second type sensor information acquired by the acquisition step with each piece of sensor information including the first type sensor information and the second type sensor information included in the history information, and estimating the entry and exit of the target user into and from the target store based on a target store which is a store associated with sensor information similar to the target sensor information among the pieces of sensor information included in the history information and a context associated with the sensor information; a providing step of providing the target user with a coupon that can be used in a store located within a predetermined range from the target store when the estimating step estimates that the target user has left the target store; An information processing program characterized by causing a computer to execute the above.

Images