Information processing device, information processing method and program

Abstract

To address such a problem that the prior art is unable to present users' keystone habits.SOLUTION: An information processing device includes: a set determination unit referring to a behavior management unit in which behavior information identifying one user's behavior is stored in association with each of four or more time periods and determining a behavior set, the series of two or more behavior sets, satisfying a set condition; a keystone habit acquisition unit for acquiring keystone habit information including behavior information that identifies behavior to be a starting point of the behavior set determined by the set determination unit, and a keystone habit output unit for outputting keystone habit information. Accordingly, the information processing device can present users' keystone habits.SELECTED DRAWING: Figure 43

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and the like that acquires and outputs a keystone habit that is the starting point of a user's set of actions.

Background Art

[0002] Conventionally, there has been an action determination system that determines actions such as the sleep of a resident using energy consumption data (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, it has not been possible to present a user's keystone habit. Note that a keystone habit is a key habit. A habit, in this specification, is what the action information indicates.

Means for Solving the Problems

[0005] The information processing apparatus according to the first aspect of the present invention refers to an action management unit in which action information for specifying the actions of a single user is stored, associated with each of four or more time zones, determines a set of actions that is a series of two or more sets of actions and satisfies set conditions, a keystone habit acquisition unit that acquires keystone habit information including action information for specifying an action that is the starting point of the set of actions determined by the set determination unit, and a keystone habit output unit that outputs the keystone habit information.

[0006] With such a configuration, it is possible to present a user's keystone habit.

[0007] Further, the information processing apparatus of the second invention, compared with the first invention, is an information processing apparatus in which the keystone habit acquisition unit acquires keystone habit information including action information identifying an action that is the starting point of an action set and a start time included in a time zone associated with the action information.

[0008] With such a configuration, the user's keystone habit and its start time and the like can be presented.

[0009] Further, the information processing apparatus of the third invention, compared with the first or second invention, further includes a time acquisition unit that acquires time, a position acquisition unit that acquires position information associated with the time, and an action estimation unit that acquires action information identifying the user's action in a time zone specified by the time included in two or more pieces of action source information including the position information associated with the time. At least a part of the action information associated with each of the two or more time zones in the action management unit is the action information in the time zone acquired by the action estimation unit.

[0010] With such a configuration, the user's action can be estimated using the position information associated with the time.

[0011] Further, the information processing apparatus of the fourth invention, compared with the first or second invention, is an information processing apparatus in which emotion information identifying emotion is associated with the action information in the action management unit, and the set determination unit determines an action set using the emotion information.

[0012] With such a configuration, the action set can be determined using the emotion information.

[0013] Further, the information processing apparatus of the fifth invention further includes a query reception unit that receives a query including a time and action information for any one of the first to fourth inventions. The keystone habit acquisition unit is action information that identifies an action that is the starting point of the action set determined by the set determination unit. It determines a time zone and action information corresponding to the time and action information included in the query, and is a time zone before the determined time zone and includes action information that identifies an action that is the starting point of the action set in the time zone closest to the determined time zone. It is an information processing apparatus that acquires keystone habit information.

[0014] With such a configuration, the keystone habit corresponding to the query from the user can be presented to the user.

[0015] Further, the information processing apparatus of the sixth invention is an information processing apparatus in which, for any one of the first to fourth inventions, the keystone habit output unit outputs a recommendation including the keystone habit information.

[0016] With such a configuration, a recommendation using the keystone habit can be made.

[0017] Further, the information processing apparatus of the seventh invention, with respect to the fifth invention, the action information of the action management unit is associated with emotion information that identifies emotion. It acquires emotion information corresponding to the action information included in the keystone habit information or the action information included in the query, and further includes a recommendation acquisition unit that configures a recommendation using the emotion information and the keystone habit information. The keystone habit output unit is an information processing apparatus that outputs a recommendation.

[0018] With such a configuration, a recommendation using the keystone habit and emotion information can be made.

Effects of the Invention

[0019] According to the information processing apparatus of the present invention, the user's keystone habit can be presented.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Figure 45

Figure 46

Figure 47

Figure 48

Figure 49

Figure 50

Figure 51

Mode for Carrying Out the Invention

[0021] Hereinafter, embodiments of an information processing apparatus and the like will be described with reference to the drawings. In the embodiments, components denoted by the same reference numerals perform the same operations, and thus the description may be omitted again.

[0022] (Embodiment 1) In the present embodiment, a location information production apparatus will be described. The location information production apparatus is an apparatus that acquires location information described later for a specific location.

[0023] In this specification, the fact that information X is associated with information Y means that information Y can be acquired from information X, or information X can be acquired from information Y, and the method of the association is not limited. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, information Y may be included in information X, etc.

[0024] In addition, in this specification, selecting or determining information Z means obtaining information Z, obtaining a pointer to information Z, obtaining the ID of information Z, setting a flag for information Z, etc., as long as information Z can be accessed.

[0025] FIG. 1 is a conceptual diagram of an information system A including a location information production device 1 according to the present embodiment. The information system A includes a location information production device 1 and three or more communication devices B.

[0026] Each of the three or more communication devices B is a device that transmits radio waves to other devices such as the location information production device 1. The communication device B transmits a device identifier for identifying the communication device B to other devices. The communication device B is, for example, a Wi-fi router or a communication device using BLE (Bluetooth Low Energy), but it doesn't matter.

[0027] FIG. 2 is a block diagram of the location information production device 1 according to the present embodiment. The location information production device 1 includes a storage unit 11, a reception unit 12, a reception unit 13, and a processing unit 14. The reception unit 12 includes a position reception unit 121. The processing unit 14 includes an intensity acquisition unit 141, a type determination unit 142, and a storage unit 143.

[0028] The reception unit 12 receives various instructions and information. The various instructions and information are, for example, the location information described later. The input means for the various instructions and information can be anything, such as a touch panel, a keyboard, a mouse, or a menu screen.

[0029] The position reception unit 121 receives the position information of a specific location. The position reception unit 121 usually receives the position information of three or more specific locations. The position reception unit 121 receives, for example, the position information that is the input of the user. The position reception unit 121 reads the position information from, for example, the storage unit 11.

[0030] The specific location can be a specific location indoors or outdoors. Here, the location information is information that identifies the location indoors or outdoors. The location information can be, for example, three-dimensional coordinate values (x, y, z) indicating the relative position indoors or outdoors, or two-dimensional coordinate values (x, y) are also acceptable. Note that the origin of the coordinate values for identifying the relative position indoors or outdoors is not restricted. The specific outdoor location is preferably a location where GPS signals are difficult to reach, such as among high-rise building groups or in the middle of a forest, but it is not restricted. The location information can also be information (such as a character string) or an ID that a person can recognize a place. Such location information can be, for example, labels such as "living room", "workroom", "meeting room", "east side of the library", "toy section of the department store", etc.

[0031] The position reception unit 121 may generate a unique ID. Such a unique ID is a label and can also be considered as location information.

[0032] The position reception unit 121 does not necessarily need to receive location information. In such a case, the position reception unit 121 is unnecessary.

[0033] The receiving unit 13 receives radio waves including device identifiers from each of three or more communication devices B at a specific location. The receiving unit 13 usually continuously receives radio waves including device identifiers from each of three or more communication devices B.

[0034] The device identifier is information that identifies the communication device B. The device identifier can be, for example, the ID of the communication device B or the name of the communication device B. It is acceptable to consider the reception of radio waves as the reception of information.

[0035] The processing unit 14 performs various processes. The various processes are, for example, the processes performed by the intensity acquisition unit 141, the type determination unit 142, and the storage unit 143.

[0036] The intensity acquisition unit 141 acquires the intensity of the radio wave received from each communication device B with 3 or more communication devices B. The intensity acquisition unit 141 acquires the radio wave intensity in pairs with the device identifier of the communication device B. The intensity acquisition unit 141 acquires the time-series radio wave intensity. The time-series radio wave intensity is two or more radio wave intensities that are continuous in time. It goes without saying that being continuous in time may allow for an interval in time.

[0037] The type determination unit 142 uses the time-series radio wave intensity acquired by the intensity acquisition unit 141 to determine whether each of the 3 or more communication devices B is a fixed terminal or a mobile terminal. A fixed terminal is a communication device whose installation position is fixed. A mobile terminal is a communication device whose installation position is not fixed and is moving.

[0038] The type determination unit 142, for example, acquires the degree of variation of two or three or more time-series and temporally continuous radio wave intensities paired with one device identifier, and when the degree of variation is equal to or greater than a threshold value, determines that the communication device B identified by the one device identifier is a mobile terminal. Also, the type determination unit 142, for example, acquires the degree of variation of two or three or more time-series and temporally continuous radio wave intensities paired with one device identifier, and when the degree of variation is equal to or less than a threshold value, determines that the communication device B identified by the one device identifier is a fixed terminal.

[0039] Note that the degree of variation is information indicating the degree of variation or change in the time-series radio wave intensity. The degree of variation is, for example, variance, standard deviation, or a number based on a difference (for example, a difference, a value obtained by adding the differences between two consecutive radio wave intensities among three or more temporally continuous radio wave intensities).

[0040] The type determination unit 142 is, for example, the number of radio wave intensities acquired within a predetermined time, and when the number of time-series and temporally continuous radio wave intensities paired with one device identifier is equal to or less than a threshold value, determines that the communication device B identified by the one device identifier is a mobile terminal.

[0041] The storage unit 143 forms and stores location information having the device identifier and the radio wave intensity of the communication device B determined by the type determination unit 142 to be a fixed terminal. It is preferable that the storage unit 143 forms and stores location information having the device identifier and the radio wave intensity for each of three or more communication devices B.

[0042] The storage unit 143 forms and stores location information having the device identifier, the radio wave intensity, and the location information of a specific location of the communication device B determined by the type determination unit 142 to be a fixed terminal. It is preferable that the storage unit 143 forms and stores location information having the device identifier, the radio wave intensity, and the location information of a specific location for each of three or more communication devices B. The storage unit 143 stores the location information in the storage unit 11, for example, but it may be stored in other devices. It is preferable that the location information has location information, but it may not have location information. The location information may be composed only of the device identifier and the radio wave intensity.

[0043] The radio wave intensity stored by the storage unit 143 is usually a representative value of the time-series radio wave intensity of the radio wave from the communication device B. The representative value is, for example, the median value, the average value, the maximum value, or the minimum value.

[0044] The storage unit 11 is preferably a non-volatile recording medium, but can also be realized with a volatile recording medium.

[0045] The process of storing information in the storage unit 11 is not limited. For example, information may be stored in the storage unit 11 via a recording medium, information transmitted via a communication line or the like may be stored in the storage unit 11, or information input via an input device may be stored in the storage unit 11.

[0046] The reception unit 12 and the position reception unit 121 can be realized by a device driver of an input means such as a touch panel or a keyboard, control software of a menu screen, or the like.

[0047] The reception unit 13 is usually realized by wireless or wired communication means.

[0048] The processing unit 14, the intensity acquisition unit 141, the type determination unit 142, and the storage unit 143 can usually be realized from a processor, a memory, and the like. The processing procedures of the processing unit 14 and the like are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (a dedicated circuit). Note that the processor may be a CPU, an MPU, a GPU, or the like, and its type is not limited.

[0049] Next, an operation example of the location information production device 1 will be described using the flowchart of FIG. 3.

[0050] (Step S301) The position reception unit 121 determines whether or not it has received the position information of a specific location. If it has received the position information, it proceeds to step S302, and if it has not received it, it returns to step S301.

[0051] (Step S302) The storage unit 143 acquires the position information received in step S301.

[0052] (Step S303) The processing unit 14 and the like perform a time-series intensity acquisition process. The time-series intensity acquisition process is a process of acquiring the time-series radio wave intensities of radio waves from three or more communication devices B. An example of the time-series intensity acquisition process will be described using the flowchart of FIG. 4.

[0053] (Step S304) The processing unit 14 and the like perform a fixed information acquisition process. It returns to step S301. The fixed information acquisition process is a process of acquiring the intensity of radio waves from a fixed terminal at the location specified by the position information received in step S301. An example of the fixed information acquisition process will be described using the flowchart of FIG. 5.

[0054] In the flowchart of FIG. 3, it is preferable that the user holding the location information production device 1 moves to three or more specific locations, and the location information production device 1 receives the position information for each of the three or more specific locations and repeatedly performs the processes from S301 to S304.

[0055] Also, in the flowchart of FIG. 3, the process ends due to an interrupt such as power-off or end of processing.

[0056] Next, an example of the time-series intensity acquisition process in step S303 will be described using the flowchart of FIG. 4.

[0057] (Step S401) The receiving unit 13 determines whether it has received radio waves from any communication device B. If radio waves are received, the process proceeds to step S402, and if not, the process returns to step S401.

[0058] (Step S402) The storage unit 143 acquires the device identifier corresponding to the radio waves received in step S401.

[0059] (Step S403) The intensity acquisition unit 141 acquires the intensity of the radio waves received in step S401.

[0060] (Step S404) The storage unit 143 appends the radio wave intensity acquired in step S403 to a buffer (not shown) in association with the device identifier acquired in step S402.

[0061] (Step S405) The storage unit 143 determines whether it meets the storage condition of the location information. If it meets the storage condition, it returns to the upper-level process, and if not, it returns to step S401. Note that the storage condition is, for example, that a threshold time or more has elapsed since receiving the position information of a specific location, or that the radio wave intensities of a threshold number or more in pairs with three or more each device identifier have been stored.

[0062] Next, an example of the fixed information acquisition process in step S304 will be described using the flowchart of FIG. 5.

[0063] (Step S501) The type determination unit 142 substitutes 1 for the counter i.

[0064] (Step S502) The type determination unit 142 determines whether the i-th device identifier exists in a buffer (not shown). If the i-th device identifier exists, it proceeds to step S503; if the i-th device identifier does not exist, it returns to the upper-level process.

[0065] (Step S503) The type determination unit 142 determines the type of the communication device B identified by the i-th device identifier. An example of such type determination processing will be described using the flowchart of FIG. 6.

[0066] (Step S504) If the determination result in step S503 is "fixed terminal", it proceeds to step S505; if it is "mobile terminal", it proceeds to step S508.

[0067] (Step S505) The storage unit 143 acquires two or more radio wave intensities paired with the i-th device identifier from a buffer (not shown).

[0068] (Step S506) The storage unit 143 acquires a representative value of the two or more radio wave intensities.

[0069] (Step S507) The storage unit 143 stores, in the storage unit 11 in association with the position information received in step S301, a pair of the i-th device identifier and the representative value of the radio wave intensity acquired in step S506.

[0070] (Step S508) The type determination unit 142 increments the counter i by 1. It returns to step S502.

[0071] Note that in the flowchart of FIG. 5, in step S506, the storage unit 143 may acquire the most recent radio wave intensity instead of the representative value of the two or more radio wave intensities.

[0072] Next, an example of the type determination processing in step S503 will be described using the flowchart of FIG. 6.

[0073] (Step S601) The type determination unit 142 acquires two or more radio wave intensities that correspond to the i-th device identifier in step S502 from a buffer (not shown).

[0074] (Step S602) The type determination unit 142 acquires the degree of variation of the two or more radio wave intensities acquired in step S601.

[0075] (Step S603) The type determination unit 142 determines whether the degree of variation acquired in step S602 is equal to or less than a threshold value or less than the threshold value. If the degree of variation is equal to or less than the threshold value or less than the threshold value, it proceeds to step S604, and if it is equal to or greater than the threshold value or greater than the threshold value, it proceeds to step S605.

[0076] (Step S604) The type determination unit 142 sets the type of the communication device B as a "fixed terminal". Return to the upper-level process.

[0077] (Step S605) The type determination unit 142 sets the type of the communication device B as a "mobile terminal". Return to the upper-level process.

[0078] Hereinafter, a specific operation example of the location information production device 1 in the present embodiment will be described. Here, it is assumed that the accumulation condition is that a predetermined time (for example, 3 minutes) has elapsed since the position information of a specific location was received.

[0079] Assume that user A is, for example, in a certain indoor area (for example, user A's home or a department store that user A often visits). And assume that user A has input the position information (x1, y1) to the location information production device 1.

[0080] Next, the position reception unit 121 of the location information production device 1 receives the position information (x1, y1) of the specific location. Next, the storage unit 143 acquires the received position information (x1, y1) in a buffer (not shown).

[0081] Then, the receiving unit 13 receives radio waves including device identifiers from each communication device B with 3 or more for a predetermined time (e.g., 3 minutes). And the storage unit 143 acquires the device identifiers included in the received radio waves. Also, the intensity acquisition unit 141 acquires the intensity of the received radio waves. Next, the storage unit 143 appends the acquired radio wave intensity to a buffer (not shown) in association with the acquired device identifier. As a result, a time-series radio wave intensity management table shown in FIG. 7 is configured in the buffer (not shown). The time-series radio wave intensity management table shown in FIG. 7 is a table at a specific location indicated by the position information (x1, y1).

[0082] The time-series radio wave intensity management table is a table that manages the time-series radio wave intensities for each communication device B. The time-series radio wave intensity management table is a table that manages two or more records having "ID", "device identifier", and "time-series radio wave intensity". "ID" is information for identifying a record. "Time-series radio wave intensity" is radio wave intensity that is continuous over time. "R 11 」「R 12 」「R 21 」 etc. are radio wave intensities.

[0083] After the management table in FIG. 7 is configured, since a predetermined time (e.g., 3 minutes) has elapsed after the position information (x1, y1) of the specific location is received by the position reception unit 121, the storage unit 143 determines that it meets the storage condition of the location information.

[0084] Next, the type determination unit 142 acquires the degree of variation in the time-series radio wave intensity of each record in FIG. 7 according to the operation of the flowchart in FIG. 6, and determines whether each communication device B is a fixed terminal or a mobile terminal. And assume that the type determination unit 142 determines that the communication device B identified by the device identifiers "device 1, device 3, device 4, device 6,..." is a fixed terminal, and the communication device B identified by the device identifiers "device 2, device 5,..." is a mobile terminal.

[0085] Next, the storage unit 143 forms radio field intensity information by pairing the device identifier of the communication device B, which is a fixed terminal, with the representative value of the radio field intensity. Then, the storage unit 143 stores a plurality of pieces of each radio field intensity information in association with the position information (x1, y1). By such processing, the record of "ID = 1" in the location information management table of FIG. 8 is configured. Note that the storage unit 143 may store only the device identifier and the radio field intensity. In such a case, each record in FIG. 8 does not have position information. Also, in such a case, the position reception unit 121 does not need to receive the position information of a specific location.

[0086] The location information management table is a table for managing location information. In the location information management table, there are records corresponding to the position information, and a plurality of records having "ID", "device identifier", and "radio field intensity information" are stored. The "radio field intensity information" has "device identifier" and "radio field intensity".

[0087] By the above processing, the location information at the specific location 1 at the position indicated by the position information (x1, y1) is stored.

[0088] User A moves to the specific location 2 at the position indicated by the position information (x2, y2) with the location information production device 1 and performs the same operations as above. As a result, the location information production device 1 configures and stores the record of "ID = 2" in the location information management table of FIG. 8. Further, User A moves to each specific location including the specific location 3 or more with the location information production device 1 and performs the same operations as above. As a result, the location information production device 1 configures and stores the record (not shown) of the transition of "ID = 3" in the location information management table of FIG. 8.

[0089] As described above, according to the present embodiment, location information for acquiring the position of the terminal device indoors can be obtained. That is, according to the present embodiment, three or more pieces of location information for acquiring the position of the terminal device indoors can be produced.

[0090] Note that the processing in this embodiment may be implemented by software. Further, this software may be distributed by software download or the like. Also, this software may be recorded on a recording medium such as a CD-ROM and distributed. Note that this also applies to other embodiments in this specification. The software that realizes the location information production device 1 in this embodiment is a program as follows. That is, this program causes a computer to function as a position reception unit that receives position information of a specific location, a reception unit that receives radio waves including device identifiers for identifying the communication devices from three or more communication devices at the specific location, an intensity acquisition unit that acquires time-series radio wave intensities for each of the three or more communication devices, a type determination unit that determines whether each of the three or more communication devices is a fixed terminal that is a communication device fixed in place or a mobile terminal that is a moving communication device using the time-series radio wave intensities acquired by the intensity acquisition unit, and a storage unit that functions to configure and store location information having the device identifiers, radio wave intensities, and the position information of the specific location of each of the three or more communication devices determined by the type determination unit to be fixed terminals.

[0091] (Embodiment 2) In this embodiment, a terminal device that receives radio waves from each of three or more communication devices B, determines the type of each communication device B using the time-series radio wave intensity, and acquires and outputs a terminal position indicating the position of the terminal device indoors using the radio wave intensity only from the communication device B of which the type is "fixed terminal" will be described.

[0092] Also, in this embodiment, a terminal device that determines whether the terminal device is moving or stopped, and uses the determination result to acquire and output the terminal position will be described.

[0093] FIG. 9 is a conceptual diagram of the information system C in this embodiment. The information system C includes one or two or more terminal devices 2 and three or more communication devices B.

[0094] The terminal device 2 is a terminal capable of acquiring position information indoors. The terminal device 2 is, for example, a smartphone, a tablet terminal, a smartwatch, a so-called personal computer, etc., and its type is not limited.

[0095] FIG. 10 is a block diagram of the terminal device 2 in the present embodiment. The terminal device 2 includes a storage unit 21, a reception unit 22, a processing unit 23, and an output unit 24. The storage unit 21 includes a location information storage unit 211. The processing unit 23 includes a strength acquisition unit 231, a type determination unit 232, a movement determination unit 233, and a position acquisition unit 234. The position acquisition unit 234 includes a strength acquisition means 2341, a location determination means 2342, and a position acquisition means 2343. The output unit 24 includes a position output unit 241.

[0096] Various types of information are stored in the storage unit 21. The various types of information are, for example, the location information described later.

[0097] Three or more pieces of location information are stored in the location information storage unit 211. It is preferable that the three or more pieces of location information in the location information storage unit 211 are the information accumulated by the location information production device 1.

[0098] Each of the three or more pieces of location information in the location information storage unit 211 has, for example, location information of a specific location, a device identifier, and a radio wave strength. It is preferable that three or more pieces of radio wave strength information are associated with the three or more pieces of location information. The radio wave strength information has a device identifier and a radio wave strength. The three or more pieces of radio wave strength information may constitute a radio wave strength vector. The radio wave strength vector is a vector using the radio wave strength information, and has, for example, a structure of (radio wave strength of device identifier 1, radio wave strength of device identifier 2, radio wave strength of device identifier 3, ··· radio wave strength of device identifier n). A location information management table having the structure of FIG. 8, for example, is stored in the location information storage unit 211.

[0099] Note that the terminal device 2 does not necessarily have the location information storage unit 211. In such a case, the terminal device 2 refers to the location information storage unit 211 of an external device (not shown) and acquires the terminal position described later.

[0100] The receiving unit 22 receives radio waves including a device identifier for identifying the communication device B from each of three or more communication devices B. The receiving unit 22 usually performs the same functions as the above-described receiving unit 13. The receiving unit 22 usually receives radio waves including a device identifier from each of three or more communication devices B. The receiving unit 22 usually receives radio waves continuously.

[0101] The processing unit 23 performs various processes. The various processes are, for example, processes performed by the intensity acquisition unit 231, the type determination unit 232, the movement determination unit 233, and the position acquisition unit 234.

[0102] The intensity acquisition unit 231 acquires time-series radio wave intensities for each of three or more communication devices B. The intensity acquisition unit 231 acquires the radio wave intensity based on the radio waves received by the receiving unit 22. Note that the intensity acquisition unit 231 performs the same functions as the above-described intensity acquisition unit 141.

[0103] The type determination unit 232 uses the time-series radio wave intensities acquired by the intensity acquisition unit 231 to determine whether each of the three or more communication devices B is a fixed terminal or a mobile terminal. The type determination unit 232 performs the same functions as the above-described type determination unit 142.

[0104] The movement determination unit 233 determines whether the terminal device 2 is in motion or stopped, and obtains a movement determination result that is the result of the determination. The movement determination result is, for example, "in motion" or "stopped".

[0105] The movement determination unit 233 obtains, for example, sensor information of the terminal device 2 and uses the sensor information to obtain a movement determination result. The sensor information is, for example, acceleration by a gyroscope and time-series position information.

[0106] The movement determination unit 233 obtains a movement determination result of "stopped", for example, if the acceleration by the gyroscope is "0" or less than or equal to a threshold value. The movement determination unit 233 obtains a movement determination result of "in motion", for example, when the acceleration by the gyroscope is greater than or equal to the threshold value or greater than the threshold value.

[0107] The movement determination unit 233 determines, for example, that when there is no change in the time-series radio wave intensities of one or two or more communication devices B using the time-series radio wave intensities of each communication device B of 3 or more obtained by the intensity acquisition unit 231, it is in a stopped state, and acquires a movement determination result of "stopped".

[0108] The position acquisition unit 234 acquires the radio wave intensities of 3 or more communication devices B determined by the type determination unit 232 to be fixed terminals, and uses the radio wave intensities of the fixed terminals to acquire the terminal position, which is the position information of the terminal device 2 indoors.

[0109] The position acquisition unit 234 acquires, for example, the radio wave intensities of 3 or more communication devices B determined by the type determination unit 232 to be fixed terminals, refers to 3 or more location information in the location information storage unit 211 using the 3 or more radio wave intensities, and acquires the terminal position by the fingerprint method.

[0110] It is preferable for the position acquisition unit 234 to acquire position information using the movement determination result. For example, it is preferable for the position acquisition unit 234 to acquire the terminal position only when the movement determination result is "stopped".

[0111] The position acquisition unit 234 may acquire the terminal position using the location information including the device identifier only when the device identifier corresponding to the radio wave received by the reception unit 22 is included in the location information of the location information storage unit 211. This is because the location information of the location information storage unit 211 is the location information of the fixed terminal.

[0112] The intensity acquisition means 2341 acquires, in association with the device identifier, the radio wave intensities of 3 or more communication devices determined by the type determination unit 232 to be fixed terminals.

[0113] The location determination means 2342 determines, from the location information in the location information storage unit 211, one or two or more location information that satisfies similar conditions to the radio wave intensities associated with each of the 3 or more device identifiers acquired by the intensity acquisition means 2341.

[0114] The location determination means 2342 acquires, for example, a first radio wave intensity vector that is a vector having, as elements, the radio wave intensities paired with each of three or more device identifiers included in the location information. Further, the location determination means 2342 acquires, for example, a second radio wave intensity vector that is a vector having, as elements, the radio wave intensities corresponding to each of three or more device identifiers acquired by the intensity acquisition means 2341. The location determination means 2342 acquires, for example, the similarity between the two radio wave intensity vectors, and when the similarity is equal to or greater than a threshold value, acquires the location information corresponding to the first radio wave intensity vector.

[0115] The position acquisition means 2343 acquires the position information included in each of one or more location information determined by the location determination means 2342, and acquires the terminal position using the one or more position information.

[0116] The output unit 24 outputs various types of information. The various types of information are, for example, here, the terminal position and an indoor map.

[0117] Here, output includes concepts such as display on a display, projection using a projector, printing by a printer, sound output, transmission to an external device, storage in a recording medium, and delivery of a processing result to another processing device or another program.

[0118] The position output unit 241 outputs the terminal position acquired by the position acquisition unit 234. The position output unit 241, for example, displays a symbol indicating the position specified by the terminal position on an indoor map.

[0119] The storage unit 21 and the location information storage unit 211 are preferably non-volatile recording media, but can also be realized with volatile recording media.

[0120] The process of storing information in the storage unit 21 or the like is not limited. For example, information may be stored in the storage unit 21 or the like via a recording medium, information transmitted via a communication line or the like may be stored in the storage unit 21 or the like, or information input via an input device may be stored in the storage unit 21 or the like.

[0121] The receiving unit 22 is usually realized by wireless or wired communication means.

[0122] The processing unit 23, the intensity acquisition unit 231, the type determination unit 232, the movement determination unit 233, the position acquisition unit 234, the intensity acquisition means 2341, the location determination means 2342, and the position acquisition means 2343 can usually be realized from a processor, a memory, etc. The processing procedures of the processing unit 23, etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may also be realized by hardware (a dedicated circuit). Note that the processor is a CPU, an MPU, a GPU, etc., and its type does not matter.

[0123] The output unit 24 and the position output unit 241 can be realized, for example, by driver software of an output device such as a display or a speaker, or by driver software of the output device and the output device, etc.

[0124] Next, a first operation example of the terminal device 2 will be described using the flowchart of FIG. 11.

[0125] (Step S1101) The movement determination unit 233 determines whether the terminal device 2 is moving or stopped. An example of such movement determination processing will be described using the flowchart of FIG. 12.

[0126] (Step S1102) If the determination result in Step S1101 is "stopped", the process proceeds to Step S1103, and if it is "moving", the process returns to Step S1101.

[0127] (Step S1103) The intensity acquisition means 2341 performs time-series intensity acquisition processing. An example of the time-series intensity acquisition processing was described using the flowchart of FIG. 4.

[0128] (Step S1104) The type determination unit 232, the location determination means 2342, etc. perform fixed information acquisition processing. An example of the fixed information acquisition processing was described using the flowchart of FIG. 5.

[0129] (Step S1105) The position acquisition means 2343 performs a position estimation process to acquire the terminal position. An example of the position estimation process will be described using the flowchart of FIG. 13.

[0130] (Step S1106) The position output unit 241 outputs the terminal position acquired in Step S1105. Return to Step S1101.

[0131] Note that in the flowchart of FIG. 11, the process ends due to a power-off or a process end interrupt.

[0132] Next, an example of the movement determination process in Step S1101 will be described using the flowchart of FIG. 12.

[0133] (Step S1201) The movement determination unit 233 acquires the sensor value (for example, acceleration) of the terminal device 2 and temporarily stores it in a buffer (not shown).

[0134] (Step S1202) The movement determination unit 233 determines whether to perform a movement determination using the sensor values in the buffer (not shown). If a movement determination is to be performed, go to Step S1203; if not, return to Step S1201. Note that the movement determination unit 233 may always perform a movement determination, or may perform a movement determination after accumulating a predetermined number or more of sensor values in the buffer, or after a predetermined time has elapsed since the acquisition of the sensor values.

[0135] (Step S1203) The movement determination unit 233 determines whether the terminal device 2 is moving or stopped using one or more sensor values in the buffer (not shown). If it is stopped, go to Step S1204; if it is moving, go to Step S1205.

[0136] (Step S1204) The movement determination unit 233 sets the movement determination result to "stopped". Go to Step S1206.

[0137] (Step S1205) The movement determination unit 233 sets the movement determination result to "moving".

[0138] (Step S1206) The movement determination unit 233 clears a buffer (not shown) and returns to the upper-level process.

[0139] Next, an example of the position estimation process in step S1105 will be described using the flowchart of FIG. 13.

[0140] (Step S1301) The position acquisition means 2343 acquires three or more radio wave intensity information (pairs of device identifiers and radio wave intensities) of the terminal device 2.

[0141] (Step S1302) The position acquisition means 2343 vectorizes the three or more radio wave intensity information to obtain a radio wave intensity vector. The radio wave intensity vector is, for example, (radio wave intensity of device identifier 1, radio wave intensity of device identifier 2, radio wave intensity of device identifier 3,... radio wave intensity of device identifier n).

[0142] (Step S1303) The position acquisition means 2343 substitutes 1 into the counter i.

[0143] (Step S1304) The position acquisition means 2343 determines whether the i-th location information exists in the location information storage unit 211. If the i-th location information exists, it proceeds to step S1305; if not, it proceeds to step S1309.

[0144] (Step S1305) The position acquisition means 2343 acquires the i-th radio wave intensity vector included in the i-th location information from the location information storage unit 211.

[0145] (Step S1306) The position acquisition means 2343 acquires the similarity between the radio wave intensity vector acquired in step S1302 and the i-th radio wave intensity vector acquired in step S1305. Next, the position acquisition means 2343 determines whether the similarity satisfies the similarity condition (for example, the similarity is equal to or greater than a threshold value). If the similarity satisfies the similarity condition, it proceeds to step S1307; if not, it proceeds to step S1308.

[0146] (Step S1307) The position acquisition means 2343 acquires the position information and the similarity of the i-th point information and stores them in a buffer (not shown).

[0147] (Step S1308) The position acquisition means 2343 increments the counter i by 1. It returns to step S1304.

[0148] (Step S1309) The position acquisition means 2343 acquires the terminal position that specifies the position of the terminal device 2 using the set of position information and similarity stored in a buffer (not shown) that is 3 or more. It returns to the upper-level process.

[0149] Next, a second operation example of the terminal device 2 will be described using the flowchart of FIG. 14.

[0150] (Step S1401) The intensity acquisition means 2341 performs a time-series intensity acquisition process. An example of the time-series intensity acquisition process was described using the flowchart of FIG. 4.

[0151] (Step S1402) The point determination means 2342 performs a fixed information acquisition process. An example of the fixed information acquisition process was described using the flowchart of FIG. 5.

[0152] (Step S1403) The position acquisition means 2343 performs a position estimation process for acquiring the terminal position. An example of the position estimation process was described using the flowchart of FIG. 13.

[0153] (Step S1404) The position output unit 241 outputs the terminal position acquired in step S1403. Return to step S1401.

[0154] In addition, in the flowchart of FIG. 14, the process ends due to a power-off or a process end interrupt.

[0155] Next, a second example of the type determination process in the fixed information acquisition process of step S1402 in the flowchart of FIG. 14 will be described with reference to the flowchart of FIG. 15. Note that the first example of the type determination process was described with reference to the flowchart of FIG. 6.

[0156] (Step S1501) The type determination unit 232 acquires the device identifier of the communication device B for which the type is to be determined.

[0157] (Step S1502) The type determination unit 232 determines whether the device identifier acquired in step S1501 exists in any of the location information in the location information storage unit 211. If it exists in any of the location information, go to step S1503; if it does not exist, go to step S1504.

[0158] (Step S1503) The type determination unit 232 sets the type to "fixed terminal". Return to the upper-level process.

[0159] (Step S1504) The type determination unit 232 sets the type to "mobile terminal". Return to the upper-level process.

[0160] Hereinafter, a specific operation example of the terminal device 2 in the present embodiment will be described.

[0161] Assume that User B holds his / her terminal device 2 and enters an indoor location identified by a location identifier (P). Then, the receiving unit 22 of the terminal device 2 transmits a location information request having the location identifier (P) to an external device (not shown) and receives a location information management table shown in FIG. 8 from the device. Then, assume that the processing unit 23 temporarily stores the location information management table in the location information storage unit 211.

[0162] Then, the terminal device 2 operates as follows according to the processing from step S1103 to S1106 in FIG. 11 or the processing of the flowchart in FIG. 14.

[0163] That is, the intensity acquisition means 2341 performs the time-series intensity acquisition process described with reference to the flowchart in FIG. 4, acquires the radio wave intensities of three or more communication devices B at the location X where the terminal device 2 is present, and constructs a time-series radio wave intensity management table having the structure shown in FIG. 7.

[0164] Next, the intensity acquisition means 2341 performs the time-series intensity acquisition process, acquires the time-series radio wave intensities of each communication device B that can receive radio waves at the location X, and constructs a time-series radio wave intensity management table having the structure shown in FIG. 7.

[0165] Next, the type determination unit 142 refers to the time-series radio wave intensity management table and determines whether each communication device B is a "fixed terminal" or a "mobile terminal" by the type determination process described with reference to the flowchart in FIG. 4.

[0166] Next, the location determination means 2342 acquires the radio wave intensities of "Device 1", "Device 3", "Device 4", "Device 6",... determined to be fixed terminals. Then, the location determination means 2342 acquires a radio wave intensity vector "(radio wave intensity of Device 1, radio wave intensity of Device 3, radio wave intensity of Device 4, radio wave intensity of Device 6,...) = (P1, P3, P4, P6,...)". Here, the radio wave intensity of the communication device B acquired by the location determination means 2342 may be a representative value of two or more radio wave intensities or a single radio wave intensity such as the latest radio wave intensity of the communication device B.

[0167] Next, the position acquisition means 2343 performs the position estimation process described using the flowchart of FIG. 13, and calculates the similarity between the radio wave intensity vector at point X and the radio wave intensity vectors of each record in FIG. 8 (vectors constituted by radio wave intensity information). Next, the position acquisition means 2343 determines radio wave intensity vectors that satisfy the similarity condition "similarity >= threshold value" (for example, the radio wave intensity vector of "ID=1" in FIG. 8 (S 11 , S 12 , S 13 , ···), the radio wave intensity vector of "ID=2" (S 21 , S 22 , S 23 , ···), ···). Next, the position acquisition means 2343 acquires a set of position information and similarity that are paired with the radio wave intensity vector that satisfies the similarity condition (for example, "(x1, y1), DS1", "(x2, y2), DS2", ···). Next, the position acquisition means 2343 acquires the position (x1×DS1 / sum of similarities + x2×DS2 / sum of similarities + ···, y1×DS1 / sum of similarities + y2×DS2 / sum of similarities + ···) of point X indoors. Note that the sum of similarities is "DS1 + DS2 + ···".

[0168] Next, the position output unit 241 outputs the map of the indoor or outdoor area stored in the storage unit 21, and arranges a symbol at the position indicated by the position information (terminal position) acquired by the position acquisition means 2343 on the map.

[0169] As described above, according to the present embodiment, the position of the terminal device 2 indoors or outdoors can be easily acquired.

[0170] Note that the processing in this embodiment may be implemented by software. And this software may be distributed by software download or the like. Also, this software may be recorded on a recording medium such as a CD-ROM and distributed. Note that this also applies to other embodiments in this specification. The software that realizes the terminal device 2 in this embodiment is the following program. That is, this program causes a computer to function as a receiving unit that receives radio waves including device identifiers for identifying the communication devices from three or more communication devices, an intensity acquisition unit that acquires the time-series radio wave intensity for each of the three or more communication devices, a type determination unit that determines whether each of the three or more communication devices is a fixed terminal where the communication device is fixed or a mobile terminal that is moving, using the time-series radio wave intensity acquired by the intensity acquisition unit, a position acquisition unit that acquires the terminal position, which is the position information of the terminal device, using the radio wave intensity of the three or more communication devices determined by the type determination unit to be fixed terminals, and a position output unit that outputs the terminal position acquired by the position acquisition unit.

[0171] (Embodiment 3) In this embodiment, an action acquisition device that acquires the user's action information and time zone using the user's position information corresponding to the time and outputs the action information associated with the time zone will be described. Note that it is preferable that the action acquisition device further uses the user's activity data and vital data to acquire the user's action information and time zone. Also, the position information used when acquiring the action information may be the indoor position information or the like acquired by the terminal device 2 described in Embodiment 2.

[0172] Also, in this embodiment, an action acquisition device that acquires action information using past record information will be described. Note that the past record information may be information based on the input of one or two or more users.

[0173] Also, in this embodiment, a behavior acquisition device that acquires and outputs a user's emotional information will be described. Also, in this embodiment, it is preferable to acquire emotional information using past record information.

[0174] In this embodiment, the behavior acquisition device is a terminal. However, as described in Embodiment 4, the behavior acquisition device may also be a server. That is, the process of acquiring the behavior information or emotional information described later may be performed by the user's terminal or the server.

[0175] Also, in this embodiment, when behavior information cannot be acquired, a behavior acquisition device that acquires and outputs location information using a map will be described.

[0176] Furthermore, in this embodiment, a behavior acquisition device that displays the estimated behavior information and the confirmed behavior information in a visually distinguishable manner will be described.

[0177] FIG. 16 is a conceptual diagram of the information system D in this embodiment. The information system D includes one or two or more behavior acquisition devices 3, a server device 4, and three or more communication devices B.

[0178] The behavior acquisition device 3 is a terminal. The behavior acquisition device 3 is a device that acquires and outputs behavior information. The behavior acquisition device 3 is, for example, a smartphone, a tablet terminal, a smartwatch, a so-called personal computer, etc., and its type is not limited.

[0179] The server device 4 is, for example, a set of behavior source information and behavior information of two or more users, and is a device that stores a set for each time zone. The server device 4 stores, for example, learning information described later and provides the learning information to the behavior acquisition device 3. The server device 4 is, for example, a cloud server, an ASP server, but its type is not limited.

[0180] FIG. 17 is a block diagram of the information system D in this embodiment. FIG. 18 is a block diagram of the behavior acquisition device 3.

[0181] The action acquisition device 3 includes a storage unit 31, a reception unit 32, a processing unit 33, and an output unit 34. The storage unit 31 includes a learning management unit 311, a map management unit 312, and an action management unit 313. Note that the action management unit 313 may exist in an external device (not shown). The processing unit 33 includes an intensity acquisition unit 231, a type determination unit 232, a time acquisition unit 331, a position acquisition unit 332, an activity acquisition unit 333, a vital sign acquisition unit 334, an action estimation unit 335, an emotion estimation unit 336, a location acquisition unit 337, a storage unit 338, and a configuration unit 339. The output unit 34 includes an action output unit 341 and an emotion output unit 342.

[0182] The server device 4 includes a server storage unit 41, a server reception unit 42, a server processing unit 43, and a server transmission unit 44.

[0183] The action acquisition device 3 receives, for example, an output instruction, a confirmation instruction, and input of information. The output instruction is an instruction to output output information described later. The output instruction usually has period information. The period information is information that specifies the period for outputting action information and the like. The confirmation instruction is an instruction to confirm the estimated action information or emotion information. The input of information is the input of information for changing the action information or the emotion information when the estimated action information or emotion information is incorrect. The input of information is the updated action information or the updated emotion information.

[0184] Various types of information are stored in the storage unit 31 that constitutes the action acquisition device 3. The various types of information are, for example, learning information described later, a map described later, action information described later, location information, a calendar template, action information associated with two or more action conditions, and emotion information associated with two or more emotion conditions.

[0185] The calendar template is information indicating the calendar template to be output. The calendar template is, for example, an ICS file, a file described in HTML, or a file described in XML, and its data structure is not limited.

[0186] An action condition is a condition for acquiring action information. The action condition is a condition using two or more pieces of action source information. The action condition is associated with the action information. The action condition is, for example, "location information = office AND 8:00 <= time <= 19:00", and the action information associated with such an action condition is "work". The action condition is, for example, "location information = kitchen AND activity data = standing AND 7:00 <= time <= 8:00", and the action information associated with such an action condition is "cooking". The action condition is, for example, "location information = park AND activity data = standing AND 120 <= heart rate", and the action information associated with such an action condition is "running".

[0187] An emotion condition is a condition for acquiring emotion information. The emotion condition is a condition using two or more pieces of emotion source information. The emotion condition is associated with the emotion information. The emotion condition is, for example, "location information = office AND 8:00 <= time <= 19:00", and the emotion information associated with such an action condition is "positive". The emotion condition is, for example, "location information = kitchen AND activity data = standing AND 7:00 <= time <= 8:00", and the emotion information associated with such an action condition is "positive". The action condition is, for example, "location information = park AND activity data = standing AND 120 <= heart rate", and the emotion information associated with such an action condition is "negative".

[0188] Learning information is stored in the learning management unit 311. The learning information is information based on two or more pieces of teacher data. The learning information of the learning management unit 311 is, for example, action learning information and emotion learning information. Each of the two or more pieces of learning information in the learning management unit 311 may be associated with different user attribute value conditions. The user attribute value condition is a condition regarding one or two or more user attribute values.

[0189] A user attribute value is an attribute value of a user. The user attribute value is, for example, occupation, family composition, unmarried or married, gender, age, age group, morning type or night type, residential area, etc., without limitation.

[0190] The behavioral learning information is information based on two or more pieces of behavioral teacher data. The behavioral learning information is, for example, a behavioral learning model or a behavior correspondence table. The emotional learning information is information based on two or more pieces of emotional teacher data. The emotional learning information is, for example, an emotional learning model or an emotion correspondence table.

[0191] The behavioral teacher data has, for example, one or two or more pieces of action source information and action information. The emotional teacher data has, for example, one or two or more pieces of action source information, action information, and emotion information.

[0192] The emotional teacher data has, for example, one or two or more pieces of action source information or action information and emotion information. The emotional teacher data has, for example, one or two or more pieces of action source information, action information, and emotion information. In the emotional teacher data, one or more pieces of action source information, action information, or one or more pieces of action source information and action information are explanatory variables, and the emotion information is the target variable.

[0193] The action information is information that identifies the user's actions. The action information is, for example, "work", "watching TV", "walking", "running", "going to the gym", "taking a bath", "sleeping".

[0194] The emotion information is information regarding the user's emotions. The emotion information is, for example, positive (e.g., "1") or negative (e.g., "0"). The emotion information is, for example, the degree of positiveness or the degree of negativeness. The emotion information is, for example, happy (e.g., "1"), angry (e.g., "2"), sad (e.g., "3"), happy (e.g., "4").

[0195] The action source information is the information that serves as the basis for acquiring action information. The action source information includes location information. It is preferable that the action source information includes activity data or one or more types of vital data. The action source information may include emotion information. The action source information may include one or more pieces of past action information. Among the past action information, usually, the immediately preceding action information is included. The action source information may include one or more pieces of the user's future schedule information. The schedule information is, for example, information stored in a calendar server (not shown) (e.g., the server of "Google Calendar (registered trademark)"). The action source information may include the elapsed time since arriving at the same location information. The action source information may include one or more user attribute values.

[0196] The location information is the information that identifies the location of the action acquisition device 3. The location information is, for example, (latitude, longitude), (latitude, longitude, altitude), the three-dimensional relative position (x, y, z) indoors, or the two-dimensional relative position (x, y) indoors, or location information. The location information is the information that expresses the meaning of a location. The location information is, for example, indoor location information or outdoor location information. The indoor location information is the information that identifies an indoor location. The indoor location information is, for example, "living room", "kitchen", "study", "office". The outdoor location information is the information that identifies an outdoor location. The outdoor location information is, for example, "ABC Station", "library", "izakaya", "Location A".

[0197] The body data is the information related to the user's body. The body data is, for example, activity data, vital data.

[0198] The activity data is the information that identifies the user's activity. The activity data is, for example, "standing", "grounded (e.g., sitting)".

[0199] Vital data is information that can be obtained from a user's living body. Vital data may also be referred to as biometric information. Vital data includes, for example, the heart rate, heart rate variability, blood pressure (systolic and / or diastolic), respiratory rate per unit time (e.g., 1 minute or 30 seconds), and body temperature. Learning information includes, for example, a learning model or a correspondence table. A learning model is information constructed by a learning process of machine learning using two or more pieces of teacher data and is used for the prediction process of machine learning. A learning model may also be referred to as a learning device, classifier, classification model, etc. The algorithm of machine learning is not limited, such as deep learning, random forest, decision tree, SVM, etc. Also, for machine learning, various machine learning functions such as the TensorFlow (registered trademark) library, the random forest module of the R language, TinySVM, etc., and various existing libraries can be used. Also, when the learning information is a learning model, one or two or more pieces of action source information of the teacher data are explanatory variables, and the action information is the target variable.

[0200] The learning model here is, for example, a behavior learning model or an emotion learning model. A behavior learning model is a learning model for obtaining behavior information and is information obtained by a learning process of machine learning using behavior teacher data. Behavior teacher data has one or two or more pieces of action source information and action information.

[0201] An emotion learning model is a learning model for obtaining emotion information and is information obtained by a learning process of machine learning using emotion teacher data. Emotion teacher data has one or two or more pieces of emotion source information and emotion information.

[0202] The correspondence table is an action correspondence table or an emotion correspondence table. The action correspondence table is a table for acquiring action information. The action correspondence table has two or more pieces of action correspondence information. The action correspondence information is information indicating the correspondence between one or two or more pieces of action source information and action information. Note that one or two or more pieces of action source information have, for example, the structure of a vector. Such a vector is called an action source vector. The action source vector is a vector having one or two or more pieces of each action source information as elements. The emotion correspondence table has two or more pieces of emotion correspondence information. The emotion correspondence information is information indicating the correspondence between one or two or more pieces of emotion source information and emotion information. One or two or more pieces of emotion source information have, for example, the structure of a vector. Such a vector is called an emotion source vector. The emotion source vector is a vector having one or two or more pieces of each emotion source information as elements.

[0203] The map management unit 312 stores a map. The map has location information corresponding to one or two or more pieces of each location information. The map is, for example, in the KIWI format, but its structure is not limited.

[0204] The action management unit 313 stores action information associated with two or more time zones. The action information here is, for example, the information acquired by the action estimation unit 335. The action information is the information acquired by the action estimation unit 335 and modified by the user.

[0205] It is preferable that it is possible to determine whether the action information here is confirmed action information. The action information is, for example, associated with a confirmation flag. The confirmation flag is a flag indicating that the action information is confirmed. The ability to determine whether the action information is confirmed means, for example, that the storage areas for confirmed action information and unconfirmed action information are different. In addition, any method for making it possible to determine whether the action information is confirmed is acceptable.

[0206] The receiving unit 32 receives radio waves including a device identifier for identifying the communication device B from each of one or more communication devices B. The receiving unit 32 usually receives radio waves from three or more communication devices B. The receiving unit 32 has the same function as the receiving unit 22.

[0207] The processing unit 33 performs various processes. The various processes are, for example, the processes performed by the intensity acquisition unit 231, the type determination unit 232, the time acquisition unit 331, and the like.

[0208] The time acquisition unit 331 acquires time. The time acquisition unit 331 acquires time from, for example, a clock (not shown). The time acquisition unit 331 receives time from, for example, the server device 4 or a device (not shown). The time may be in hours, minutes, and seconds, or may be in hours and minutes. The time may include one or more pieces of information of "year", "month", and "day". The time acquisition unit 331 may acquire the day of the week. The day of the week may be considered as information included in the acquired time.

[0209] The position acquisition unit 332 acquires position information. The position information is associated with time. The position acquisition unit 332 usually acquires position information in association with the time acquired by the time acquisition unit 331. The position acquisition unit 332 may perform the same process as the position acquisition unit 234. In particular, when the behavior acquisition device 3 is indoors and a GPS signal cannot be received, it is preferable that the position acquisition unit 332 perform the same process as the position acquisition unit 234. It is preferable that the position acquisition unit 332 has a GPS receiver. The position acquisition unit 332 acquires position information by, for example, a GPS receiver. Such position information is absolute position information. The position information acquired by the position acquisition unit 332 may be either outdoor or indoor position information.

[0210] It is preferable that the position acquisition unit 332 acquires indoor position information using the radio wave intensity of the communication device B determined by the type determination unit 232 to be a fixed terminal. The radio wave intensity used here is preferably the radio wave intensity of three or more communication devices B, but may also be the radio wave intensity of one or more communication devices B.

[0211] The activity acquisition unit 333 acquires the user's activity data associated with the time. The activity acquisition unit 333 usually acquires the activity data in association with the time acquired by the time acquisition unit 331. The process of acquiring the activity data is a known technique.

[0212] The vital acquisition unit 334 acquires one or more types of vital data of the user associated with the time. The vital acquisition unit 334 usually acquires one or more types of vital data associated with the time acquired by the time acquisition unit 331. The process of acquiring the vital data is a known technique.

[0213] The behavior estimation unit 335 acquires behavior information for specifying the user's behavior in the time zone specified by the time included in two or more pieces of behavior source information including the position information associated with the time, using the two or more pieces of behavior source information. It is preferable that the behavior source information also includes the activity data. Also, it is preferable that the behavior source information also includes one or more types of vital data.

[0214] The behavior estimation unit 335, for example, detects a behavior condition in which two or more pieces of behavior source information including the position information associated with the time match, and acquires the behavior information paired with the behavior condition from the storage unit 31.

[0215] The behavior estimation unit 335, for example, when sitting at the position of the desk at home indoors at 13:15, acquires the behavior information "working". The behavior estimation unit 335, for example, when sitting in the living room at home indoors at 20:17, acquires the behavior information "watching TV". The behavior estimation unit 335, for example, when acquiring the position information "izakaya" at 20:17, acquires the behavior information "drinking party".

[0216] The behavior estimation unit 335 may also acquire the behavior information in the time zone using the behavior learning information of the learning management unit 311 and two or more pieces of behavior source information including the position information associated with the time. Hereinafter, the processing of the behavior estimation unit 335 when the learning information is a learning model and when it is a correspondence table will be described.

[0217] The action estimation unit 335 may acquire one or more user attribute values, acquire, from the learning management unit 311, the behavior learning information that pairs with the user attribute value condition that the one or more user attribute values match, and use the behavior learning information to acquire behavior information. (1) When the behavior learning information is a behavior learning model

[0218] The action estimation unit 335 acquires the learning model of the learning management unit 311. Also, the action estimation unit 335 acquires the time and one or two or more pieces of action source information associated with the time. Next, the action estimation unit 335 provides the time, the action source information, and the learning model to a module that performs prediction processing of machine learning, executes the module, and acquires action information.

[0219] Note that when the score output by the module is less than or equal to or less than the threshold value, the action estimation unit 335 may not acquire the action information. (2) When the behavior learning information is a behavior correspondence table

[0220] The action estimation unit 335 acquires the time and the action source information associated with the time. Next, the action estimation unit 335 acquires an action source vector having the time and the action source information as elements. Next, the action estimation unit 335 calculates the similarity between the action source vector and the action source vectors of each of the two or more pieces of action correspondence information included in the action correspondence table. Next, the action estimation unit 335 acquires, from the action correspondence table, the action information that pairs with the action source vector having the maximum similarity. Note that even if the similarity is the maximum, when the similarity is less than or equal to or less than the threshold value, the action estimation unit 335 may not acquire the action information.

[0221] The emotion estimation unit 336 acquires emotion information regarding the user's emotion in a time zone using the action information or the action source information.

[0222] The emotion estimation unit 336 detects, for example, an emotion condition in which two or more pieces of emotion source information including position information associated with the time match, and acquires, from the storage unit 31, the emotion information that pairs with the emotion condition.

[0223] For example, when sitting at the position of a desk at home indoors at 13:15, the emotion estimation unit 336 acquires the emotion information "positive". For example, when sitting in the living room of a home indoors at 20:17, the emotion estimation unit 336 acquires the emotion information "positive". For example, when the location information "izakaya" is acquired at 20:17, the emotion estimation unit 336 acquires the emotion information "positive".

[0224] The emotion estimation unit 336 uses the emotion learning information of the learning management unit 311 and the action information acquired by the action estimation unit 335 or one or more action source information from which the action information is obtained to acquire emotion information in a time zone. Here, since the action information or one or more pieces of action source information are used for acquiring emotion information, they are referred to as emotion source information.

[0225] The emotion estimation unit 336 may acquire one or more user attribute values, acquire from the learning management unit 311 the emotion learning information that pairs with the user attribute value conditions that the one or more user attribute values match, and use the emotion learning information to acquire emotion information.

[0226] The emotion estimation unit 336 will hereinafter explain the processing of the action estimation unit 335 when the emotion learning information is an emotion learning model and when it is an emotion correspondence table. (1) When the emotion learning information is an emotion learning model

[0227] The emotion estimation unit 336 acquires the emotion learning model of the learning management unit 311. Also, the emotion estimation unit 336 acquires one or more pieces of action source information or action information associated with the time. Next, the emotion estimation unit 336 provides the acquired one or more pieces of action source information or action information and the emotion learning model to a module that performs prediction processing of machine learning, executes the module, and acquires emotion information.

[0228] Note that when the score output by the module is equal to or less than the threshold value or less than the threshold value, the emotion estimation unit 336 does not have to acquire emotion information. (2) When the emotion learning information is an emotion correspondence table

[0229] The emotion estimation unit 336 acquires one or more pieces of actor information or action information associated with the time. Next, the emotion estimation unit 336 acquires an emotion source vector having the one or more pieces of actor information or action information as elements. Next, the emotion estimation unit 336 calculates the similarity between the emotion source vector and the emotion source vectors of each of the two or more pieces of corresponding information in the emotion correspondence table. Next, the emotion estimation unit 336 acquires, from the emotion correspondence table, the emotion information paired with the emotion source vector having the maximum similarity. Note that the emotion estimation unit 336 does not have to acquire the emotion information even if the similarity is the maximum and the similarity is equal to or less than the threshold value or less than the threshold value.

[0230] The location acquisition unit 337 refers to the map of the map management unit 312 and acquires location information corresponding to the location information acquired by the location acquisition unit 332. The location information in such a case is usually absolute location information (for example, (latitude, longitude)).

[0231] It is preferable that the location acquisition unit 337 acquires the location information only for the time period when the action estimation unit 335 does not acquire the action information.

[0232] The storage unit 338 associates the action information acquired by the action estimation unit 335 with the time period and stores it in the action management unit 313.

[0233] The storage unit 338 may associate the emotion information acquired by the emotion estimation unit 336 with the time period and store it in the action management unit 313.

[0234] The composition unit 339 composes the information to be output using the action information of the action management unit 313. The composition unit 339 composes the information to be output using, for example, the emotion information of the action management unit 313.

[0235] The component 339 constitutes output information having action information paired with each of two or more time zones on a calendar in a region specified by the time zones. In the output information, it is preferable that two or more pieces of action information are arranged so that the determined action information and the undetermined action information can be visually distinguished. The component 339 preferably constitutes output information that visually shows the emotion information corresponding to two or more time zones. The component 339 preferably constitutes output information in which, for example, a time zone with "positive" emotion information and a time zone with "negative" emotion information are visibly distinguishable. The component 339 preferably constitutes output information such that, for example, the background colors of a time zone with "positive" emotion information and a time zone with "negative" emotion information are different.

[0236] The output unit 34 outputs various types of information. The various types of information are, for example, action information, emotion information, and location information.

[0237] Here, output generally refers to display on a display, but may also be a concept including projection using a projector, printing by a printer, transmission to an external device, storage in a recording medium, delivery of a processing result to another processing device or another program, etc.

[0238] The action output unit 341 outputs the action information for each of one or more time zones.

[0239] The action output unit 341 preferably outputs the location acquired by the location acquisition unit 337 when the action estimation unit 335 cannot acquire the action information.

[0240] The action output unit 341 preferably outputs two or more pieces of action information so that the determined action information and the undetermined action information can be visually distinguished.

[0241] The emotion output unit 342 outputs emotion information. The emotion output unit 342 outputs, for example, the emotion information acquired by the emotion estimation unit 336. The emotion output unit 342 preferably outputs the emotion information for each of one or more time zones.

[0242] In the server storage unit 41 that constitutes the server device 4, various types of information are stored. The various types of information are, for example, the learning information described above, the action source information and time associated with two or more user identifiers, two or more action teacher data, and two or more emotion teacher data.

[0243] The server reception unit 42 receives various instructions and information. The various instructions and information are, for example, an instruction to transmit information. The information here is, for example, learning information and action source information.

[0244] The server processing unit 43 performs various processes. The various processes are, for example, a learning process. The learning process is, for example, an action learning process and an emotion learning process.

[0245] The action learning process is a process of obtaining an action learning model using two or more action teacher data. For example, the server processing unit 43 provides two or more action teacher data to a learning process module of machine learning, executes the module, obtains an action learning model, and accumulates it in the server storage unit 41. For example, for each candidate of two or more pieces of action information, the server processing unit 43 provides two or more positive examples, which are teacher data including the action information, and two or more negative examples, which are teacher data not including the action information, to a learning process module of machine learning, executes the module, obtains an action learning model for each candidate of the action information, and accumulates it in the server storage unit 41 in association with the action information. For example, the server processing unit 43 obtains an action correspondence table, which is a table having two or more pieces of each action teacher data as records, and accumulates it in the server storage unit 41.

[0246] Sentiment learning processing is a process of obtaining a sentiment learning model using two or more sentiment teacher data. The server processing unit 43, for example, provides two or more sentiment teacher data to a learning processing module of machine learning, executes the module, obtains a sentiment learning model, and stores it in the server storage unit 41. The server processing unit 43, for example, for each candidate of two or more pieces of each sentiment information, provides two or more positive examples that are teacher data including the sentiment information and two or more negative examples that are teacher data not including the sentiment information to the learning processing module of machine learning, executes the module, obtains a sentiment learning model for each candidate of the sentiment information, and stores it in the server storage unit 41 in association with the sentiment information. The server processing unit 43, for example, obtains a sentiment correspondence table that is a table with two or more pieces of each sentiment teacher data as records, and stores it in the server storage unit 41.

[0247] The server transmission unit 44 transmits various types of information. The various types of information are, for example, an action learning model, a sentiment learning model, an action correspondence table, and a sentiment correspondence table.

[0248] The storage unit 31, the learning management unit 311, the map management unit 312, the action management unit 313, and the server storage unit 41 are preferably non-volatile recording media, but can also be realized with volatile recording media.

[0249] The process of storing information in the storage unit 31 or the like is not limited. For example, information may be stored in the storage unit 31 or the like via a recording medium, information transmitted via a communication line or the like may be stored in the storage unit 31 or the like, or information input via an input device may be stored in the storage unit 31 or the like.

[0250] The reception unit 32, the server reception unit 42, and the server transmission unit 44 are usually realized by wireless or wired communication means.

[0251] The processing unit 33, time acquisition unit 331, position acquisition unit 332, activity acquisition unit 333, vital acquisition unit 334, action estimation unit 335, emotion estimation unit 336, location acquisition unit 337, storage unit 338, configuration unit 339, and server processing unit 43 can generally be realized from a processor, memory, etc. The processing procedures of the processing unit 33, etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may also be realized by hardware (a dedicated circuit). Note that the processor may be a CPU, MPU, GPU, etc., and its type does not matter.

[0252] The output unit 34, action output unit 341, and emotion output unit 342 may or may not be considered to include output devices such as a display and a speaker. The output unit 34 can be realized by the driver software of the output device or the driver software of the output device and the output device, etc.

[0253] Next, an operation example of the action acquisition device 3 constituting the information system D will be described using the flowchart of FIG. 19.

[0254] (Step S1901) The processing unit 33 determines whether to acquire information. If acquiring information, it proceeds to step S1902, and if not acquiring information, it proceeds to step S1916. Note that the processing unit 33 may always determine to acquire information, or may determine to acquire information when a flag indicating acquisition of information is stored in the storage unit 31, etc. The conditions for such determination do not matter.

[0255] (Step S1902) The time acquisition unit 331 acquires the time from a clock (not shown). Here, the time acquisition unit 331 may acquire the day of the week.

[0256] (Step S1903) The processing unit 33 acquires one or two or more pieces of action source information. An example of such action source acquisition processing will be described using the flowchart of FIG. 20.

[0257] (Step S1904) The action estimation unit 335 estimates action information for specifying the user's action using the one or more action source information acquired in step S1903. An example of such action estimation processing will be described using the flowcharts of FIGS. 22 to 24.

[0258] (Step S1905) The location acquisition unit 337 determines whether action information could be acquired in step S1904. If action information could be acquired, it proceeds to step S1907, and if action information could not be acquired, it proceeds to step S1906.

[0259] (Step S1906) The location acquisition unit 337 refers to the map of the map management unit 312 and acquires location information corresponding to the position information acquired in step S1903. Note that it may not be possible to acquire location information here.

[0260] (Step S1907) The storage unit 338 determines whether the action information stored in a buffer (not shown), which is the action information accumulated immediately before, matches the action information acquired in step S1904. If they match, it proceeds to step S1908, and if they do not match, it proceeds to step S1912.

[0261] (Step S1908) The storage unit 338 associates the acquired action information, etc. with the time acquired in step S1902 and stores it in a buffer (not shown).

[0262] (Step S1909) The emotion estimation unit 336 performs processing to estimate emotion information. An example of such emotion estimation processing will be described using the flowcharts of FIGS. 25 to 27.

[0263] (Step S1910) The storage unit 338 determines whether emotion information could be acquired in step S1909. If emotion information could be acquired, it proceeds to step S1911, and if emotion information could not be acquired, it returns to step S1901.

[0264] (Step S1911) The storage unit 338 stores the emotion information acquired in step S1909 in a buffer (not shown) in association with the time acquired in step S1902. Return to step S1901.

[0265] (Step S1912) The storage unit 338 stores the time acquired in step S1902 and the acquired action information, etc. in a buffer (not shown) in association with each other.

[0266] (Step S1913) The storage unit 338 acquires the previous action information, etc.

[0267] (Step S1914) The storage unit 338 acquires the time zone specified by two or more times associated with the previous action information, etc.

[0268] (Step S1915) The storage unit 338 associates the time zone acquired in step S1914 with the previous action information, etc. acquired in step S1913 and stores it in the action management unit 313. Here, the storage unit 338 may also associate the time zone and the previous action information, etc. in association with the user identifier. In such a case, the storage destination is preferably the server device 4.

[0269] (Step S1916) The action acquisition device 3 determines whether an output instruction has been received. If an output instruction has been received, go to step S1917; if not, go to step S1919.

[0270] (Step S1917) The configuration unit 339 configures output information using the action information, etc. of the action management unit 313. An example of such output configuration processing will be described using the flowchart of FIG. 28.

[0271] (Step S1918) The output unit 34 outputs the output information configured in step S1917. Return to step S1901.

[0272] (Step S1919) The action acquisition device 3 determines whether it has received an input of information with respect to the output information being output. If it has received an input of information, it proceeds to step S1920; if it has not received an input, it proceeds to step S1923.

[0273] (Step S1920) The processing unit 33 determines whether the information received in step S1919 is a confirmation instruction for the estimated action information or the estimated emotion information. If it is a confirmation instruction, it proceeds to step S1921; if it is not a confirmation instruction, it proceeds to step S1922.

[0274] (Step S1921) The storage unit 338 performs processing to confirm the action information or emotion information corresponding to the confirmation instruction. It returns to step S1901. Note that such processing is, for example, processing of associating a confirmation flag with the action information corresponding to the confirmation instruction or the emotion information corresponding to the confirmation instruction.

[0275] (Step S1922) The storage unit 338 stores the input information. It returns to step S1901. Note that the input information is, for example, correct action information or correct emotion information. Then, the storage unit 338 updates the estimated action information or emotion information corresponding to the input information to the input action information or emotion information. Also, the storage unit 338 performs processing to confirm such action information or emotion information.

[0276] (Step S1923) The action acquisition device 3 determines whether it has received a learning instruction. If it has received a learning instruction, it proceeds to step S1924; if it has not received a learning instruction, it returns to step S1901.

[0277] (Step S1924) A learning unit (not shown) or a learning device (not shown) of the action acquisition device 3 constructs action learning information using two or more action teacher data including action information, etc., and stores it in the learning management unit 311. An example of such action learning processing will be described using the flowcharts of FIGS. 29 and 30.

[0278] (Step S1925) A learning unit (not shown) or a learning device (not shown) of the behavior acquisition device 3 constructs emotion learning information using two or more emotion teacher data including emotion information and stores it in the learning management unit 311. Return to step S1901. An example of such emotion learning processing will be described using the flowcharts of FIGS. 31 and 32.

[0279] Note that in the flowchart of FIG. 19, the processing ends due to a power-off or an interrupt for ending the processing.

[0280] Next, an example of the action source acquisition process in step S1903 will be described using the flowchart of FIG. 20.

[0281] (Step S2001) The processing unit 33 determines whether the receiving unit 32 can acquire a GPS signal. If the GPS signal can be acquired, go to step S2002; if the GPS signal cannot be acquired, go to step S2003.

[0282] (Step S2002) The position acquisition unit 332 acquires absolute position information based on the GPS signal received by the receiving unit 32.

[0283] (Step S2003) The position acquisition unit 332 acquires position information. An example of such position estimation processing will be described using the flowchart of FIG. 21.

[0284] (Step S2004) The activity acquisition unit 333 acquires the user's activity data.

[0285] (Step S2005) The vital acquisition unit 334 acquires one or two or more types of the user's vital data.

[0286] (Step S2006) The action estimation unit 335 acquires one or more pieces of past action information. Note that the one or more pieces of past action information include the action information immediately before in terms of time.

[0287] (Step S2007) The action estimation unit 335 determines whether to use the emotion information for the action estimation process. If using the emotion information, it proceeds to step S2008; if not using the emotion information, it proceeds to step S2009. Note that whether to use the emotion information for the action estimation process is usually determined in advance.

[0288] (Step S2008) The emotion estimation unit 336 acquires the emotion information. An example of such emotion estimation processing will be described using the flowcharts of FIGS. 25 to 27.

[0289] (Step S2009) The action estimation unit 335 acquires the elapsed time since the start of the new action specified by the new action information.

[0290] (Step S2010) The action estimation unit 335 constructs the information to be used in the action estimation process using two or more types of action source information including time and position information. It returns to the upper-level process. Here, the information to be constructed is usually a set of action source information, for example, an action source vector with two or more pieces of action source information as elements. The two or more types of action source information are, for example, two or more types of information among time, day of the week, position information, activity data, vital data, past action information, emotion information, and elapsed time.

[0291] Note that in the flowchart of FIG. 20, even if the GPS signal can be acquired, the position acquisition unit 332 may acquire the position information by the position estimation process described using the flowchart of FIG. 21.

[0292] Also, in the flowchart of FIG. 20, the action estimation unit 335 may acquire one or two or more user attribute values and acquire action source information including the one or more user attribute values. Note that the user attribute value may be information stored in the storage unit 31 or information input by the user or the like. Next, an example of the position estimation process in step S2003 will be described with reference to the flowchart of FIG. 21. In the flowchart of FIG. 21, the description of the same steps as in FIG. 13 will be omitted. Also, the position estimation process in step S2003 may be the same process as the flowchart of FIG. 13.

[0293] (Step S2101) The position acquisition unit 332 acquires the similarity of two radio field intensity vectors, associates the similarity with the i-th point information, and temporarily stores it in a buffer (not shown). Proceed to step S1308.

[0294] (Step S2102) The position acquisition unit 332 acquires the position information included in the point information paired with the maximum similarity. Return to the upper-level process. Note that the acquired position information is the terminal position.

[0295] Next, an example of the first action estimation process in step S1904 will be described with reference to the flowchart of FIG. 22. The flowchart of FIG. 22 is a process of estimating action information by prediction processing of machine learning using one action learning model. That is, the flowchart of FIG. 22 is a process of estimating action information by prediction processing of multi-class classification of machine learning.

[0296] (Step S2201) The action estimation unit 335 acquires two or more types of action source information (for example, action source vectors) acquired in step S1903.

[0297] (Step S2202) The action estimation unit 335 acquires an action learning model from the learning management unit 311.

[0298] (Step S2203) The action estimation unit 335 provides two or more types of action source information acquired in Step S2201 and the action learning model to the prediction processing module of machine learning, and executes the module.

[0299] (Step S2204) The action estimation unit 335 acquires the estimated action information and the score, which are the execution results in Step S2203.

[0300] (Step S2205) The action estimation unit 335 determines whether the score acquired in Step S2204 is equal to or greater than the threshold value. If it is equal to or greater than the threshold value, it proceeds to Step S2206; if it is less than the threshold value, it proceeds to Step S2207.

[0301] (Step S2206) The action estimation unit 335 acquires the action information acquired in Step S2204 as the output action information. Return to the upper-level process.

[0302] (Step S2207) The action estimation unit 335 acquires "empty" action information. Return to the upper-level process.

[0303] Note that in the flowchart of FIG. 22, the processes from Step S2205 to Step S2207 may not be performed.

[0304] Next, an example of the second action estimation process in Step S1904 will be described with reference to the flowchart of FIG. 23. The flowchart of FIG. 23 is a process of estimating action information by prediction processing of machine learning using the action learning model for each candidate of two or more pieces of action information. That is, the flowchart of FIG. 22 is a process of estimating action information by prediction processing of binary classification of machine learning.

[0305] (Step S2301) The action estimation unit 335 acquires two or more types of action source information acquired in Step S1903.

[0306] (Step S2302) The action estimation unit 335 assigns 1 to the counter i.

[0307] (Step S2303) The action estimation unit 335 refers to the learning management unit 311 and determines whether there is a candidate for the i-th action information. If there is a candidate for the i-th action information, it proceeds to step S2304; if not, it proceeds to step S2309.

[0308] (Step S2304) The action estimation unit 335 obtains the i-th action learning model corresponding to the candidate for the i-th action information from the learning management unit 311.

[0309] (Step S2305) The action estimation unit 335 provides the two or more types of action source information obtained in step S2301 and the i-th action learning model obtained in step S2304 to a prediction processing module that performs binary classification of machine learning, and executes the module.

[0310] (Step S2306) The action estimation unit 335 determines whether the execution result in step S2305 is "true". If it is "true", it proceeds to step S2307; if it is "false", it proceeds to step S2308.

[0311] (Step S2307) The action estimation unit 335 temporarily stores in a buffer (not shown) a score that is part of the execution result in step S2305, in association with the candidate for the i-th action information.

[0312] (Step S2308) The action estimation unit 335 increments the counter i by 1. It returns to step S2303.

[0313] (Step S2309) The action estimation unit 335 obtains the maximum score and determines whether the maximum score is greater than or equal to a threshold value. If the maximum score is greater than or equal to the threshold value, it proceeds to step S2310; if it is less than the threshold value, it proceeds to step S2311.

[0314] (Step S2310) The action estimation unit 335 commends the action information corresponding to the maximum score. It returns to the upper-level process.

[0315] (Step S2311) The action estimation unit 335 acquires the action information of "empty". Return to the upper-level process.

[0316] Note that in the flowchart of FIG. 23, the processes from step S2308 to step S2311 may not be performed.

[0317] Next, an example of the third action estimation process in step S1904 will be described using the flowchart of FIG. 24. The flowchart of FIG. 24 is a process of estimating action information using an action correspondence table.

[0318] (Step S2401) The action estimation unit 335 acquires two or more types of action source information acquired in step S1903. The two or more types of action source information here are action source vectors.

[0319] (Step S2402) The action estimation unit 335 substitutes 1 into the counter i.

[0320] (Step S2403) The action estimation unit 335 determines whether the i-th action correspondence information exists in the action correspondence table of the learning management unit 311. If the i-th action correspondence information exists, it proceeds to step S2404, and if it does not exist, it proceeds to step S2407.

[0321] (Step S2404) The action estimation unit 335 acquires the i-th action source vector included in the i-th action correspondence information.

[0322] (Step S2405) The action estimation unit 335 acquires the similarity between the action source vector acquired in step S2403 and the action source vector acquired in step S2404, and associates it with the i-th action correspondence information.

[0323] (Step S2406) The action estimation unit 335 increments the counter i by 1. Return to step S2403.

[0324] (Step S2407) The action estimation unit 335 acquires the maximum similarity.

[0325] (Step S2408) The action estimation unit 335 determines whether the maximum similarity acquired in Step S2407 is greater than or equal to a threshold value. If it is greater than or equal to the threshold value, it proceeds to Step S2409; if it is less than the threshold value, it proceeds to Step S2410.

[0326] (Step S2409) The action estimation unit 335 acquires the action information associated with the i-th action correspondence information paired with the maximum similarity. It returns to the upper-level process.

[0327] (Step S2410) The action estimation unit 335 acquires the action information of "empty". It returns to the upper-level process.

[0328] Note that in the flowchart of FIG. 24, the processes from Step S2408 to Step S2411 do not have to be performed.

[0329] Next, an example of the first emotion estimation process in Step S1909 will be described using the flowchart of FIG. 25. The flowchart of FIG. 25 is a process of estimating emotion information by machine learning prediction processing using one emotion learning model. That is, the flowchart of FIG. 25 is a process of estimating emotion information by the prediction processing of multi-class classification of machine learning.

[0330] (Step S2501) The emotion estimation unit 336 acquires two or more types of action source information acquired in Step S1903. Here, each of the two or more types of action source information is emotion source information. Also, the two or more types of emotion source information are, for example, emotion source vectors.

[0331] (Step S2502) The emotion estimation unit 336 acquires an emotion learning model from the learning management unit 311.

[0332] (Step S2503) The emotion estimation unit 336 provides two or more types of emotion source information acquired in step S2501 and the emotion learning model to the prediction processing module of machine learning and executes the module.

[0333] (Step S2504) The emotion estimation unit 336 acquires the estimated emotion information and score that are the execution results in step S2503.

[0334] (Step S2505) The emotion estimation unit 336 determines whether the score acquired in step S2504 is equal to or greater than the threshold value. If it is equal to or greater than the threshold value, it proceeds to step S2506; if it is less than the threshold value, it proceeds to step S2507.

[0335] (Step S2506) The emotion estimation unit 336 acquires the emotion information acquired in step S2504 as the output emotion information. Return to the upper-level process.

[0336] (Step S2507) The emotion estimation unit 336 acquires "empty" emotion information. Return to the upper-level process.

[0337] Note that in the flowchart of FIG. 25, the processes from step S2505 to step S2507 do not have to be performed.

[0338] Next, an example of the second emotion estimation process in step S1909 will be described with reference to the flowchart of FIG. 26. The flowchart of FIG. 26 is a process of estimating emotion information by prediction processing of machine learning using an emotion learning model for each candidate of two or more pieces of emotion information. That is, the flowchart of FIG. 26 is a process of estimating emotion information by prediction processing of binary classification of machine learning.

[0339] (Step S2601) The emotion estimation unit 336 acquires two or more types of emotion source information acquired in step S1903.

[0340] (Step S2602) The emotion estimation unit 336 substitutes 1 for the counter i.

[0341] (Step S2603) The emotion estimation unit 336 refers to the learning management unit 311 to determine whether there is a candidate for the i-th emotion information. If there is a candidate for the i-th emotion information, it proceeds to step S2604; if not, it proceeds to step S2609.

[0342] (Step S2604) The emotion estimation unit 336 obtains the i-th emotion learning model corresponding to the candidate for the i-th emotion information from the learning management unit 311.

[0343] (Step S2605) The emotion estimation unit 336 provides the two or more types of emotion source information obtained in step S2601 and the i-th emotion learning model obtained in step S2604 to a prediction processing module that performs binary classification of machine learning, and executes the module.

[0344] (Step S2606) The emotion estimation unit 336 determines whether the execution result in step S2605 is "true". If it is "true", it proceeds to step S2607; if it is "false", it proceeds to step S2608.

[0345] (Step S2607) The emotion estimation unit 336 temporarily stores in a buffer (not shown) a score that is part of the execution result in step S2605, in association with the candidate for the i-th emotion information.

[0346] (Step S2608) The emotion estimation unit 336 increments the counter i by 1. It returns to step S2603.

[0347] (Step S2609) The emotion estimation unit 336 obtains the maximum score and determines whether the maximum score is greater than or equal to a threshold value. If the maximum score is greater than or equal to the threshold value, it proceeds to step S2610; if it is less than the threshold value, it proceeds to step S2611.

[0348] (Step S2610) The emotion estimation unit 336 determines the emotion information corresponding to the maximum score. It returns to the upper-level process.

[0349] (Step S2611) The emotion estimation unit 336 acquires emotion information of "empty". Return to the upper-level process.

[0350] Note that in the flowchart of FIG. 26, the processes from step S2608 to step S2611 may not be performed.

[0351] Next, an example of the third emotion estimation process in step S1909 will be described using the flowchart of FIG. 27. The flowchart of FIG. 27 is a process of estimating emotion information using an emotion correspondence table.

[0352] (Step S2701) The emotion estimation unit 336 acquires two or more types of emotion source information acquired in step S1903. The two or more types of emotion source information here are emotion source vectors.

[0353] (Step S2702) The emotion estimation unit 336 substitutes 1 for the counter i.

[0354] (Step S2703) The emotion estimation unit 336 determines whether the i-th emotion correspondence information exists in the emotion correspondence table of the learning management unit 311. If the i-th emotion correspondence information exists, it proceeds to step S2704, and if it does not exist, it proceeds to step S2707.

[0355] (Step S2704) The emotion estimation unit 336 acquires the i-th emotion source vector included in the i-th emotion correspondence information.

[0356] (Step S2705) The emotion estimation unit 336 acquires the similarity between the emotion source vector acquired in step S2703 and the emotion source vector acquired in step S2704, and associates it with the i-th emotion correspondence information.

[0357] (Step S2706) The emotion estimation unit 336 increments the counter i by 1. Return to step S2703.

[0358] (Step S2707) The emotion estimation unit 336 acquires the maximum similarity.

[0359] (Step S2708) The emotion estimation unit 336 determines whether the maximum similarity acquired in Step S2707 is greater than or equal to the threshold value. If it is greater than or equal to the threshold value, it proceeds to Step S2709; if it is less than the threshold value, it proceeds to Step S2710.

[0360] (Step S2709) The emotion estimation unit 336 acquires the emotion information associated with the i-th emotion correspondence information paired with the maximum similarity. It returns to the upper-level process.

[0361] (Step S2710) The emotion estimation unit 336 acquires "empty" emotion information. It returns to the upper-level process.

[0362] Note that in the flowchart of FIG. 27, the processes from Step S2708 to Step S2711 do not necessarily need to be performed.

[0363] Next, an example of the output configuration process in Step S1917 will be described using the flowchart of FIG. 28.

[0364] (Step S2801) The configuration unit 339 acquires the calendar template from the storage unit 31.

[0365] (Step S2802) The configuration unit 339 assigns 1 to the counter i.

[0366] (Step S2803) The configuration unit 339 determines whether the i-th time zone stored in the action management unit 313 exists. If the i-th time zone exists, it proceeds to Step S2804; if it does not exist, it returns to the upper-level process. Note that in the action management unit 313, action information and emotion information are stored in association with each time zone of 1 or more.

[0367] (Step S2804) Component 339 determines whether the i-th time period stored in the action management unit 313 is included in the period covered by the calendar template acquired in Step S2801. If it is included, it proceeds to Step S2805; if not, it proceeds to Step S2809.

[0368] (Step S2805) Component 339 acquires the action information corresponding to the i-th time period from the action management unit 313.

[0369] (Step S2806) Component 339 acquires the emotion information corresponding to the i-th time period from the action management unit 313. Here, it is not necessary to be able to acquire the emotion information.

[0370] (Step S2807) Component 339 constructs time period information that is the information to be arranged in the i-th time period of the calendar, can identify the action information acquired in Step S2805, and can identify the emotion information acquired in Step S2806.

[0371] (Step S2808) Component 339 arranges the time period information constructed in Step S2807 at the position in the calendar specified by the i-th time period.

[0372] (Step S2809) Component 339 increments the counter i by 1. It returns to Step S2803.

[0373] Next, an example of the first action learning process in Step S1924 will be described using the flowchart in FIG. 29. Assume that the action learning process is performed by a learning unit (not shown), for example. The learning unit may be a learning device different from the action acquisition device 3. The first action learning process is a process of acquiring an action learning model for multi-class classification.

[0374] (Step S2901) The learning unit substitutes 1 for the counter i.

[0375] (Step S2902) The learning unit determines whether the i-th action information etc. exists in the action management unit 313. If the i-th action information etc. exists, it proceeds to step S2903, and if it does not exist, it proceeds to step S2905.

[0376] (Step S2903) The learning unit uses the i-th action information etc. to construct action teacher data and append it to a buffer (not shown). Note that the action teacher data is usually information that uses two or more types of action source information as explanatory variables and the action information as the target variable.

[0377] (Step S2904) The learning unit increments the counter i by 1. It returns to step S2902.

[0378] (Step S2905) The learning unit provides the two or more action teacher data stored in the buffer (not shown) to the learning processing module of machine learning, executes the module, and obtains an action learning model.

[0379] (Step S2906) The learning unit stores the action learning model obtained in step S2905 in the learning management unit 311.

[0380] Note that in the flowchart of FIG. 29, the learning unit may store in the learning management unit 311 an action correspondence table in which each of the two or more action teacher data in the buffer (not shown) is a record (action correspondence information) without performing the learning processes of steps S2905 and S2906.

[0381] Next, an example of the second action learning process in step S1924 will be described using the flowchart of FIG. 30. The second action learning process is a process of obtaining a binary classification action learning model for each of two or more action information candidates.

[0382] (Step S3001) The learning unit assigns 1 to the counter i.

[0383] (Step S3002) The learning unit determines whether there is action information of the i-th type. If there is action information of the i-th type, it proceeds to step S3003; if not, it returns to the upper-level process.

[0384] (Step S3003) The learning unit acquires the action information of the i-th type.

[0385] (Step S3004) The learning unit acquires two or more positive examples that are teacher data in the action management unit 313 and are action teacher data including the action information of the i-th type.

[0386] (Step S3005) The learning unit acquires two or more negative examples that are teacher data in the action management unit 313 and do not include the action information of the i-th type.

[0387] (Step S3006) The learning unit provides the two or more positive examples acquired in step S3004 and the two or more negative examples acquired in step S3005 to the learning processing module of machine learning, executes the module, and acquires an action learning model.

[0388] (Step S3007) The learning unit stores the action learning model acquired in step S3006 in the learning management unit 311 in pairs with the action information of the i-th type.

[0389] (Step S3008) The learning unit increments the counter i by 1. It returns to step S3002.

[0390] Next, an example of the first emotion learning process in step S1925 will be described using the flowchart of FIG. 31. Note that the action learning process is performed by, for example, a learning unit (not shown). The learning unit may be a learning device different from the action acquisition device 3. The first emotion learning process is a process of acquiring a multi-classification emotion learning model.

[0391] (Step S3101) The learning unit assigns 1 to the counter i.

[0392] (Step S3102) The learning unit determines whether the i-th emotion information or the like exists in the behavior management unit 313. If the i-th emotion information or the like exists, it proceeds to step S3103; if not, it proceeds to step S3105.

[0393] (Step S3103) The learning unit uses the i-th emotion information or the like to construct emotion teacher data and append it to a buffer (not shown). Note that the emotion teacher data is information with two or more types of emotion source information as explanatory variables and emotion information as the target variable.

[0394] (Step S3104) The learning unit increments the counter i by 1 and returns to step S3102.

[0395] (Step S3105) The learning unit provides the two or more pieces of emotion teacher data stored in a buffer (not shown) to the learning processing module of machine learning, executes the module, and obtains an emotion learning model.

[0396] (Step S3106) The learning unit stores the emotion learning model obtained in step S3105 in the learning management unit 311.

[0397] Note that in the flowchart of FIG. 31, the learning unit may store in the learning management unit 311 an emotion correspondence table having two or more pieces of emotion teacher data in a buffer (not shown) as records (emotion correspondence information) without performing the learning processes of steps S3105 and S3106.

[0398] Next, an example of the second emotion learning process in step S1925 will be described with reference to the flowchart of FIG. 32. The second emotion learning process is a process of obtaining a binary classification emotion learning model for each candidate of two or more pieces of emotion information.

[0399] (Step S3201) The learning unit assigns 1 to the counter i.

[0400] (Step S3202) The learning unit determines whether the i-th type of emotion information exists. If the i-th type of emotion information exists, it proceeds to step S3203; if not, it returns to the upper-level process.

[0401] (Step S3203) The learning unit acquires the i-th type of emotion information.

[0402] (Step S3204) The learning unit acquires two or more positive examples that are emotion teacher data in the action management unit 313 and include the i-th type of emotion information.

[0403] (Step S3205) The learning unit acquires two or more negative examples that are emotion teacher data in the action management unit 313 and do not include the i-th type of emotion information.

[0404] (Step S3206) The learning unit provides the two or more positive examples acquired in step S3204 and the two or more negative examples acquired in step S3205 to the learning processing module of machine learning, executes the module, and acquires an emotion learning model.

[0405] (Step S3207) The learning unit stores the emotion learning model acquired in step S3206 in the learning management unit 311 in pairs with the i-th type of emotion information.

[0406] (Step S3208) The learning unit increments the counter i by 1 and returns to step S3202.

[0407] Next, a specific operation example of the information system D in this embodiment will be described. Now, in the storage unit 31 of the server device 4, an action learning model obtained by learning processing of machine learning using a large number of teacher data including action source information of one or two or more users is stored. Also, in the storage unit 31, an emotion learning model obtained by learning processing of machine learning using a large number of teacher data including emotion source information of one or two or more users is stored.

[0408] In addition, in the storage unit 31 of the behavior acquisition device 3, which is a terminal (for example, a smartwatch) held by the user "U1", a large number of behavior source information at two or more consecutive times acquired by the processing unit 33 is stored in the behavior source management table shown in FIG. 33 by the above-described processing.

[0409] The behavior source management table (FIG. 33) is a record having "ID", "time information", "physical data", "position information", and "elapsed time". "ID" is information for identifying the record. "Time information" is information for specifying the time, and here it has "month / day", "time", and "day of the week". "Physical data" has "activity data" and "vital data". "Vital data" has "heart rate", "systolic blood pressure", "diastolic blood pressure", and "body temperature". "Heart rate" is the heart rate per unit time (here, "1 minute"). "Systolic blood pressure" is the maximum blood pressure, and "diastolic blood pressure" is the minimum blood pressure. "Position information" is, for example, the position information acquired by the processing described in Embodiment 2. "Elapsed time" is the time elapsed since the start of the same behavior.

[0410] Then, it is assumed that the user "U1" inputs an output instruction to the behavior acquisition device 3. Then, the behavior acquisition device 3 receives the output instruction.

[0411] Next, the behavior estimation unit 335 accesses, for example, the server device 4, receives the behavior learning model and the emotion learning model from the server device 4, and stores the behavior learning model and the emotion learning model in the learning management unit 311.

[0412] Next, the action estimation unit 335 constructs an action source vector having time information, physical data, position information, elapsed time, etc. for each record in FIG. 33 by the process described using the flowchart of FIG. 22, for example. Next, the action estimation unit 335 acquires an action learning model from the learning management unit 311. Next, the action estimation unit 335 gives the action source vector and the action learning model to the prediction processing module of machine learning and executes the module. Then, it is assumed that the action estimation unit 335 acquires action information "A1" for the action source vectors from the record of "ID=1" to the record of "ID=289", and acquires action information "A2" for the action source vectors from the record of "ID=290" to the record of "ID=N". Then, the storage unit 338 stores the action information and the action confirmation flag "0" in the action management unit 313 for each record. Note that "0" of the action confirmation flag and the emotion confirmation flag indicates uncertainty, and "1" indicates certainty.

[0413] Also, the emotion estimation unit 336 constructs an emotion source vector having time information, physical data, position information, elapsed time, action information, etc. for each record in FIG. 33 by the process described using the flowchart of FIG. 25, for example. Next, the emotion estimation unit 336 acquires an emotion learning model from the learning management unit 311. Next, the emotion estimation unit 336 gives the emotion source vector and the emotion learning model to the prediction processing module of machine learning and executes the module. Then, it is assumed that the emotion estimation unit 336 acquires emotion information "E1" for the action source vectors from the record of "ID=1" to the record of "ID=289", and acquires emotion information "E2" for the action source vectors from the record of "ID=290" to the record of "ID=N". Then, the storage unit 338 stores the emotion information and the emotion confirmation flag "0" in the action management unit 313 for each record.

[0414] As a result of the above processing, the action-emotion management table shown in FIG. 34 is stored in the action management unit 313. The action-emotion management table has two or more records having "ID", "action information", "action confirmation flag", "emotion information", and "emotion confirmation flag".

[0415] Next, for each record in FIGS. 33 and 34, when the accumulation unit 338 pairs with the same action information (e.g., "A1"), the times (e.g., T 001 , ···, T 002 , T 289 ) of the time period (e.g., "T 001 from T 289 " which is "TZ1") are obtained, and the time period and the action information are associated and accumulated.

[0416] Also, for each record in FIGS. 33 and 34, when the accumulation unit 338 pairs with the same emotion information (e.g., "E1"), the times (e.g., T 001 , ···, T 002 , T 289 ) of the time period (e.g., "T 001 from T 289 " which is "TZ1") are obtained, and the time period and the emotion information are associated and accumulated. At this stage, both the action determination flag and the emotion determination flag corresponding to each time period are "0". And an example of the accumulated information is shown in FIG. 35. FIG. 35 is a time period information management table. The time period information management table has one or more records having "ID", "time period", "action information", "action determination flag", "emotion information", and "emotion determination flag".

[0417] Then, the component 339 uses one or more sets of the time period, the action information, and the emotion information accumulated by the accumulation unit 338 to perform the process described with reference to the flowchart of FIG. 28, constructs the time period information for each action information, arranges it in the calendar template, and constructs the output information.

[0418] Next, the output unit 34 outputs the output information. Such an output example is shown in FIG. 36. In FIG. 36, the estimated action information for each time period of each day in the calendar is displayed.

[0419] Then, if the action information for each time period is correct, user "U1" inputs a "confirmation instruction" for the displayed action information, and if the estimated action information is incorrect, user "U1" inputs the correct action information. Also, if the emotion information for each time period is correct, user "U1" inputs a "confirmation instruction" for the output emotion information, and if the estimated emotion information is incorrect, user "U1" inputs the correct emotion information. With the user's input, the "action information", "action confirmation flag", "emotion information", and "emotion confirmation flag" in FIG. 35 will be changed.

[0420] As described above, according to this embodiment, the user's actions can be estimated using the position information corresponding to the time.

[0421] Also, according to this embodiment, the user's actions can be estimated using the position information corresponding to the time and the user's activity data corresponding to the time.

[0422] Also, according to this embodiment, the user's actions can be estimated with higher accuracy using the position information corresponding to the time, the user's activity data corresponding to the time, and the user's vital data corresponding to the time.

[0423] Also, according to this embodiment, the emotion of the user during the action can be estimated.

[0424] Also, according to this embodiment, the user's actions can be estimated with higher accuracy using past records.

[0425] Also, according to this embodiment, the user's actions can be estimated with higher accuracy using the past records of two or more users.

[0426] Also, according to this embodiment, when the user's actions cannot be estimated, the location where the user was can be output.

[0427] Furthermore, according to this embodiment, using the indoor position information and the like obtained by the position information acquisition method described in Embodiment 2, the user's actions can be estimated with high accuracy even in a place where a GPS signal cannot be received.

[0428] Note that the processing in this embodiment may be realized by software. And this software may be distributed by software download or the like. Also, this software may be recorded on a recording medium such as a CD-ROM and distributed. Note that this also applies to other embodiments in this specification. The software that realizes the information system D in this embodiment is a program as follows. That is, this program causes a computer to function as a time acquisition unit that acquires time, a position acquisition unit that acquires position information associated with the time, and an action estimation unit that acquires action information for specifying the user's action in the time zone specified by the time included in two or more pieces of action source information including the position information associated with the time, and an action output unit that outputs the action information in the time zone.

[0429] (Embodiment 4) The difference between this embodiment and Embodiment 3 is as follows. That is, in this embodiment, the action acquisition device is a server, and the action acquisition device uses the position information and the like received from the user's terminal device to estimate the user's action information and emotion information.

[0430] FIG. 37 is a conceptual diagram of the information system E in this embodiment. The information system E includes an action acquisition device 5, one or two or more terminal devices 6, and one or two or more communication devices B.

[0431] The action acquisition device 5 is a server, for example, a cloud server, an ASP server, and its type does not matter. The action acquisition device 5 is a device that receives action source information such as position information from the user's terminal device 6, uses the action source information to estimate the user's action information, and transmits the action information to the terminal device 6. The action acquisition device 5 is a device that receives emotion source information from the user's terminal device 6, uses the emotion source information to estimate the user's emotion information, and transmits the action information to the terminal device 6.

[0432] The terminal device 6 is a terminal used by the user. The terminal device 6 is, for example, a smartphone, a tablet terminal, a smartwatch, a so-called personal computer, etc., and its type does not matter. The terminal device 6 is a terminal that transmits action source information and emotion source information including position information, etc. to the action acquisition device 5, receives action information and emotion information from the action acquisition device 5, and outputs it. Note that the device that transmits the action source information and emotion source information to the action acquisition device 5 and the device that receives and outputs the action information and emotion information from the action acquisition device 5 may be different devices.

[0433] FIG. 38 is a block diagram of the information system E in the present embodiment. FIG. 39 is a block diagram of the action acquisition device 5.

[0434] The action acquisition device 5 includes a storage unit 51, a reception unit 52, a processing unit 53, and a transmission unit 54. The storage unit 51 includes a learning management unit 311 and an action management unit 313. The reception unit 52 includes a position acquisition unit 521, an activity acquisition unit 522, and a vital acquisition unit 523. The processing unit 53 includes a time acquisition unit 331, an action estimation unit 335, an emotion estimation unit 336, an accumulation unit 338, and a configuration unit 339. The transmission unit 54 includes an action output unit 341 and an emotion output unit 342.

[0435] The terminal device 6 includes a terminal storage unit 61, a terminal reception unit 62, a terminal reception unit 63, a terminal processing unit 64, a terminal transmission unit 65, and a terminal output unit 66. The terminal storage unit 61 includes a map management unit 312. The terminal processing unit 64 includes an intensity acquisition unit 231, a type determination unit 232, a position acquisition unit 332, an activity acquisition unit 333, a vital acquisition unit 334, and a location acquisition unit 337.

[0436] Various types of information are stored in the storage unit 51 that constitutes the action acquisition device 5. The various types of information are, for example, the learning information and the action information described above.

[0437] The reception unit 52 receives various instructions and information from the terminal device 6. The various instructions and information are, for example, position information, activity data, vital data, output instructions, confirmation instructions, action information to be corrected, and emotion information to be corrected.

[0438] It is preferable that the receiving unit 52 receives position information, activity data, vital data, etc. from the terminal device 6 at one time. It is preferable that the receiving unit 52 receives position information etc. associated with the user identifier at one time. The user identifier is information for identifying the user who uses the terminal device 6. The user identifier is, for example, a user ID, a telephone number, an email address, or an identifier of the terminal device 6. The identifier of the terminal device 6 is, for example, an IP address.

[0439] The position acquisition unit 521 receives position information from the terminal device 6. Such position information is associated with time. When the position acquisition unit 521 receives the position information, it is preferable to acquire the time from a clock (not shown) and associate the time with the position information. It is preferable that such position information is associated with the user identifier.

[0440] The activity acquisition unit 522 receives activity data from the terminal device 6. Such activity data is associated with time. When the activity acquisition unit 522 receives the activity data, it is preferable to acquire the time from a clock (not shown) and associate the time with the activity data. It is preferable that such activity data is associated with the user identifier.

[0441] The vital acquisition unit 523 receives one or two or more types of vital data from the terminal device 6. Such vital data is associated with time. When the vital acquisition unit 523 receives the vital data, it is preferable to acquire the time from a clock (not shown) and associate the time with the vital data. It is preferable that such vital data is associated with the user identifier.

[0442] The processing unit 53 performs various processes. The various processes are, for example, the processes performed by the time acquisition unit 331, the action estimation unit 335, the emotion estimation unit 336, and the storage unit 338.

[0443] The transmission unit 54 transmits various types of information to the terminal device 6. The various types of information are, for example, the estimated behavior information, the estimated emotion information, and the output information configured by the component 339.

[0444] The behavior output unit 341 is the behavior information acquired by the behavior estimation unit 335, and transmits the behavior information associated with the time zone to the terminal device 6.

[0445] The emotion output unit 342 is the emotion information acquired by the emotion estimation unit 336, and transmits the emotion information associated with the time zone to the terminal device 6.

[0446] Various types of information are stored in the terminal storage unit 61 that constitutes the terminal device 6. The various types of information are, for example, location information, activity data, and vital data.

[0447] The terminal reception unit 62 receives various types of instructions and information. The various types of instructions and information are, for example, an output instruction, a confirmation instruction, the behavior information modified by the user for the estimated behavior information, and the emotion information modified by the user for the estimated emotion information.

[0448] The input means for the various types of instructions and information can be anything, such as a touch panel, a keyboard, a mouse, or a menu screen.

[0449] The terminal reception unit 63 receives various types of information from the behavior acquisition device 5. The various types of information are, for example, output information, behavior information, and emotion information.

[0450] The terminal processing unit 64 performs various types of processing. The various types of processing are, for example, the processing of changing the instructions and information received by the terminal reception unit 62 into the instructions and information of a transmission structure, and the processing of changing the information received by the terminal reception unit 63 into an output structure.

[0451] The terminal transmission unit 65 transmits various types of instructions and information. The various types of instructions and information are, for example, an output instruction, a confirmation instruction, the behavior information to be changed, and the emotion information to be changed.

[0452] The terminal output unit 66 outputs various types of information. The various types of information are, for example, output information, action information, and emotion information.

[0453] The storage unit 51 and the terminal storage unit 61 are preferably non-volatile recording media, but can also be realized with volatile recording media.

[0454] The process by which information is stored in the storage unit 51 or the like is not limited. For example, information may be stored in the storage unit 51 or the like via a recording medium, information transmitted via a communication line or the like may be stored in the storage unit 51 or the like, or information input via an input device may be stored in the storage unit 51 or the like.

[0455] The receiving unit 52, the position acquisition unit 521, the activity acquisition unit 522, the vital acquisition unit 523, the transmitting unit 54, the action output unit 341, the emotion output unit 342, the terminal receiving unit 63, and the terminal transmitting unit 65 are realized by, for example, wireless or wired communication means.

[0456] The processing unit 53 and the terminal processing unit 64 can usually be realized from a processor, memory, etc. The processing procedures of the processing unit 53 or the like are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may also be realized by hardware (a dedicated circuit). Note that the processor may be a CPU, MPU, GPU, etc., and its type is not limited.

[0457] The terminal reception unit 62 can be realized by a device driver of an input means such as a touch panel or a keyboard, control software for a menu screen, or the like.

[0458] The terminal output unit 66 may or may not be considered to include output devices such as a display and a speaker. The terminal output unit 66 can be realized by driver software for the output device or by driver software for the output device and the output device or the like.

[0459] Next, an operation example of the action acquisition device 5 will be described using the flowchart of FIG. 40. In the flowchart of FIG. 40, the description of the same steps as in FIG. 19 will be omitted.

[0460] (Step S4001) The receiving unit 52 determines whether or not it has received position information or the like that pairs with the user identifier from the terminal device 6. If it has received the position information or the like, it proceeds to step S4002, and if it has not received it, it proceeds to step S4004. Note that the position information or the like is, for example, the user identifier and the position information. The position information or the like is, for example, one or more types of information among the user identifier and the position information, and the activity data and the vital data.

[0461] (Step S4002) The time acquisition unit 331 acquires the time from a clock (not shown). Here, the time acquisition unit 331 may acquire the day of the week. Also, the time usually includes the hour and minute. The time may include any one or more of the year, month, and day.

[0462] (Step S4003) The storage unit 338 stores the position information or the like received in step S4001 and the time in association with the user identifier in the action management unit 313. It returns to step S4001.

[0463] (Step S4004) The receiving unit 52 determines whether or not it has received an output instruction from the terminal device 6. If it has received the output instruction, it proceeds to step S4005, and if it has not received it, it proceeds to step S4009. Note that the received output instruction is usually associated with the user identifier. Also, the output instruction usually includes period information (for example, "from December 17, 2023 to December 23, 2023") that specifies the period for acquiring the action information.

[0464] (Step S4005) The action estimation unit 335 substitutes 1 for the counter i.

[0465] (Step S4006) The action estimation unit 335 determines whether the i-th action source information paired with the user identifier associated with the output instruction received in Step S4004 exists in the action management unit 313. If the i-th action source information exists, it proceeds to Step S4007; if it does not exist, it proceeds to Step S1917.

[0466] (Step S4007) The action estimation unit 335 determines whether action information associated with the i-th action source information exists. If the action information exists, it proceeds to Step S4008; if it does not exist, it proceeds to Step S1904. Note that when the action information associated with the action source information exists, usually, the estimation of the action information has already been performed using the action source information.

[0467] (Step S4008) The action estimation unit 335 increments the counter i by 1. It returns to Step S4006.

[0468] (Step S4009) The reception unit 52 determines whether it has received information or the like from the terminal device 6. If it has received information or the like, it proceeds to Step S1920; if it has not received it, it proceeds to Step S4010. Note that the information or the like is, for example, a confirmation instruction, action information to be corrected, or emotion information to be corrected.

[0469] (Step S4010) The reception unit 52 determines whether it has received a learning instruction from the terminal device 6. If it has received a learning instruction, it proceeds to Step S1924; if it has not received it, it returns to Step S4001.

[0470] (Step S4011) The transmission unit 54 transmits the output information configured in Step S1917 to the terminal device 6. Return to Step S4001.

[0471] Note that in the flowchart of FIG. 40, the process ends due to a power-off or a processing end interrupt.

[0472] Next, an operation example of the terminal device 6 will be described using the flowchart of FIG. 41. In the flowchart of FIG. 41, the description of the same steps as those in FIG. 19 will be omitted.

[0473] (Step S4101) The terminal transmission unit 65 acquires the user identifier in the terminal storage unit 61, and transmits the position information and the like acquired in step S1903 to the behavior acquisition device 5 in association with the user identifier.

[0474] (Step S4102) The terminal transmission unit 65 transmits the output instruction received in step S1916 to the behavior acquisition device 5 in association with the user identifier in the terminal storage unit 61. Note that the output instruction usually includes period information.

[0475] (Step S4103) The terminal reception unit 63 determines whether or not it has received output information from the behavior acquisition device 5. If it has received the output information, it proceeds to step S4104, and if it has not received it, it returns to step S4103.

[0476] (Step S4104) The terminal processing unit 64 configures the output information to be output using the received output information. The terminal output unit 66 outputs the output information. It returns to step S1901.

[0477] (Step S4105) The terminal transmission unit 65 transmits the information and the like acquired from the information input received in step S1919 to the behavior acquisition device 5 in association with the user identifier in the terminal storage unit 61. It returns to step S1901.

[0478] Note that the information and the like are, for example, a confirmation instruction, changed behavior information, and changed emotion information. Note that the confirmation instruction includes information for specifying the behavior information or emotion information to be confirmed. The changed behavior information is associated with the information for specifying the behavior information to be corrected. The changed emotion information is associated with the information for specifying the emotion information to be corrected.

[0479] Note that in the flowchart of FIG. 41, the process ends due to a power-off or a processing end interrupt.

[0480] As described above, according to this embodiment, the behavior of the user can be estimated using the position information corresponding to the time.

[0481] Also, according to this embodiment, the behavior of the user can be estimated using the position information corresponding to the time and the activity data of the user corresponding to the time.

[0482] Also, according to this embodiment, the behavior of the user can be estimated with higher accuracy using the position information corresponding to the time, the activity data of the user corresponding to the time, and the vital data of the user corresponding to the time.

[0483] Also, according to this embodiment, the emotion of the user during the behavior can be estimated.

[0484] Also, according to this embodiment, the behavior of the user can be estimated with higher accuracy using past records.

[0485] Also, according to this embodiment, the behavior of the user can be estimated with higher accuracy using the past records of two or more users.

[0486] Also, according to this embodiment, when the behavior of the user cannot be estimated, the location where the user was can be output.

[0487] Furthermore, the software that realizes the behavior acquisition device 5 in this embodiment is a program as follows. That is, this program causes a computer to function as a time acquisition unit that acquires time, a position acquisition unit that acquires position information associated with the time, and an action estimation unit that acquires action information that specifies the behavior of the user in the time zone specified by the time included in two or more pieces of action source information including the position information associated with the time, and an action output unit that outputs the action information in the time zone.

[0488] (Embodiment 5) In the present embodiment, an information processing apparatus will be described which detects a set of actions, which is a series of actions, from a set of action information associated with the time zone of a user, acquires keystone habit information having the action information that is the starting point of the set of actions, and outputs the information.

[0489] In the present embodiment, an information processing apparatus will be described which also acquires the start time of a keystone habit and outputs the information.

[0490] In the present embodiment, an information processing apparatus will be described which uses emotion information to detect a set of actions.

[0491] In the present embodiment, an information processing apparatus will be described which acquires keystone habit information corresponding to a query from a user and outputs the information.

[0492] Furthermore, in the present embodiment, an information processing apparatus will be described which uses the acquired keystone habit information to make a recommendation regarding an action to the user.

[0493] FIG. 42 is a conceptual diagram of an information system F in the present embodiment. The information system F includes an information processing apparatus 7, 1 or two or more terminal devices 6, and three or more communication devices B.

[0494] The information processing apparatus 7 is a server that transmits keystone habit information to the terminal device 6. The information processing apparatus 7 is, for example, a cloud server or an ASP server, but its type is not limited. Also, it is preferable that the information processing apparatus 7 has the functions of the server apparatus 4 and the action acquisition apparatus 5.

[0495] Figure 43 is a block diagram of the information system F in the present embodiment. The information processing apparatus 7 includes a storage unit 71, a reception unit 72, a processing unit 73, and an output unit 74. The storage unit 71 includes an action management unit 313. The reception unit 72 includes a query reception unit 721. The processing unit 73 includes a set determination unit 731, a keystone habit acquisition unit 732, and a recommendation acquisition unit 733. The output unit 74 includes a keystone habit output unit 741.

[0496] Various types of information are stored in the storage unit 71 that constitutes the information processing apparatus 7. The various types of information are, for example, learning information, action information, and one or more recommendation templates.

[0497] A recommendation template is information that serves as a template for constructing a recommendation. The recommendation template is, for example, a recommended template or a non-recommended template. The recommended template is template information for recommending a keystone habit. For example, it includes a sentence such as "<During the time period specified by <time period>>, one should perform the keystone habit that is <action information>>." Here, <time period> and <action information> in the template are variables, and the time period of the keystone habit and the action information that is the keystone habit are substituted. The non-recommended template is template information for not recommending a keystone habit. For example, it includes a sentence such as "<During the time period specified by <time period>>, one should stop performing the keystone habit that is <action information>>."

[0498] Action information corresponding to four or more time periods is stored in the action management unit 313. It is preferable that a user identifier is associated with each of the four or more pieces of action information. It is preferable that the action management unit 313 stores, for example, action information, emotion information, etc. acquired by the action acquisition device 5. However, the action management unit 313 may store, for example, action information, emotion information, etc. input manually. The process by which action information, emotion information, etc. are stored in the action management unit 313 is not limited.

[0499] The reception unit 72 receives various instructions and information. The various instructions and information are, for example, output instructions and queries.

[0500] The output instruction is an instruction to output keystone habit information. The output instruction is usually associated with a user identifier.

[0501] Here, reception usually means receiving information transmitted via a wired or wireless communication line, but it may also include concepts such as receiving information input from input devices such as keyboards, mice, and touch panels, and receiving information read from recording media such as optical disks, magnetic disks, and semiconductor memories.

[0502] The query reception unit 721 receives queries. A query may also be called an inquiry. The query includes time and action information. The query may include sentiment information. The query is, for example, "<time> 7 o'clock <action information> get up", "<time> 7 o'clock <action information> get up <sentiment information> positive". Note that the query "<time> 7 o'clock <action information> get up" is an inquiry requesting a keystone habit for waking up at 7 in the morning. The query "<time> 7 o'clock <action information> get up <sentiment information> positive" is an inquiry requesting a keystone habit for waking up feeling good at 7 in the morning.

[0503] The processing unit 73 performs various processes. The various processes are, for example, processes performed by the set determination unit 731, the keystone habit acquisition unit 732, or the recommendation acquisition unit 733.

[0504] The set determination unit 731 refers to the action management unit 313 and determines an action set that satisfies the set conditions. The set determination unit 731 determines the action set for each user. It is preferable for the set determination unit 731 to use sentiment information to determine the action set. Note that the action management unit 313 may be provided in an external device not shown in the figure.

[0505] An action set is a set of two or more pieces of action information that are temporally continuous. The action set is a set of action information of a single user.

[0506] A set condition is information for determining an action set. A set condition is a condition for determining that it is an action set. The set condition is usually a condition regarding the number of occurrences of an action set in a set of action information of a single user. The set condition is, for example, to appear N times or more (N is a natural number of 2 or more) in the action management unit 313.

[0507] The keystone habit acquisition unit 732 acquires keystone habit information including action information for specifying an action that is the starting point of the action set determined by the set determination unit 731 from the action management unit 313. The action information for specifying the action that is the starting point of the action set is the action information of the first time zone that the action set has.

[0508] The keystone habit acquisition unit 732 acquires, for example, keystone habit information including the action information for specifying the action that is the starting point of the action set determined by the set determination unit 731 and the start time included in the time zone associated with the action information from the action management unit 313.

[0509] The keystone habit acquisition unit 732 acquires, for example, the time zone and action information corresponding to the time and action information included in the received query, and acquires keystone habit information including the action information for specifying the action that is the starting point of the action set in the time zone before the acquired time zone and closest to the determined time zone. It is preferable that the keystone habit information includes the start time or time zone of the starting action information. The keystone habit information may have emotion information paired with the starting action information.

[0510] The recommendation acquisition unit 733 constitutes a recommendation including the keystone habit information acquired by the keystone habit acquisition unit 732.

[0511] The recommendation acquisition unit 733 constructs a recommendation by, for example, substituting the keystone habit information into the recommendation template in the storage unit 71.

[0512] The recommendation acquisition unit 733 acquires, for example, the emotion information corresponding to the action information included in the keystone habit information or the action information included in the query, and constructs a recommendation using the emotion information and the keystone habit information.

[0513] The recommendation acquisition unit 733 acquires, for example, a recommendation template paired with the emotion information from the storage unit 71, substitutes the keystone habit information into the recommendation template, and constructs a recommendation.

[0514] The output unit 74 outputs various types of information. The various types of information are, for example, keystone habits, start times, time zones, and recommendations.

[0515] The keystone habit output unit 741 outputs the keystone habit information acquired by the keystone habit acquisition unit 732. The keystone habit output unit 741 outputs the recommendation acquired by the recommendation acquisition unit 733.

[0516] The output here usually refers to transmission to the terminal device 6, but it may also be a concept including display on a display, projection using a projector, printing by a printer, sound output, storage in a recording medium, delivery of processing results to other processing devices and other programs, etc.

[0517] The storage unit 71 is preferably a non-volatile recording medium, but can also be realized with a volatile recording medium.

[0518] The process by which information is stored in the storage unit 71 is not limited. For example, information may be stored in the storage unit 71 via a recording medium, information transmitted via a communication line or the like may be stored in the storage unit 71, or information input via an input device may be stored in the storage unit 71.

[0519] The reception unit 72 and the query reception unit 721 are preferably implemented by wireless or wired communication means. However, they may also be implemented by means of receiving broadcasts, device drivers of input means such as touch panels and keyboards, control software for menu screens, and the like.

[0520] The processing unit 73, the set determination unit 731, the keystone habit acquisition unit 732, and the recommendation acquisition unit 733 can usually be realized from a processor, a memory, and the like. The processing procedures of the processing unit 73 and the like are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may also be realized by hardware (a dedicated circuit). The processor may be a CPU, an MPU, a GPU, or the like, and its type does not matter.

[0521] The output unit 74 and the keystone habit output unit 741 are preferably implemented by wireless or wired communication means. However, they may also be implemented by driver software for output devices such as displays and speakers, or by driver software for output devices and output devices.

[0522] Next, an operation example of the information processing apparatus 7 will be described using the flowchart of FIG. 44.

[0523] (Step S4401) The reception unit 72 determines whether or not it has received an output instruction. If it has received an output instruction, it proceeds to step S4402, and if it has not received it, it proceeds to step S4406. Here, for example, the reception unit 72 determines whether or not it has received an output instruction from the terminal device 6.

[0524] (Step S4402) The processing unit 73 acquires the user identifier corresponding to the output instruction received in step S4401. Next, the processing unit 73 acquires all the action information and the like paired with the user identifier from the action management unit 313. The action information and the like include action information and time zones. It is preferable that the action information and the like include emotion information. It is assumed that the acquired action information is sorted in the order of time zones.

[0525] (Step S4403) The processing unit 73 performs keystone habit acquisition processing using the action information and the like acquired in step S4402. An example of the keystone habit acquisition processing will be described using the flowchart of FIG. 45.

[0526] (Step S4404) The recommendation acquisition unit 733 performs recommendation acquisition processing. An example of the recommendation acquisition processing will be described using the flowchart of FIG. 46.

[0527] (Step S4405) The keystone habit output unit 741 outputs recommendations and the like. It returns to step S4401. The recommendations and the like are, for example, one or more recommendations and one or more keystone habit information. Here, for example, the keystone habit output unit 741 transmits the recommendations and the like to the terminal device 6.

[0528] (Step S4406) The query reception unit 721 determines whether a query has been received. If a query has been received, it proceeds to step S4407, and if not, it returns to step S4401. Here, for example, the query reception unit 721 determines whether a query has been received from the terminal device 6.

[0529] (Step S4407) The keystone habit acquisition unit 732 acquires the start time included in the query.

[0530] (Step S4408) The keystone habit acquisition unit 732 acquires the keystone habit information of the time zone immediately before the start time closest to the start time from the action management unit 313.

[0531] (Step S4409) The processing unit 73 configures the information to be output, which is the information including the keystone habit information acquired in step S4408.

[0532] (Step S4410) The keystone habit output unit 741 outputs the information configured in step S4409. Return to step S4401. Here, for example, the keystone habit output unit 741 transmits the information configured in the terminal device 6.

[0533] In addition, in the flowchart of FIG. 44, the trigger for acquiring and accumulating the action set and the keystone habit information is not limited.

[0534] Also, in the flowchart of FIG. 44, the process ends due to a power-off or a processing end interrupt.

[0535] Next, an example of the keystone habit acquisition process in step S4403 will be described using the flowchart of FIG. 45.

[0536] (Step S4501) The set determination unit 731 substitutes 1 for the counter i.

[0537] (Step S4502) The set determination unit 731 determines whether the i-th action information acquired in step S4402 exists. If the i-th action information exists, go to step S4503; if not, return to the upper-level process.

[0538] (Step S4503) The set determination unit 731 acquires the i-th action information acquired in step S4402.

[0539] (Step S4504) The set determination unit 731 substitutes n1 for the counter j. Note that n1 is the minimum number of action information that can constitute an action set, and is, for example, "2", "3", or "4", but it doesn't matter.

[0540] (Step S4505) The set determination unit 731 acquires an action set that is j consecutive action information after the i-th action information from the set of action information acquired in step S4402.

[0541] (Step S4506) The set determination unit 731 obtains the number of occurrences of the action set obtained in step S4505 among the set of action information obtained in step S4402.

[0542] (Step S4507) The set determination unit 731 determines whether the number of occurrences obtained in step S4506 satisfies the set condition. If it satisfies the set condition, it proceeds to step S4508; if not, it proceeds to step S4511.

[0543] (Step S4508) The keystone habit acquisition unit 732 accumulates the action set etc. obtained in step S4505 in the storage unit 71. The action set etc. may be a set of action information, a set of pairs of action information and start time, or a set of pairs of action information and time zone. In the action set etc., it is preferable to have emotion information associated with the action information. The keystone habit acquisition unit 732 may accumulate, in the storage unit 71, keystone habit information including the action information that is the starting point of the action set, in association with the action set.

[0544] (Step S4509) The set determination unit 731 sets the counter i to 1 and increments it.

[0545] (Step S4510) The set determination unit 731 determines whether the counter j is less than or equal to n2. If it is less than or equal to n2, it returns to step S4504; if it is greater than n2, it proceeds to step S4511. n2 is the maximum number of action information that can constitute the action set, and for example, it can be "6", "7", or "8", but it doesn't matter.

[0546] (Step S4511) The set determination unit 731 determines whether an action set etc. starting from the i-th action information has been accumulated. If it has been accumulated, it proceeds to step S4512; if not, it proceeds to step S4513.

[0547] (Step S4512) The set determination unit 731 increments the counter i from 1 to the next action information after the last action information included in the accumulated action set. Return to step S4502.

[0548] (Step S4513) The set determination unit 731 increments the counter i by 1. Return to step S4502.

[0549] In the flowchart of FIG. 45, when two or more action sets etc. with the same starting (first) action information are accumulated, it is preferable to leave only the action set etc. including the maximum number of action information and delete the others.

[0550] Also, in the flowchart of FIG. 45, the end condition of the loop of the action set acquisition process from step S4505 to step S4510 was that the maximum number (counter j) of the action information constituting the action set was larger than n2. However, in the flowchart of FIG. 45, the end condition of the loop of the action set acquisition process from step S4505 to step S4510 may be that specific action information (for example, "sleep" "get up") is included in the action set.

[0551] Also, the set determination unit 731 may acquire an action set having two or more action information from two or more action information between the first specific action information and the second specific action information. Note that from the first specific action information to the second specific action information, it constitutes a segment which is a set of a series of action information. Note that the segment may or may not include the first specific action information and the second specific action information. Also, for example, the first specific action information is "get up" and the second specific action information is "commute". Also, for example, the first specific action information is "commute" and the second specific action information is "return home". Also, for example, the first specific action information is "return home" and the second specific action information is "sleep".

[0552] Next, an example of the recommendation acquisition process in step S4404 will be described using the flowchart of FIG. 46.

[0553] (Step S4601) The recommendation acquisition unit 733 substitutes 1 for the counter i.

[0554] (Step S4602) The recommendation acquisition unit 733 determines whether the i-th action set accumulated in Step S4403 exists. If the i-th action set exists, it proceeds to Step S4603; if not, it returns to the upper-level process.

[0555] (Step S4603) The recommendation acquisition unit 733 acquires keystone habit information including action information that is the starting action from among the i-th action sets. The keystone habit information includes action information. It is preferable that the keystone habit information includes one or more types of information among start time, time zone, and emotion information.

[0556] (Step S4604) The recommendation acquisition unit 733 acquires a recommendation template from the storage unit 71. The recommendation acquisition unit 733 acquires, for example, a recommendation template that pairs with the emotion information included in the keystone habit information acquired in Step S4603 from the storage unit 71.

[0557] (Step S4605) The recommendation acquisition unit 733 arranges the keystone habit information in the recommendation template acquired in Step S4604 to form a recommendation.

[0558] (Step S4606) The recommendation acquisition unit 733 arranges the recommendation formed in Step S4605 in the information to be transmitted.

[0559] (Step S4607) The recommendation acquisition unit 733 increments the counter i by 1. It returns to Step S4602.

[0560] Next, a specific operation example of the information system F in the present embodiment will be described.

[0561] Now, assume that the behavior management unit 313 of the information processing apparatus 7 stores the tables of FIGS. 33 to 35. In FIGS. 34 and 35, assume that all action determination flags and all emotion determination flags are "1" (determined).

[0562] Then, by the processing of steps S4402 to S4404 described above, assume that a set of keystone habit information associated with the user identifier "U" is stored based on the table of FIG. 35. The set of the keystone habit information is the keystone habit management table of FIG. 47. The keystone habit management table has records having "action set ID", "time zone", "action information", and "emotion information".

[0563] Here, assume that the user U of the terminal device 6 thinks "I want to wake up cheerfully at 7:00 in the morning" and inputs the query "<time> 7 o'clock <action information> wake up <emotion information> 1" to the terminal device 6. Note that the emotion information "1" means "positive", and "0" means "negative".

[0564] Next, the terminal reception unit 62 of the terminal device 6 receives the query "<time> 7 o'clock <action information> wake up <emotion information> 1". Next, the terminal device 6 transmits the query to the information processing apparatus 7 in pair with the user identifier "U".

[0565] Next, the query reception unit 721 of the information processing apparatus 7 receives the query "<time> 7 o'clock <action information> wake up <emotion information> 1" that is paired with the user identifier "U".

[0566] Next, the keystone habit acquisition unit 732 acquires the start time "7 o'clock" included in the query. Then, the keystone habit acquisition unit 732 acquires the keystone habit information "<time zone> 18:00-19:00 <action information> dinner <emotion information> 1", which is the action information serving as the starting point in the action set of the time zone closest to the start time "7 o'clock" paired with the user identifier "U" (the record of "ID = 1" in FIG. 47), from the keystone habit management table (FIG. 47).

[0567] Next, the processing unit 73 configures the information to be output, which is the information including the acquired keystone habit information "<Time zone> 18:00-19:00 <Action information> Dinner <Emotion information> 1".

[0568] Next, the keystone habit output unit 741 transmits the configured information to the terminal device 6.

[0569] Next, the terminal device 6 receives and outputs the keystone habit information and the like. An example of such output is shown in FIG. 48.

[0570] As described above, according to the present embodiment, the user's keystone habit can be presented.

[0571] Also, according to the present embodiment, the user's keystone habit and its start time and the like can be presented.

[0572] Also, according to the present embodiment, the keystone habit corresponding to the query from the user can be presented to the user.

[0573] Also, according to the present embodiment, recommendations using the keystone habit can be made.

[0574] Furthermore, according to the present embodiment, recommendations using the keystone habit and emotion information can be made.

[0575] Note that the software that realizes the information processing apparatus 7 in the present embodiment is a program as follows. That is, this program causes a computer to refer to an action management unit that stores action information for specifying the actions of one user, associated with each of four or more time zones, and determines an action set that is a set of two or more series of actions and satisfies set conditions, and a keystone habit acquisition unit that acquires keystone habit information including action information for specifying an action that is the starting point of the action set determined by the set determination unit, and is a program for causing the computer to function as a keystone habit output unit that outputs the keystone habit information.

[0576] (Embodiment 6) In the present embodiment, the difference from Embodiment 5 is that the information processing apparatus is a terminal.

[0577] FIG. 49 is a conceptual diagram of the information system G in the present embodiment. The information system G includes one or two or more information processing apparatuses 8, a server apparatus 4, and three or more communication apparatuses B.

[0578] The information processing apparatus 8 is a terminal that determines an action set, acquires and outputs keystone habit information. The information processing apparatus 8 is, for example, a smartphone, a tablet terminal, a smartwatch, a so-called personal computer, etc., and its type is not limited.

[0579] Figure 50 is a block diagram of the information system G in the present embodiment. The information processing apparatus 8 includes a storage unit 31, a reception unit 72, a processing unit 83, and an output unit 84. The storage unit 31 includes a learning management unit 311, a map management unit 312, and a behavior management unit 313. The reception unit 72 includes a query reception unit 721. The processing unit 83 includes an intensity acquisition unit 231, a type determination unit 232, a time acquisition unit 331, a position acquisition unit 332, an activity acquisition unit 333, a vital acquisition unit 334, a behavior estimation unit 335, an emotion estimation unit 336, a location acquisition unit 337, an accumulation unit 338, a configuration unit 339, a set determination unit 731, a keystone habit acquisition unit 732, and a recommendation acquisition unit 733. The output unit 84 includes a behavior output unit 341, an emotion output unit 342, and a keystone habit output unit 741.

[0580] Next, the operation example of the information processing apparatus 8 is the same as the processing described using the flowchart of FIG. 44. Note that the reception unit 72 and the query reception unit 721 of the information processing apparatus 8 usually receive user input.

[0581] Also, it is preferable that the information processing apparatus 8 has the functions of the terminal device 2 and the behavior acquisition device 3.

[0582] As described above, according to the present embodiment, the user's keystone habit can be presented.

[0583] Also, according to the present embodiment, the user's keystone habit and its start time and the like can be presented.

[0584] Also, according to the present embodiment, an action set can be determined using emotion information.

[0585] Also, according to the present embodiment, the keystone habit corresponding to the query from the user can be presented to the user.

[0586] Also, according to the present embodiment, a recommendation using the keystone habit can be made.

[0587] Furthermore, according to the present embodiment, recommendations can be made using keystone habits and emotional information.

[0588] Also, each of the devices with reference numeral 7 in FIG. 42 and reference numeral 8 in FIG. 49 shows the appearance of a computer that executes the programs described in this specification to realize the information processing apparatus and the like of the various embodiments described above. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. Each of the devices with reference numeral 7 in FIG. 42 and reference numeral 8 in FIG. 49 is a schematic view of this computer system 300, and FIG. 51 is a block diagram of the system 300.

[0589] In FIG. 42 with reference numeral 7 and FIG. 49 with reference numeral 8, the computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0590] In FIG. 51, the computer 301 includes, in addition to the CD-ROM drive 3012, an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012 and the like, a ROM 3015 for storing programs such as a boot-up program, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions of an application program and providing a temporary storage space, and a hard disk 3017 for storing an application program, a system program, and data. Here, although not shown, the computer 301 may further include a network card for providing connection to a LAN.

[0591] A program for causing the computer system 300 to execute the functions of the information processing apparatus 7 and the like in the above-described embodiment may be stored in the CD-ROM 3101, inserted into the CD-ROM drive 3012, and further transferred to the hard disk 3017. Alternatively, the program may be transmitted to the computer 301 via a network (not shown) and stored in the hard disk 3017. The program is loaded into the RAM 3016 when it is executed. The program may be loaded directly from the CD-ROM 3101 or the network.

[0592] The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the information processing apparatus 7 and the like in the above-described embodiment. The program only needs to include a part of instructions that call appropriate functions (modules) in a controlled manner so as to obtain a desired result. How the computer system 300 operates is well known, and a detailed description thereof will be omitted.

[0593] In the above program, in steps such as the step of transmitting information and the step of receiving information, processing performed by hardware, for example, processing performed by a modem or an interface card in the transmission step (processing that can only be performed by hardware) is not included.

[0594] Also, the computer that executes the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

[0595] Also, in each of the above embodiments, it goes without saying that two or more communication means existing in one apparatus may be physically realized by one medium.

[0596] Also, in each of the above embodiments, each process may be realized by being centrally processed by a single apparatus, or may be realized by being distributedly processed by a plurality of apparatuses.

[0597] The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that they are also included in the scope of the present invention.

Industrial Applicability

[0598] As described above, the information processing apparatus according to the present invention has an effect of being able to present a user's keystone habit, and is useful as an information processing apparatus or the like.

Explanation of Signs

[0599] F, G Information system 4 Server device 6 Terminal device 7, 8 Information processing apparatus 31, 71 Storage unit 72 Reception unit 73, 83 Processing unit 74, 84 Output unit 231 Strength acquisition unit 232 Type determination unit 311 Learning management unit 312 Map management unit 313 Behavior management unit 331 Time acquisition unit 332 Position acquisition unit 333 Activity acquisition unit 334 Vital acquisition unit 335 Behavior estimation unit 336 Emotion estimation unit 337 Location acquisition unit 338 Accumulation unit 339 Configuration unit 341 Behavior output unit 342 Emotion output unit 721 Query reception unit 731 Set determination unit 732 Keystone habit acquisition unit 733 Recommendation acquisition unit 741 Keystone habit output unit

Claims

1. With reference to an action management unit that stores action information for identifying the actions of a single user, associated with each time period of 4 or more, a set determination unit that determines a set of actions that is a series of 2 or more sets of actions and satisfies the set conditions, a keystone habit acquisition unit that acquires keystone habit information including action information for identifying the action that is the starting point of the set of actions determined by the set determination unit, and an information processing apparatus comprising a keystone habit output unit that outputs the keystone habit information.

2. The keystone habit acquisition unit acquires keystone habit information including action information for identifying the action that is the starting point of the set of actions and the start time included in the time period associated with the action information, according to the information processing apparatus of Claim 1.

3. a time acquisition unit that acquires time, a position acquisition unit that acquires position information associated with the time, and an action estimation unit that acquires action information for identifying the action of the user in the time period specified by the time included in the two or more pieces of action source information including the position information associated with the time, using the two or more pieces of action source information, wherein at least a part of the action information associated with each of the two or more time periods of the action management unit is action information in the time period acquired by the action estimation unit, according to the information processing apparatus of Claim 1 or Claim 2.

4. Emotion information for identifying emotion is associated with the action information of the action management unit, and the set determination unit determines the set of actions using the emotion information, according to the information processing apparatus of Claim 1 or Claim 2.

5. further comprising a query reception unit that receives a query including time and action information, and the keystone habit acquisition unit determines the time period and action information corresponding to the time and action information included in the query, which is action information for identifying the action that is the starting point of the set of actions determined by the set determination unit, and acquires keystone habit information including action information for identifying the action that is the starting point of the set of actions in the time period before the determined time period and closest to the determined time period, according to the information processing apparatus of Claim 1.

6. The keystone habit output unit outputs a recommendation including the keystone habit information, according to the information processing apparatus of Claim 1.

7. Emotion information for identifying emotion is associated with the action information of the action management unit, Obtain the emotional information corresponding to the action information included in the keystone habit information or the action information included in the query, and further include a recommendation acquisition unit that constructs a recommendation using the emotional information and the keystone habit information. The keystone habit output unit The information processing apparatus according to claim 5, which outputs the recommendation.

8. A set determination unit, a keystone habit acquisition unit, and a keystone habit output unit An information processing method realized by A set determination step in which the set determination unit refers to an action management unit that stores action information for specifying the actions of a single user in association with each of four or more time zones, and determines an action set that is a series of two or more action sets and satisfies the set conditions. A keystone habit acquisition step in which the keystone habit acquisition unit acquires keystone habit information including action information for specifying an action that is the starting point of the action set determined by the set determination unit. An information processing method including a keystone habit output step in which the keystone habit output unit outputs the keystone habit information.

9. A computer A set determination unit that refers to an action management unit that stores action information for specifying the actions of a single user in association with each of four or more time zones, and determines an action set that is a series of two or more action sets and satisfies the set conditions. A keystone habit acquisition unit that acquires keystone habit information including action information for specifying an action that is the starting point of the action set determined by the set determination unit. A program for causing the computer to function as a keystone habit output unit that outputs the keystone habit information.

Images