Information processing apparatus, information processing method, and recording medium
By obtaining sensor data of specific community members, we automatically generate behavior rules, and solve the problems of pre-determined behavior change stages and rules in the existing technology, and realize voluntary behavior change within the community.
Patent Information
- Application Number
- CN202410950982.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2018-01-23
- Filing Date
- 2018-10-30
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In the prior art, the stages and rules of behavior change are pre-determined, and the rules of community behavior cannot be automatically generated, and behavior rules cannot be generated for each specific community, resulting in the inability to effectively promote voluntary behavior change.
By obtaining sensor data of specific community members, behavior rules are automatically generated and using these rules to encourage community members to perform behavior changes, and voluntary behavior changes within the community are achieved.
It realizes the automatic generation of community behavior rules, promotes voluntary behavior changes within the community, and improves the efficiency of behavior changes for specific communities.
Smart Images

Figure CN118941413A_ABST
Abstract
Description
[0001] This application is a divisional application of the Chinese patent application with an application date of October 30, 2018, an international application number of PCT / JP2018 / 040269, an invention name of “Information processing device, information processing method and recording medium”, and an application number of 201880086792.5 that has entered the Chinese national phase. Technical Field
[0002] The present disclosure relates to an information processing device, an information processing method, and a recording medium. Background Art
[0003] Recently, an agent has been provided that recommends content and behavior corresponding to a user's question, request, and context by using a dedicated terminal such as a smart phone, a tablet terminal, or a home agent. Such an agent has been designed to improve the user's current short-term convenience and comfort. For example, when asking a question, an agent that answers the weather, sets an alarm, or manages a schedule is closed in a short session in which the response to the question or topic is direct and short-term (completed by request and response).
[0004] In contrast, there are the following existing techniques for promoting behavior change that approach solutions to issues step by step from a long-term perspective.
[0005] For example, the following patent document 1 discloses a behavior support system, which includes: a device for determining which behavior change stage an object corresponds to based on the behavior data of a target and an object in the fields of healthcare, education, rehabilitation, autism treatment, etc.; and a device for selecting an intervention method for performing behavior change on the object based on the determination.
[0006] In addition, the following patent document 2 discloses a support device for automatically determining a behavior change stage by an evaluation unit having an evaluation condition of an evaluation rule, the evaluation rule being automatically generated using data for learning. Specifically, the behavior change stage can be determined based on a conversation between a person in charge of metabolic syndrome guidance and a subject.
[0007] Reference List
[0008] Patent Literature
[0009] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2016-85703
[0010] Patent Document 2: Japanese Unexamined Patent Application Publication No. 2010-102643. Summary of the invention
[0011] Problems to be solved by the present invention
[0012] However, in each of the above prior art, the specific topic has been predetermined, and the topic itself has not yet been determined. In addition, the stage of behavior change has also been predetermined, and specific events can only be determined on a rule-based basis.
[0013] Furthermore, with respect to specific communities such as families, the smaller the group, the higher the likelihood that the behavioral rules differ between communities, but behavioral rules have not yet been generated for each specific community.
[0014] Therefore, the present disclosure proposes an information processing device, an information processing method, and a recording medium that can automatically generate behavioral rules for a community and promote voluntary behavioral changes.
[0015] Means of solving the problem
[0016] According to the present disclosure, an information processing device is proposed, which includes a controller, which acquires sensor data obtained by sensing members belonging to a specific community, automatically generates behavior rules in the specific community based on the acquired sensor data, and performs control to prompt members to perform behavior changes based on the behavior rules.
[0017] According to the present disclosure, there is provided an information processing device including a controller, which encourages members belonging to a specific community to perform behavioral changes based on the sensor data obtained by sensing the members belonging to the specific community, depending on behavioral rules that are automatically generated in advance based on sensor data obtained by sensing the members belonging to the specific community.
[0018] According to the present disclosure, there is provided an information processing method executed by a processor, the method comprising: acquiring sensor data obtained by sensing members belonging to a specific community, automatically generating behavior rules in the specific community based on the acquired sensor data, and executing control to prompt members to perform behavior changes based on the behavior rules.
[0019] According to the present disclosure, there is provided a recording medium having a program recorded therein, which enables a computer to be used as a controller for performing the following operations: acquiring sensor data obtained by sensing members belonging to a specific community, automatically generating behavior rules in the specific community based on the acquired sensor data, and performing control to prompt members to perform behavior changes based on the behavior rules.
[0020] According to the present disclosure, an information processing device is provided, comprising a circuit, wherein the circuit is configured to: acquire sensor data obtained by sensing members belonging to a specific community, automatically generate behavior rules in the specific community based on the acquired sensor data, set a target variable as the behavior rule, generate a relationship graph indicating the relationship between factor variables starting from the target variable, and indirectly prompt the members to perform behavior changes on the factor variables to be intervened in which the behavior change may be performed among the factor variables associated with the target variable.
[0021] According to the present disclosure, there is provided an information processing method performed by an information processing device, the method comprising: acquiring sensor data obtained by sensing members belonging to a specific community, automatically generating behavior rules in the specific community based on the acquired sensor data, setting a target variable as the behavior rule, generating a relationship graph indicating the relationship between factor variables starting from the target variable, and indirectly prompting the members to perform behavior changes on the factor variables to be intervened in which behavior changes may be made among the factor variables associated with the target variable.
[0022] According to the present disclosure, there are provided a computer-readable storage medium having stored thereon a program and a computer program product including the program, which, when executed by a computing device, causes the computing device to function as the above-mentioned information processing device.
[0023] Effects of the Invention
[0024] As described above, according to the present disclosure, behavioral rules for a community can be automatically generated and voluntary behavioral changes can be encouraged.
[0025] Note that the above effects are not necessarily limiting. With or in place of the above effects, any of the effects described in this specification or other effects that can be understood from this specification can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] [ Figure 1 ] Figure 1 : is a diagram illustrating an overview of an information processing system according to an embodiment of the present disclosure.
[0027] [ Figure 2 ] Figure 2 is a block diagram showing a configuration example of an information processing system according to an embodiment of the present disclosure.
[0028] [ Figure 3 ] Figure 3 is a flowchart of an operational process of an information processing system according to an embodiment of the present disclosure.
[0029] [ Figure 4 ] Figure 4 It is a diagram for explaining the outline of a master system according to a first working example of the present embodiment.
[0030] [ Figure 5 ] Figure 5 : is a block diagram showing a configuration example of a master system according to a first working example of the present embodiment.
[0031] [ Figure 6 ] Figure 6 : is a diagram showing an example of a topic index according to the first working example of the present embodiment.
[0032] [ Figure 7 ] Figure 7 is a diagram illustrating cause-effect analysis according to the first working example of the present embodiment.
[0033] [ Figure 8 ] Figure 8 is a diagram for explaining a causal path search based on a causal analysis result according to the first working example of the present embodiment.
[0034] [ Fig. 9 ] Fig. 9 : is a table of probability distribution between breakfast start time and reunion time period (hours / week) according to the first working example of the present embodiment.
[0035] [ Fig.10 ] Fig.10 is the probability distribution between the wake-up time and the breakfast start time according to the first working example of the present embodiment.
[0036] [ Fig.11 ] Fig.11 is a diagram illustrating a matrix operation for determining a probability distribution between a wake-up time and a reunion time period in a first working example according to the present embodiment.
[0037] [ Fig.12 ] Fig.12 is shown as Fig.11 The figure shows a table of probability distribution between wake-up times and reunion time periods obtained as a result of matrix operation.
[0038] [ Fig.13 ] Fig.13 It is a flowchart of the overall flow of the operation process according to the first working example of the present embodiment.
[0039] [ Fig.14 ] Fig.14 : is a flowchart of the topic estimation process according to the first working example of the present embodiment.
[0040] [ Fig.15 ] Fig.151 is a flowchart of the intervention reservation process according to the first working example of the present embodiment.
[0041] [ Fig.16 ] Fig.16 is a flowchart of the intervention process according to the first working example of the present embodiment.
[0042] [ Fig.17 ] Fig.17 is a diagram showing some examples of causal paths of value gaps according to the first working example of the present embodiment.
[0043] [ Fig.18 ] Fig.18 : is a block diagram showing a configuration example of a master system according to a second working example of the present embodiment.
[0044] [ Fig.19 ] Fig.19 1 is a basic flowchart of the operation process according to the second working example of the present embodiment.
[0045] [ Fig. 20 ] Fig. 20 It is a flowchart of the behavior change processing related to dining discipline according to the second working example of this embodiment.
[0046] [ Fig.21 ] Fig.21 1 is a flowchart of a behavior change process related to clearing away dishes according to a second working example of the present embodiment.
[0047] [ Fig. 22 ] Fig. 22 4 is a flowchart of a behavior change process related to desktop cleaning according to a second working example of the present embodiment.
[0048] [ Fig.23 ] Fig.23 1 is a flowchart of a behavior change process related to room tidying according to a second working example of the present embodiment.
[0049] [ Fig.24 ] Fig.24 It is an explanation that encourages Fig.23 A diagram of an example of an example behavior change presentation of information is shown.
[0050] [ Fig.25 ] Fig.25 4 is a flowchart of a behavior change process related to a crying baby according to a second working example of the present embodiment.
[0051] [ Fig.26 ] Fig.26 : is a flowchart of the behavior change process related to the toy according to the second working example of the present embodiment.
[0052] [ Fig. 27 ] Fig. 27 4 is a flowchart of a behavior change process related to common values according to a second working example of the present embodiment.
[0053] [ Fig.28 ] Fig.28 : is a table of calculation examples for each candidate of the common value value according to the second working example of the present embodiment.
[0054] [ Fig.29 ] Fig.29 : is a block diagram showing a configuration example of a master system according to a third working example of the present embodiment.
[0055] [ Fig.30 ] Fig.30 is a graph showing an example of food records according to the third working example of the present embodiment.
[0056] [ Fig.31 ] Fig.31 2 is a diagram illustrating the deviation of the rhythm of life according to the third working example of the present embodiment.
[0057] [ Fig.32 ] Fig.32 1. It is a flowchart of the operation process of generating the rhythm of dinner time according to the third working example of the present embodiment.
[0058] [ Fig.33 ] Fig.33 : is a diagram showing an example of a formula for calculating the cumulative average time for each day of the week according to the third working example of the present embodiment.
[0059] [ Fig.34 ] Fig.34 It is a flowchart of generating advice based on life rhythm according to the third working example of this embodiment.
[0060] [ Fig.35 ] Fig.35 It is a flowchart for prompting adjustment of the rhythm of life (behavior change) according to the overlap of events according to a modification of the third working example of the present embodiment.
[0061] [ Fig.36 ] Fig.36 is a block diagram showing an example of the hardware configuration of the information processing apparatus according to the present embodiment. DETAILED DESCRIPTION
[0062] Preferred embodiments of the present disclosure are described in detail below with reference to the accompanying drawings. It should be noted that in the present specification and the drawings, components having substantially the same functional configuration are indicated by the same reference numerals, and thus redundant descriptions thereof are omitted.
[0063] It should be noted that the description is given in the following order.
[0064] 1. Overview of Information Processing System According to Embodiments of the Present Disclosure
[0065] 2. First working example (estimating issues and behavior change)
[0066] 2-1. Configuration example
[0067] 2-2. Operation Process
[0068] 2-3. Supplement
[0069] 3. Second working example (generating value standards and behavior changes)
[0070] 3-1. Configuration example
[0071] 3-2. Operation Process
[0072] 4. The third work example (adjustment of life rhythm)
[0073] 4-1. Configuration example
[0074] 4-2. Operation Process
[0075] 4-3. Modification Example
[0076] 5. Hardware Configuration Example
[0077] 6. Conclusion
[0078] [1. Overview of information processing system according to an embodiment of the present disclosure]
[0079] Figure 1 1 is a diagram for explaining an overview of an information processing system according to an embodiment of the present disclosure. Figure 1 As shown, in the information processing system according to the present embodiment, there are master systems 10A to 10C, each of which promotes behavior change according to predetermined behavior rules for a corresponding community among communities 2A to 2C such as a family through a virtual agent (playing the role of a master of a specific community (hereinafter referred to as a "master" in this specification)). Figure 1In FIG. 1 , the master systems 10A to 10C are all shown as people. The master systems 10A to 10C can automatically generate behavioral rules based on the behavioral records of each user in a specific community, and indirectly promote behavioral changes based on the behavioral rules, thereby performing community issue resolution, etc. For users, while taking actions according to the words of the master, issues in the community can be resolved without knowing the behavioral rules (issues or value standards), and value standards can be adjusted before anyone knows, which allows the situation of the community to be improved.
[0080] [background]
[0081] As described above, in each existing master system, a specific topic has been predetermined, and the topic itself has not yet been determined. In addition, although the existing master systems are all closed in a short session completed by request and response, there are many topics in which multiple factors are complexly intertwined in real life and these topics cannot be solved directly or in a short period of time.
[0082] The content of the issue and the solution are different, for example, it is believed that in the case of family issues, the severity of the issue and the solution may vary depending on the behavioral rules and the treatment environment. Therefore, it is important to analyze the relationship between multiple factors to explore long-term rather than short-term solutions and explore where to intervene. Taking behavioral rules as an example, in a specific community such as a family, the smaller the group, the higher the possibility that the behavioral rules are different in the community, and the greater the possibility that each community has a unique "moral". Therefore, it is impossible to limit behavioral rules to a general purpose object, nor can the entire big data collected be used as a standard; therefore, it is important to collect data focusing on a specific community such as a family and clarify the behavioral rules in that specific community.
[0083] Therefore, if Figure 1 As shown, the present embodiment provides a master system 10 that can automatically generate behavioral rules for each specific community and promote voluntary behavioral changes.
[0084] Figure 2 1 is a block diagram showing a configuration example of an information processing system (master system 10) according to an embodiment of the present disclosure. Figure 2 As shown, the guru system 10 according to the present embodiment includes a data analyzer 11, a behavior rule generator 12 and a behavior change instruction unit 13. The guru system 10 may be a server on a network, or may be a client device including: a dedicated terminal such as a home agent; a smart phone; a tablet, etc.
[0085] The data analyzer 11 analyzes sensing data obtained by sensing the behavior of users belonging to a specific community such as a family.
[0086] The behavior rule generator 12 generates behavior rules for a specific community based on the analysis results obtained by the data analyzer 11. Here, "behavior rules" include means for solving issues that a specific community has (for example, estimating issues with short reunion time periods, and automatically generating behavior rules that increase the reunion time periods), or generating (estimating) value standards in a specific community.
[0087] The behavior change instruction section 13 controls notifications and the like that urge users of a specific community to perform behavior changes according to the behavior rules generated by the behavior rule generator 12 .
[0088] The operation process of the master system 10 having such a configuration is as follows Figure 3 As shown. Figure 3 As shown, first, the master system 10 collects sensor data of a specific community (step S103), and the sensor data is analyzed by the data analyzer 11 (step S106).
[0089] Next, the behavior rule generator 12 generates behavior rules for a specific community based on the analysis results obtained by the data analyzer 11 (step S109), and when the behavior rule generator 12 has been able to generate behavior rules (step S109 / yes), accumulates information of behavior rule data (step S112).
[0090] Then, the behavior change instruction unit 13 determines the event to be intervened that can be used for behavior change based on the behavior rule (step S115 / yes). For example, an event (getting up time, exercise frequency, etc. or life rhythm) that can be used for behavior change to achieve the behavior rule or a situation that deviates from the value standard is determined as the event to be intervened.
[0091] Thereafter, when an event to be intervened that can be changed in behavior is found (step S115 / yes), the behavior change instruction unit 13 indirectly prompts the users in the specific community to perform behavior change (step S118). Specifically, the behavior change instruction unit 13 indirectly prompts a change in behavior, an adjustment of the rhythm of life, or a behavior that resolves deviations from value standards. By automatically generating behavior rules and indirectly prompting behavior changes, each user in a specific community can act according to the master without knowing the behavior rules (issues or value standards) to resolve issues in the specific community, and act according to the value standards without anyone knowing, which can improve the situation of the specific community.
[0092] The overview of the information processing system according to the embodiment of the present disclosure has been described above. It should be noted that the configuration of the present embodiment is not limited to Figure 2Example shown. For example, in a case where there are already behavioral rules in a specific community that are automatically generated in advance based on sensor data obtained by sensing members belonging to the specific community, an information processing device can be used that performs control to encourage the member to perform behavioral changes (behavior change instruction unit 13) based on sensor data (data analyzer 11) obtained by sensing members belonging to the specific community. Next, the information processing system according to the present embodiment will be described in detail with reference to the first to third working examples. The first working example describes performing "analysis of means for solving the estimated issue" to generate behavioral rules, and indirectly prompting behavioral changes to solve the issue. In addition, the second working example describes performing "generation of value standards" to generate behavioral rules, and indirectly prompting behavioral changes in the event of deviation from the value standards. In addition, the third working example describes adjusting the pace of life as a behavioral change for solving the issue estimated in the first working example.
[0093] [2. First working example (estimation of issues and behavior change)]
[0094] First, refer to Figures 4 to 17 , the master system 10-1 according to the first working example will be described. In the present embodiment, daily data collection and daily analysis (contingent analysis) are performed on small communities such as those based on families to identify issues arising in the family and to perform interventions that prompt behavioral changes to solve the issues in the long term. That is, the family's issues are estimated based on the family data collected daily, the target variable is automatically generated as a behavioral rule for solving the issue (e.g., "(increase) reunion time period"), a relationship diagram of factor variables starting from the target variable is created, the intervention point (i.e., the point at which the behavior change is prompted so that the target variable has an expected value) is detected (e.g., "late-night drinking amount" or "exercise intensity"; factor variables) and intervened at the intervention point, and the family's issues are guided to long-term solutions (e.g., members are prompted to perform behavioral changes so that the factor variables associated with the target variable are close to the expected value). For the analysis algorithm, the causal analysis algorithm CALC (registered trademark) provided by Sony Computer Science Laboratories, Inc. can be used; therefore, complex causal relationships between many variables can be analyzed.
[0095] Figure 4 1 is a diagram for explaining the outline of the first working example. The first working example is generally performed by Figure 4The process shown in is executed. That is, A: perform daily behavior monitoring, B: perform issue estimation, C: automatically set the issue as the target variable of causal analysis, and D: perform intervention (promote behavior change) at the point and timing where intervention is possible. By repeating the process from A to D on a daily basis, behavior change is performed and issues in a specific community are gradually resolved.
[0096] [A: Daily behavior monitoring]
[0097] In this embodiment, as the number of pieces of information that can be sensed increases, a wider range of data can be used for analysis. The data to be analyzed is not limited to a specific type of data. For example, in the prior art, the data to be analyzed is predetermined by limiting the application. However, this is not necessary in this embodiment, and the types of data that may be acquired can be increased as appropriate (registered in the database as appropriate).
[0098] [B: Topic Estimate]
[0099] In this embodiment, an index list (e.g., an index list related to family intimacy) may be used to estimate topics, which describes the relationship between an index of topics that may be related to a family as an example of a specific community and an index of a sensor or a behavior history required to calculate the index. Specifically, the value of each sensor / behavior history index is checked to determine whether an index that may be a topic (e.g., "family reunion time period") is below (or above) a threshold. The number of times the process is performed is the same as the number of items in the list, so that topics held by the family can be listed.
[0100] [C: Automatically set the topic as the target variable for causal analysis]
[0101] Causal analysis is performed using the detected topic as the target variable and other sensor / behavior history information as explanatory variables. In this case, not only the index related to the topic in the index list can be entered, but also other indexes can be entered as explanatory variables. In the case of multiple topics, these topics are analyzed multiple times individually as target variables.
[0102] [D: Master intervention at the point and timing where intervention is possible]
[0103] The result obtained by the analysis has a graphical structure in which a factor directly related to the target variable is coupled to the target variable, and another factor is also coupled to the factor. By tracing the graph from the target variable as the starting point, the causal relationship can be traced and checked in the direction from the result to the cause. At this time, each factor has a flag indicating whether each factor is an interveneable factor (e.g., the time to get up), and if it can be intervened, the master intervenes in the factor to promote behavioral changes to improve the results. As a method of promoting behavioral changes, in addition to the method of directly issuing instructions to the user, indirect intervention can also be performed, for example, playing relaxing music and setting the time to get up to the optimal time.
[0104] [2-1. Configuration example]
[0105] Figure 5 1 is a block diagram showing a configuration example of the master system 10-1 of the first working example. Figure 5 As shown, the master system 10 - 1 includes an information processing device 20 , an environment sensor 30 , a user sensor 32 , a service server 34 , and an output device 36 .
[0106] [Sensor Group]
[0107] The environment sensor 30 , the user sensor 32 , and the service server 34 are examples from which information on users (members) belonging to a specific community is acquired, and the present embodiment is not limited thereto and is not limited to a configuration including all of the above devices.
[0108] For example, the environment sensor 30 includes a camera installed in the room, a microphone (hereinafter referred to as a microphone), a distance sensor, an illumination sensor, various sensors provided on the environment side, for example, a pressure / vibration sensor installed on a table or a chair, a bed, etc. The environment sensor 30 performs detection based on each community, and determines the amount of smile using, for example, a fixed camera in a living room, which makes it possible to obtain the amount of smile under a single condition at home.
[0109] The user sensor 32 includes various sensors, for example, acceleration sensors, gyroscope sensors, geomagnetic sensors, position sensors, biosensors such as heart rate and body temperature, cameras and microphones provided in smart phones, mobile phone terminals, tablet terminals, wearable devices (HMD, smart glasses, smart belts, etc.), etc.
[0110] It is assumed that the service server 34 is an SNS server, location information acquisition server, and e-commerce server (e.g., an e-commerce site) used by users belonging to a specific community, and that the service server 34 can obtain user-related information (information related to user behavior, etc., such as movement history and shopping history) from the network in addition to information obtained by sensors.
[0111] [Information processing device 20]
[0112] The information processing device 20 (causal analysis server) includes a receiver 201, a transmitter 203, an image processor 210, a voice processor 212, a sensor / behavior data processor 214, a factor variable DB (database) 220, an intervention device DB 224, an intervention rule DB 226, an intervention reservation DB 228, an issue index DB 222, an issue estimation section 230, a causal analyzer 232, and an intervention section 235. The image processor 210, the voice processor 212, the sensor / behavior data processor 214, the issue estimation section 230, the causal analyzer 232, and the intervention section 235 can be controlled by a controller provided on the information processing device 20. The controller functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing device 20 according to various programs. For example, the controller is implemented by an electronic circuit such as a CPU (central processing unit) or a microprocessor. In addition, the controller may include: a ROM (read only memory) which stores programs to be used, operating parameters, etc.; and a RAM (random access memory) which temporarily stores parameters, etc. that are appropriately changed.
[0113] The information processing device 20 may be a cloud server on a network, may be an intermediate server or an edge server, may be a dedicated terminal located at home such as a home agent, or may be an information processing terminal such as a PC or a smart phone.
[0114] - Receiver 201 and transmitter 203
[0115] The receiver 201 acquires sensor information and behavior data of each user belonging to a specific community from the environment sensor 30, the user sensor 32, and the service server 34. The transmitter 203 transmits a control signal to the output device 36, which issues an instruction for output control for indirectly causing a behavior change according to the processing performed by the intervention part 235.
[0116] The receiver 201 and the transmitter 203 are configured by a communication section (not shown) provided in the information processing apparatus 20. The communication section is coupled to external devices such as the environment sensor 30, the user sensor 32, the service server 34, and the output device 36 by wire or radio, and transmits and receives data. For example, the communication section communicates with the external device through a wired / wireless LAN (Local Area Network) or Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution)), 3G (third generation mobile communication system), etc.
[0117] -Data Processor
[0118] Various sensor information and behavior data of users belonging to a specific community are appropriately processed by the image processor 210, the voice processor 212, and the sensor / behavior data processor 214. Specifically, the image processor 210 performs person recognition, expression recognition, object recognition, etc. based on the image captured by the camera. In addition, the voice processor 212 performs conversation recognition, speaker recognition, affirmative / negative recognition of conversations, emotion recognition, etc. based on the voice collected by the microphone. In addition, the sensor / behavior data processor 214 performs processing such as converting raw data into meaningful tags by performing processing instead of recording the raw data as it is according to the sensor (for example, converting the raw data into a sitting time period based on a chair vibration sensor). In addition, the sensor / behavior data processor 214 extracts user behavior contexts indicating where and what is being done (for example, eating in a restaurant with family) from SNS information and location information (for example, GPS). In addition, the sensor / behavior data processor 214 is also able to extract positive / negative emotions from sentences posted to SNS, and extract information such as who the user is with and who the user agrees with from the interaction information between users.
[0119] The data processed in this way is stored in the factor variable DB 220 as a variable for topic estimation and causal analysis. Hereinafter, the variables stored in the factor variable DB 220 are all referred to as "factor variables". Examples of factor variables may include the types indicated in Table 1 below; however, the types of factor variables according to the present embodiment are not limited thereto, and any available index may be used.
[0120] [Table 1]
[0121]
[0122]
[0123] - Topic Estimation Department 230
[0124] The topic estimation section 230 checks the values of factor variables associated with respective topic indexes registered in the topic index DB 222, and determines whether an topic (estimated topic) has occurred. Figure 6 An example of a topic index according to this embodiment is shown. Figure 6 As shown in , for example, as topic indexes related to family intimacy, "time period for talking with daughter", "time period for family reunion", "time period for children's rebellion", and "time period for quarrels between husband and wife" are pre-set. Examples of factor variables for each topic index include: Figure 6 Items shown. In addition, the topic index DB 222 is also associated with conditions for determining the existence of topics based on factor variables. For example, based on the time period when the family sits together at the table, the time period of active conversation, the amount of smiles, etc., more specifically, the topic of "family reunion time period" is determined based on the following conditions: "The conversation time period per week is 3 hours or less", "All members eat breakfast together on weekdays for 2 days or less per week", "The percentage of active conversation in the entire conversation content is 30% or less", etc.
[0125] The topic estimation unit 230 can determine that a topic exists when all conditions presented in the topic index are met, or can determine that a topic exists when any one condition is met. In addition, it is allowed to pre-set whether to consider that a topic exists when all conditions are met or when any one condition is met. It is also allowed to set a flag that sets complex conditions for each topic. The factor variables used here are pre-written based on the rules associated with people for each topic index.
[0126] -Causal Analyzer 232
[0127] In the case where the topic estimation unit 230 estimates the topic (determines that the topic has occurred), the causal analyzer 232 performs causal analysis on the topic. In the past, the estimation of statistical causal relationships based on observation data in multivariate random variables was roughly divided into: a method of obtaining an estimation result obtained by an information criterion, a penalized maximum likelihood method, or a Bayesian method as a score and maximizing the score; and a method of performing estimation by a statistical test of conditional independence between variables. Due to the readability of the results, a presentation in which the causal relationship between the obtained variables is represented as a graphical model (acyclic model) is often performed. There is no particular limitation on the causal analysis algorithm, and for example, the CALC provided by Sony Computer Science Laboratories, Ltd. mentioned above can be used. CALC is a technology that has been commercialized as an analysis technology for causal relationships in large-scale data (https: / / www.isid.co.jp / news / release / 2017 / 0530.html, https: / / www.isid.co.jp / solution / calc.html).
[0128] Specifically, the causal analyzer 232 sets the topic as the target variable, and sets all or some of the remaining factor variables (basically it is best to include all factor variables, but due to limitations on computing time or memory, for example, by giving priority to factor variables with a larger number of data or giving priority to factor variables with a larger amount of data recently acquired) as explanatory variables, and performs causal analysis. Figure 7 It is a diagram for explaining the cause-effect analysis according to this embodiment.
[0129] like Figure 7 As shown, in the case of estimating the topic "reunion time period", the topic is set as the target variable. Note that in the case where it is impossible to directly set the variables stored in the factor variable DB 220 as the target variable, the target variable can be created dynamically. For example, since it is impossible to directly sense the "reunion time period", the target variable is generated by combining other variables. Specifically, variables such as the time period when all family members sit at the table at the same time, the time period when active conversations are conducted, and the time period when the percentage of the degree of smile is greater than or equal to a specific value are combined to derive the total time period of happy reunion, the quality of reunion, etc. as the target variable. The rules for combining variables can be pre-stored in the information processing device 20 as a knowledge base or can be automatically extracted.
[0130] The cause-and-effect analyzer 232 outputs the analysis result to the intervention unit 235 .
[0131] -Intervention Department 235
[0132] The intervention unit 235 checks the causal analysis results, traces the arrow backward from the factor variable directly connected to the target variable, and extracts multiple causal paths backward until there are no more arrows to trace. It should be noted that, depending on the analysis method to be used, the arrow does not necessarily have to exist, and in some cases, a simple straight line can be used as a link. In this case, for convenience, the direction of the arrow is determined by utilizing the characteristics of the causal analysis technology to be used. For example, it can be processed by assuming that there is a convenient arrow, the direction of which is from the factor variable that is farther away from the target variable (how many factor variables are there in between) toward the factor variable that is closer to the target variable. In the case where the factor variables at the same distance from the target variable are coupled by a straight line, the convenient direction is determined by considering the characteristics of the method used in a similar manner.
[0133] here, Figure 8 FIG. 4 is a diagram for explaining the causal path search based on the causal analysis result of this embodiment. Figure 8 As shown, for example, the intervention unit 235 uses the "reunion time period" as the starting point to trace the causal path (arrow 2105) coupled to the "reunion time period" (target variable 2001) in the backward direction (arrow 2200), and also traces the causal path (arrow 2104) coupled to the destination factor variable 2002 in the backward direction (arrow 2201), and continues this causal path search until there are no more arrows to trace. That is, the causal paths are traced in sequence in the backward direction (arrows 2200 to 2205). Figure 8 The arrows 2105 to 2100 of the causal path shown in FIG. 2105 are the arrows 2105 to 2100 of the causal path shown in FIG. 2105. At the point in time when there are no more arrows to be traced in the backward direction (at the point in time when the arrows assigned to Figure 8 At the time point of the factor variable 2007 of the mark 2300 shown in FIG. 2007 , the search for the path is terminated. Figure 8 In the example, a causal path including factor variables can be extracted: "Exercise intensity → amount of stress → amount of alcohol consumed after 22:00 → sleep quality → wake-up time → family breakfast start time → reunion time period"; however, in the causal path search, the intervention unit 235 traces the arrow of this causal path backwards with "reunion time period" as the starting point, and checks the relationship between a specific factor variable upstream and the next factor variable.
[0134] For example, the intervention unit 235 checks the "reunion time period", "family breakfast start time", "(own = father's) wake-up time" in terms of probability distribution, and calculates the upstream factor variable that maximizes the expected value in order to make the value of the target variable within the target range. Figures 9 to 14 Describe the calculation of expected values by probability distribution calculation between these factor variables. Fig. 9 It is the probability distribution table between breakfast start time and reunion time period (hours / week). Fig. 9 The table in indicates that when breakfast starts between 7:30 and 8:00, the expected value of the reunion time period is the highest. Specifically, the reunion time period of the target variable (because the reunion time period has a width, the median such as 0.5, 1.5, 2.5, 3.5, 5.0 and 6.0 is used as a representative value) is multiplied with each probability (0.000, 0.029, 0.124, 0.141, 0.284 and 0.442) in turn, and the sum becomes the expected value of the reunion. In this example, 4.92 hours is the expected value. The expected value is determined by calculating other time slots in a similar manner, and the result is that the reunion time period is the longest when breakfast starts between 7:30 and 8:00.
[0135] Fig.10 is the probability distribution between the wake-up time and the breakfast start time. Fig.10 From the table in , it can be understood that when getting up between 7:00 and 7:30, the breakfast start time is most likely between 7:30 and 8:00. It should be noted that the probability distribution between two coupled adjacent factor variables can be determined by cross-tabulating the original data.
[0136] Fig.11 is a diagram showing a matrix operation for determining the probability distribution between the wake-up time and the reunion time period. Fig. 9 The table in is denoted by A and Fig.10 In the case where the table in is represented by B, it can be Fig.11 The matrix operations shown in determine the probability distribution between the wake-up time and the reunion time period.
[0137] Fig.12 is shown as Fig.11 The table of probability distribution between the wake-up time and the reunion time period obtained as a result of the matrix operation shown in FIG. Fig.12 As shown, when getting up between 7:00 and 7:30, the probability of the reunion time period being more than 6 hours is 24.3%, and the probability of the reunion time period being more than 3 hours is about 70%. In contrast, when getting up at 8:30 or later, the rate of the reunion time period being two hours or less is about 81%.
[0138] Therefore, by repeating the multiplication of the conditional probability table upstream, it is possible to find out which value each factor variable of the causal path ultimately takes when the value of the target variable becomes the maximum target value.
[0139] It should be noted that, as an analysis method other than CALC, for example, a relationship analysis method for representing variables with probability called a Bayesian network can also be used. In the case of applying this method, the arrows (or line segments) of the variables (nodes) and the coupled variables (nodes) do not represent a causal relationship, but the coupled variables are related to each other, so the present embodiment can be applied as a convenient causal relationship. In the present embodiment, even if the term "causal relationship" is not used, the relationship between the variables can be regarded as a causal relationship for convenience and the relationship can be applied as a causal relationship.
[0140] Then, the intervention part 235 searches for a factor variable having an intervention available flag in the causal path, and acquires an intervention method for the factor variable from the intervention rule DB 226. When the factor variable is stored in the database, the factor variable is set with a flag indicating intervention availability. The flag may be set in advance by a person, or may be set in advance to be intervention available for the original sensor data, and if at least one sensor data having an intervention available flag is included when generating the factor variable, the factor variable may also be intervention available. Figure 8 In the example shown, for example, factor variable 2003 (getting up time), factor variable 2005 (amount of drinking after 22:00), and factor variable 2007 (exercise intensity) are respectively set with intervention available flags. For example, regarding the getting up time, intervention can be performed through the alarm setting of the wearable device; therefore, the getting up time is registered in the database in a state where it is provided with the intervention available flag. As described above, in the present embodiment, intervention available points can be extracted from the factor variables on the way of tracing the causal path backward from the target variable, and indirect behavior change (intervention) can be performed. Here, some examples of intervention rules registered in the intervention rule DB 226 are shown in Table 2 below.
[0141] [Table 2]
[0142]
[0143]
[0144] It should be noted that in practice the number of factor variables and the number of intervention methods are not infinite, and the intervention rules are arranged as a certain degree of pattern, so they can be shared by all agents in the cloud. However, the parameters set during the intervention (wake-up time and target exercise intensity) may vary according to individuals and families.
[0145] After acquiring the intervention method, the intervention part 235 searches for a device having the target device capability in the intervention device DB 224. Devices available to a user or a home are registered in the intervention device DB 224. Here, some examples of the intervention devices are indicated in Table 3 below.
[0146] [Table 3]
[0147]
[0148] When the intervention part 235 finds a suitable device for intervention, the intervention part 235 registers the device ID, trigger condition, intervention command, and parameter in the intervention reservation DB 228. Some examples of intervention reservation are indicated in Table 4 below.
[0149] [Table 4]
[0150]
[0151] Then, if the condition is satisfied, the intervention section 235 transmits the command and the parameter from the transmitter 203 to the specific device based on the reservation data registered in the intervention reservation DB 228 .
[0152] [Output device 36]
[0153] The output device 36 is a device that urges users belonging to a specific community to indirectly perform behavioral changes to solve the issue according to the control of the intervention unit 235. For example, the output device 36 can widely include IoT devices such as smartphones, tablet terminals, mobile phone terminals, PCs, wearable devices, televisions, lighting equipment, speakers, and desk clocks.
[0154] In the case where the output device 36 has received a command from the information processing apparatus 20, the intervention operation is performed in the expression method of the device. For example, when the information processing device 20 sends a sound and vibration command together with the set time to a smart phone, the corresponding application on the smart phone sets the alarm at that time. Alternatively, when the information processing device 20 issues a command to the corresponding smart speaker, the speaker plays music at the specified time. In addition, when the information processing device 20 sends a coupon to the smart phone, a push notification is displayed, and the coupon is displayed in the browser. In addition, when the information processing device 20 performs sending to a PC, etc., the PC can automatically perform conversion into an email and perform notification to the user. In this way, the display method is converted into a display method suitable for each output device 36, and the converted display method is output, which makes it possible to use any device without relying on a specific model or device.
[0155] [2-2. Operation Process]
[0156] Next, the processing performed by the above-mentioned respective configurations will be described with reference to flowcharts.
[0157] [2-2-1. Overall process]
[0158] Fig.13: is a flowchart showing the overall flow of the operation process of the first working example. Fig.13 As shown, first, the information processing device 20 inputs data from the sensor group (step S103).
[0159] Subsequently, factor variables are generated at the image processor 210, the voice processor 212, or the sensor / behavior data processor 214 according to the type of sensor (step S106).
[0160] Next, it is determined whether there is any intervention appointment that satisfies the intervention condition (step S109). If there is no intervention appointment that satisfies the intervention condition, an agenda estimation process is performed (step S112), and if there is any intervention appointment that satisfies the intervention condition, an intervention operation process is performed (step S133). It should be noted that the timing for executing step S109 is not limited to this timing, and may be different from the timing of step S109. Fig.13 The processing shown is performed in parallel. Fig.14 The flow of the topic estimation process is shown in . Fig.16 The flow of interventional operation processing is shown in FIG.
[0161] Then, if an issue is estimated (step S115 / Yes), the causal analyzer 232 sets the issue as a target variable (step S118 ) and performs causal analysis (step S121 ).
[0162] Next, the intervention part 235 extracts intervention-available (behavior change-available) points (causal variables, events) from the causal variables included in the causal path (step S124 ).
[0163] Then, if an intervention available point is found (step S127 / Yes), the intervention unit 235 determines the intervention behavior and adds an intervention reservation (step S130). Fig.15 The process from extraction of intervention points to addition of intervention appointments is described in more detail.
[0164] [2-2-2. Issue estimation and processing]
[0165] Fig.14 is a flowchart of the issue estimation process. Fig.14 As shown, first, the topic estimation unit 230 clears the topic list (step S143), and obtains the topic index from the topic index DB 222 (see Figure 6 )(Step S146).
[0166] Next, the topic estimation section 230 selects an unprocessed topic from the acquired topic indexes (step S149).
[0167] Thereafter, the topic estimation unit 230 selects an unprocessed factor variable from the topic factor variable list (see Figure 6 ) (step S152), and checks the value of the selected factor variable (step S155). In other words, the topic estimation section 230 determines whether the value of the selected factor variable satisfies the condition for determining the existence of the topic associated with the topic index (see Figure 6 ).
[0168] Next, if it is determined that there is an issue (step S158 / Yes), the issue estimation section 230 adds the issue to the issue list (step S161).
[0169] Thereafter, the agenda estimation section 230 repeats the above-described steps S152 to S161 until the agenda estimation section 230 checks all values of the factor variables listed in the factor variable list of the agenda (step S164).
[0170] In addition, when all topics listed in the topic index have been checked (step S167 / No), if there is a topic in the topic list (step S170 / Yes), the topic estimation unit 230 returns the topic list (to the causal analyzer 232) (step S176). On the contrary, if there is no topic in the topic list (step S170 / No), the process returns to the state that there is no topic (to the causal analyzer 232) (step S176). Fig.13 (Step S115 shown) (Step S179).
[0171] [2-2-3. Intervention appointment processing]
[0172] Fig.15 is a flowchart of the intervention appointment process. Fig.15 As shown, first, the intervention section 235 sets the target variable (issue) of the analysis result obtained by the causal analyzer 232 as the starting point of causal path generation (step S183).
[0173] Next, the intervention unit 235 traces all arrows backward from the starting point, and repeats until reaching the factor variable at the end, thereby generating all causal paths (step S186 ).
[0174] Thereafter, the intervention unit 235 generates a probability distribution table between two factor variables coupled to each other on the causal path (step S189 ).
[0175] Next, the intervention unit 235 multiplies the matrix while tracing the probability distribution table upstream of the causal path to determine the probability distribution between the target variable and the factor variables that are not immediately adjacent to the target variable (step S192).
[0176] Thereafter, the intervention unit 235 checks whether there is a factor variable with an intervention available flag (step S195), and if there is a factor variable with an intervention available flag, the intervention unit 235 obtains the intervention method from the intervention rule DB 226 (step S198). Note that the intervention unit 235 can also determine whether to intervene in the factor variable with intervention available. For example, in the case where the "wake-up time" has an intervention available flag, and in order to make the target variable ("reunion time period") within the target range (for example, "3 hours or more") (to solve the issue of less "reunion time period"), the "wake-up time" is set to 7:30, the intervention unit 235 obtains the user's usual wake-up time trend, and, in the case where the user tends to get up at 9:00, the intervention unit 235 determines that "intervention should be performed" to wake up the user at 7:30.
[0177] Next, a device having the capability necessary for intervention is retrieved from the intervention device DB (step S201), and if a corresponding device is found (step S204 / Yes), the intervention conditions and commands / parameters are registered in the intervention reservation DB 228 (step S207). For example, if the wake-up function of the user's smartphone can be controlled, an intervention reservation such as "setting the alarm of the user's smartphone at 7:00" is performed.
[0178] [2-2-4. Intervention treatment]
[0179] Fig.16 is a flow chart of the intervention process performed by the output device 36. Fig.16 As shown, the output device 36 waits for a command to be received from the intervening section 235 of the information processing apparatus 20 (step S213).
[0180] Thereafter, the output device 36 parses the received command and parameter (step S216 ), and selects a presentation method corresponding to the command (step S219 ).
[0181] Then, the output device 36 executes the command (step S222).
[0182] [2-3.Supplement]
[0183] In the first working example described above, topics related to family intimacy are used as examples, but the present embodiment is not limited thereto, and, for example, there may be a "value gap." As a relationship between factors for detecting the occurrence of a value gap (estimated topic), for example, the items shown in Table 5 below can be given.
[0184] [Table 5]
[0185]
[0186] The "item separation line segment" in Table 5 above has the following characteristics: when comparing an image of a messy room with an image of a tidy room, the density of contour lines is low and a single contour line is long. Therefore, in the image analysis of each user's room or living room, for example, the degree of clutter can be calculated based on the item separation line segment.
[0187] Fig.17 is a diagram showing some examples of causal paths for value gaps. Fig.17 As shown, when causal analysis is performed by setting "value gap" in target variable 2011, for example, causal variable 2013 "room cleanliness rate", causal variable 2014 "time period until opening mail", causal variable 2015 "percentage of time period at home every day", causal variable 2016 "number of times of drinking per month", and causal variable 2017 "number of times of playing golf per month" appear on the causal path.
[0188] As the intervention method in this case, for example, the items indicated in the following Table 6 can be given.
[0189] [Table 6]
[0190]
[0191]
[0192] In this way, for example, the intervention unit 235 notifies the user to reduce the number of times he drinks and plays golf, thereby increasing the time period at home, increasing the "room cleanliness rate" associated with the time period at home, and eliminating family value gaps (e.g., a single member's room is more messy).
[0193] [3. Second working example (generating value standards and behavioral changes)]
[0194] Next, refer to Figures 18 to 28 , a master system 10 - 2 according to a second working example will be described.
[0195] In this embodiment, for example, based on data collected from a specific community such as a family or a small-scale group (a company, school, town association, etc.), values (value standards) to become standards in the community are automatically generated as behavioral rules, and members who have deviated from the value standards (to a certain extent or a higher degree) are indirectly prompted to perform behavioral changes (i.e., behaviors that are close to the value standards).
[0196] Fig.18 is a block diagram showing a configuration example of a master system 10-2 according to the second working example. Fig.18As shown, the master system 10 - 2 includes an information processing device 50 , a sensor 60 (or a sensor system), and an output device 62 (or an output system).
[0197] [Sensor 60]
[0198] The sensor 60 is similar to the sensor group according to the first working example, and is a device / system that obtains every piece of information about the user. For example, it includes: environmental sensors (e.g., cameras and microphones) installed in the room and various user sensors (e.g., motion sensors (acceleration sensors, gyroscope sensors, or geomagnetic sensors)), biosensors, position sensors, cameras, microphones, etc. installed in smart phones or wearable devices owned by users. In addition, the user's behavior history (mobile history, SNS, shopping history, etc.) can be obtained from the network. The sensor 60 senses the behavior of members in a specific community on a daily basis, and the information processing device 50 collects the sensed behavior.
[0199] [Output device 62]
[0200] The output device 62 is an expression device that prompts behavioral changes, and similar to the first working example, the output device 62 widely includes IoT devices such as: for example, smart phones, tablet terminals, mobile phone terminals, PCs, wearable devices, televisions, lighting devices, speakers, and vibration devices.
[0201] [Information processing device 50]
[0202] The information processing device 50 (value presentation server) includes a communication unit 510, a controller 500, and a storage device 520. The information processing device 50 may be a cloud server on a network, an intermediate server or an edge server, a dedicated terminal located at home such as a home agent, or an information processing terminal such as a PC or a smartphone.
[0203] -Controller 500
[0204] The controller 500 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing device 50 according to various programs. For example, the controller is implemented by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor. In addition, the controller 500 may include a ROM (Read Only Memory) that stores programs to be used, operating parameters, etc., and a RAM (Random Access Memory) that temporarily stores appropriately changing parameters, etc.
[0205] Furthermore, the controller 500 according to the present embodiment may also function as the user management section 501 , the value estimation section 502 , the value comparison section 503 , and the presentation section 504 .
[0206] The user management unit 501 appropriately manages information for identifying users and values of each user with respect to target behaviors / items and stores them in the storage device 520. Various indexes are assumed for values, and some examples of values used in this embodiment are indicated in the following Table 7. In addition, in this embodiment, the behaviors to be sensed (necessary data) for estimating each value can be predefined as follows.
[0207] [Table 7]
[0208]
[0209]
[0210] The value estimation unit 502 automatically estimates (generates) and accumulates the value standards (hereinafter, also referred to as standard values) determined in the group (specific community) of the target behavior / item in the storage device 520. The value estimation unit 502 also estimates and manages the values of a single user. For example, the standard values of the group can be the average value of the values of each user in the group (which can be calculated by assigning a weight to each member of the group), or the values of a specific user (e.g., a parent) can be used as the standard values of the group. For example, as shown in Table 8 below, it can be predefined based on what information each value is estimated.
[0211] [Table 8]
[0212]
[0213]
[0214] The value comparison unit 503 detects the deviation of each user's values from the standard values of daily sensed behaviors / items. The standard values of the group can be automatically generated by the value estimation unit 502 as described above, or can be preset (the default value can be set on the system, or the default value can be manually set by the users of the group).
[0215] When the values deviate, the presentation unit 504 prompts a behavior change that brings the values closer to the standard values of the group. Specifically, the presentation unit 504 sends a behavior change command from the communication unit 510 to the output device 62 .
[0216] [Communication Department 510]
[0217] The communication section 510 is coupled to an external device such as the sensor 60 and the output device 62 via wire or radio, and transmits and receives data. For example, the communication section 510 communicates with the external device through a wired / wireless LAN (Local Area Network) or Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 3G (third generation mobile communication system)), etc.
[0218] [Storage device 520]
[0219] The storage device 520 is realized by a ROM (Read Only Memory) which stores programs, operation parameters, and the like to be used for processing executed by the controller 500 , and a RAM (Random Access Memory) which temporarily stores parameters and the like which are changed appropriately.
[0220] The configuration of the master system 10 - 2 according to the present embodiment has been described above in detail.
[0221] [3-2. Operation Process]
[0222] Subsequently, the operation processing of the above-mentioned master system 10-2 will be described with reference to the flowchart.
[0223] (3-2-1. Basic process)
[0224] Fig.19 is a basic flow chart of the operation process according to this embodiment. Fig.19 As shown, the information processing device 50 first collects (step S303 ) and analyzes (step S306 ) the behavior of each member in the group and the sensing information of the object.
[0225] Next, in the case where sensing can be performed on the behavior or article related to the values (step S309 / Yes), the information processing device 50 registers information related to the values of the behavior or article to be targeted (step S312).
[0226] Thereafter, the information processing device 50 performs calculation of the standard values (of the group) and estimation of the values of the individual (personal values) (step S315). For example, the standard values can be calculated by averaging the values of the members of the group or by using the values of one of the members as the standard values.
[0227] Subsequently, in the case where the member deviates from the standard values (step S318 / Yes), the information processing device 50 performs presentation processing for prompting the member to perform behavioral changes (step S321). For example, in the case where the member's values (personal values) deviate from the (group's) standard values, a predetermined UI presentation for prompting behavioral changes is performed. Such information presentation for prompting behavioral changes may be presentation of specific instructions for eliminating deviations from standard values, or presentation of content for arbitrarily prompting behavioral changes.
[0228] The above basic flow will be described below using a specific example. Hereinafter, the information presentation process of behavior change will be described in detail using a specific example of values.
[0229] [3-2-2. Values related to dining]
[0230] First, "dining discipline" is assumed to be a value related to "dining", that is, valuing food and not leaving any leftovers. In this embodiment, in the case of deviation from such dining values, presentation is performed to prompt the target member to perform behavioral changes.
[0231] Fig. 20 FIG. 4 is a flowchart showing a behavior change process related to dining discipline according to the present embodiment. Fig. 20 As shown, first, the information processing device 50 observes the dining behavior using a camera or the like (step S333), and analyzes the sensor data (step S336).
[0232] Next, if the event of food left / no food left is detected (step S339 / Yes), the information processing device 50 records the behavior related to whether food is left (step S342).
[0233] Next, if the information processing device 50 detects that the member has left a predetermined number of times regardless of the fact that there are leftover meals (step S345 / yes), information presentation is performed to urge the member not to leave any leftover meals. For example, for children, an image indicating the importance of food (rice and vegetables) by using a presentation character is presented. In this embodiment, the number of leftover meals is estimated as a personal value, and if a behavior different from the values of most people in the group as a whole (the standard values of the group to become a behavioral rule, for example, in the case where most people in the group do not leave any leftover meals every time, the standard values of the group are that no meals are left every time) is performed a predetermined number of times, it is determined that a deviation from the standard values has occurred. The image can be presented on a smartphone or wearable device of the target child, or can be projected onto a table by a projector. In addition, it can be output by a sound such as the sound AR of the leftover food, as if the food is talking, for example, "Don't leave me!" or "One grain is worth a thousand pounds."
[0234] [3-2-3. Values related to housework]
[0235] In addition, for example, suppose that the value related to housework is "all family members clean up the dishes after meals." In the case of deviation from this housework value, presentation is performed to prompt the target member to perform behavior change.
[0236] Fig.21 FIG. 4 is a flowchart showing a behavior change process related to cleaning dishes according to the present embodiment. Fig.21 As shown, first, the information processing device 50 observes the dining behavior using a camera or the like (step S353), and analyzes the sensor data (step S356).
[0237] Next, if an event of cleaning the dishes / not cleaning the dishes is detected (step S359 / Yes), the information processing device 50 records the behavior data of whether each member has cleaned the dishes (step S362).
[0238] Next, if the information processing device 50 detects the fact that the member has left without cleaning the dishes for a predetermined number of times (step S365 / Yes), the information processing device 50 may present information that prompts the dishes to be cleaned, for example, for children, the sound AR may be used to output a voice of a dish whispering "I want to get clean quickly". In the present embodiment, the number of times the dishes are cleaned is estimated as a personal value, and if a behavior different from the values of the majority of the group as a whole (the standard values of the group to become a behavioral rule, for example, in the case where most people in the group clean the dishes every time, the standard value of the group is to clean the dishes every time) is performed a predetermined number of times, it is determined that a deviation from the standard value has occurred.
[0239] [3-2-4. The beauty of the room]
[0240] Furthermore, for example, it is assumed that the value of the aesthetics of a room such as an office or one's own room is neatness (cleanliness), for example, the fact that items are not scattered on the floor or desk.
[0241] Fig. 22 is a flow chart of a behavior change process related to cleaning a desk in an office. Fig. 22 As shown, for example, the information processing device 50 detects (photographs) the number of items placed on the desk in the office using a camera or the like (step S373), and performs analysis of the sensor data (calculates the number of items by image analysis or the like) (step S376). Although the "number of items" is used as an example here, neatness can be detected by image analysis.
[0242] Next, if the status of all members in the office is detected (step S379), the information processing device 50 registers the average number of the group as a standard (standard value), and also records the number of items placed on each member's desk for calculation of personal values (step S382).
[0243] Thereafter, if the number of items on the member's desk is greater than the average value of the group (step S385 / yes), the information processing device 50 can indirectly indicate that it is best to tidy up the desk by performing information presentation to encourage the member to clean up the desk (for example, by projecting a projection diagram in which the file pile becomes taller and is collapsing or particularly highlighting the file pile). The information presentation to encourage the member to clean up the desk can be presented by sound (for example, sound AR).
[0244] Fig.23 is a flow chart of the behavior change process related to room tidying. Fig.23 As shown, first, the information processing device 50 detects the number of items scattered (fallen) on the floor using a camera or the like, and detects the mother's angry words to the child using a microphone or the like (step S393), and analyzes the sensor data (step S396).
[0245] Next, if the mother is angry with the child about the state of the room (step S399 / yes), the information processing device 50 regards the number of items dropped on the floor as the mother's tolerance limit, and registers the number as the standard value of the group (step S402). In the present embodiment, the mother's tolerance limit is defined as the value standard of the group regarding the beauty of the room. It should be noted that the beauty of the room is not limited to the number of items dropped on the floor, and, for example, the value standard can be defined based on sensing targets such as the percentage of the floor area of the room (a condition where there is nowhere to stand can be called messy), the difference from the state of the usual room (floor area, neatness, etc.), etc.
[0246] Thereafter, if the condition of the room exceeds the mother's standard (i.e., if the number of items left in the room exceeds the "number of items" of the group's standard value, which is the mother's standard) (step S405 / yes), information presentation prompting the room to be tidied is performed, for example, Fig.24 As shown, a projection of a more cluttered room is projected. Fig.24 In the illustrated case, the number of items dropped on the floor is detected by a sensor 60 (e.g., a camera installed in the room), and if the number of items dropped on the floor exceeds a standard, an image 620 that looks more messy is projected by an output device 62 such as a projector. Information presentation that encourages tidying up the room may be presented by voice such as voice AR.
[0247] In addition, the parent can be presented with an image of the room's condition from the current child's perspective. The messiness of the room can also be mapped to other values, such as emotions to be presented to the child. For example, when the room is dirty, the hero associated with the room will become weak or look bad.
[0248] [3-2-5. Values related to child-rearing]
[0249] In addition, for example, regarding values related to childrearing, mothers immediately notice a baby's nighttime crying, but fathers are usually slow to respond. Thus, the following situation is given as an example: the mother's acceptable level of response to a baby's crying (having to get up and put the baby to sleep) is defined as the standard value for the group, and the father's behavior is prompted to change.
[0250] Fig.25 is a flow chart for dealing with behavioral changes associated with infant crying. Fig.25 As shown, for example, the information processing device 50 detects the crying volume level when the mother gets up due to the crying of the baby by using a camera, a microphone, etc. (step S413), and analyzes the sensor data (step S416).
[0251] Next, if the mother gets up to take care of the baby (step S419 / yes), the information processing device 50 registers the crying volume level that makes the mother get up as a standard (i.e., the mother's acceptable level, and sets it as the standard value of the group) (step S422).
[0252] Thereafter, if the baby's crying exceeds the wife's acceptable level (i.e., the standard value of the group) (step S425 / yes), the information processing device 50 performs information presentation to prompt the father to get up, for example, presenting the father with the amplified sound AR of the baby's crying (step S428).
[0253] [3-2-6. Values of objects]
[0254] In addition, for example, regarding values related to liking of items, a particular stuffed toy is extremely important to the child, but the mother treats all stuffed toys in the same way. In this embodiment, when the difference between the child's values and the mother's values for items (e.g., stuffed toys) becomes greater than or equal to a specific value, the child's values can be visualized and the father can be prompted to (indirectly) perform behavioral changes.
[0255] Fig.26 is a flow chart showing a behavior change process related to a toy. Fig.26 As shown, first, the information processing device 50 senses the frequency of use of the toy, words and actions related to the toy, the handling of the toy, etc. (step S433) by using a camera, a microphone, etc., and analyzes the sensor data (step S436). Specifically, for example, the frequency of use (the frequency with which the child plays with the toy) can be measured by using a camera image or the proximity of radio waves such as BLE / RFID (emitted from the toy). The microphone can also be used to collect conversations and extract and calculate words about which toy is important, which toy is fun, which toy is his / her favorite, etc. In addition, the handling of the toy (whether the handling is careful or rough) can also be measured by using images captured by the camera, voices of conversations from the microphone, radio waves such as BLE / RFID, etc.
[0256] Next, if the child's attachment level (eg, degree of liking) to the toy is high (step S439 / Yes), the information processing device 50 registers the toy as an important toy (a highly likable toy) (step S442 ).
[0257] Next, for example, if it is time for the mother to sort out the toys (step S445 / yes), in the case where the toy that the mother is trying to discard is a toy that the child loves highly, information about the child's values is presented to the mother, for example, an image of the child carefully treating the toy is presented on the mother's smart phone, etc. (step S448). For example, the timing of the mother sorting out the toys can be determined by analyzing an image captured by a camera or by analyzing sounds collected by a microphone (such as words such as "There are too many toys, I'm going to sort them out" or "I'm going to throw them away"). In addition, for example, it can be determined which toy the mother is trying to discard based on analysis of an image captured by a camera, analysis of radio waves such as BLE / RFID transmitted from a tag set on the toy (which becomes undetectable due to the fact that the toy is discarded in a trash can, etc.), etc.
[0258] [3-2-7. Common Values]
[0259] Next, what is assumed to be an example of values is: what kind of values are considered to be important values (common values). For example, the values (basic values) used as the basis when calculating common values include the above-mentioned "cherish meals", "all family members assist in housework", "aesthetics (room tidy state)", "parenting", "love for objects", etc. Based on these basic values, values (i.e., "common values") are estimated as to what kind of values (which will become candidates for common values) each member values, and, for example, the average value of the group is adopted as the common value. Thereafter, if a deviation occurs between the common values of the group and the common values of individuals (members), members can be prompted to perform behavioral changes (e.g., adjust the common values of the group) by presenting the common values of the group to the members.
[0260] Fig. 27 is a flow chart showing the behavior change process related to universal values. Fig. 27 As shown, the information processing device 50 first estimates the basic values of an individual (each member of the group) (step S453).
[0261] Next, the information processing device 50 normalizes the values of the individual's basic values (step S456 ).
[0262] Thereafter, the information processing device 50 refers to the value association table and calculates the value of each universal value according to the weighted value of the associated universal value (step S459). Here, an example of the value association table is shown in Table 9 below. As shown in Table 9 below, examples of candidates for universal values include "honesty", "care", "society" and "personality".
[0263] [Table 9]
[0264]
[0265]
[0266] Next, the information processing device 50 sets the common value as the highest value (ie, the most important value) (step S462). Fig.28 An example of the value of each common value of a single member calculated by referring to the weights shown in Table 9 is shown. Fig.28 In the case shown, since the value of the value of "caring" has the highest value, this value is the value that members consider to be the most important, that is, the "common value" of the members.
[0267] Thereafter, if the common values of the member deviate from the group average common values (step S465 / yes), the information processing device 50 presents the change of the common values to the member (step S468).
[0268] [4. The third work example (adjusting the rhythm of life)]
[0269] Next, refer to Figure 29 to Figure 35 , the master system 10-3 according to the third working example will be described.
[0270] In this embodiment, for example, when an issue of insufficient reunion time period is estimated based on data collected from the family (the estimation of this issue is similar to that of the first working example), the meal time period set as the behavioral rule is adjusted to resolve the issue, the family's rhythm of life (each member's dinner time period, etc.) is detected, and behavioral changes in the rhythm of life are indirectly promoted so that the meal times of each member can be adjusted.
[0271] Fig.29 is a block diagram showing a configuration example of a master system 10-3 according to the third working example. Fig.29 As shown, the master system 10 - 3 includes an information processing device 70 , a sensor 80 (or a sensor system) and an output device 82 (or an output system).
[0272] [Sensor 80]
[0273] The sensor 80 is similar to the sensor group according to the first working example, and is a device / system that obtains each piece of information about the user. For example, it includes: environmental sensors (e.g., cameras and microphones) installed in the room and various user sensors (e.g., motion sensors (acceleration sensors, gyroscope sensors, or geomagnetic sensors)), biosensors, position sensors, cameras, microphones, etc. installed in smart phones or wearable devices owned by users. In addition, the user's behavior history (mobile history, SNS, shopping history, etc.) can be obtained from the network. The sensor 80 senses the behavior of members in a specific community on a daily basis, and the information processing device 70 collects the sensed behavior.
[0274] [Output device 82]
[0275] The output device 82 is an expression device that prompts behavioral changes, and similar to the first working example, the output device 82 widely includes IoT devices such as: for example, smart phones, tablet terminals, mobile phone terminals, PCs, wearable devices, televisions, lighting devices, speakers, and vibration devices.
[0276] [Information processing device 70]
[0277] The information processing device 70 (life rhythm export server) includes a communication unit 710, a controller 700, and a storage device 720. The information processing device 70 may be a cloud server on a network, an intermediate server or an edge server, a dedicated terminal located at home such as a home agent, or an information processing terminal such as a PC or a smartphone.
[0278] -Controller 700
[0279] The controller 700 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing device 70 according to various programs. For example, the controller is implemented by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor. In addition, the controller 700 may include a ROM (Read Only Memory) that stores programs to be used, operating parameters, etc., and a RAM (Random Access Memory) that temporarily stores appropriately changing parameters, etc.
[0280] Furthermore, the controller 700 according to the present embodiment also functions as a person recognition section 701 , a motion recognition section 702 , a rhythm derivation section 703 , a deviation detector 704 , a deviation cause estimation section 705 , and a response generator 706 .
[0281] The person recognition unit 701 recognizes a person by performing facial recognition or the like on an image captured by a camera. The action recognition unit 702 recognizes the action of each user (e.g., returning home, eating, bathing, relaxing time, sleeping, etc.) based on the image captured by the camera and various sensor data. More specifically, for example, sensors (cameras, microphones, etc.) in the home sense the time when the family returns home, the time when they eat, etc., and record the time when they return home, the time when they eat, etc. In addition, as Fig.30 As shown, the people who dine with him, the number of people who dine together, etc. are also recorded.
[0282] The rhythm derivation unit 703 calculates the family's life rhythm (for example, trends in the time of returning home, meal time, bathing time, etc., every day of the week) based on the family's behavior records.
[0283] Deviation detector 704 compares the life rhythms of the various members of the family with each other and detects the deviation part. For example, if only the frequency of the rhythm of the father's dinner time significantly deviating from the dinner time of the family increases, a deviation is detected.
[0284] The deviation cause estimation unit 705 estimates the cause of the deviation. For example, if only the frequency of the father's dinner time greatly deviating increases, the cause of the deviation of the father's dinner time is estimated. For the estimation of the cause, for example, a causal analysis method or a method using Bayesian estimation is given. For example, in the case where a family member cannot have dinner with the family because he returns home late every Thursday, it can be estimated that the late return home time is caused by the work meeting every Thursday.
[0285] The response generator 706 generates a response that indirectly prompts a behavior change to adjust the rhythm of life. For example, as described above, in the case where only the father is often unable to have dinner together on Thursdays, it can be analyzed that the reason is a regular meeting, and therefore, a suggestion such as "How about changing the regular meeting on Thursday?" can be presented to the father from a PC screen or the like. As a result, following the suggestion makes it possible to have dinner together with the family. It should be noted that the suggestion can be presented using an email, SNS, or other messaging function.
[0286] here, Fig.31 A graph illustrating the deviation of the rhythm of life is shown. Fig.31 The dinner time of the father, mother and children is shown, as well as the life rhythm (behavior rules) to be the standard of the family. For example, the life rhythm to be the standard of the family is the cumulative average time of the dinner time of each family member every day of the week. Fig.31As shown, when the life rhythm of the dinner time of the father, mother and children is calculated, it can be understood that only the father's meal time on Thursday has a large deviation. In this case, it can be understood that based on the cause estimation, for example, due to the regular meeting, the return home time is late, and the meal time has shifted. In contrast, it can be understood that the family's dinner time period on Tuesday is later than other days of the week. In this case, by changing the date of the regular meeting to Tuesday, the father can have dinner earlier on Thursday, and even if the return home time is later due to the regular meeting, because the meal time on Tuesday is late, the father may have dinner together on Tuesday. Therefore, the response generator 706 is able to generate specific suggestions, such as "How about changing the date of the regular meeting from Thursday to Tuesday?" It should be noted that the response generator 706 including Fig.31 The graph and suggested image 7001 shown are presented as suggestions to the father.
[0287] [Communication Department 710]
[0288] The communication section 710 is coupled to an external device such as the sensor 80 and the output device 82 via wire or radio, and transmits and receives data. For example, the communication section 710 communicates with the external device through a wired / wireless LAN (Local Area Network) or Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution)), 3G (third generation mobile communication system), etc.
[0289] [Storage device 720]
[0290] The storage device 720 is realized by a ROM (Read Only Memory) which stores programs, operation parameters, and the like to be used for processing executed by the controller 700 , and a RAM (Random Access Memory) which temporarily stores parameters and the like which are changed appropriately.
[0291] The configuration of the master system 10 - 3 according to the present embodiment has been described above in detail.
[0292] [4-2. Operation Process]
[0293] Next, the operation processing executed by the above-mentioned master system 10-3 will be described with reference to the flowchart.
[0294] Fig.32 is a flow chart of the operation process for generating a rhythm for dinner time. Fig.32 As shown, first, the information processing device 70 recognizes a person at the dining table by using a camera or the like (step S503), and recognizes that the person is "having a meal" by motion analysis (step S506).
[0295] Next, if it is possible to identify who is having a meal (step S509 / Yes), the information processing device 70 records the dinner time of the family members (step S512). An example of the dinner time record of the family members is indicated in Table 10 below.
[0296] [Table 10]
[0297] Personnel ID Dinner time 00011(Father) Thursday, September 26, 2017 20:30 00012 (Mother) Thursday, September 26, 2017, 18:30 00013 (Children) Thursday, September 26, 2017, 17:30
[0298] Thereafter, if the dinner time period (of a reasonable day) has ended (step S515 / yes), the information processing device 50 adds the data of today's family dinner time to the previous average family dinner time, and calculates the cumulative average time for each day of the week (generating a dinner time rhythm) (step S518). Fig.33 An example of a calculation formula that indicates the cumulative average time for each day of the week. For example, you can Fig.33 The calculation formula shown is used to calculate the cumulative average time for each day of the week (i.e. Fig.31 The standard pace of life for a family is shown in the figure).
[0299] Fig.34 is a flowchart for generating suggestions based on the pace of life. Fig.34 As shown, the information processing device 70 first detects the deviation of the family's life rhythm. More specifically, for example, the information processing device 70 calculates the mean square error between the dinner time of the members and the cumulative average time of each day of the week in the past predetermined time period (for example, three months) (step S523). ).
[0300] Next, if the calculated error exceeds a predetermined threshold value (step S526 / yes), the information processing device 70 estimates the reason why the dinner time deviates from the family's dinner time (the reason for the deviation), and selects an indirect expression that prompts a behavior change (step S529). For example, the estimation of the deviation reason can be performed by a causal data analysis method.
[0301] Thereafter, the information processing device 70 sends the message in the selected indirect expression form (step S532).
[0302] It should be noted that the behavior change for adjusting the dinner time is not limited to prompting only the father who has a deviation in the dinner time, but other family members can be prompted so that the result is that dinner can be eaten with all family members. For example, modifying the family's life rhythm, for example, so that the family members are located near the nearest station at the father's homecoming time. Specifically, for example, based on Fig.31In the rhythm of life shown, Master System 10-3 advised the mother on Thursday night, "How about taking your children to the station?", "XX store in front of the station seems to be popular", etc. When the mother followed the Master's words and took her children shopping in front of the station, the father on his way home contacted her and said, "I'm almost at the station." The mother replied, "Oh, I'm near the station," and the family members met naturally, which allowed them to have dinner at a restaurant near the station.
[0303] In addition, although "dinner time" is used as an example of the rhythm of life in the present embodiment, the present disclosure is not limited to this, and for example, waking up time, sleeping time, working time, exercise time, media viewing time, etc. are also assumed.
[0304] [4-3. Modifications]
[0305] In the above-mentioned embodiment, it is expected to adjust the rhythm of life, however, the present disclosure is not limited thereto. For example, indirect suggestions can be provided to make the rhythm of life deviate from each other (asynchronous). For example, it is preferred to deviate the bathing time, toilet time, time to use the wash basin, etc. from each other.
[0306] The information processing device 70 has a knowledge table of events and the like that occur when the life rhythm is synchronized, as shown in Table 11 below, and indirectly provides suggestions to perform behavioral changes to change the life rhythm of community members by referring to the following table.
[0307] [Table 11]
[0308]
[0309]
[0310] For example, it is assumed that the master system 10-3 senses the behavior of family members on a daily basis through sensors such as cameras or microphones installed in the home, and records the situation. In this case, for example, when the master system 10-3 detects that most family members (father, mother, daughter, etc.) gather in the living room and watch TV, and knows that the bathroom tends to be crowded after each TV watching (can be learned and obtained, or can be pre-registered, see Table 11), the master system 10-3 notifies the eldest son who is alone in his room without watching TV: "If you go in now, you can use the bathtub for a long time." The notification can be issued by various output devices such as smart phones, projectors, speakers, etc. The eldest son studying in the room may say "Good time, I want to lie in the bathtub and relax", and can temporarily stop studying to take a bath.
[0311] Fig.35 1 is a flowchart of promoting the adjustment of the rhythm of life (behavior change) according to the overlap of events according to a modification of the present embodiment. Fig.35 As shown, first, the information processing device 70 identifies the state (behavior) of the family (step S543), and determines whether the state is a behavior (causing an event to occur) registered in the table shown in Table 11 (step S546). For example, suppose that there are many people whose waking up time, TV watching time, etc. overlap.
[0312] Next, if the behavior overlap is greater than or equal to the threshold (step S549 / yes), the information processing device 70 selects a person to receive the suggestion (step S552). The person can be selected from the person with overlapping behavior or the person without overlapping behavior. As shown in Table 11, for each expected event, the conditions for selecting the person can be pre-registered.
[0313] Thereafter, the information processing device 70 executes the advice registered in the table for the selected person (step S555).
[0314] In the above example, it is assumed that a large number of cameras and microphones are installed in the house as described above, and the family situation is grasped on a daily basis; however, even if a large number of cameras and microphones are not installed in the house, the family situation can be grasped based on the cameras, microphones, motion sensors, etc. of, for example, smart phones, smart bands, etc. owned by the user.
[0315] For example, the camera or microphone of a smartphone can sense that it is dinner time and that TV is being watched. In addition, location information such as which room a smartphone is located in can be acquired through radio waves from the smartphone, etc. (therefore, when the location such as bathroom, toilet, living room, etc. is known, it is possible to roughly predict what is being done).
[0316] In addition, as to whether a person is in the toilet, it is possible to determine that the person is in a smaller enclosed space (i.e., the toilet) (or bathroom) by detecting the sound of flushing water through the microphone of a smart phone brought into the toilet, or by detecting that the sound has a large echo and the interval between echoes is short.
[0317] Additionally, it may also be determined whether the user has taken a shower (wet hair, wearing pajamas, using a hair dryer, etc.) based on the user's appearance captured by the smartphone's camera.
[0318] [5. Hardware Configuration Example]
[0319] Finally, refer to Fig.36 , the hardware configuration of the information processing apparatus according to the present embodiment will be described. Fig.36 is a block diagram showing an example of the hardware configuration of the information processing device 20, the information processing device 50, or the information processing device 70 according to the present embodiment. Note that, Fig.36The information processing device 800 shown can implement, for example, the information processing device 20, the information processing device 50, or the information processing device 70. The information processing performed by the information processing device 20, the information processing device 50, or the information processing device 70 according to the present embodiment is implemented by cooperation with software and hardware to be described below.
[0320] like Fig.36 As shown in, for example, the information processing device 800 includes a CPU 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, an output device 879, a storage device 880, a driver 881, a coupling port 882, and a communication device 883. It should be noted that the hardware configuration shown herein is only an example, and some components may be omitted. In addition, components other than those shown herein may also be included.
[0321] [CPU 871]
[0322] For example, the CPU 871 functions as an arithmetic processing unit or a control unit, and controls the overall operation of each component or a part thereof based on various programs recorded in the ROM 872 , the RAM 873 , the storage device 880 , or the removable recording medium 901 .
[0323] Specifically, the CPU 871 realizes operation processing performed in the information processing device 20 , the information processing device 50 , or the information processing device 70 .
[0324] [ROM 872 and RAM 873]
[0325] The ROM 872 is a device that stores a program to be read by the CPU 871 and data to be used for arithmetic operations. For example, a program to be read by the CPU 871 and various parameters and the like that are appropriately changed when executing the program are temporarily or permanently stored in the RAM 873.
[0326] [Host bus 874, bridge 875, external bus 876 and interface 877]
[0327] For example, the CPU 871, the ROM 872, and the RAM 873 are coupled to each other via a host bus 874 capable of high-speed data transmission. At the same time, for example, the host bus 874 is coupled to an external bus 876 having a relatively low data transmission speed via a bridge 875. In addition, the external bus 876 is coupled to various components via an interface 877.
[0328] [Input device 878]
[0329] For example, a mouse, a keyboard, a touch panel, a button, a switch, a joystick, etc. are used as the input device 878. Furthermore, in some cases, a remote controller (hereinafter referred to as a remote controller) capable of transmitting a control signal using infrared rays or other radio waves may also be used as the input device 878. In addition, the input device 878 includes a sound input device such as a microphone.
[0330] [Output device 879]
[0331] The output device 879 is a device capable of notifying the user of acquired information in a visual or auditory manner, for example: a display device such as a CRT (cathode ray tube), LCD, or organic EL; an audio output device such as a speaker, earphone; a printer; a mobile phone; or a fax machine, etc. In addition, the output device 879 according to the present disclosure includes various vibration devices capable of outputting tactile stimulation.
[0332] [Storage device 880]
[0333] The storage device 880 is a device for storing various data. As the storage device 880, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like is used.
[0334] [Drive 881]
[0335] For example, the drive 881 is a device that reads information recorded in the removable recording medium 901 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information in the removable recording medium 901 .
[0336] [Removable recording medium 901]
[0337] For example, the removable recording medium 901 is a DVD medium, a Blu-ray (registered trademark) medium, an HDDVD medium, various semiconductor storage media, etc. It goes without saying that the removable recording medium 901 may be, for example, an IC card equipped with a non-contact IC chip, an electronic device, etc.
[0338] [Coupling port 882]
[0339] For example, the coupling port 882 is a port for coupling the external coupling device 902, such as a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface), an RS-232C port, or an optical audio terminal.
[0340] [External coupling device 902]
[0341] For example, the external coupling device 902 is a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder. For example, the external coupling device 902 can also be an environmental sensor 30, a user sensor 32, an output device 36, a sensor 60, an output device 62, a sensor 80, or an output device 82.
[0342] [Communication equipment 883]
[0343] Communication device 883 is a communication device for coupling to a network, and, for example, is a communication card for wired or wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), or WUSB (Wireless USB), a router for optical communication, an ADSL (Asymmetric Digital Subscriber Line) router, or a modem for various communications.
[0344] [6. Conclusion]
[0345] As described above, the information processing system according to the embodiment of the present disclosure can automatically generate behavioral rules for a community and promote voluntary behavioral changes.
[0346] The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such embodiments. Obviously, a person skilled in the art in the field of the present disclosure can make various changes and modifications within the scope of the technical ideas described in the attached claims, and it should be understood that such changes and modifications essentially fall within the technical scope of the present disclosure.
[0347] Furthermore, a computer program may be created for causing hardware (e.g., CPU, ROM, and RAM) built into the information processing device 20, the information processing device 50, or the information processing device 70 to exhibit the functions of the information processing device 20, the information processing device 50, or the information processing device 70. Furthermore, a storage medium storing the computer program is also provided.
[0348] In addition, the effects described herein are only illustrative and exemplary, and not restrictive. That is, in addition to or in place of the above effects, the technology according to the present disclosure may also exert other effects that are obvious to those skilled in the art from the description herein.
[0349] It is to be noted that the present disclosure may have the following configurations.
[0350] (1) An information processing device including a controller, the controller performing control to:
[0351] Acquiring sensor data obtained by sensing members belonging to a particular community,
[0352] Based on the acquired sensor data, automatically generate behavior rules in the specific community, and
[0353] The members are prompted to perform behavioral changes based on the behavioral rules.
[0354] (2) The information processing device according to (1), wherein the controller
[0355] estimating topics of the specific community based on the acquired sensor data, and
[0356] Automatically generate behavioral rules that solve the issue.
[0357] (3) The information processing device according to (1), wherein the controller indirectly prompts the member to perform a behavior change so that the member performs the behavior change.
[0358] (4) The information processing device according to (3), wherein the controller
[0359] Set the target variable as the behavior rule,
[0360] generating a relationship graph indicating the relationship between the factor variables starting from the target variable, and
[0361] The member is prompted to perform a behavior change on a factor variable to be intervened in which a behavior change is possible among the factor variables associated with the target variable.
[0362] (5) The information processing device according to (4), wherein the controller encourages the member so that the factor variable associated with the target variable approaches a desired value.
[0363] (6) The information processing device according to (4), wherein the controller:
[0364] A causal graph is generated by estimating the factor variables that are estimated to be the cause of the target variable set as the behavior rule, and
[0365] The members are encouraged to bring factor variables estimated to be causes of the target variable closer to expected values.
[0366] (7) The information processing device according to (3), wherein the controller
[0367] automatically generating values to become standards in the specific community as behavioral rules based on the acquired sensor data, and
[0368] Indirectly prompt the members to implement behavioral changes based on the values that are to become the norm.
[0369] (8) The information processing device according to (7), wherein the controller sets an average value of values of a plurality of members belonging to the specific community as the value to be the standard.
[0370] (9) The information processing device according to (7), wherein the controller sets values of a specific member among a plurality of members belonging to the specific community as the values to be the standard.
[0371] (10) An information processing device according to any one of (7) to (9), wherein the controller indirectly prompts a specific member to perform a behavioral change by presenting the values to become the standard to the specific member, and the values of the specific member deviate from the values to become the standard to a certain extent or more.
[0372] (11) The information processing device according to any one of (2) to (6), wherein the controller:
[0373] Based on the acquired sensor data, estimating topics that members belonging to the specific community have, and
[0374] Behavior rules related to the life rhythm of members belonging to the specific community are automatically generated so as to solve the issue.
[0375] (12) The information processing device according to (11), wherein the controller automatically generates behavioral rules that synchronize the life rhythms of multiple members belonging to the specific community so as to resolve the issue.
[0376] (13) An information processing device according to (12), wherein the controller indirectly prompts a specific member to perform behavioral changes, and the life rhythm of the specific member deviates from the life rhythm of other members belonging to the specific community for a certain period of time or longer.
[0377] (14) The information processing device according to (11), wherein the controller automatically generates a behavior rule that makes the life rhythms of multiple members belonging to the specific community asynchronous so as to solve the issue.
[0378] (15) An information processing device according to (14), wherein, when it is detected that a certain number of members or more of a plurality of members belonging to the specific community are synchronized with each other in a first life behavior, the controller indirectly prompts a specific member belonging to the specific community to perform a behavior change so that a second life behavior is performed, and the second life behavior is predicted to come after the first life behavior.
[0379] (16) An information processing device including a controller, the controller performing control to:
[0380] depending on behavioral rules in a specific community that are automatically generated in advance based on sensor data obtained by sensing members belonging to the specific community,
[0381] Based on sensor data obtained by sensing members belonging to a specific community,
[0382] The member is encouraged to implement behavioral changes.
[0383] (17) An information processing method executed by a processor, the method comprising:
[0384] Acquire sensor data obtained by sensing members belonging to a specific community,
[0385] Based on the acquired sensor data, automatically generate behavior rules in the specific community, and
[0386] The members are prompted to perform behavioral changes based on the behavioral rules.
[0387] (18) A recording medium having recorded thereon a program for causing a computer to function as a controller for executing:
[0388] Acquire sensor data obtained by sensing members belonging to a specific community,
[0389] Based on the acquired sensor data, automatically generate behavior rules in the specific community, and
[0390] The members are prompted to perform behavioral changes based on the behavioral rules.
[0391] Reference numerals list
[0392] 2A to 2C communities
[0393] 10, 10A to 10C, 10-1 to 10-3 Master System
[0394] 11. Data Analyzer
[0395] 12 Behavior Rule Generator
[0396] 13Behavior Change Instructions
[0397] 20 Information processing device (causal analysis server)
[0398] 30 Environmental Sensors
[0399] 32 user sensors
[0400] 34 Service Server
[0401] 36 Output devices
[0402] 50 Information processing device
[0403] 70 Information processing device
[0404] 80 sensors
[0405] 82 Output devices
[0406] 201 Receiver
[0407] 203 Launcher
[0408] 210 Image Processor
[0409] 212 Voice Processor
[0410] 214 Sensor / Behavior Data Processor
[0411] 220 factor variables DB
[0412] 222 Topic Index DB
[0413] 224Interventional Devices DB
[0414] 226 Intervention Rules DB
[0415] 228 Intervention Appointment DB
[0416] 230 Issue Estimates Department
[0417] 232 Causal Analyzer
[0418] 235 Intervention Department
[0419] 500 Controller
[0420] 501 User Management Department
[0421] 502 Value Estimation Department
[0422] 503 Value Comparison Department
[0423] 504 Presentation Department
[0424] 510 Communications Department
[0425] 520 storage device
[0426] 700 Controller
[0427] 701 Personnel Identification Department
[0428] 702 Action Recognition Unit
[0429] 703 Rhythm Export Section
[0430] 704 Deviation Detector
[0431] 705 Deviation Cause Estimation Department
[0432] 706 Response Generator
[0433] 710 Communications Department
[0434] 720 storage device
Claims
1. An information processing device, comprising a circuit, wherein the circuit is configured to: Acquiring sensor data obtained by sensing members belonging to a particular community, Based on the acquired sensor data, the behavior rules in the specific community are automatically generated. Set the target variable as the behavior rule, generating a relationship graph indicating the relationship between the factor variables starting from the target variable, and The member is indirectly prompted to perform a behavior change on a factor variable to be intervened in which a behavior change is possible among the factor variables associated with the target variable.
2. The information processing device according to claim 1, wherein: The circuit is also configured to: estimating topics of the specific community based on the acquired sensor data, and Automatically generate behavioral rules that solve the issue.
3. The information processing device according to claim 1, wherein: The circuit is also configured to encourage the member to bring the factor variable associated with the target variable closer to a desired value.
4. The information processing device according to claim 1, wherein: The circuit is also configured to: A causal graph is generated by estimating the factor variables that are estimated to be the causes of the target variable set as the behavior rule, and The members are encouraged to bring the factor variables estimated to be the causes of the target variable close to the expected values.
5. The information processing device according to claim 1, wherein: The circuit is also configured to: automatically generating values to become standards in the specific community as behavioral rules based on the acquired sensor data, and Indirectly motivating said members to implement behavioral changes based on the values that are to become the norm.
6. The information processing device according to claim 5, wherein: The circuit is further configured to set an average value of values of a plurality of members belonging to the specific community as the value to be the standard.
7. The information processing device according to claim 5, wherein: The circuit is further configured to set the values of a specific member among a plurality of members belonging to the specific community as the values to be made the standard.
8. The information processing device according to claim 5, wherein: The circuit is also configured to indirectly prompt a specific member to perform a behavioral change by presenting the values to be standardized to the specific member, whose values deviate from the values to be standardized to a certain extent or more.
9. The information processing device according to claim 1, wherein: The circuit is also configured to: Based on the acquired sensor data, estimating topics that members belonging to the specific community have, and Behavior rules related to the life rhythm of members belonging to the specific community are automatically generated so as to solve the issue.
10. The information processing device according to claim 9, wherein: The circuit is also configured to automatically generate a behavior rule that synchronizes the life rhythms of multiple members belonging to the specific community so as to resolve the issue.
11. The information processing device according to claim 10, wherein: The circuit is also configured to indirectly prompt a specific member to perform behavioral changes, wherein the life rhythm of the specific member deviates from the life rhythm of other members belonging to the specific community for a certain period of time or longer.
12. The information processing device according to claim 9, wherein: The circuit is also configured to automatically generate a behavior rule that makes the life rhythms of multiple members belonging to the specific community asynchronous so as to solve the issue.
13. The information processing device according to claim 12, wherein: The circuit is also configured to: When it is detected that a certain number of members or more of the multiple members belonging to the specific community are synchronized with each other in a first life behavior, specific members belonging to the specific community are indirectly prompted to perform behavioral changes so that a second life behavior is performed, and the second life behavior is predicted to come after the first life behavior.
14. An information processing method performed by an information processing device, the method comprising: Acquire sensor data obtained by sensing members belonging to a specific community, Based on the acquired sensor data, the behavior rules in the specific community are automatically generated. Set the target variable as the behavior rule, generating a relationship graph indicating the relationship between the factor variables starting from the target variable, and The member is indirectly prompted to perform a behavior change on a factor variable to be intervened in which a behavior change is possible among the factor variables associated with the target variable.
15. A computer-readable storage medium having stored thereon a program which, when executed by a computing device, causes the computing device to function as the information processing device according to any one of claims 1 to 13.
16. A computer program product comprising a program which, when executed by a computing device, causes the computing device to function as an information processing device according to any one of claims 1 to 13.
Citation Information
Patent Citations
Apparatus and method for interactive guidance support
JP2010102643A
Behavior support system, terminal, device, method, and program
JP2016085703A
Electric stimulator
JP2017000530A
Exhaust emission control catalyst device for internal combustion engine
JP2018040269A
