Intervention control program, device, system and method for determining intervention policy from estimated intervention results

Abstract

To provide an intervention control program, system, and method that control intervention while also taking into account psychology of a target.SOLUTION: An intervention control program, which controls intervention to a target using target information on the target, causes a computer to function as: intervention result estimation means that estimates intervention result information on a result when intervention is implemented on the target, from target information including psychological characteristic information and / or psychological state information, using a trained intervention result estimation model; intervention policy determination means that determines intervention policy including selection information on selection of either intervention or non-intervention from the acquired target information and the estimated intervention result information; and intervention control means that controls, on the basis of the determined intervention policy, intervention. Here, the target information preferably also includes physiological information and / or context information of the target. It is also preferable that the intervention policy also includes intervention timing information on whether or not to implement intervention at preset timing.SELECTED DRAWING: Figure 1

Claims

1. An intervention control program that controls intervention as presentation of intervention content to a target using target information related to the target, The target information includes at least one of psychological characteristic information and psychological state information of the target, an intervention result estimation means for estimating, from the acquired target information, intervention result information relating to the result of implementing an intervention on the target, which is determined by a feature quantity that quantifies the features of the constituent content, and which does not depend on a single intervention content, using a trained intervention result estimation model; an intervention policy determination means for determining, using a reinforcement learning algorithm, an intervention policy including selection information relating to a selection between intervention and non-intervention from the acquired target information and the estimated intervention result information, the intervention policy not relating to one intervention content identified by the feature; an intervention control means for controlling the intervention based on the determined intervention policy; An intervention control program characterized by causing a computer to function as follows.

2. The intervention control program of claim 1 , wherein the subject information also includes at least one of physiological information of the subject and context information relating to the subject's situation, environment, or behavior.

3. 2. The intervention control program according to claim 1, wherein the intervention policy determination means determines an intervention policy that also includes intervention timing information relating to whether or not the intervention is to be performed at a preset timing.

4. An intervention control program for controlling an intervention in a target using target information relating to the target, The target information includes at least one of psychological characteristic information and psychological state information of the target, an intervention result estimation means for estimating, from the acquired target information, indirect intervention result information relating to the results when an indirect intervention is implemented on the target, and direct intervention result information relating to the results when a direct intervention is implemented on the target, using a trained intervention result estimation model; an intervention policy determination means for determining an intervention policy including selection information relating to selection of indirect intervention, direct intervention, or no intervention as the intervention, using a reinforcement learning algorithm from the acquired target information and the estimated indirect intervention result information and direct intervention result information; an intervention control means for controlling the intervention based on the determined intervention policy; An intervention control program characterized by causing a computer to function as follows.

5. the intervention control means presents a task related to a target behavior for the subject as an indirect intervention, and acquires a response result after the task is presented; The intervention control program generates learning data for training the intervention result estimation model that estimates the indirect intervention result information based on the acquired response results, and further causes the computer to function as model training means that trains the intervention result estimation model using the learning data.

5. The intervention control program according to claim 4.

6. An intervention control program for controlling an intervention in a target using target information relating to the target, The target information includes at least one of psychological characteristic information and psychological state information of the target, an intervention result estimation means for estimating intervention result information relating to the results of implementing an intervention on the subject from the acquired subject information using a trained intervention result estimation model; an intervention policy determination means for determining an intervention policy including selection information relating to selection of either intervention or non-intervention from the acquired target information and the estimated intervention result information using a reinforcement learning algorithm; an intervention control means for controlling the intervention based on the determined intervention policy; an acceptability estimation means for estimating acceptability information regarding the acceptability of the subject to the intervention using a trained acceptability estimation model from expression information regarding the expression by the subject obtained after the implementation of the intervention; to make the computer function better, The intervention policy determination means determines a reward based on the estimated receptivity information, the acquired target behavior implementation information related to the implementation of the target behavior by the subject, and the intervention result information estimated by the intervention result estimation means from the subject information acquired after the implementation of the intervention, and updates the intervention policy using the reward. An intervention control program characterized by:

7. An intervention control program for controlling an intervention in a target using target information relating to the target, The subject information includes information regarding the subject's degree of sense of agency (SoA), an intervention result estimation means for estimating intervention result information relating to the results of implementing an intervention on the subject from the acquired subject information using a trained intervention result estimation model; an intervention policy determination means for determining an intervention policy including selection information relating to selection of either intervention or non-intervention from the acquired target information and the estimated intervention result information using a reinforcement learning algorithm; an intervention control means for controlling the intervention based on the determined intervention policy; An intervention control program characterized by causing a computer to function as follows.

8. The intervention control program described in claim 1, 2, 3, 6 or 7, characterized in that the intervention policy determination means determines the intervention policy using a reinforcement learning algorithm that takes the acquired target information and the estimated intervention result information as states, and takes either intervention or non-intervention as actions, and determines a reward based on at least the acquired target behavior implementation information related to the target behavior being performed by the target, and the estimated intervention result information.

9. An intervention control device that controls intervention as presentation of intervention content to a target using target information related to the target, The target information includes at least one of psychological characteristic information and psychological state information of the target, an intervention result estimation means for estimating, from the acquired target information, intervention result information relating to the result of implementing an intervention on the target, which is determined by a feature quantity that quantifies the features of the constituent content, and which does not depend on a single intervention content, using a trained intervention result estimation model; an intervention policy determination means for determining, using a reinforcement learning algorithm, an intervention policy including selection information relating to a selection between intervention and non-intervention from the acquired target information and the estimated intervention result information, the intervention policy not relating to one intervention content identified by the feature; an intervention control means for controlling the intervention based on the determined intervention policy; An intervention control device comprising:

10. An intervention control system that controls intervention as presentation of intervention content to a target using target information related to the target, The target information includes at least one of psychological characteristic information and psychological state information of the target, an intervention result estimation means for estimating, from the acquired target information, intervention result information relating to the result of implementing an intervention on the target, which is determined by a feature quantity that quantifies the features of the constituent content, and which does not depend on a single intervention content, using a trained intervention result estimation model; an intervention policy determination means for determining, using a reinforcement learning algorithm, an intervention policy including selection information relating to a selection between intervention and non-intervention from the acquired target information and the estimated intervention result information, the intervention policy not relating to one intervention content identified by the feature; an intervention control means for controlling the intervention based on the determined intervention policy; An intervention control system comprising:

11. An intervention control method for controlling an intervention as a presentation of intervention content to a target using target information relating to the target, The target information includes at least one of psychological characteristic information and psychological state information of the target, a step of estimating intervention result information relating to the results of implementing an intervention on the subject from the acquired subject information using a trained intervention result estimation model, the results being independent of one intervention content identified by a feature amount that quantifies the features of the constituent content; a step of determining an intervention policy using a reinforcement learning algorithm from the acquired target information and the estimated intervention result information, the intervention policy including selection information regarding selection of either intervention or non-intervention, the intervention policy not being related to one intervention content identified by the feature; controlling the intervention based on the determined intervention policy; 1. A computer-implemented method for intervention control, comprising:

Images