Information processing device, information processing system, non-transitory computer readable medium, and information processing method

Abstract

The present disclosure provides an information processing device, an information processing system, a non-transitory computer-readable medium, and an information processing method for identifying an action related to the deterioration of the relationship between multiple users. The information processing device (10) includes a control unit (15) that performs the following processing, namely: obtaining action data of multiple users, extracting from the obtained action data a specific action of the action data indicating that the relationship between the multiple users has deteriorated, and identifying a cause pattern of action data associated with the specific action, which is included in at least one action data obtained before the specific action.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, an information processing system, a program, and an information processing method. Background Art

[0002] There is known a technique for detecting the behavior of a person captured based on an image such as a moving picture captured by a camera.

[0003] Patent Document 1 discloses a technology in which a camera installed in a door captures an image of a subject person passing through a door, and determines whether the subject person's behavior detected based on the captured image is a dangerous behavior.

[0004] Prior Art Literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2011-34357 Summary of the invention

[0007] Problems to be solved by the invention

[0008] For example, if actions that cause a deterioration in the relationship between multiple users living in the same house can be identified based on images captured by a camera, etc., this is useful because it is possible to prevent the deterioration in the relationship between the multiple users in advance.

[0009] An object of the present disclosure is to identify actions that may lead to deterioration of relationships among a plurality of users.

[0010] Methods for solving problems

[0011] An information processing device involved in the present disclosure includes a control unit, which performs the following processing, namely: obtaining action data of multiple users, extracting unique actions from the obtained action data, wherein the unique actions are action data indicating that the relationship between the multiple users has deteriorated, and specifying a cause pattern, wherein the cause pattern includes at least one action data in the action data obtained before the unique action and is associated with the unique action.

[0012] The present disclosure relates to a non-temporary computer-readable medium, which stores a program that causes a computer to execute the following processing, the processing being: obtaining action data of multiple users; extracting unique actions from the obtained action data, the unique actions being action data indicating a situation in which the relationship between the multiple users has deteriorated; and specifying a cause pattern, the cause pattern including at least one action data in the action data obtained before the unique action, which is associated with the unique action.

[0013] An information processing method involved in the present disclosure is an information processing method in an information processing device, which includes the following processing, namely: obtaining action data of multiple users; extracting unique actions from the obtained action data, the unique actions being action data indicating that the relationship between the multiple users has deteriorated; and specifying a cause pattern, the cause pattern including at least one action data in the action data obtained before the unique action, which is associated with the unique action.

[0014] Effects of the Invention

[0015] According to the present disclosure, it is possible to identify actions that may lead to deterioration of the relationship between a plurality of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a diagram showing the configuration of an information processing system according to an embodiment of the present disclosure.

[0017] Figure 2 It is a block diagram showing the structure of an information processing device involved in an embodiment of the present disclosure.

[0018] Figure 3 It is a block diagram showing the structure of a terminal device involved in an embodiment of the present disclosure.

[0019] Figure 4 A diagram showing an example of a cause pattern.

[0020] Figure 5 A diagram showing an example of a recommendation message.

[0021] Figure 6 It is a flowchart showing the operation of the information processing system involved in the embodiment of the present disclosure.

[0022] Figure 7 This is a flowchart showing the operation of the information processing system according to the embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0024] Figure 1 1 is a diagram showing the configuration of an information processing system 1 according to an embodiment of the present disclosure. Figure 1 The configuration and overview of an information processing system 1 according to an embodiment of the present disclosure will be described.

[0025] The information processing system 1 includes an information processing device 10, a terminal device 20A, a terminal device 20B, a camera 30, a voice input device 40, and an output device 50. The information processing device 10, the terminal device 20A, the terminal device 20B, the camera 30, the voice input device 40, and the output device 50 are connected together in a communicative manner via a network 60. The network 60 may be a network including a mobile communication network and the Internet.

[0026] like Figure 1 As shown, the camera 30, the voice input device 40, and the output device 50 are installed in the house 2. In addition, although the house 2 is taken as an example of a building in this embodiment, the house 2 may be other types of buildings. For example, the house 2 may be a building used for other purposes such as a store or an office.

[0027] In addition, in this embodiment, as an example, the case where user A and user B are located in the house 2 is described. The terminal device 20A is a terminal device owned by the user A located in the house 2. The terminal device 20B is a terminal device owned by the user B located in the house 2. In the following description, when there is no need to distinguish between the terminal device 20A and the terminal device 20B, they may be described as simply "terminal device 20". In addition, when there is no need to distinguish between user A and user B, they may be described as simply "user".

[0028] Although in Figure 1 Although one information processing device 10, one camera 30, one voice input device 40, and one output device 50 are shown in the figure, there may be two or more information processing devices 10, one camera 30, one voice input device 40, and one output device 50 respectively.

[0029] In addition, although Figure 1 , two users, user A and user B, are located in the house 2, but any number of users may exist in the house 2. When each user has a terminal device 20, the number of terminal devices 20 corresponds to the number of users.

[0030] The information processing device 10 is, for example, a dedicated computer configured to function as a server. The information processing device 10 may also be a general-purpose PC (Personal Computer).

[0031] The information processing device 10 can communicate with the terminal device 20 , the camera 30 , the voice input device 40 , and the output device 50 via the network 60 .

[0032] The information processing device 10 obtains the action data of a plurality of users in the residence 2 from the terminal device 20, the camera 30, and the voice input device 40. The action data is data related to the actions of the users. The action data includes at least one of image data of the users, voice data of the users' conversations detected, and SNS (Social Networking Service) data posted by the users.

[0033] The information processing device 10 acquires image data of a user in the house 2 captured by the camera 30 from the camera 30. The image data may be still image data or moving image data.

[0034] The information processing device 10 acquires, from the voice input device 40 , voice data of a conversation of a user detected by the voice input device 40 as being present in the residence 2 .

[0035] The information processing device 10 acquires SNS data posted by the user in the house 2 from the terminal device 20. Alternatively, the information processing device 10 acquires SNS data posted by the user in the house 2 from an external server storing the SNS data posted by the user.

[0036] The information processing device 10 extracts a characteristic action indicating that the relationship between multiple users has deteriorated from the acquired user action data. In the following description, a "characteristic action" is defined as an action indicating that the relationship between multiple users has deteriorated. For example, a characteristic action is an action indicating that a quarrel has occurred between multiple users, an action indicating that a fight has occurred between multiple users, and the like.

[0037] The information processing device 10 can determine that the obtained user action data is a unique action based on various criteria and extract the unique action. For example, when the information processing device 10 detects that the action data including voice data contains words that are likely to be violent insults to the other party, it can determine that a quarrel has occurred between multiple users and determine the action data as a unique action.

[0038] When a unique action is extracted, the information processing device 10 identifies a cause pattern, wherein the cause pattern includes a combination of action data associated with the unique action among the action data acquired before the unique action. The cause pattern may include a combination of multiple action data. Whenever a cause pattern is identified, the information processing device 10 saves the identified cause pattern.

[0039] When action data corresponding to action data included in a previously saved cause pattern is obtained, the information processing device 10 generates a message that recommends avoiding deterioration of relationships between multiple users, that is, avoiding situations involving specific actions. In the following description, a message that recommends avoiding situations involving specific actions may be referred to as a "recommended message."

[0040] The information processing device 10 sends the generated recommendation message to either the terminal device 20A or the terminal device 20B, and causes either the terminal device 20A or the terminal device 20B to output the message. The information processing device 10 may also send the generated recommendation message to both the terminal device 20A and the terminal device 20B, and cause both the terminal device 20A and the terminal device 20B to output the message. The information processing device 10 may also send the generated recommendation message to the output device 50, and cause the output device 50 to output the message.

[0041] The terminal device 20 can communicate with the information processing device 10 via the network 60. The terminal device 20 is a terminal device owned by a user located in the residence 2. The terminal device 20 receives a recommendation message from the information processing device 10. The terminal device 20 outputs the received recommendation message. The terminal device 20 can output the recommendation message as a voice. The terminal device 20 can output the recommendation message as an image. The terminal device 20 can also vibrate before outputting the recommendation message to draw the user's attention to the terminal device 20. The terminal device 20 can be, for example, a smartphone or a tablet computer.

[0042] The camera 30 can communicate with the information processing device 10 via the network 60. The camera 30 always captures an image of a user in the house 2. The camera 30 transmits captured image data to the information processing device 10.

[0043] The voice input device 40 can communicate with the information processing device 10 via the network 60. The voice input device 40 always detects the conversation of the user in the house 2. The voice input device 40 sends the detected voice data to the information processing device 10. The voice input device 40 may be a microphone, for example.

[0044] The output device 50 can communicate with the information processing device 10 via the network 60. The output device 50 receives the recommendation message from the information processing device 10. The output device 50 outputs the received recommendation message. The output device 50 includes at least one of a speaker and a display. The output device 50 can output the recommendation message as a voice. The output device 50 can output the recommendation message as an image. The output device 50 can output voice and images, etc. as information that can be perceived by both parties of the multiple users located in the residence 2.

[0045] Reference Figure 2 Next, the configuration of the information processing device 10 according to the embodiment of the present disclosure will be described.

[0046] The information processing device 10 includes a communication unit 11 , a storage unit 12 , an input unit 13 , an output unit 14 , and a control unit 15 .

[0047] The communication unit 11 includes a communication module connected to the network 60. For example, the communication unit 11 may also include a communication module corresponding to a LAN (Local Area Network). In one embodiment, the information processing device 10 is connected to the network 60 via the communication unit 11. The communication unit 11 sends and receives various information via the network 60. The communication unit 11 can communicate with the terminal device 20, the camera 30, the voice input device 40, and the output device 50 via the network 60.

[0048] The storage unit 12 is, for example, a semiconductor memory, a magnetic memory, or an optical memory, but is not limited thereto. The storage unit 12 may also function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores any information used for the operation of the information processing device 10. For example, the storage unit 12 may also store various information received through system programs, application programs, and the communication unit 11. The information stored in the storage unit 12 may also be updated using information received from the network 60 via the communication unit 11. A portion of the storage unit 12 may also be provided outside the information processing device 10. In this case, the portion of the storage unit 12 provided outside may also be connected to the information processing device 10 via any interface.

[0049] The input unit 13 includes one or more input interfaces for detecting user input and obtaining input information based on user operation. The input unit 13 includes, for example, physical buttons, electrostatic capacitance buttons, a touch screen integrated with the display of the output unit 14, or a microphone for receiving voice input, but is not limited thereto.

[0050] The output unit 14 includes one or more output interfaces that output information to notify the user. The output unit 14 includes, for example, a display that outputs information in the form of images or a speaker that outputs information in the form of voice, but is not limited thereto.

[0051] The control unit 15 includes at least one processor, at least one dedicated circuit, or a combination thereof. The processor is a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 15 controls each part of the information processing device 10 and performs processing related to the operation of the information processing device 10.

[0052] Reference Figure 3 The structure of the terminal device 20 involved in the embodiment of the present disclosure is described.

[0053] The terminal device 20 includes a communication unit 21 , a storage unit 22 , an input unit 23 , an output unit 24 , a vibration unit 25 , and a control unit 26 .

[0054] The communication unit 21 includes a communication module connected to the network 60. For example, the communication unit 21 may also include a communication module corresponding to mobile communication standards such as LTE, 4G, and 5G. In one embodiment, the terminal device 20 is connected to the network 60 via the communication unit 21. The communication unit 21 sends and receives various information via the network 60. The communication unit 21 can communicate with the information processing device 10 via the network 60.

[0055] The storage unit 22 is, for example, a semiconductor memory, a magnetic memory, or an optical memory, but is not limited thereto. The storage unit 22 may also function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 22 stores any information used for the operation of the terminal device 20. For example, the storage unit 22 may also store various information received through system programs, application programs, and the communication unit 21. The information stored in the storage unit 22 may also be updated using information received from the network 60 via the communication unit 21. A portion of the storage unit 22 may also be provided outside the terminal device 20. In this case, the portion of the storage unit 22 provided outside may also be connected to the terminal device 20 via any interface.

[0056] The input unit 23 includes one or more input interfaces for detecting user input and obtaining input information based on the user's operation. The input unit 23 includes, for example, physical buttons, electrostatic capacitance buttons, a touch screen integrated with the display of the output unit 24, or a microphone for receiving voice input, but is not limited thereto.

[0057] The output unit 24 includes one or more output interfaces that output information to notify the user. The output unit 24 includes, for example, a display that outputs information in the form of images, or a speaker that outputs information in the form of voice, but is not limited thereto.

[0058] The vibration unit 25 includes a vibration mechanism that can vibrate the entire terminal device 20. The vibration unit 25 may include, for example, an eccentric weight and a motor.

[0059] The control unit 26 includes at least one processor, at least one dedicated circuit, or a combination thereof. The processor is a general-purpose processor such as a CPU or a GPU, or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA or an ASIC. The control unit 26 controls each part of the terminal device 20 and executes processing related to the operation of the terminal device 20.

[0060] (Operation of the information processing system)

[0061] Reference Figures 1 to 3 Come to Figure 1 The operation of the information processing system 1 shown will be described.

[0062] The camera 30 installed in the house 2 always captures an image of a user in the house 2. The camera 30 transmits captured image data to the information processing device 10 as action data of the user.

[0063] The voice input device 40 installed in the house 2 always detects the conversation of the user in the house 2. The voice input device 40 transmits the detected voice data to the information processing device 10 as the user's action data.

[0064] When a user in the house 2 posts SNS data, the terminal device 20 owned by the user transmits the posted SNS data as the user's action data to the information processing device 10. The terminal device 20 may transmit the SNS data to an external server that manages the SNS data.

[0065] The communication unit 11 of the information processing device 10 receives the image data sent by the camera 30 as the user's action data. The control unit 15 obtains the image data sent by the camera 30 as the user's action data via the communication unit 11. The control unit 15 analyzes the obtained image data to recognize which user has performed what action. For example, the control unit 15 analyzes the image and recognizes that user A is drinking beer.

[0066] The communication unit 11 receives the voice data sent by the voice input device 40 as the user's action data. The control unit 15 obtains the voice data sent by the voice input device 40 via the communication unit 11 as the user's action data. The control unit 15 analyzes the obtained voice data to identify which user has had what kind of conversation. For example, the control unit 15 recognizes that user A has made a speech to user B requesting him to do laundry. When identifying which user has made the speech, the control unit 15 can identify it by the characteristics of the voice data, or by analyzing the image data obtained from the camera 30 at the time of the speech.

[0067] The communication unit 11 receives the SNS data sent by the terminal device 20 as the user's action data. The control unit 15 obtains the SNS data sent by the terminal device 20 as the user's action data via the communication unit 11. The control unit 15 analyzes the obtained SNS data to identify which user has posted what kind of comment. For example, the control unit 15 recognizes that user A has posted a comment that he is in poor health.

[0068] <Extraction of unique actions and identification of cause patterns>

[0069] The control unit 15 extracts a unique action indicating that the relationship between the multiple users has deteriorated from the action data of the multiple users obtained from the camera 30 and the voice input device 40. For example, when the control unit 15 detects that the action data including the voice data contains a word that is highly likely to insult the other party, it determines that a quarrel has occurred between the multiple users, and determines the action data as a unique action and extracts it.

[0070] When a unique action is extracted, the control unit 15 analyzes the action data obtained before the extracted unique action is obtained, thereby identifying the combination of action data that can be associated with the unique action. In this embodiment, the combination of action data that can be associated with the unique action identified in this way is called a "cause pattern".

[0071] When analyzing that there is a combination of action data that is frequently acquired before a certain specific unique action, the control unit 15 identifies the combination of action data as a cause pattern.

[0072] For example, the control unit 15 may specify a certain combination of action data as a cause pattern when the probability of a specific action being induced after acquiring a certain combination of action data is greater than or equal to a predetermined threshold. The predetermined threshold may be, for example, 70%.

[0073] exist Figure 4 In FIG. 1 , an example of a cause pattern is shown. Figure 4 The cause patterns 1 and 2 shown are cause patterns associated with a specific action, “User A and User B are arguing.” Cause patterns 1 and 2 each include a combination of three action data.

[0074] Cause pattern 1 is a combination of the following three action data.

[0075] Action data 1: User A refuses to take out the trash

[0076] Action data 2: User A rolls up his socks and puts them into the washing machine

[0077] Action data 3: User B drinks beer

[0078] Cause pattern 1 indicates that when the control unit 15 obtains the above three action data 1 to 3, there is a high possibility that the following is related to a unique action such as "user A and user B are arguing". For example, there is a case where, even if there are actions corresponding to action data 1 and action data 2, if there is no action corresponding to action data 3 afterwards, the possibility of being related to the unique action is also low. In such a case, by specifying the combination of action data 1 to 3 as cause pattern 1, the user's action can be more accurately associated with the unique action.

[0079] Cause pattern 2 is a combination of the following three action data.

[0080] Action data 1: User A requests to do laundry

[0081] Action data 2: User A requests to wash dishes

[0082] Action data 3: User A requests to clean

[0083] Cause pattern 2 indicates that when the control unit 15 obtains the above three action data 1 to 3, there is a high possibility that a unique action such as "user A and user B are arguing" will be caused afterwards. For example, there is a case where, even if there are actions corresponding to action data 1 and action data 2, if there is no action corresponding to action data 3 afterwards, the possibility of being related to the unique action is also low. In such a case, by specifying the combination of action data 1 to 3 as cause pattern 2, the user's action can be more accurately associated with the unique action.

[0084] When the cause pattern associated with the specific action is identified, the control unit 15 stores the identified cause pattern in the storage unit 12 .

[0085] The control unit 15 may store the cause pattern in the storage unit 12 as data that depends on the order of the action data, or may store the cause pattern in the storage unit 12 as data that does not depend on the order of the action data.

[0086] In e.g. Figure 4 When the cause pattern 1 shown is stored in the storage unit 12 as data that depends on the order of the action data, the control unit 15 determines that the combination of the action data 1 and the action data 3 in the order of the change is less likely to cause a unique action. Figure 4 When the cause pattern 1 shown is stored in the storage unit 12 as data that does not depend on the order of the action data, the control unit 15 determines that the combination of the action data 1 to 3 in any order is likely to cause a unique action.

[0087] The control unit 15 may also store the cause pattern in the storage unit 12 in a form that normalizes the action data. Figure 4 When the cause pattern 2 shown is stored in the storage unit 12, it is stored in the storage unit 12 in the form of "user A has entrusted housework three times". In this case, the control unit 15 determines that when user A has entrusted housework three times, there is a high possibility that a specific action will be triggered.

[0088] The control unit 15 may also identify the cause pattern in a manner associated with time, and store the cause pattern in the storage unit 12 in a manner associated with time. Figure 4 When the combination of action data 1 to 3 shown as cause pattern 2 is highly likely to cause a specific action when implemented within a predetermined time range, the combination of action data 1 to 3 is identified as a cause pattern by associating it with the predetermined time range.

[0089] <Generation and output of recommendation messages>

[0090] When the action data is obtained, the control unit 15 determines whether the obtained action data is action data included in the cause pattern stored in the storage unit 12. When it is determined that the obtained action data is included in the cause pattern stored in the storage unit 12, the control unit 15 generates a message recommending that the relationship between the plurality of users be prevented from deteriorating.

[0091] The control unit 15 may generate a recommendation message when the acquired action data matches part of the action data included in the cause pattern. For example, when the cause pattern is a combination of three action data, the control unit 15 may generate a recommendation message when one or two of the action data are acquired.

[0092] Alternatively, the control unit 15 may generate a recommendation message at a stage where multiple action data included in all cause patterns are obtained. For example, when the cause pattern is a combination of three action data, the control unit 15 may generate a recommendation message at a stage where all three action data are obtained. The stage at which the recommendation message is generated may be set, for example, as a setting value.

[0093] The control unit 15 transmits the generated recommendation message to the terminal device 20 via the communication unit 11. The control unit 15 transmits the generated recommendation message to, for example, the terminal device 20 owned by the user who has performed an action corresponding to the action data included in the cause pattern. Figure 4In the case of the action data included in the cause pattern 2 shown, the control unit 15 transmits the recommendation message to the terminal device 20 owned by the user A.

[0094] The communication unit 21 of the terminal device 20 receives the recommendation message transmitted by the information processing device 10 . The control unit 26 acquires the recommendation message transmitted by the information processing device 10 via the communication unit 21 .

[0095] When the recommended message is acquired, the control unit 26 controls the vibration unit 25 to vibrate the entire terminal device 20. The control unit 26 can urge the user of the terminal device 20 to direct his attention to the terminal device 20 by vibrating the terminal device 20.

[0096] The control unit 26 causes the output unit 24 to output the recommendation message. The control unit 26 may cause the output unit 24 to display the recommendation message as an image, or may cause the output unit 24 to output the information as a voice.

[0097] exist Figure 5 , an example of the terminal device 20 causing the output unit 24 to display a recommendation message "Keep your distance from Mr. / Ms. B for now." is shown. If user A who has seen such a recommendation message keeps his distance from user B for now, the probability of a unique action such as a quarrel between user A and user B being triggered can be reduced.

[0098] Although an example has been described in which the control unit 15 transmits the recommendation message to one terminal device 20 and causes the terminal device 20 to output the recommendation message, the control unit 15 may transmit the recommendation message to both terminal devices 20 and cause both terminal devices 20 to output the recommendation message.

[0099] Alternatively, the control unit 15 may send the recommended message to the output device 50 and cause it to be output. Since the message output by the output device 50 can be recognized by multiple users, in this case, the message output by the output device 50 is recognized by both users. By having both users take the action recommended by the recommended message, the probability of a unique action such as a quarrel between user A and user B being triggered can be reduced.

[0100] Reference Figure 6 as well as Figure 7 The operation of the information processing system 1 will be described with reference to the flowchart shown. Figure 6 1 is a flowchart showing a process of specifying a cause pattern by the information processing system 1 . Figure 7 1 is a flowchart showing a process of generating and outputting a recommendation message by the information processing system 1 .

[0101] First, refer to Figure 6The flowchart shown in FIG. 1 is used to explain the process of specifying the cause mode by the information processing system 1.

[0102] In step S101, the control unit 15 of the information processing device 10 obtains the action data of the plurality of users in the house 2. The control unit 15 obtains the action data of the plurality of users in the house 2 from the camera 30 and the voice input device 40 and the like.

[0103] In step S102 , the control unit 15 extracts a specific behavior indicating that the relationship between the plurality of users has deteriorated from the user behavior data acquired from the camera 30 and the voice input device 40 .

[0104] In step S103 , when the unique behavior is extracted, the control unit 15 analyzes the behavior data acquired before the extracted unique behavior is acquired to identify the cause pattern. The control unit 15 stores the identified cause pattern in the storage unit 12 .

[0105] Next, refer to Figure 7 The process of generating and outputting a recommendation message by the information processing system 1 will be described with reference to the flowchart shown in FIG. Figure 7 The process shown is that Figure 6 The processing shown is performed in a state where at least one cause pattern is stored in the storage unit 12 of the information processing device 10 .

[0106] In step S201, the control unit 15 of the information processing device 10 obtains the action data of the plurality of users in the house 2. The information processing device 10 obtains the action data of the plurality of users in the house 2 from the camera 30 and the voice input device 40 and the like.

[0107] In step S202 , the control unit 15 determines whether the acquired action data is action data included in the cause pattern stored in the storage unit 12 .

[0108] If it is determined that the acquired action data is not included in the cause pattern, that is, if the determination is No in step S202, the control unit 15 repeats the process of step S202. If it is determined that the acquired action data is included in the cause pattern, that is, if the determination is Yes in step S202, the control unit 15 proceeds to step S203.

[0109] In step S203 , the control unit 15 generates a recommendation message for recommending avoiding a situation in which the relationship between the plurality of users deteriorates.

[0110] In step S204, the control unit 15 transmits the generated recommendation message. The control unit 15 may transmit the recommendation message to the terminal device 20 and the output device 50. When receiving the recommendation message, the terminal device 20 and the output device 50 output the received recommendation message.

[0111] As described above, in the information processing device 10 according to the present embodiment, the control unit 15 extracts the characteristic action as action data indicating that the relationship between multiple users has deteriorated from the acquired action data. In addition, the control unit 15 identifies the cause pattern including at least one action data associated with the characteristic action in the action data acquired before the extracted characteristic action. Therefore, the information processing device 10 according to the present embodiment can identify the action related to the deterioration of the relationship between multiple users as the cause pattern.

[0112] In addition, as described above, the cause pattern may include a combination of multiple action data. In this way, by identifying the cause pattern including a combination of multiple action data, the information processing device 10 involved in this embodiment can identify a combination of multiple actions that, for example, the user has not noticed and a combination of actions that is likely to deteriorate the relationship between users.

[0113] The present disclosure is not limited to the above-mentioned embodiments. For example, multiple modules recorded in the block diagram may be integrated, or one module may be divided. Instead of executing multiple steps recorded in the flowchart in a time sequence according to the description, the steps may be executed in parallel or in a different order according to the processing capability of the device executing each step or as needed. In addition, changes can be made within the scope of the subject matter of the present disclosure.

[0114] For example, in the above-mentioned embodiment, a part of the processing actions executed in the information processing device 10 can also be executed in the terminal device 20, the camera 30, the voice input device 40 or the output device 50.

[0115] For example, a general-purpose electronic device such as a smartphone or a computer can also be configured to function as the information processing device 10 involved in the above-mentioned embodiment. Specifically, a program describing the processing contents of each function of the information processing device 10 involved in the embodiment is stored in a memory of the electronic device, and the processor of the electronic device reads the program and executes it. Therefore, the disclosure involved in one embodiment can also be implemented as a program executable by a processor.

[0116] For example, although the above-mentioned embodiment is described in a manner that the voice input device 40 and the output device 50 are independent devices, the voice input device 40 and the output device 50 may also be integrated devices. The voice input device 40 and the output device 50 may also be an integrated smart speaker, for example.

[0117] For example, the information processing device 10 described in the above embodiment may be installed in the residence 2 .

[0118] For example, in the above-mentioned embodiment, the case where a cause pattern includes a combination of a plurality of action data is described as an example, but the cause pattern may include only one action data.

[0119] For example, although the above-described embodiment takes the case where two users exist in the house 2 as an example for explanation, the number of users in the house 2 may be one or three or more.

[0120] Explanation of symbols

[0121] 1. Information processing system;

[0122] 2. Residence;

[0123] 10. Information processing device;

[0124] 11. Ministry of Communications;

[0125] 12. Storage unit;

[0126] 13, input unit;

[0127] 14, output unit;

[0128] 15. Control unit;

[0129] 20, terminal device;

[0130] 21. Ministry of Communications;

[0131] 22, storage unit;

[0132] 23, input unit;

[0133] 24, output unit;

[0134] 25, vibration part;

[0135] 26, control unit;

[0136] 30, camera;

[0137] 40, voice input device;

[0138] 50, output device;

[0139] 60, Internet.

Claims

1. An information processing device comprising a control unit, wherein the control unit performs the following processing, namely: Get action data of multiple users. Extracting a unique behavior from the acquired behavior data, the unique behavior being behavior data indicating that the relationship between the plurality of users located in the same house has deteriorated, and identifying a cause pattern, the cause pattern including at least one piece of action data associated with the specific action among the action data acquired before the specific action, The control unit generates a message recommending that the relationship between the plurality of users be prevented from being deteriorated when the action data included in the cause pattern is acquired. the control unit causes an output device capable of outputting information perceivable by each of the plurality of users to output the generated message, The action data includes at least one of image data of the user, voice data of the user's conversation, and social network service data posted by the user. The cause pattern includes a combination of multiple action data. The control unit specifies the combination of the plurality of action data as the cause pattern when the probability that the specific action is triggered after acquiring the combination of the plurality of action data is equal to or greater than a predetermined threshold.

2. The information processing device according to claim 1, wherein: The combination of the plurality of action data depends on the sequence.

3. An information processing system comprising: The information processing device according to claim 1 or 2; At least one of a camera and a voice input device for detecting the action data.

4. A non-transitory computer-readable medium storing a program for causing a computer to perform the following actions, the actions comprising: Get action data of multiple users; extracting a unique behavior from the acquired behavior data, the unique behavior being behavior data indicating that the relationship between the plurality of users located in the same house has deteriorated; Specifying a cause pattern, the cause pattern including at least one piece of action data associated with the specific action among the action data acquired before the specific action; When the action data included in the cause pattern is obtained, a message is generated to recommend avoiding a situation where the relationship between the plurality of users deteriorates; causing an output device capable of outputting information perceivable by each of the plurality of users to output the generated message; causing the action data to include at least any one of image data in which the user is photographed, voice data in which voice of a conversation of the user is detected, and social network service data posted by the user; The cause pattern includes a combination of multiple action data; and When the probability that the specific behavior is triggered after the combination of the plurality of behavior data is obtained is equal to or greater than a predetermined threshold, the combination of the plurality of behavior data is identified as the cause pattern.

5. The non-transitory computer-readable medium of claim 4, wherein: The combination of the plurality of action data depends on the sequence.

6. An information processing method, which is an information processing method in an information processing device, and includes the following processing, namely: Get action data of multiple users; extracting a unique behavior from the acquired behavior data, the unique behavior being behavior data indicating that the relationship between the plurality of users located in the same house has deteriorated; Specifying a cause pattern, the cause pattern including at least one piece of action data associated with the specific action among the action data acquired before the specific action; When the action data included in the cause pattern is obtained, a message is generated to recommend avoiding a situation where the relationship between the plurality of users deteriorates; causing an output device capable of outputting information perceivable by each of the plurality of users to output the generated message; causing the action data to include at least any one of image data in which the user is photographed, voice data in which voice of a conversation of the user is detected, and social network service data posted by the user; The cause pattern includes a combination of multiple action data; and When the probability that the specific behavior is triggered after the combination of the plurality of behavior data is obtained is equal to or greater than a predetermined threshold, the combination of the plurality of behavior data is identified as the cause pattern.

7. The information processing method according to claim 6, wherein: The combination of the plurality of action data depends on the sequence.

Images