Information processing method, information processing device, and information processing program

Abstract

This information processing method: collects information of at least one of verbal information or non-verbal information about one or more users; determines whether a negative reaction is detected from the user on the basis of at least one of the verbal information or the non-verbal information; and when the negative reaction is detected, reduces the negative reaction by controlling parameter changing devices that can change parameters of a space in which the user is present.

Description

Information processing method, information processing device, and information processing program

[0001] The present disclosure relates to techniques for controlling spatial parameters.

[0002] Systems that provide users with personalized spaces are known. For example, Patent Document 1 discloses an environmental control system that monitors a user's heart rate measured by a biometric measuring device, compares the measured heart rate with reference data stored in a memory unit, and, if the heart rate is lower than the reference data, determines that the sympathetic nervous system is weak and performs a first control to prioritize the sympathetic nervous system. In the first control, this environmental control system causes an indirect lighting device to emit light in a color not preferred by the user, thereby favoring the sympathetic nervous system over the parasympathetic nervous system. Another environmental control system also discloses an environmental control system that determines that the parasympathetic nervous system is weak if the heart rate is higher than the reference data, thereby performing a second control to prioritize the parasympathetic nervous system. In the second control, this environmental control system causes an indirect lighting device to emit light in a color preferred by the user, thereby favoring the parasympathetic nervous system over the sympathetic nervous system.

[0003] However, the system's personalization of the space may result in a decrease in the comfort of the space.

[0004] Patent No. 7113299

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a technology that can improve the comfort of a space.

[0006] An information processing method in one aspect of the present disclosure is an information processing method in a computer, which collects at least one of verbal information and non-verbal information of one or more users, determines whether a negative reaction is detected from the users based on at least one of the verbal information and the non-verbal information, and if a negative reaction is detected, controls a parameter change device capable of changing parameters of a space in which the users are present to reduce the negative reaction.

[0007] According to the present disclosure, the comfort of the space can be improved.

[0008] Fig. 1 is a diagram showing an example of the configuration of an information processing system according to embodiment 1. Fig. 2 is a diagram for explaining the processing of an identification unit. Fig. 3 is a flowchart showing an overall picture of the processing of the information processing system according to embodiment 1. Fig. 4 is a block diagram showing an example of the configuration of an information processing system. Fig. 5 is a diagram schematically showing level correspondence information. Fig. 6 is a flowchart showing an overall picture of the processing of an information processing system according to embodiment 2.

[0009] (Background to the present disclosure) Conventionally, as disclosed in Patent Document 1, a system that provides a personalized space to a user is known.

[0010] However, as a result of personalizing the space, the system may create a space that is uncomfortable for the user. For example, in the first control described in Patent Document 1, the indirect lighting device emits light in a color that the user does not like. If the user does not understand the intention of such control, or if an uncomfortable environment that the user cannot tolerate is created, the user may stop using the system.

[0011] Therefore, in order to encourage users to continue using the system, if a negative reaction is detected from the user, it is desirable to control the parameters of the space so as to reduce the negative reaction and improve the comfort of the space.

[0012] The present invention has been made in view of the above-mentioned problems, and aims to provide a technique that can improve the comfort of a space.

[0013] In order to solve the above problems, the following techniques are disclosed.

[0014] (1) An information processing method in one aspect of the present disclosure is an information processing method in a computer, which collects at least one of verbal information and nonverbal information of one or more users, determines whether a negative reaction is detected from the users based on at least one of the verbal information and the nonverbal information, and, if a negative reaction is detected, controls a parameter change device capable of changing parameters of a space in which the users are present to reduce the negative reaction.

[0015] According to this configuration, when a negative reaction from the user is detected, the parameters of the space are changed to reduce the negative reaction of the user, thereby improving the comfort of the space.

[0016] (2) In the information processing method described in (1) above, when collecting at least one of the verbal information and the non-verbal information, at least one of the user's facial expression, the content of the user's remarks, and the user's biometric information may be collected, and when determining whether or not a negative reaction is detected, it may be determined whether or not a negative reaction is detected based on at least one of the facial expression, the content of the user's remarks, and the biometric information.

[0017] According to this configuration, a negative reaction is detected based on at least one of the user's facial expression, the content of the user's utterance, and the user's biometric information, so that a negative reaction can be detected with high accuracy.

[0018] (3) In the information processing method described in (1) or (2) above, the one or more users are a plurality of users that make up a community, and further, a power level indicating the strength of each of the plurality of users in the community is evaluated based on at least one of the verbal information and the non-verbal information, and the parameter change device may be controlled so that the negative reaction of a first user whose power level is lower than a predetermined value is reduced preferentially over the negative reaction of a second user whose power level is equal to or higher than the predetermined value.

[0019] According to this configuration, the negative reactions of the first user are reduced with priority over the negative reactions of the second user, so that a comfortable space can be provided for the first user, i.e., a comfortable environment can be provided for users who are in a weaker position within the community.

[0020] (4) In the information processing method described in (3) above, the evaluation of the power levels may include evaluating the power levels of each of the plurality of users based on attribute information indicating attributes of each of the plurality of users.

[0021] According to this configuration, attribute information indicating the attributes of each of the multiple users is used to evaluate the power level of each of the multiple users, so that the power level can be evaluated more accurately.

[0022] (5) In the information processing method described in (3) above, the evaluation of the power levels may include evaluating the power levels of each of the plurality of users based on the volume of speech of each of the plurality of users.

[0023] According to this configuration, the amount of speech of each of the plurality of users is used to evaluate the power level of each of the plurality of users, so that the power level can be evaluated more accurately.

[0024] (6) In the information processing method described in (3) above, the degree of influence of each of the plurality of users on the parameter may be calculated based on the content of each of the plurality of users' comments regarding the parameter and the operation history of the parameter change device, and in evaluating the power level, the power level of each of the plurality of users may be adjusted based on the degree of influence.

[0025] The degree of influence on a parameter may be proportional to the power level. Here, according to the above configuration, the power level of each of the multiple users is adjusted based on the degree of influence of each of the multiple users. In this way, the power level of each user can be evaluated more accurately.

[0026] (7) In the information processing method described in any one of (1) to (6) above, if the negative reaction is detected in response to a change in the parameter, the changed parameter may be identified as the negative parameter that caused the negative reaction, and the parameter change device may be controlled to change the negative parameter, thereby reducing the negative reaction.

[0027] According to this configuration, when a negative reaction is detected in response to a change in a parameter, the changed parameter is identified as a negative parameter, and the negative parameter is changed to reduce the negative reaction, thereby more reliably improving the comfort of the space.

[0028] (8) In the information processing method described in any one of (1) to (6) above, the method may further include acquiring an operation history of the user on the parameter change device, and further identifying a negative parameter that caused the negative reaction based on the operation history, and controlling the parameter change device to change the negative parameter, thereby reducing the negative reaction.

[0029] According to this configuration, the negative parameters are identified using the user's operation history, so the negative parameters can be identified with high accuracy.The negative parameters are then changed to reduce negative reactions, so the comfort of the space can be improved more reliably.

[0030] (9) In the information processing method described in any one of (1) to (8) above, when a negative reaction is detected in response to a change in the parameter, the parameter change device may control the parameter change device to reduce the negative reaction by returning the changed setting value to the setting value before the change, either all at once or gradually, and the setting value may be information for operating the parameter change device.

[0031] With this configuration, the setting value that caused the negative reaction is returned to the original setting value, so the negative reaction can be reliably reduced, and as a result, the comfort of the space can be more reliably improved.

[0032] (10) In the information processing method described in any one of (1) to (8) above, the method further includes acquiring an operation history of the user on the parameter change device, and further acquiring a user setting value that the user previously inputted to the parameter change device based on the operation history. In the control of the parameter change device, if a negative reaction is detected in response to a change of the parameter, the user setting value may be output to the parameter change device to reduce the negative reaction.

[0033] The user setting values ​​previously input by the user are considered to be setting values ​​that can provide the user with a comfortable environment. Here, according to the above configuration, if a negative reaction from the user is detected, the user setting values ​​are output to the parameter change device. This allows the parameter change device to operate based on the user setting values, thereby more reliably improving the comfort of the space.

[0034] (11) In another aspect of the present disclosure, an information processing device includes a collection unit that collects at least one of verbal information and nonverbal information of one or more users; a determination unit that determines whether a negative reaction is detected from the user based on at least one of the verbal information and the nonverbal information; and a control unit that, when the negative reaction is detected, controls a parameter change device that can change parameters of a space in which the user is present to reduce the negative reaction.

[0035] According to this configuration, it is possible to provide an information processing device that can obtain the same effects as the above-described information processing method.

[0036] (12) In another aspect of the present disclosure, an information processing program causes a computer to function as an information processing device, and causes the computer to collect at least one of verbal information and nonverbal information of one or more users, determine whether a negative reaction is detected from the users based on at least one of the verbal information and the nonverbal information, and, if a negative reaction is detected, control a parameter change device capable of changing parameters of a space in which the users are present to reduce the negative reaction.

[0037] According to this configuration, it is possible to provide an information processing program that can achieve the same effect as the above-described information processing method.

[0038] The present disclosure can also be realized as an information processing system operated by such an information processing program. Needless to say, such a computer program can be distributed on a non-transitory computer-readable recording medium such as a CD-ROM or via a communication network such as the Internet.

[0039] Note that each of the embodiments described below represents a specific example of the present disclosure. The numerical values, shapes, components, steps, and step orders shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims that represent the highest concept are described as optional components. Furthermore, in all of the embodiments, the respective contents can be combined.

[0040] (First Embodiment) FIG. 1 is a diagram illustrating an example of the configuration of an information processing system 100 according to a first embodiment. The information processing system 100 is a system that improves the comfort of a room (an example of a space) in a house where a user lives. As illustrated in FIG. 1 , the information processing system 100 according to this embodiment includes a plurality of parameter change devices 1, one or more response acquisition sensors 5, a plurality of parameter measurement sensors 6, a user terminal 7, and a server 10 (an example of an information processing device). The plurality of parameter change devices 1, the one or more response acquisition sensors 5, the plurality of parameter measurement sensors 6, the user terminal 7, and the server 10 are connected to each other so as to be able to communicate with each other via a network NW. The network NW is, for example, a public communication line such as the Internet. However, the network NW may also be a local area network.

[0041] Each of the multiple parameter change devices 1 is a device capable of changing the parameters of a room. A parameter is a variable that affects the comfort of the room. Examples of parameters include temperature, humidity, illuminance, color temperature, the volume of sound output into the space, the genre of music, the genre of video output to a display or the like placed in the room, the type of fragrance, the concentration of the fragrance, the airflow, the airflow direction, and the carbon dioxide concentration.

[0042] The multiple parameter change devices 1 according to this embodiment include a speaker 2, an air conditioner 3, and a lighting device 4. The speaker 2 is installed on the floor or a table of a room and outputs sounds such as music and voices at a predetermined volume. The air conditioner 3 is installed on the wall or ceiling of the room and controls the temperature and humidity of the room. The lighting device 4 is installed on the ceiling of the room and controls the illuminance and color temperature of the room. Note that the configuration of the multiple parameter change devices 1 is not limited to that shown in FIG. 1 . For example, the multiple parameter change devices 1 may further include various parameter change devices such as a fragrance generator, a ventilation device, an air blower, and an indirect lighting device. Furthermore, it is not necessary to install multiple parameter change devices 1 in a room; a single parameter change device 1 may be installed.

[0043] Each of the one or more response acquisition sensors 5 acquires a user's response to a parameter. The one or more response acquisition sensors 5 includes, for example, one or more microphone devices, one or more imaging devices, and one or more biometric sensors. The one or more microphone devices capture sounds generated in a room and generate sound data recording the sounds. For example, the one or more microphone devices generate sound data recording a user's speech. The one or more imaging devices capture images of the user's facial expressions, the user's body movements, etc., and generate image data or video data recording the facial expressions and body movements. The one or more microphone devices and the one or more imaging devices are installed, for example, on the walls or ceiling of the room. The one or more biometric sensors acquire biometric information such as the user's pulse and heart rate. The one or more biometric sensors are configured, for example, by a wearable device such as a smart watch. Information collected by the microphone devices, imaging devices, and biometric sensors is transmitted to the server 10. Note that the microphone devices, imaging devices, and biometric sensors may be built into a user terminal 7, which will be described later.

[0044] Each of the multiple parameter measurement sensors 6 measures a room parameter. The multiple parameter measurement sensors 6 include various sensors such as a thermometer, a hygrometer, a photometer, a color temperature meter, and a sound pressure meter. In addition, the multiple parameter measurement sensors 6 may further include various sensors capable of measuring room parameters. Furthermore, the information processing system 100 does not necessarily need to include multiple parameter measurement sensors 6, and may include only a single parameter measurement sensor 6.

[0045] The user terminal 7 is an information processing terminal operated by a user, and is configured, for example, by a desktop computer, a laptop computer, or a mobile terminal such as a smartphone or a tablet terminal.

[0046] The server 10 is, for example, a cloud server configured with one or more computers. As shown in FIG. 1, the server 10 includes a communication circuit 20, a memory 30, and a processor 40.

[0047] The communication circuit 20 is a communication interface circuit compatible with a communication method using a network such as Ethernet (registered trademark), and connects the server 10 to the network NW.

[0048] The memory 30 is configured by a non-volatile rewritable storage device such as a solid state drive, a hard disk drive, etc. The memory 30 according to this embodiment has a negative word storage unit 31 and a negative facial expression storage unit 32.

[0049] The negative word storage unit 31 stores negative words. Negative words are words that are considered to indicate a user's discomfort or dislike. For example, the negative word storage unit 31 stores various words such as "hot," "cold," "humid," "dry," "dark," "glaring," "noisy," "can't hear," and "not to my liking."

[0050] The negative facial expression storage unit 32 stores template images that show negative facial expressions. A negative facial expression is an expression that shows discomfort or disgust. For example, the negative facial expression storage unit 32 stores various template images such as a frowning facial expression, a grimacing facial expression, a stern facial expression, etc.

[0051] The processor 40 is configured by, for example, a CPU. The processor 40 has a collection unit 41, a determination unit 42, an identification unit 43, and a control unit 44. The collection unit 41 to the control unit 44 may be realized by the processor 40 executing a predetermined program stored in the memory 30, or may be configured by a dedicated hardware circuit.

[0052] The collection unit 41 collects verbal information and non-verbal information. Verbal information refers to linguistic information emitted by the user. Examples of verbal information include the user's utterances and text included in messages sent by the user through the user terminal 7. Non-verbal information refers to non-verbal information emitted by the user. Examples of non-verbal information include the user's facial expression, biometric information, gaze, posture, gestures, body language, tone of voice, voice volume, and user attributes (described below). The collection unit 41 acquires verbal information and non-verbal information based on, for example, information acquired by one or more of the reaction acquisition sensors 5, a message transmission history recorded in the user terminal 7, and the like.

[0053] The collection unit 41 does not necessarily need to collect both verbal information and non-verbal information, and may collect only one of the verbal information and non-verbal information.

[0054] The determination unit 42 determines whether or not a negative reaction is detected from the user based on the verbal information and non-verbal information collected by the collection unit 41. A negative reaction refers to a reaction that indicates a feeling of disgust or discomfort.

[0055] It should be noted that the determination unit 42 does not necessarily need to detect a negative reaction based on both verbal information and non-verbal information, and may detect a negative reaction based on either verbal information or non-verbal information.

[0056] The determination unit 42 according to the present embodiment determines whether or not a negative reaction is detected based on at least one of the user's facial expression, the content of the user's utterance, and the user's biological information. Details will be described later.

[0057] The identification unit 43 identifies the negative parameters that have caused the negative reaction, i.e., the identification unit 43 identifies the parameters that the user is dissatisfied with.

[0058] The processing of the identification unit 43 will be described with reference to FIG. 2 . FIG. 2 is a diagram for explaining the processing of the identification unit 43, showing that three parameter changes were made and that a negative reaction was detected after the third parameter change. The horizontal axis t in FIG. 2 represents time, with the left side of the horizontal axis t representing the past and the right side representing the present. As shown in FIG. 2 , the first parameter change changes the genre of background music output in the room from A (e.g., classical music) to B (e.g., pop music). The first parameter change also changes the volume of the background music from 30 decibels to 40 decibels. The second parameter change changes the illuminance from 500 lux to 750 lux. The second parameter change also changes the light temperature from 2800 Kelvin to 4000 Kelvin. The third parameter change changes the room temperature from 23.5 degrees Celsius to 25 degrees Celsius. In this specification, temperatures are expressed in degrees Celsius unless otherwise specified. However, if necessary, Celsius may be interpreted as Fahrenheit. As shown in FIG. 2 , a negative reaction is detected after the third parameter change. In this case, the identification unit 43 identifies the parameter, room temperature 25 degrees, as a negative parameter. Thus, when a negative reaction is detected in response to a parameter change, the identification unit 43 according to this embodiment identifies the changed parameter as the negative parameter that caused the negative reaction. In other words, when there is temporal synchronization between the parameter change and the detection of the negative reaction, the identification unit 43 identifies the parameter related to the change as a negative parameter. For example, when a negative reaction is detected within a predetermined time after the parameter change, the identification unit 43 determines that there is temporal synchronization between the parameter change and the detection of the negative reaction.

[0059] When a negative reaction is detected, the control unit 44 controls the parameter modification device 1 to reduce the negative reaction. Furthermore, the control unit 44 according to the present embodiment controls the parameter modification device 1 so that the negative parameter identified by the identification unit 43 is changed, thereby reducing the negative reaction.

[0060] Specifically, the control unit 44 executes a first control and a second control. The first control is executed when a predetermined condition is satisfied, and is a control for creating a space personalized for the user. In the first control, the control unit 44 outputs setting values ​​for operating the parameter change device 1 and changes the parameters of the room, thereby personalizing the room.

[0061] The second control is a control executed by the control unit 44 when a negative reaction of the user is detected in response to a change in the room parameters by the first control. In the second control, the control unit 44 reduces the negative reaction by simultaneously returning the setting values ​​changed by the first control to the setting values ​​before the change. Details will be described later.

[0062] The processing of the information processing system 100 configured as described above will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an overall view of the processing of the information processing system 100 according to the first embodiment. The processing shown in Fig. 3 starts, for example, when a predetermined condition for executing the first control is satisfied.

[0063] In step S1, the control unit 44 executes a first control to create a space personalized for the user. For example, the control unit 44 changes the set temperature (an example of a set value) of the air conditioner 3 from 23.5 degrees to 25 degrees. As a result, the room temperature (an example of a parameter) changes from 23.5 degrees to 25 degrees.

[0064] In step S2, the collection unit 41 collects verbal information and non-verbal information. For example, the collection unit 41 collects sound data including the user's utterances (hereinafter referred to as user utterance data), image data including the user's facial expressions (hereinafter referred to as user facial expression data), and the user's heart rate based on data acquired by one or more response acquisition sensors 5. In addition, the collection unit 41 may collect text sent by the user via the user terminal 7 as verbal information.

[0065] In step S3, the determination unit 42 determines whether a negative reaction is detected. If a negative reaction is detected (YES in step S3), the process proceeds to step S4. If a negative reaction is not detected (NO in step S3), the process ends. The process of the determination unit 42 in step S3 will be described in detail below.

[0066] First, the determination unit 42 determines whether or not negative words are detected from the user utterance data acquired in step S2. For example, the determination unit 42 analyzes the user utterance data to convert the content of the user's utterance into text, and checks whether or not the converted text contains words corresponding to negative words stored in the negative word storage unit 31. Note that, if text is collected in step S2, the determination unit 42 may further determine whether or not negative words are included in the text.

[0067] Next, the determination unit 42 determines whether a negative facial expression is detected from the user facial expression data acquired in step S2. For example, the determination unit 42 extracts feature amounts of the user facial expression image and feature amounts of each of the plurality of template images stored in the negative facial expression storage unit 32. Then, the determination unit 42 calculates the similarity between the user facial expression image and each of the plurality of template images based on these feature amounts. Then, if the similarity between the user facial expression image and any of the plurality of template images exceeds a predetermined reference similarity, the determination unit 42 determines that a negative facial expression has been detected.

[0068] Next, the determination unit 42 determines whether negative biological information is detected from the biological information acquired in step S2. Negative biological information is biological information that is considered to indicate a negative reaction. For example, the determination unit 42 determines whether the user's heart rate exceeds a reference heart rate. If the user's heart rate exceeds the reference heart rate, the determination unit 42 determines that negative biological information has been detected.

[0069] If at least one of negative words, negative facial expressions, and negative biometric information is detected, the determination unit 42 determines that a negative reaction has been detected (YES in step S3). On the other hand, if none of negative words, negative facial expressions, and negative biometric information is detected, the determination unit 42 determines that a negative reaction has not been detected (NO in step S3).

[0070] The determination unit 42 may determine that a negative reaction has been detected when at least two of the negative words, negative facial expressions, and negative biometric information are detected. Alternatively, the determination unit 42 may determine that a negative reaction has been detected when all of the above are detected.

[0071] In step S4, the identification unit 43 identifies a negative parameter. For example, assume that a negative reaction is detected within a predetermined time after the room temperature is changed to 25 degrees Celsius by the first control in step S1. In this case, the identification unit 43 determines that there is temporal synchronization between the change of the parameter and the detection of the negative reaction, and identifies the parameter of room temperature 25 degrees as a negative parameter.

[0072] In step S5, the control unit 44 controls the parameter change device 1 so as to reduce negative reactions. That is, the control unit 44 performs the second control. For example, the control unit 44 immediately returns the set temperature of the air conditioner 3, which was changed to 25 degrees in the first control, to 23.5 degrees. This returns the room temperature to 23.5 degrees, thereby reducing the user's negative reactions.

[0073] According to the information processing system 100 configured as described above, when a negative reaction from the user is detected, the parameters of the space are changed to reduce the negative reaction of the user, thereby improving the comfort of the space.

[0074] Furthermore, according to the information processing system 100S, negative reactions are detected based on information that the user can instantly provide, such as the user's facial expression, the content of the user's statements, and biometric information. This configuration allows for faster detection of negative parameters compared to detecting negative reactions by having the user answer a questionnaire about room parameters, for example. Furthermore, room parameters are changed based on the quickly detected negative parameters, allowing for quick improvement in the comfort of the space. Furthermore, usability is high because the user does not need to perform cumbersome tasks such as pressing a button or answering a questionnaire to explicitly express their intention.

[0075] The present disclosure can employ the following modifications.

[0076] (1-1) In the first embodiment, an example in which the control unit 44 executes the first control has been described, but the first control is not essential. That is, the control unit 44 may have only the function of executing the second control. For example, when multiple users are present in a room and one of the multiple users manually changes the setting value of the parameter change device 1, and a negative reaction is detected from a user other than the one user, the control unit 44 may execute the second control.

[0077] Furthermore, in the first embodiment, an example has been described in which the first control is executed to provide a user with a personalized space, but the first control does not necessarily have to be executed in accordance with the above-mentioned purpose. The first control may simply be control that automatically changes space parameters according to preset conditions. For example, the first control may be control that automatically changes the volume of the speaker 2 according to the number of people in the room, control that automatically changes the room temperature according to the time of day, control that automatically changes the amount of light in the room according to the weather, etc.

[0078] (1-2) In the first embodiment, an example has been described in which the control unit 44 returns the changed set value to the set value before the change all at once. However, the control unit 44 may return the changed set value to the set value before the change in stages. For example, the control unit 44 may return the set temperature of the air conditioner 3, which was changed from 25 degrees to 23.5 degrees in the first control, in stages in the second control, from 23.5 degrees to 24 degrees, 24.5 degrees, and 25 degrees.

[0079] In this modification, one or more response acquisition sensors 5 may measure the user's response to the parameters at each stage, and the collection unit 41 may collect these responses. The control unit 44 may then maintain the set value at which the user's response is no longer measured. For example, assume that the control unit 44 returns the set temperature of the air conditioner 3 to 24.5 degrees and no negative response is measured from the user. In this case, the control unit 44 may maintain the set temperature at 24.5 degrees. In this way, by gradually changing the set value while measuring the user's response, it is possible to identify a set value that is optimized for the user.

[0080] (1-3) In the first embodiment, an example has been described in which the processor 40 includes the identification unit 43, but the identification unit 43 is not essential. For example, if the information processing system 100 includes a single parameter change device 1 instead of multiple parameter change devices 1, and this single parameter change device 1 is a device that can change only a single parameter, the identification unit 43 is not essential.

[0081] (1-4) The collection unit 41 may acquire a history of user operations on the parameter change device 1. Furthermore, the identification unit 43 may identify a negative parameter that has caused a negative reaction based on the operation history.

[0082] For example, the collection unit 41 according to this modification acquires user setting values ​​previously input by the user to the parameter modification device 1 based on the operation history. Then, when a negative reaction of the user is detected, the identification unit 43 identifies a parameter modification device 1 having a setting value that does not match the user setting value, and identifies the parameter controlled by the parameter modification device 1 as a negative parameter. Then, the control unit 44 controls the parameter modification device 1 so as to change the negative parameter, thereby reducing the negative reaction.

[0083] If there are multiple user setting values, the collection unit 41 may identify one user setting value by a predetermined method and acquire the user setting value. For example, the collection unit 41 may acquire the user setting value that has been set by the user the most times among the multiple user setting values.

[0084] Additionally, the collection unit 41 may identify a user's preferred setting value from the user's operation history. For example, if the user has input the same setting value into a predetermined parameter change device 1 a predetermined number of times in the past, the collection unit 41 may identify the setting value as the user's preferred setting value. Then, if a setting value different from the user's preferred setting value is input into the predetermined parameter change device 1, the identification unit 43 may identify the parameter controlled by the parameter change device 1 as a negative parameter.

[0085] (1-5) In the second control, the control unit 44 may output the user's setting value to the parameter change device 1 to reduce negative reactions. Specifically, the collection unit 41 according to this modification acquires a history of user operations on the parameter change device 1. Then, the collection unit 41 acquires user setting values ​​that the user previously input to the parameter change device 1 based on the operation history. Then, when a negative reaction is detected in response to a parameter change, the control unit 44 according to this modification outputs the user's setting value to the parameter change device 1.

[0086] For example, assume that the control unit 44 changes the set temperature of the air conditioner 3 from 23.5 degrees to 25 degrees through the first control, changing the room temperature to 25 degrees. Then, assume that a negative reaction from the user is detected in response to the change in the room temperature to 25 degrees. Here, assume that the user previously set the set temperature of the air conditioner 3 to 22 degrees. In this case, the collection unit 41 acquires "set temperature 22 degrees" as the user setting value. The control unit 44 then outputs this user setting value to the air conditioner 3, changing the room temperature to 22 degrees. This reliably reduces the user's negative reaction, thereby more reliably improving the comfort of the room.

[0087] (1-6) In the first embodiment, an example has been described in which the information processing system 100 is applied to a room in a house where a user lives, but the application of the information processing system 100 is not limited to rooms. The information processing system 100 can be applied to various spaces formed in, for example, an office or a public facility.

[0088] Second Embodiment An information processing system 100S according to a second embodiment will be described. The information processing system 100S is a system that provides a comfortable environment to members of a community whose power level is lower than a predetermined value. Note that a "community" refers to a collective made up of multiple members, and examples of communities include a workplace, a home, a local club, and a sports club. In addition, communities include communities made up of members who provide services and members who receive the services, such as hospitals and supermarkets. A power level is an index that indicates the strength of each of multiple members' power within a community. Power within a community refers to, for example, authority, influence, speaking ability, and political power.

[0089] In the following, an example will be described in which the information processing system 100S is applied to an office (an example of a space) of a company (an example of a community) made up of multiple members. In the following example, the multiple members making up the company are referred to as multiple users.

[0090] In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted.

[0091] Fig. 4 is a block diagram showing an example of the configuration of an information processing system 100S. As shown in Fig. 4, a server 10S of the information processing system 100S has a memory 30S and a processor 40S. The memory 30S has an attribute information storage unit 33 and a level correspondence information storage unit 34. The processor 40S has a control unit 44S instead of the control unit 44 described above. The processor 40S also has a level evaluation unit 45.

[0092] The attribute information storage unit 33 of the memory 30S stores attribute information indicating the attributes of each of a plurality of users. The attribute information includes, for example, age, job title, length of membership in a community, and blood relationship between a user and other users.

[0093] The level correspondence information storage unit 34 of the memory 30S stores level correspondence information 340 indicating the correspondence between user attributes and user power levels. FIG. 5 is a diagram illustrating the level correspondence information 340. As shown in FIG. 5, the level correspondence information 340 according to the present embodiment indicates that the power level value assigned to the position of trainee is 2, the power level value assigned to the position of general manager is 6, and the power level value assigned to the position of director is 8. The level correspondence information 340 also indicates that the power level value assigned to the position of assistant manager is 4, the power level value assigned to the position of manager is 5, the power level value assigned to the position of executive director is 9, and the power level value assigned to the position of president is 10. In addition, the level correspondence information 340 may store correspondence between various attributes and power levels.

[0094] The level evaluation unit 45 of the processor 40S evaluates the power level indicating the strength of each of the multiple users within the community based on at least one of the verbal information and non-verbal information collected by the collection unit 41.

[0095] The level evaluation unit 45 according to this embodiment evaluates the power level of each of the multiple users based on attribute information indicating the attributes of each of the multiple users, as will be described in detail later.

[0096] The control unit 44S of the processor 40S controls the parameter change device 1 so that the negative reaction of a first user whose power level is lower than a predetermined value is reduced preferentially over the negative reaction of a second user whose power level is equal to or higher than the predetermined value. The predetermined value is, for example, 5. In this case, a user whose power level is lower than 5 corresponds to the first user, and a user whose power level is 5 or higher corresponds to the second user. Note that the predetermined value is not limited to 5 and can be changed as appropriate.

[0097] The processing of the information processing system 100S configured as described above will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an overall view of the processing of the information processing system 100S according to the second embodiment. The processing shown in Fig. 6 starts, for example, when a predetermined condition for executing the first condition is satisfied. In the following description, it is assumed that the multiple users include user A, user B, and user C.

[0098] In step S101, the collection unit 41 acquires attribute information of each of a plurality of users. For example, the collection unit 41 collects attribute information indicating that the job title of user A is trainee, the job title of user B is general manager, and the job title of user C is director. As described above, this attribute information is stored in the attribute information storage unit 33 of the memory 30S.

[0099] In step S102, the level evaluation unit 45 evaluates the power levels of each of the multiple users. Specifically, the level evaluation unit 45 acquires the level correspondence information 340 shown in FIG. 5 from the level correspondence information storage unit 34 of the memory 30S. Then, by referring to the level correspondence information 340, the level evaluation unit 45 determines that the power level of a trainee is assigned a value of 2, the power level of a general manager is assigned a value of 6, and the power level of a director is assigned a value of 8. Next, by referring to the attribute information acquired by the collection unit 41 in step S1, the level evaluation unit 45 determines that User A's job title is Trainee, User B's job title is General Manager, and User C's job title is Director. Based on this information, the level evaluation unit 45 evaluates User A's (Trainee) power level as 2, User B's (General Manager) power level as 6, and User C's (Director) power level as 8.

[0100] In step S103, the level evaluation unit 45 identifies a first user whose power level is lower than a predetermined value and a second user whose power level is equal to or higher than the predetermined value. The predetermined value is, for example, 5. In this case, user A whose power level is 2 corresponds to the first user, and user B whose power level is 6 and user C whose power level is 8 correspond to the second users.

[0101] In step S104, the control unit 44S executes the first control. For example, the control unit 44S executes the first control to change the set temperature (an example of a set value) of the air conditioner 3 from 23.5 degrees to 25 degrees. As a result, the temperature (an example of a parameter) in the office changes from 23.5 degrees to 25 degrees.

[0102] In step S105, the collection unit 41 collects verbal information and nonverbal information of each of the multiple users. For example, the collection unit 41 collects sound data including utterances of users A, B, and C, image data including facial expressions of users A, B, and C, and heart rates (an example of biometric information) of users A, B, and C.

[0103] In step S106, the determination unit 42 determines whether a negative reaction is detected from the first user whose power level is lower than a predetermined value. If a negative reaction is detected from the first user (YES in step S106), the process proceeds to step S107. If a negative reaction is not detected from the first user (NO in step S106), the process proceeds to step S108.

[0104] In this example, since user A corresponds to the first user, the determination unit 42 determines whether or not a negative reaction is detected from user A. That is, it determines whether or not negative words, negative facial expressions, or negative biometric information are detected from user A. This process is the same as that described in step S3 of the first embodiment, and therefore a description thereof will be omitted.

[0105] In step S107, the negative parameters of the first user are identified, and the parameter modification device 1 is controlled so as to reduce the negative reaction of the first user. That is, the parameters with which the first user is dissatisfied are identified, and the parameter modification device 1 is controlled so as to change the parameters, thereby reducing the negative reaction of the first user. The processing of step S107 is the same as the processing described in steps S5 and S6 of the first embodiment, and therefore a description thereof will be omitted.

[0106] In addition, if there are multiple first users and a negative reaction is detected from each of the multiple first users, the control unit 44S may execute the processing of step S107 so as to reduce the negative reaction of, for example, the first user with the lowest power level among the multiple first users.

[0107] In step S108, the determination unit 42 determines whether a negative reaction is detected from the second user whose power level is equal to or greater than a predetermined value. If a negative reaction is detected from the second user (YES in step S108), the process proceeds to step S109. If a negative reaction is not detected from the second user (NO in step S108), the process ends.

[0108] In step S109, the determination unit 42 identifies the negative parameters of the second user and controls the parameter change device 1 so as to reduce the negative reaction. That is, the determination unit 42 identifies the parameters that the second user is dissatisfied with and changes the parameters to reduce the negative reaction of the second user. The processing in step S109 is similar to the processing described in steps S5 and S6, and therefore will not be described again.

[0109] In addition, if there are multiple second users and a negative reaction is detected from each of the multiple second users, the control unit 44S may execute the processing of step S109 so as to reduce the negative reaction of, for example, the second user with the lowest power level among the multiple second users.

[0110] According to the information processing system 100S configured as described above, the negative reactions of the first user are reduced preferentially over the negative reactions of the second user, so that a comfortable space can be provided for the first user. In other words, a comfortable environment can be provided for users who are in a weaker position within the community.

[0111] However, users with low power levels may avoid expressing negative reactions through verbal information out of consideration for users with high power levels. In contrast, the above configuration detects a user's negative reaction based on verbal information and nonverbal information. That is, a negative reaction is detected based on information explicitly provided by the user and information implicitly provided by the user. This makes it possible to more reliably detect a negative reaction from a user with a low power level than when a user's negative reaction is detected based solely on verbal information. As a result, a comfortable environment can be provided more reliably for users with a low power level.

[0112] The present disclosure can employ the following modifications.

[0113] (Modification)

[0114] (2-1) In the second embodiment, an example has been described in which the power level of a user is evaluated based on the user's job title, but the level evaluation unit 45 may also evaluate the power level of a user based on the amount of speech made by the user. For example, the level evaluation unit 45 may calculate the total speech time of each user over a certain period of time, and evaluate the power level of users in descending order of the total time.

[0115] The level evaluation unit 45 may also evaluate the power level of each user based on the voice volume of each user. For example, the level evaluation unit 45 may calculate an average voice volume for each user and evaluate the power level higher in descending order of the average voice volume.

[0116] (2-2) The level evaluation unit 45 may adjust the power level evaluated based on the user's job title based on the amount of messages sent by the user over a certain period of time. For example, the level evaluation unit 45 may adjust the power level of the user in accordance with the amount of messages sent in a day.

[0117] Specifically, the level evaluation unit 45 according to this modification calculates the message volume for one day using the following formula 1.

[0118] c(t) = c1 · k1 + c2 · k2 + c3 · k3 + c4 · k4 ... (Equation 1) In the above equation 1, c(t) indicates the amount of speech made by the user in one day. c1 indicates the amount of time the user participated in online meetings in one day. k1 indicates a first weighting coefficient for correcting c1. c2 indicates the amount of time the user exchanged messages using online chat tools such as email in one day. k2 indicates a second weighting coefficient for correcting c2. c3 indicates the amount of time the user participated in real-world meetings in one day. k3 indicates a third weighting coefficient for correcting c3. c4 indicates the amount of time the user engaged in one-on-one conversations with another user in the real world in one day. k4 indicates a fourth weighting coefficient for correcting c4.

[0119] The above formula 1 is merely an example, and the level evaluation unit 45 may calculate the user's daily message volume by referring to various information other than c1 to c4. The information related to c1 to c4 in the above formula 1 may be acquired by the collection unit 41 at a predetermined timing. For example, the information may be acquired when the company's business hours end. In this modification, the values ​​of k1 to k4 are set so that k1 < k2 < k3 < k4. However, the magnitude relationship between k1 and k4 can be changed as appropriate. Regarding c2 in formula 1, the collection unit 41 may acquire the number of characters of text sent by the user in the exchange using the online chat tool instead of the time spent by the user exchanging messages using the online chat tool. In this case, the level evaluation unit 45 may convert the number of characters of text into the time required for the exchange using the online chat tool using a predetermined calculation formula. For example, the level evaluation unit 45 calculates the average number of characters spoken by the user per minute based on the verbal information. The level evaluation unit 45 then performs a conversion process based on the average number of characters spoken and the number of characters of text. Specifically, if a user's average number of characters spoken per minute is 100 characters, and the user sends 300 characters of text using an online chat tool, the level evaluation unit 45 calculates that the time required for the user to communicate using the online chat tool is 3 minutes.

[0120] After calculating Equation 1, the level evaluation unit 45 calculates Equation 2 below.

[0121] L1 = L2 + l c(t) (Equation 2) L1 indicates the value of the user's power level adjusted based on the user's speech volume over a certain period of time. L2 indicates the value of the power level set based on the user's attribute information. In other words, L2 indicates the value of the user's power level evaluated by the process described in step S102 of embodiment 2. l is a correction coefficient for adjusting the value of L1. c(t) is the user's speech volume in one day calculated using Equation 1 above.

[0122] The level evaluation unit 45 then evaluates L1 calculated by calculating Equation 2 as the user's power level. In this way, the power level statically determined based on the user's attribute information can be dynamically adjusted based on the user's daily message volume. This allows for a more accurate evaluation of the user's power level.

[0123] (2-3) The collection unit 41 may calculate the degree of influence of each of the multiple users on the parameter based on the content of each user's comments regarding the parameter and the operation history of the parameter change device. Furthermore, the level evaluation unit 45 may adjust the power level of each of the multiple users based on the degree of influence.

[0124] The collection unit 41 according to this modification acquires the content of comments made by multiple users regarding the parameters. The collection unit 41 also acquires the operation history of the parameter change device. The collection unit 41 then acquires, for each user, the number of times that the content of comments has been associated with a change to the parameter. This "number of times that the content of comments has been associated with a change to the parameter" is the user's influence on the parameter.

[0125] For example, assume that user A says "it's hot," and then the air conditioner 3 is operated within a predetermined time, causing the temperature in the office to change. In this case, the collection unit 41 determines that the content of the statement and a change in the parameter are associated. In addition, in this case, the collection unit 41 increases the number of times (the degree of influence) that the content of user A's statement and a change in the parameter are associated. The collection unit 41 performs the above process for each of the multiple users.

[0126] Then, the level evaluation unit 45 according to this modification calculates the following equation 3.

[0127] L3 = L2 + p d (Equation 3) L3 indicates the value of the user's power level adjusted based on the influence. L2 indicates the value of the power level set based on the user's attribute information. That is, L2 indicates the value of the user's power level evaluated by the processing of step S102 in embodiment 2. p indicates a weighting coefficient. d indicates the user's influence.

[0128] The level evaluation unit 45 then evaluates L3 calculated by calculating Equation 3 as the user's power level. In this way, the power level statically determined based on the user's attribute information can be dynamically adjusted based on the degree of influence on the user's parameters. This allows the user's power level to be evaluated more accurately.

[0129] (2-4) Multiple users may control the parameter modification device 1 through the user terminal 7. Furthermore, in this modification, the operation history of each user on the parameter modification device 1 may be stored in the memory 30S. In this manner, the user setting values ​​for each user are stored in the memory 30S. In particular, the user setting values ​​of the first user may be stored. The identification unit 43 may identify negative parameters based on the user setting values ​​of the first user. That is, when a negative reaction from the first user is detected, the control unit 44S may identify a parameter modification device 1 having a setting value that does not match the user setting value of the first user, and identify the parameter controlled by the parameter modification device 1 as a negative parameter. Furthermore, when a negative reaction from the first user is detected, the control unit 44S may output the user setting value of the first user to the parameter modification device 1.

[0130] (2-5) In the second embodiment, an example in which the information processing system 100S is applied to a company office has been described, but the application of the information processing system 100S is not limited to offices. The information processing system 100S can be applied to various spaces formed in homes, public facilities, and the like.

[0131] The present disclosure is useful in the technical field of improving the comfort of spaces.

Claims

1. An information processing method for a computer, comprising: collecting at least one of verbal and non-verbal information from one or more users; determining whether a negative reaction is detected from the users based on at least one of the verbal and non-verbal information; and, if a negative reaction is detected, controlling a parameter change device capable of changing parameters of a space in which the users exist, to reduce the negative reaction.

2. The information processing method of claim 1, wherein collecting at least one of the verbal information and the non-verbal information includes collecting at least one of the user's facial expression, the content of the user's remarks, and the user's biometric information, and determining whether or not a negative reaction is detected includes determining whether or not a negative reaction is detected based on at least one of the facial expression, the content of the user's remarks, and the biometric information.

3. The information processing method according to claim 1 or 2, wherein the one or more users are a plurality of users that make up a community, and further comprising: evaluating a power level indicating the strength of each of the plurality of users in the community based on at least one of the verbal information and the non-verbal information; and controlling the parameter modification device so that the negative reaction of a first user whose power level is lower than a predetermined value is reduced with priority over the negative reaction of a second user whose power level is equal to or higher than the predetermined value.

4. The information processing method according to claim 3, wherein the evaluation of the power levels includes evaluating the power levels of each of the plurality of users based on attribute information indicating attributes of each of the plurality of users.

5. The information processing method according to claim 3, wherein the evaluation of the power levels includes evaluating the power levels of each of the plurality of users based on the volume of speech of each of the plurality of users.

6. The information processing method of claim 3, further comprising: calculating the degree of influence of each of the plurality of users on the parameter based on the content of each of the plurality of users' comments regarding the parameter and the operation history of the parameter change device; and adjusting the power level of each of the plurality of users based on the degree of influence in evaluating the power level.

7. The information processing method according to claim 1 or 2, further comprising: when a negative reaction is detected in response to a change in the parameter, identifying the changed parameter as the negative parameter that caused the negative reaction; and controlling the parameter change device to change the negative parameter, thereby reducing the negative reaction.

8. The information processing method according to claim 1 or 2, further comprising: acquiring an operation history of the user on the parameter change device; identifying a negative parameter that caused the negative reaction based on the operation history; and controlling the parameter change device to change the negative parameter, thereby reducing the negative reaction.

9. The information processing method of claim 1 or 2, wherein, in the control of the parameter change device, if a negative reaction is detected in response to a change to the parameter, the negative reaction is reduced by returning the changed setting value to the setting value before the change, either all at once or gradually, and the setting value is information for operating the parameter change device.

10. An information processing method as described in claim 1 or 2, further comprising: acquiring an operation history of the user on the parameter change device; and acquiring a user setting value previously input by the user to the parameter change device based on the operation history; and controlling the parameter change device so that, when a negative reaction is detected in response to a change to the parameter, the user setting value is output to the parameter change device to reduce the negative reaction.

11. An information processing device comprising: a collection unit that collects at least one of verbal information and non-verbal information of one or more users; a determination unit that determines whether a negative reaction is detected from the user based on at least one of the verbal information and the non-verbal information; and a control unit that, when the negative reaction is detected, controls a parameter change device that can change the parameters of the space in which the user is present, to reduce the negative reaction.

12. An information processing program that causes a computer to function as an information processing device, the information processing program causing the computer to: collect at least one of verbal and non-verbal information from one or more users; determine whether a negative reaction is detected from the users based on at least one of the verbal and non-verbal information; and, if a negative reaction is detected, control a parameter change device that can change the parameters of the space in which the user is present, to perform processing to reduce the negative reaction.

Images