Solution provision system

Abstract

To provide a solution providing system that can easily provide an appropriate solution according to a user's emotion or fatigue state by analyzing the user's emotion or fatigue state. [Solution] The system includes a memory unit that stores information on multiple solutions for improving a user's condition, which is one or both of the user's emotions and fatigue state; a user information acquisition unit that acquires user information including information obtained from the user's body or movements; a user state information generation unit that generates user state information based on the information acquired from the body or movements; a solution determination unit that determines a solution from the multiple solutions according to the user state information; and a solution provision unit that provides the determined solution to the user.

Description

[Technical Field]

[0001] The present invention relates to a system for providing a solution to improve a user's emotions or fatigue state. [Background technology]

[0002] BACKGROUND ART Conventionally, biometric devices and mind-body state induction devices are known (see Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-197910 [Patent Document 2] Japanese Patent Publication No. 2020-62282 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the invention of Patent Document 1, the user's condition can be determined based on pulse wave information obtained from an image of the user's face captured using near-infrared light, and a predetermined alarm can be issued according to the user's condition.

[0005] Furthermore, according to the invention of Patent Document 2, the physical condition of the user can be identified from the user's biological information, and a stimulus can be emitted to induce a breathing rhythm that is appropriate for the physical condition.

[0006] These technologies could be applied to a system that analyzes a user's emotions or fatigue state, provides an appropriate solution according to the user's condition, and improves the user's condition.

[0007] The content of the solution that should be provided to the user to improve their condition varies greatly depending on the condition of the user. Therefore, if a solution that is not suitable for the user's condition is provided, it will not only not help improve the user's condition, but may even make it worse.

[0008] However, the technology in Patent Document 1 can only issue a predetermined alarm to the user, and the technology in Patent Document 2 can only issue a stimulus to regulate the breathing rhythm.As a result, they are not mechanisms that can provide appropriate solutions according to the user's emotions or fatigue state.

[0009] Therefore, an object of the present invention is to provide a solution providing system that can analyze a user's emotions or fatigue state and easily provide an appropriate solution according to the user's emotions or fatigue state. [Means for solving the problem]

[0010] 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of the solutions that can be provided to the user; Contains information necessary to obtain information about the user's heart rate a user information acquisition unit that acquires user information; a user status information generation unit that generates user status information indicating the user status of the user based on the user information acquired by the user information acquisition unit; a solution determination unit that determines vibration information as solution information corresponding to the user status information; and a solution provision unit that provides the determined vibration information to the user, The solution determination unit determines, based on the user state information, information on a pattern of change in the period after the start of the vibration as the information on the vibration. It is characterized by:

[0011] The predetermined periodic vibration has the effect of inducing a person to a calm state or inducing recovery from fatigue. In particular, it is more effective to change the period at the start of the vibration and the period of the vibration after the start of the vibration according to the state of the person's heart rate.

[0012] According to the present invention, user information is acquired by a user information acquisition unit, and user status information consisting of information indicating the user's heartbeat cycle is generated by a user status information generation unit based on information regarding the user's heartbeat acquired from the user information.

[0013] And the solution decision part Ri, Yu User Status information Based on , shaking Pattern of change in period after the onset of movement Information but As vibration information Once this is decided, the Solutions Department will Determined vibration information is provided to the user.

[0014] Thus, according to the present invention ,Based on user state information, Since the period of vibration is changed after the start of vibration, the user's emotions and fatigue can be effectively improved.

[0015] The solution providing system of the present invention comprises: 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of the solutions that can be provided to the user; Contains information necessary to obtain information about the user's heart rate a user information acquisition unit for acquiring user information; user a user state information generating unit that generates user state information indicating the user state of the user based on the information; a solution determining unit that determines a solution according to the user state information; and Information a solution providing unit that provides the user with the The user state information generation unit Information necessary to obtain information about the user's heart rate and acquiring autonomic nervous balance information indicating the autonomic nervous balance of the user based on information about the user's heart rate acquired from the Information necessary to obtain information about the user's heart rate acquire information indicating the user's fatigue state based on information about the user's heart rate acquired from the The solution determination unit Solution Informationand a method for bringing the user into a state in which the autonomic nervous system is balanced and the degree of fatigue is low, based on a combination of the autonomic nervous system balance information and the information indicating the fatigue state. Solution Information Determine The solution providing unit Solution Information to the user It is characterized by:

[0016] According to the present invention, the user information acquisition unit acquires user information, and the user status information generation unit generates the user status information. Information needed to obtain information about the user's heart rate Based on information about the user's heart rate acquired from the monitor, autonomic nervous balance information indicating the user's autonomic nervous balance and information indicating the user's fatigue state are acquired.

[0017] Then, the solution determination unit determines solution information for bringing the user into a balanced state of the autonomic nerves and into a state of low fatigue level based on the autonomic nerve balance information and the information indicating the fatigue state, and the solution provision unit provides the user with information on the determined solution.

[0018] According to the present invention, a method for bringing a user into a state of balanced autonomic nerves and low fatigue level is provided based on a combination of two objective pieces of information, namely, information indicating autonomic nerve balance based on information regarding the user's heart rate and information indicating the user's fatigue state. Solution Information is determined, it is possible to effectively reduce the user's fatigue and maintain the autonomic nervous balance.

[0019] In the solution providing system of the present invention, the user state information generation unit acquires information indicating a position in a matrix table having one of the state of autonomic nervous balance of the user indicated by the autonomic nervous balance information and the state of fatigue of the user indicated by the information indicating the fatigue state as a vertical axis and the other as a horizontal axis; The solution determination unit uses information indicating a correspondence between the position acquired by the user state information generation unit and the solution to determine a solution for bringing the user into a balanced state of autonomic nerves and into a state with a low level of fatigue. Solution Information It is preferable to determine

[0020] According to the present invention, solution information for bringing the user into a balanced state of autonomic nervous system and into a state of low fatigue level is determined using specific information indicating the correspondence between the position in a matrix table, in which one of the user's autonomic nervous system balance indicated by the autonomic nervous system balance information and the user's fatigue state indicated by the information indicating the fatigue state is on the vertical axis and the other is on the horizontal axis, thereby effectively reducing the user's fatigue and maintaining the autonomic nervous system balance.

[0021] The solution providing system of the present invention comprises: 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of the solutions that can be provided to the user; Contains information necessary to obtain information about the user's heart rate a user information acquisition unit for acquiring user information; user a user state information generating unit that generates user state information indicating the user state of the user based on the information; a solution determining unit that determines a solution according to the user state information; and Information a solution providing unit that provides the user with the the user state information generating unit information necessary for obtaining information about the user's heart rate acquire information indicating the user's fatigue state based on information about the user's heart rate acquired from the The solution determination unit Solution information from the user Based on fatigue status information The vibration information as the solution information As well as deciding and information indicating the user's fatigue state. based on, The vibration information is The pattern of change in the period after the start of the oscillation Further information will be determined It is characterized by:

[0022] According to the present invention, a heart rate monitor is provided based on information about the user's heart rate. Very tired Since the user condition information is generated based on objective information indicating the working condition, the reliability of the user condition information is increased.

[0023] Furthermore, periodic vibrations have the effect of inducing a person's emotions to a calm state or inducing recovery from fatigue, and it is particularly effective to change the period at the start of vibration and the period of vibration after the start of vibration according to the state of the person's heart rate. This provides information on the user's fatigue level. Based on the pattern of change in period after the start of vibration, the user is provided with Information is determined, and the solution providing unit provides information on the determined solution to the user, thereby effectively improving the user's emotions or fatigue state.

[0024] The solution providing system of the present invention comprises: 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on the plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information; user a user state information generating unit that generates user state information indicating the user state of the user based on the information; a solution determining unit that determines a solution according to the user state information; and Information a solution providing unit that provides the user with the The user state information generation unit The aforementioned accepts input of user information consisting of linguistic information, such as text and / or voice, from the user information acquisition unit, acquires characteristic words and phrases contained in the linguistic information from the linguistic information included in the user information, and generates user state information indicating the user state of the user using either or both of a dictionary of correspondence between the acquired characteristic words and the user state and a judgment model that uses the words and phrases as input and outputs the user state; The solution determination unit Solution Information according to the user state information Solution Information Determine The solution providing unit Solution Information to the user It is characterized by:

[0025] According to the present invention, the user state information generation unit acquires characteristic words and phrases included in the linguistic information, which is one or both of the characters and the voice input by the user, and generates user state information using a dictionary of correspondence between the characteristic words and the user state, which is one or both of the user's emotions and fatigue state, and a determination model that inputs the characteristic words and outputs the user state.The solution determination unit then generates a solution according to the user state information thus determined. Solution Information is determined, and the solution department Solution Information is provided to the user.

[0026] According to the present invention, user state information is generated using specific means, such as a dictionary of characteristic words and phrases contained in either or both of the characters and voice input by the user and the user state, which is either or both of the emotion and fatigue state, and one or both of a judgment model for the user state based on the characteristic words and phrases, thereby improving the accuracy of the user state information.

[0027] As described above, according to the present invention, the user's emotions or fatigue state can be analyzed with high accuracy, and an appropriate solution according to the user's emotions or fatigue state can be easily provided.

[0028] In this solution provision system, The user condition information generation unit acquires autonomic nervous balance information indicating the autonomic nervous balance of the user using one or both of a correspondence dictionary between the acquired characteristic words and the autonomic nervous balance of the user and a determination model that inputs the words and outputs the autonomic nervous balance of the user, and generates user condition information indicating the user condition of the user based on the autonomic nervous balance information. It is preferable.

[0029] According to the present invention, the user condition information generation unit acquires autonomic nervous balance information indicating the user's autonomic nervous balance using either or both of a dictionary of correspondence between characteristic words and the user's autonomic nervous balance and a determination model that uses the words as input and outputs the user's autonomic nervous balance. Then, user condition information indicating the user's condition is generated based on the autonomic nervous balance information.

[0030] In this way, user status information indicating one or both of the user's emotions and fatigue state is generated based on the autonomic nervous balance based on information naturally emitted by the user themselves, such as characters or voice input by the user, thereby increasing the likelihood that the user status information indicates the user's natural state.

[0031] In this solution provision system, the user state information generation unit acquires negative words and phrases included in the linguistic information from the linguistic information included in the user information; The solution determination unit uses one or both of a dictionary of correspondence between the negative word and a positive paraphrase of the negative word or a paraphrase that is less negative than the negative word, and a conversion model that receives the negative word as an input and outputs a positive paraphrase of the negative word or a paraphrase that is less negative than the negative word, to determine a candidate positive paraphrase corresponding to the negative word or a paraphrase that is less negative than the negative word. Solution Information Determine as It is preferable.

[0032] People who are depressed or fatigued tend to use negative words. Many negative words have positive alternatives or alternatives that are less negative than the original. If users can be informed of the existence of such alternatives in a timely manner, they can develop a positive mindset, which is expected to improve their emotions or fatigue.

[0033] According to the present invention, the user state information generating unit acquires negative words and phrases contained in the linguistic information.

[0034] The solution determination unit then uses one or both of a dictionary of correspondence between negative words and positive paraphrases of the words or paraphrases that are less negative than the words, and a conversion model that takes negative words as input and outputs positive paraphrases of the words or paraphrases that are less negative than the words, to determine as a solution a candidate positive paraphrase that corresponds to the negative words or a paraphrase that is less negative than the words.

[0035] According to the present invention, the user can be notified in a timely manner that there are positive alternatives to negative words uttered by the user himself or herself, or alternatives that are less negative than the words, which is expected to have the effect of improving the user's emotions or fatigue state.

[0036] The solution providing system of the present invention comprises: 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on the plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information; user a user state information generating unit that generates user state information indicating the user state of the user based on the information; a solution determining unit that determines a solution according to the user state information; and Information a solution providing unit that provides the user with the the user state information generation unit receives input of user information consisting of linguistic information of the user's voice, acquires characteristic intonations contained in the linguistic information from the linguistic information contained in the user information, and generates user state information indicating the user state of the user using one or both of a dictionary of correspondence between the acquired intonations and the user state and a determination model that takes the intonations as input and outputs the user state; The solution determination unit Solution Information according to the user state information Solution Information Determine The solution providing unit Solution Information to the user It is characterized by:

[0037] According to the present invention, user state information is generated using specific means, such as a dictionary that matches the characteristic intonation contained in the linguistic information of the voice input by the user with the user state, which is one or both of emotions and fatigue, and one or both of a judgment model for the user state based on the characteristic intonation, thereby improving the accuracy of the user state information.

[0038] The solution providing system of the present invention comprises: 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of the solutions that can be provided to the user; Contains information necessary to obtain information about the user's heart rate a user information acquisition unit for acquiring user information; user a user state information generating unit that generates user state information indicating the user state of the user based on the information; a solution determining unit that determines a solution according to the user state information; and Information a solution providing unit that provides the user with the The user state information generation unit Information necessary to obtain information about the user's heart rate Acquiring autonomic nervous balance information indicating the autonomic nervous balance of the user based on information about the user's heart rate acquired from Information necessary to obtain information about the user's heart rate acquiring information indicating a fatigue state of the user based on information about the user's heart rate acquired from receiving input of user information from the user information acquisition unit, the user information being composed of linguistic information such as text and / or voice, and acquiring negative words and phrases included in the linguistic information from the linguistic information included in the user information; The solution determination unit Solution Information based on the autonomic nerve balance information or the information indicating the fatigue state Solution Information and determining whether or not the negative words and phrases are positive synonyms of the negative words and phrases or synonyms that are less negative than the negative words and phrases. And,determining, as information on the solution to be provided to the user, candidate positive paraphrases or candidate paraphrases that are less negative than the negative phrases, corresponding to the negative phrases, using one or both of a conversion model that outputs positive paraphrases of the phrases or candidate paraphrases that are less negative than the negative phrases; The solution providing unit Solution Information to the user It is characterized by:

[0039] As mentioned above, people who are depressed or fatigued tend to use negative words, and many negative words have positive alternatives or alternatives that are less negative than the original. If the user can be informed of the existence of such alternatives in a timely manner, the user can develop a habit of thinking positively, which is expected to have an effect of improving the user's emotions or fatigue state.

[0040] According to the present invention, the reliability of the user condition information is increased because the user condition information is generated based on objective information such as autonomic nervous balance based on information about the user's heart rate. In addition, according to the present invention, the user can be notified in a timely manner that a negative statement made by the user has a positive alternative or an alternative that is less negative than the original statement, which can be expected to further improve the user's emotions or fatigue state.

[0041] In the present invention, The user state information generation unit receives input of user information consisting of linguistic information of the user's voice, and acquires first information indicating the user state of the user using one or both of a correspondence dictionary between the characteristic intonation of the voice included in the linguistic information of the user information and the user state and a determination model that uses the intonation as input and the user state as output, and also acquires user information consisting of an image of the user's skin, acquires information about the user's heartbeat based on a result of analyzing the skin image, acquires second information indicating the user state of the user based on the information about the user's heartbeat, and generates the user state information of the user based on the first information and the second information. It is preferable.

[0042] According to the present invention, first information indicating a user's condition is obtained using specific means, such as a dictionary that maps characteristic intonations contained in the linguistic information of the voice input by the user to the user's condition, which is one or both of emotions and fatigue, and a judgment model for the user's condition based on the characteristic intonation. Second information indicating the user's condition is obtained based on information regarding the user's heart rate, which is based on the results of analyzing an image of the user's skin. Since the user's condition information is generated based on a combination of two objective pieces of information, the first information and the second information, the accuracy of the user's condition information is improved.

[0043] In the present invention, the solution determination unit further determines, based on the user state information, information of periodic vibrations to be provided to the user, the information being included in the solution information to be provided to the user; The solution providing unit provides information about the periodic vibration to the user. It is preferable.

[0044] As described above, periodic vibrations have the effect of inducing a person's emotions to a calm state or inducing a person to recover from fatigue. According to the present invention, the information on the periodic vibrations to be provided to the user, which is included in the information on the solution to be provided to the user, is further determined based on the user state information and provided to the user, thereby more effectively improving the user's emotions and fatigue.

[0045] In the present invention, The user state information generation unit receiving input of user information from the user information acquisition unit, the user information being composed of linguistic information such as text and / or voice, and acquiring negative words and phrases included in the linguistic information from the linguistic information included in the user information; the solution determination unit further determines, as information of the solution to be provided to the user, a candidate positive paraphrase corresponding to the negative phrase or a candidate negative paraphrase corresponding to the negative phrase, using one or both of a correspondence dictionary of the negative phrase and a positive paraphrase of the negative phrase or a paraphrase of the negative phrase that is less negative than the negative phrase, and a conversion model that receives the negative phrase as input and outputs a positive paraphrase of the negative phrase or a paraphrase of the negative phrase that is less negative than the negative phrase; The solution providing unit provides information on the paraphrase candidate phrases to the user. It is preferable.

[0046] According to the present invention, positive paraphrases corresponding to negative words contained in the linguistic information or candidate paraphrases that are less negative than the words are further determined as solution information to be provided to the user and are provided to the user, thereby more effectively improving the user's emotions and fatigue.

[0047] In the present invention, the user information acquisition unit acquires the user information again after the solution is provided to the user; the user state information generation unit regenerates the user state information based on the user information acquired after the solution is provided to the user; The solution determination unit determines a solution according to the regenerated user state information. It is preferable.

[0048] It is expected that the user's emotions or fatigue state will change as a result of providing a solution, over time, or for other reasons. According to the present invention, after a solution is provided to the user, the user information acquisition unit acquires user information again. Then, based on information including the user information acquired after the solution is provided to the user, the user state information generation unit regenerates user state information, and the solution determination unit determines a solution based on the regenerated user state information. Therefore, according to the present invention, it is more likely that an individualized solution can be determined in response to changes in the user's emotions or fatigue state and provided to the user.

[0049] In the solution providing system of the present invention, The solution determination unit is configured to determine the solution that induces the user state to a relaxed state, a calm state, or an alert state, according to the user state information. It is preferable.

[0050] According to the present invention, the solution determination unit determines a solution that induces the user state to a relaxed state, a calm state, or an alert state in accordance with the user state information.

[0051] According to the present invention, it is possible to effectively induce a user into a relaxed, calm, or alert state.

[0052] In this way, the present invention can easily provide an appropriate solution for guiding a user to a relaxed, calm, or alert state according to the user's emotions or fatigue state by analyzing the user's emotions or fatigue state.

[0053] In the solution providing system of the present invention, a desired state receiving unit that receives input of desired state information indicating one or both of the user's desired emotion and fatigue state, The solution determination unit is configured to determine the solution that guides the user state toward a state indicated by the desired state information, based on the user state information and the desired state information. It is preferable.

[0054] According to the present invention, it is possible to effectively induce a user into a desired emotional state or a state of recovery from fatigue.

[0055] In the solution providing system of the present invention, the solution determined by the solution determination unit includes a predetermined periodic vibration according to the user state of the user; The solution determination unit is configured to determine a period of the vibration based on the user state information and the desired state information. It is preferable.

[0056] The predetermined periodic vibration has the effect of inducing a person's emotions to a calm state or inducing recovery from fatigue.

[0057] The present invention provides an effective solution involving periodic vibrations that can effectively induce a user into a desired emotional or fatigue state.

[0061] In the solution providing system of the present invention, the storage unit stores reference state information indicating a reference state in which one or both of the user's emotion and fatigue state are improved, The solution determination unit is configured to determine, based on the user state and the reference state information, the solution that guides the user state toward a state indicated by the reference state information. It is preferable.

[0062] According to the present invention, it is possible to effectively guide the user to the emotional or fatigue state indicated by the reference condition information.

[0066] In the solution providing system of the present invention, The solution determined by the solution determination unit is a combination of music, a recitation voice, and a predetermined periodic vibration according to the user state of the user. It is preferable.

[0067] Reading voices and predetermined periodic vibrations have the effect of activating the parasympathetic nervous system, easing tension and relieving fatigue. Music also has the effect of easing tension or activating the sympathetic nervous system, increasing tension. Appropriate combinations of these are even more effective.

[0068] According to the present invention, the solution determined by the solution determination unit is a combination of music, a recited voice, and a predetermined periodic vibration according to the user's state.

[0069] According to the present invention, a wide range of solutions can be appropriately combined depending on the user's condition to more effectively improve the user's emotions or fatigue state.

[0070] In the solution providing system of the present invention, A vibration generating unit is provided, The solution providing unit provides the user with vibrations based on the information on the vibrations determined by the solution determining unit via the vibration generating unit. It is preferable.

[0071] According to the present invention, vibrations based on vibration information determined by the solution determination unit are transmitted to the user from a vibration generating unit provided in the solution providing system, thereby effectively improving the user's emotions and fatigue without requiring the user to prepare any other equipment that generates vibrations. [Brief explanation of the drawings]

[0085] [Figure 1] 1 is a block diagram showing an overall picture of a solution providing system according to the present invention. [Figure 2] FIG. 2 is a diagram showing the contents of data used in processing by the solution providing system of the present invention. [Figure 3] 3 is a flowchart showing the processing content of the solution providing system of the present invention. [Figure 4] 3 is a flowchart showing the processing content of the solution providing system of the present invention. [Figure 5] 3 is a flowchart showing the processing content of the solution providing system of the present invention. [Figure 6]FIG. 2 is an image diagram showing the processing content of the solution providing system of the present invention. [Figure 7] FIG. 2 is a diagram showing the contents of data used in processing by the solution providing system of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0086] <Solution provision system configuration> First, the configuration of the solution providing system of this embodiment will be described with reference to Fig. 1. Note that the same components will be assigned the same reference numerals and the description thereof may be omitted.

[0087] The solution providing system of this embodiment includes a mobile terminal 10 and a server 30. The mobile terminal 10 and the server 30 are connected to each other so that they can communicate with each other via a communication network 90 such as a mobile phone network. There may be multiple mobile terminals 10 and multiple servers 30.

[0088] The mobile terminal 10 is a general-purpose terminal such as a smartphone or a tablet terminal, and includes a mobile terminal control unit 110, an input unit 130, and an output unit 150. Alternatively, the mobile terminal 10 may be a dedicated terminal that can be carried by the user.

[0089] The mobile terminal control unit 110 is configured with an arithmetic processing unit such as a CPU (Central Processing Unit), a memory, an I / O (Input / Output) device, etc. By reading and executing a predetermined program, the mobile terminal control unit 110 functions, for example, as a user information acquisition unit 111 and a solution provision unit 113, and also functions as a desired condition reception unit 115, a skin image analysis unit 117, and a situation recognition unit 119.

[0090] The user information acquisition unit 111 acquires user information including information obtained from the user's body or movements.

[0091] The information obtained from the user's body or movements acquired by the user information acquisition unit 111 is, for example, at least one piece of information related to the user's heart rate, an image of the user's skin, and language information, which is one or both of text and voice input by the user.

[0092] The user information acquisition unit 111 acquires the user's heart rate via a heart rate monitor, which is the input unit 130, for example.

[0093] Alternatively, the user information acquisition unit 111 acquires, as user information, moving images of the user's skin or still images of the user's skin captured continuously via, for example, a camera that is the input unit 130. The skin images are, for example, images of the user's facial skin or skin of the fingers, but may also be images of skin of other parts of the body.

[0094] The user information acquisition unit 111 receives input of user information including language information such as text and / or voice from the user via the input unit 130 such as a touch panel or a microphone.

[0095] The solution providing unit 113 provides the solution determined by the solution determining unit 313 to the user via the output unit 150.

[0096] The desired state receiving unit 115 receives, via the input unit 130, input of desired state information indicating one or both of the user's desired emotion and fatigue state.

[0097] The skin image analysis unit 117 analyzes the recorded skin image included in the user information.

[0098] The situation recognition unit 119 recognizes whether the user is in a first situation that causes the user information acquisition unit 111 to acquire an image of the user's finger skin, or a second situation that causes the user information acquisition unit 111 to acquire an image of the user's facial skin. For example, the situation recognition unit 119 accepts an input of the user's selection of whether the user is in the first situation or the second situation, and recognizes whether the user is in the first situation or the second situation based on the accepted selection. Alternatively, for example, the situation recognition unit 119 may recognize whether the user is in the first situation or the second situation based on the current time zone.

[0099] The input unit 130 is, for example, an image acquisition means such as a camera, an input mechanism for inputting characters and selection results such as a touch panel or keyboard, or an audio input mechanism such as a microphone.

[0100] The output unit 150 includes a vibration generating unit 151 such as a vibrator, a display unit 153 such as a liquid crystal display, an audio reproducing unit 155 such as a speaker, and a fragrance generating unit 157 that generates a fragrance. Note that a part of the output unit 150 may be an external device.

[0101] That is, for example, when an external device with a vibration generating function is provided as the vibration generating unit 151 instead of or in addition to the vibrator provided in the mobile terminal 10, the mobile terminal 10 and the external device are connected to each other so that they can communicate with each other, for example, by wireless or wired communication. Then, the external device receives a signal for providing a vibration solution from, for example, the mobile terminal 10, and provides the vibration solution to the user in accordance with the signal.

[0102] The server 30 is, for example, a computer that includes a server control unit 310 and a server storage unit 330.

[0103] The server control unit 310 is configured with a processing unit such as a CPU, a memory, an I / O device, etc. By reading and executing a predetermined program, the server control unit 310 functions as, for example, a user state information generation unit 311 and a solution determination unit 313, and also functions as a heart rate information acquisition unit 315, an autonomic nervous balance acquisition unit 317, and a language information analysis unit 319.

[0104] The user state information generating unit 311 generates user state information indicating the user state based on information acquired from the body or movement performed by the user information acquiring unit 111 .

[0105] That is, for example, the user condition information generation unit 311 generates user condition information based on information regarding heart rate included in the user information, the results of analysis by the skin image analysis unit 117, the results of analysis by the language information analysis unit 319, and autonomic nervous balance information.

[0106] The solution determination unit 313 determines a solution from a plurality of solutions according to the user state information.

[0107] Then, the heartbeat information acquisition unit 315 acquires information about the user's heartbeat from the skin image.

[0108] The autonomic nervous balance acquisition unit 317 acquires autonomic nervous balance information indicating the autonomic nervous balance of the user based on information about the heart rate included in the user information or information about the heart rate acquired by the heart rate information acquisition unit 315.

[0109] Alternatively, for example, the autonomic nervous balance acquisition unit 317 acquires the autonomic nervous balance information of the user based on information on the characteristics of the linguistic information acquired by the linguistic information analysis unit 319.

[0110] The language information analysis unit 319 analyzes the language information included in the user information. For example, the language information analysis unit 319 acquires information about the characteristics of the user information from the language information.

[0111] More specifically, for example, the language information analysis unit 319 acquires characteristic words and phrases (such as negative words and phrases) contained in the language information, or, if the user information includes voice, the intonation of the voice, as information regarding the characteristics of the user information.

[0112] The server storage unit 330 is configured with storage devices such as a ROM (Read Only Memory), a RAM (Random Access Memory), an HDD (Hard Disk Drive), etc. The server storage unit 330 stores information on a plurality of solutions that can be provided to the user to improve the user's state, which is one or both of the user's emotions and fatigue state, and further stores a correspondence dictionary 331, a judgment model 333, a conversion model 335, and reference state information 337, as well as processing results of the solution providing system of this embodiment and data required for processing.

[0113] The solution information stored in the server storage unit 330 may be digital data itself, such as music, audio, video, or a predetermined periodic vibration pattern, or may be code information, such as an ID that identifies a predetermined scent. These solutions may be provided to the user alone or in combination to function as, for example, a solution that guides the user state to a relaxed state, a calm state, or an alert state, a solution that guides the user state toward the state indicated by the desired state information, or a solution that guides the user state toward the state indicated by the reference state information 337.

[0114] Furthermore, the solutions stored in the server storage unit 330 include, for example, passive stimulation of the user's sense of touch, hearing, or smell, and more specifically, predetermined periodic vibrations, music, audio reading, predetermined scents, positive paraphrases for negative phrases, or candidate paraphrases that are less negative than the negative phrases, etc. Alternatively, the solutions may be, for example, information encouraging the user to breathe or meditate in a predetermined way.

[0115] The user's emotions are a concept that includes so-called psychological states such as joy, anger, sadness, happiness, or negative states, as well as the state of autonomic nervous system balance, which is one indicator of whether the user is in an excited or relaxed state, and the user's own self-perceived state, such as alertness, rest, calmness, and release.

[0116] The correspondence dictionary 331 is a correspondence table that stores characteristic words and phrases, such as negative words and phrases, included in the linguistic information in association with the degree of the user's state, which is one or both of the user's emotions and fatigue state, as shown in Fig. 2, or may further store positive paraphrases of the words or paraphrases that are less negative than the words in association with the characteristic words and phrases. Alternatively, the correspondence dictionary 331 is a correspondence table that stores voice intonation and user states in association with each other.

[0117] These correspondence dictionaries 331 are used when the user state information generating unit 311 generates user state information or when the solution determining unit 313 determines a solution.

[0118] The judgment model 333 is, for example, a judgment model that takes characteristic words contained in linguistic information as input and outputs the user state, or a judgment model that takes voice intonation as input and outputs the user state, and is used when the user state information generation unit 311 generates user state information.

[0119] The conversion model 335 is a conversion model that takes a negative phrase as input and outputs a positive paraphrase of that phrase or a paraphrase that is less negative than the original phrase, and is used by the solution determination unit 313 when determining a solution.

[0120] The reference state information 337 is information indicating the standard for an improved state of one or both of the user's emotions and fatigue state. For example, the heart rate, heartbeat interval, autonomic nervous balance, which are the standard for an improved state of one or both of the user's emotions and fatigue state, as well as index values for the emotions or fatigue state calculated from these data, are stored for each user characteristic, such as age and gender, or for each time period, such as day or night.

[0121] <Processing Overview> Next, the processing contents of the solution providing system of this embodiment will be described with reference to FIGS.

[0122] <Desired state reception process> When the series of processes starts, first, as necessary, the desired state receiving unit 115 of the mobile terminal 10 receives input of desired state information indicating one or both of the user's desired emotions and fatigue state, and transmits it to the server 30 (Fig. 3 / S110).

[0123] The desired state receiving unit 115 receives input of desired state information by, for example, displaying a plurality of options for the user's desired emotion and / or fatigue state on the display of the mobile terminal 10 and letting the user select one. The options displayed by the desired state receiving unit 115 may be abstract, such as "I want to be more motivated at work" or "I want to improve my recovery ability and relieve fatigue," or more specific, such as "I want to feel cheerful," "I want to feel relaxed," "I want to be calm," "I want to be in a conscious state," or "I want to balance my autonomic nervous system."

[0124] Then, the server 30 receives the desired status information and stores it in the server storage unit 330 (FIG. 3 / S130).

[0125] At this time, the situation recognition unit 119, for example, displays a selection button on the display of the mobile terminal 10 to allow the user to select whether the user is in the first situation or the second situation, and by having the user make a selection, recognizes whether the user is in the first situation or the second situation.

[0126] <User information acquisition process> Thereafter, the user information acquisition unit 111 of the mobile terminal 10 acquires the user information and transmits it to the server 30 (FIG. 3 / S150).

[0127] More specifically, as shown in FIG. 4, for example, the user information acquisition unit 111 acquires an image of the user's skin via a camera included in the mobile terminal 10 (FIG. 4 / S151), and accepts input of characters or the selection result of an option via a touch panel included in the mobile terminal 10, or input of voice via a microphone, as language information (FIG. 4 / S153).

[0128] When acquiring the skin image, the user information acquisition unit 111 acquires the skin image of the user's fingers if the user is in a first situation in which an image of the skin of the user's fingers is to be acquired, based on the recognition result by the situation recognition unit 119, and acquires the skin image of the user's face if the user is in a second situation in which an image of the skin of the user's face is to be acquired.

[0129] Then, the user information acquisition unit 111 acquires information necessary to acquire information related to the heart rate from the skin image, for example, using the function of the skin image analysis unit 117 (FIG. 4 / S155).

[0130] When acquiring information necessary for acquiring information related to the heart rate, the skin image analysis unit 117 analyzes an image of the skin of the user's fingers to acquire the information necessary for acquiring information related to the heart rate based on the recognition result by the situation recognition unit 119 if the user is in a first situation, and analyzes an image of the skin of the user's face to acquire the information if the user is in a second situation.

[0131] The skin image analysis unit 117 may use various known methods to acquire the information necessary to obtain information related to heart rate from the skin image, but for example, the skin image analysis unit 117 acquires information on the change in brightness of each RGB color component from a moving image or continuously captured still images that are skin images.

[0132] Then, the user information acquisition unit 111 transmits the acquired information necessary for acquiring language information and information related to heartbeat to the server 30 as user information (FIG. 4 / S157).

[0133] <User information analysis processing> Then, the user state information generation unit 311 of the server 30 receives the user information (FIG. 3 / S210) and analyzes the information contained in the user information, such as information necessary to obtain information related to the heart rate and language information (FIG. 3 / S230).

[0134] More specifically, as shown in FIG. 5, for example, the user state information generating unit 311 acquires information about the heartbeat from information necessary for acquiring information about the heartbeat via the heartbeat information acquiring unit 315 (FIG. 5 / S231).

[0135] Various known methods may be used by the heart rate information acquisition unit 315 to acquire information about the user's heart rate from the information necessary to acquire information about the heart rate. For example, the heart rate information acquisition unit 315 acquires the user's heart rate by analyzing the change in brightness of a specific color component (e.g., G (green)) included in the information about the change in brightness of each RGB color component using a predetermined algorithm.

[0136] Furthermore, the heartbeat information acquisition unit 315 acquires, for example, the heart rate and heartbeat interval from the user's heartbeat, or calculates and acquires index values such as CVR-R and CCVTP from this information.

[0137] Then, the heart rate information acquisition unit 315 calculates a fatigue level score indicating the user's fatigue state in increments of 0.1 between 0 and 10 using a predetermined algorithm from index values such as CVR-R and CCVTP.

[0138] Furthermore, the user state information generation unit 311 uses the function of the language information analysis unit 319 to obtain information about the characteristics of the language information included in the user information (FIG. 5 / S233).

[0139] The language information analysis unit 319 acquires, for example, characteristic words and phrases (negative words and phrases) included in the language information as information related to the characteristics of the language information. Alternatively, for example, if the user information includes voice, the language information analysis unit 319 acquires the intonation of the voice as information related to the characteristics of the user information.

[0140] Various methods may be used for the language information analysis unit 319 to acquire information about the characteristics of the language information. For example, the language information analysis unit 319 refers to a dictionary of negative words and phrases stored in advance in the server storage unit 330, extracts negative words and phrases included in words entered or selected by the user, and acquires the negative words and phrases as information about the characteristics of the language information.

[0141] Alternatively, for example, the language information analysis unit 319 divides the voice data included in the user information into syllables, analyzes each syllable to obtain its intonation pattern, and refers to a correspondence table stored in advance in the server storage unit 330 that associates the intonation patterns of people's speech with emotions, fatigue levels, autonomic nervous balance, etc., to extract characteristic (for example, frequently occurring) intonation patterns from the voice data included in the user information, and obtains the intonation patterns as information regarding the characteristics of the language information.

[0142] Thereafter, the user state information generation unit 311 uses the function of the autonomic nervous balance acquisition unit 317 to acquire autonomic nervous balance information based on information regarding the heart rate and / or information regarding the features acquired from the language information (FIG. 5 / S235).

[0143] Various methods may be used for the autonomic nervous balance acquisition unit 317 to acquire the autonomic nervous balance information. For example, the autonomic nervous balance acquisition unit 317 performs frequency analysis on the heart rate fluctuations and acquires the ratio (LF / HF) of the low frequency component LF (Low Frequency) to the high frequency component HF (High Frequency) of the heart rate fluctuations as the autonomic nervous balance information.

[0144] Then, the autonomic nerve balance acquisition unit 317 calculates an autonomic nerve balance score indicating the balance of the autonomic nerves of the user in increments of 0.1 between 0 and 10 from the autonomic nerve balance information using a predetermined algorithm.

[0145] <User status information generation process> Then, the user status information generation unit 311 of the server 30 generates user status information indicating the user status of the user based on the analysis results of the user information analysis process (FIG. 3 / S250).

[0146] For example, the user state information generating unit 311 generates the user state information based on the fatigue level score and the autonomic nerve balance score obtained above.

[0147] Then, the user state information generation unit 311 acquires information indicating where the combination of the user's fatigue level and autonomic nervous balance is located in the matrix table, using a matrix table with fatigue level on the vertical axis and autonomic nervous balance on the horizontal axis, as shown in Fig. 6, for example, and sets the acquired information as the user state information. Alternatively, for example, the user state information generation unit 311 may set the information indicating where the combination of the user's fatigue level and autonomic nervous balance is located in the matrix table acquired in this way and information combining the fatigue level score and the autonomic nervous balance score as the user state information.

[0148] That is, as shown in Figure 6, for example, the higher the vertical axis, the higher the level of fatigue, and the lower the level of fatigue. On the horizontal axis, the further to the right, the more the sympathetic nervous system is dominant, i.e., the autonomic nervous balance is in a state of mental tension, and the further to the left, the more the parasympathetic nervous system is dominant, i.e., the autonomic nervous balance is in a state of mental relaxation.

[0149] In Figure 6, an autonomic nerve score of 0 to 3.3 indicates a parasympathetic nerve dominance, 3.4 to 6.6 indicates a harmonious state where the autonomic nerves are balanced, and 6.7 to 10.0 indicates a sympathetic nerve dominance.Furthermore, a fatigue score of 0 to 3.3 indicates low fatigue, 3.4 to 6.6 indicates medium fatigue, and 6.7 to 10.0 indicates high fatigue.

[0150] When the parasympathetic nervous system is dominant and fatigue is moderate to low, the state is over-relaxed; when the sympathetic nervous system is dominant and fatigue is moderate to low, the state is over-active; and when fatigue is high, the state is dangerous. However, when the autonomic nervous system is balanced, the state requires caution.

[0151] On the other hand, when the level of fatigue is moderate and the autonomic nervous system is balanced, it is considered a normal state (me-normal), and when the level of fatigue is low and the autonomic nervous system is balanced, it is considered a fulfilling state (me-fullness). Figure 6 shows that the user state is "caution."

[0152] <Solution determination process> Then, the solution determination unit 313 of the server 30 determines a solution according to the user state information and transmits it to the mobile terminal 10 (FIG. 3 / S270).

[0153] More specifically, for example, a correspondence table between combinations of fatigue level and autonomic nervous balance and solutions, as shown in Figure 7, is stored in advance in the server storage unit 330, and the solution determination unit 313 refers to the correspondence table to obtain a solution or combination of solutions corresponding to the combination of fatigue level and autonomic nervous balance obtained as described above.

[0154] That is, in the above example, since the user's state is a "caution" state in which the autonomic nervous system is balanced but the level of fatigue is high, the solution determination unit 313 determines a 6-minute solution combination that is a combination of vibration and audio, in which a narration (reading voice) is played first, followed by music, as the solution corresponding to the user's state information.

[0155] This is a combination intended to effectively reduce fatigue and maintain autonomic nervous balance by first providing a combination of vibration and narration that has the effect of relieving fatigue to users who are highly fatigued, and then replacing the audio with music that maintains autonomic nervous balance. Also, if the user's emotional or fatigue state is good, the solution time is set relatively short, and if the user's emotional or fatigue state is not good, the solution time is set relatively long within a reasonable range for the user.

[0156] At this time, if the desired state information of the user is stored in the server storage unit 330, the solution determination unit 313 determines a solution that will guide the user's emotion or fatigue state toward the state indicated by the desired state information. That is, for example, if the user state is "caution" and the user's desired state information is "I want to improve my recovery ability and relieve fatigue," the solution determination unit 313 determines a solution to provide to the user by selecting a solution that can guide the user state toward "me-normal" or "me-fullness" from the solutions stored in the server storage unit 330.

[0157] Alternatively, in cases where the user's desired state information is not stored in the server storage unit 330, the solution determination unit 313 may be configured to determine a solution that will guide the user's state toward a relaxed state, that is, a state in which the current autonomic nervous balance is more parasympathetic dominant.

[0158] Alternatively, the solution determination unit 313 may be configured to determine a solution that guides the user state toward a calm state, i.e., a state in which the current autonomic nervous balance is more parasympathetic dominant, at a faster speed than a solution that guides the user state toward a relaxed state, or may be configured to determine a solution that guides the user state toward an awakened state, i.e., a state in which the current autonomic nervous balance is more sympathetic dominant.

[0159] Alternatively, in a case where reference state information 337 indicating a standard state in which one or both of the user's emotions and fatigue state are improved is stored in the server storage unit 330, the solution determination unit 313 may be configured to determine, based on the user state and the reference state information 337, a solution that guides the user state toward the state indicated by the reference state information 337.

[0160] That is, for example, when determining a solution, the solution determination unit 313 refers to the reference state information 337. If, for example, "fatigue level = 0 to 3.3" is specified as the reference state information 337, the solution determination unit 313 determines a solution to provide to the user by selecting a solution that leads the fatigue level to 3.3 or less from the solutions stored in the server storage unit 330.

[0161] <Determining candidate phrases for rephrasing> The solution determined by the solution determination unit 313 may be a positive paraphrase corresponding to a negative phrase, or a paraphrase candidate that is less negative than the negative phrase.

[0162] That is, for example, the solution determination unit 313 uses a correspondence dictionary of negative words contained in the language information with positive paraphrases of the words or paraphrases that are less negative than the words, and determines a candidate positive paraphrase that corresponds to the negative word or a paraphrase that is less negative than the words as a solution.

[0163] More specifically, when the linguistic information includes the word "sad," the solution determination unit 313 refers to a dictionary such as that shown in Fig. 2 and recognizes that the emotional level of the word "sad" is "-99" points and that the corresponding synonyms are "poignant" or "tear-inducing." If the word "sad" appears multiple times in the linguistic information, for example, the solution determination unit 313 recognizes that there is a high need to lower the emotional level, and selects "tear-inducing," which has a lower emotional level of "-28" points, as a candidate synonym with a lower degree of negativity, and determines it as the solution.

[0164] Alternatively, if the linguistic information contains the phrase "exhausted," the solution determination unit 313 refers to a dictionary such as that shown in Fig. 2 and recognizes that positive synonyms for "exhausted" include "fulfilling" and "a chance to show off your skills."Then, depending on the content of the linguistic information, the solution determination unit 313 selects an appropriate phrase from these and determines it as the solution.

[0165] For example, the solution determination unit 313 executes the above process each time the user inputs characters via the input unit 130 of the mobile terminal 10 and performs a character conversion operation, and transmits the selected word or phrase to the mobile terminal 10 as a solution.

[0166] Then, the solution providing unit 113 of the mobile terminal 10 displays the selected word or phrase at the top of a list of conversion candidates, for example, in a solution providing process described later.

[0167] In addition to or instead of the correspondence dictionary, the solution determination unit 313 may determine candidate paraphrases using a conversion model that inputs a negative word or phrase and outputs a positive paraphrase of the word or a paraphrase that is less negative than the word or phrase.

[0168] <Solution provision process> Then, the solution providing unit 113 of the mobile terminal 10 receives the solution (FIG. 3 / S310) and provides the received solution to the user (FIG. 3 / S330).

[0169] More specifically, depending on the content of the solution received from the server 30, the solution providing unit 113 provides the user with passive stimuli such as tactile stimuli such as predetermined periodic vibrations, auditory stimuli such as music, recitation audio, and natural sounds (birdsongs, babbling brooks, etc.), and olfactory stimuli such as predetermined scents, as well as positive paraphrases for negative words or candidate paraphrases that are less negative than the words themselves, via the vibration generating unit 151, display unit 153, audio playing unit 155, and scent generating unit 157.

[0170] That is, for example, if the received solution is digital music data, the solution providing unit 113 causes the audio playback unit 155 to play the music. Alternatively, for example, if the received solution is an ID that specifies a specific fragrance, the solution providing unit 113 causes the fragrance generation unit 157 to generate the fragrance corresponding to the ID.

[0171] The solution providing system of this embodiment may be configured to repeatedly perform this series of processes periodically or irregularly.

[0172] That is, for example, the user information acquisition unit 111 may be configured to acquire user information again after a solution is provided to the user, the user state information generation unit 311 may be configured to regenerate user state information based on information including the user information acquired after the solution is provided to the user, and the solution determination unit 313 may be configured to determine a solution according to the regenerated user state information.

[0173] As described above, according to the present invention, it is possible to analyze a user's emotions or fatigue state and easily provide an appropriate solution according to the user's emotions or fatigue state.

[0174] Although the embodiment of the present invention has been described above, the present invention is not limited to this and various modifications are possible without departing from the spirit of the present invention.

[0175] <Example of implementation of a solution provision system> An example of implementation of a solution provision system is described below.

[0176] <Combination with moving objects> The solution providing system of the present invention may be mounted on a mobile object such as an automobile.

[0177] In this case, for example, the user information acquisition unit 111 acquires user information including images of the face, fingertip skin, and heart rate information of the user who is the driver or passenger of the vehicle via, for example, one or both of a camera and a heart rate monitor installed in the vehicle. Furthermore, the user state information generation unit 311 generates user state information of the driver or passenger based on the acquired information.

[0178] The solution determined by the solution determination unit 313 is, for example, information encouraging the user to take a break, a predetermined periodic vibration according to the user's state, or a combination of these, depending on the user's state.

[0179] Furthermore, the solution providing unit 113 provides the driver or passengers with predetermined periodic vibrations according to the user's state via a vibration generating unit installed in, for example, one or both of the steering wheel and the seat of the automobile. The vibration generating unit may be built into the steering wheel or the seat, or may be an aftermarket device.

[0180] Alternatively or in addition to this, a scent depending on the user's condition may be provided as a solution.

[0181] According to the present invention, rest instructions can be given appropriately according to the emotional state of the driver or passenger, such as stress, and fatigue state, and vibrations are transmitted from the steering wheel or seat during rest, promoting recovery from stress and fatigue. In particular, for the driver, loss of concentration due to stress and fatigue associated with driving can be prevented.

[0182] <Use in medical institutions> The solution providing system of the present invention may be used in medical institutions such as hospitals and dental clinics.

[0183] In this case, for example, the user information acquisition unit 111 acquires user information including images of the patient user's face, skin of the fingers, and information regarding the heart rate via, for example, either a camera or a heart rate monitor installed in an examination room of a medical institution, or both.

[0184] The user condition information generation unit 311 then generates the patient's user condition information based on the acquired information, and the solution providing unit 113 provides the patient with a predetermined periodic vibration corresponding to the patient's user condition information via a vibration generating unit installed on the examination table of the medical institution.

[0185] The solution is determined to be a vibration pattern in which the initial period of the predetermined periodic vibration according to the user state is, for example, approximately synchronized with the patient's heartbeat, and the period is then gradually lengthened.

[0186] This is intended to lower the user's heart rate and reduce anxiety and tension by utilizing the entrainment effect, in which the user's heartbeat cycle is synchronized with the vibrations provided to the user.

[0187] According to the present invention, treatment at a medical institution becomes easier by reducing anxiety and tension. Furthermore, it is expected that the pain felt by the patient during treatment will be alleviated by reducing tension.

[0188] <Use in educational institutions> The solution providing system of the present invention may be used in educational institutions such as schools.

[0189] In this case, for example, the user information acquisition unit 111 acquires user information including images of each student's face, finger skin, and heart rate information via either or both of a camera and a heart rate monitor provided on a tablet terminal used by school students, etc.

[0190] In addition, the user status information generation unit 311 generates user status information of the student, etc. based on the acquired information, and the solution providing unit 113 provides the patient with a predetermined periodic vibration corresponding to the user status information of the student, etc. via a vibration generating unit installed on the tablet terminal and the seat where the student is seated.

[0191] Alternatively, the autonomic nervous balance acquisition unit may further analyze the autonomic nervous state of each person based on the user information.

[0192] In this case, the solution determination unit 313 determines a predetermined periodic vibration solution to guide all students into a balanced state of sympathetic and parasympathetic nerves by providing different stimuli according to the results of the autonomic nerve analysis to students with a dominant sympathetic nerve and students with a dominant parasympathetic nerve.

[0193] The solution providing unit 113 then provides the student with predetermined periodic vibrations according to the student's user state information via a vibration generating unit installed on the tablet terminal and the seat where the student is seated.

[0194] According to the present invention, it is expected that the confused situation in which there is a mixture of students with sympathetic and parasympathetic dominance and it is difficult to control the students can be resolved.

[0195] <Use in office buildings, etc.> The solution providing system of the present invention may be used in rest areas in office buildings, etc.

[0196] In this case, for example, the user information acquisition unit 111 is provided in a terminal installed in a rest spot in an office building, and acquires user information of people who work in the office building.

[0197] The solution determination unit 313 determines a solution according to the user's state, and provides the solution to the user via the solution provision unit 113 installed in a rest spot in the office building.

[0198] The solutions determined by the solution determination unit 313 include, for example, music, voice, video, scent, vibration, brightness and color of lighting, and the like provided in the rest spot.

[0199] In addition, the user information acquired by the user information acquisition unit 111 and the user status information generated by the user status information generation unit 311 may be accumulated and transmitted at any time to the manager of the workplace of the person working in the office building.

[0200] According to the present invention, the stress and fatigue states of people working in an office building can be effectively improved during break times in rest spots according to their stress and fatigue states, and it is also convenient for managers at the workplaces where these people work because it allows them to visualize the stress and fatigue states of employees.

[0201] <Application to electrical equipment with vibration function> For example, office workers can use a facial beauty device with a vibration function to relax and relieve stiffness in their facial muscles during their break. Relaxing once is effective in maintaining concentration, but it would be even better if they could change their mindset after using the facial beauty device and get back to work immediately.

[0202] Therefore, the solution providing system of the present invention may be used together with an electric device such as a facial beauty device having a vibration function.

[0203] In this case, the solution providing system is linked to the timer of the beauty device, and is configured to provide solutions to guide the user into a relaxed state (a state in which the parasympathetic nervous system is dominant) in the first half of the stage, such as vibrations for beauty treatment, and to provide solutions to guide the user into an awakened state (a state in which the sympathetic nervous system is dominant) in the second half of the stage, such as vibrations for beauty treatment.

[0204] According to the present invention, the user can be temporarily relaxed, and can also be alert and ready to start work immediately after the break.

[0205] <Use at accommodation facilities> The solution providing system of the present invention may be used in conjunction with services at accommodation facilities such as hotels and inns.

[0206] In this case, for example, the user information acquisition unit 111 is provided in a terminal installed at the front desk of an accommodation facility such as a hotel or inn, and acquires user information of guests or other users of the facility.

[0207] The solutions determined by the solution determination unit 313 include accommodation service contents, including fragrances, bath additives, and meal contents provided in the guest room used by the user.

[0208] The result of the decision made by the solution decision unit 313 is sent to the customer service staff at the hotel or inn, and is reflected in the content of the services provided to the user.

[0209] According to the present invention, it is possible to provide users of the facility with a more comfortable stay experience, effectively guiding the users to a relaxed, calm, alert, or recovered state.

[0210] <Use in tourism and passenger services> The solution delivery system of the present invention may be used in conjunction with tourism and travel services.

[0211] In this case, for example, the user information acquisition unit 111 is provided in the means of transportation used by the traveler during the trip, and acquires the user information of the traveler.

[0212] The solutions determined by the solution determination unit 313 include, for example, music, voice, video, scent, vibration, brightness and color of lighting provided in the aircraft or seat of the means of transportation.

[0213] According to the present invention, it is possible to provide travelers with a more comfortable travel experience and effectively induce users into a relaxed, calm, alert, or recovered state.

[0214] <Use at event venues such as planetariums, aquariums, and movie theaters> The solution providing system of the present invention may be used in planetariums, aquariums, movie theaters, and the like, as well as in indoor and outdoor event venues such as museums and amusement parks.

[0215] In this case, the user information acquisition unit 111 acquires user information including images of the user's face, finger skin, and information regarding heart rate, for example, via either or both of a camera and a heart rate monitor provided on equipment installed at the event venue or on a portable device, or on the user's mobile terminal 10.

[0216] The user status information generation unit 311 then generates user status information based on the acquired information, and the solution providing unit 113 provides the user with a predetermined periodic vibration corresponding to the user status information, for example, via a vibration generating unit provided in equipment installed at the event venue or in a portable device, or in the user's mobile terminal 10.

[0217] The solution is determined to be a vibration pattern in which the initial period of the predetermined periodic vibration according to the user's state is, for example, approximately synchronized with the user's heartbeat, and the period then gradually becomes longer or shorter.

[0218] This is intended to relax or activate the user by utilizing the entrainment effect in which the heartbeat cycle is synchronized with the vibrations provided to the user. This can change the user's state, including their mood, by, for example, making the user feel more relaxed while watching a planetarium or aquarium, or by inducing the user to feel more energized by the images of an action movie. In this way, by combining the solution provision system with real experiences, the user's state can be effectively induced to a relaxed state, a calm state, an excited state, or a state recovered from fatigue.

[0219] According to the present invention, the event experience can be made more memorable and better in accordance with the content of the event, and the user can be effectively guided into a relaxed state, a calm state, an alert state, or a state recovered from fatigue.

[0220] While the above describes examples of implementation methods of the present invention, these are merely examples of possible implementation methods, and it goes without saying that the present invention may be applied to other implementation methods related to or derived from these. Furthermore, various modifications are possible without departing from the spirit of the present invention.

[0221] For example, the autonomic nervous balance acquisition unit 317 may refer to a correspondence table that associates the above-mentioned intonation patterns of a person's speech with autonomic nervous balance, and acquire the autonomic nervous balance information as the autonomic nervous balance information, which is associated with the characteristic intonation patterns extracted from the voice data included in the user information.

[0222] Alternatively, for example, the autonomic nervous balance acquisition unit 317 may input characteristic words contained in the linguistic information into a model that inputs the autonomic nervous balance and outputs the autonomic nervous balance, and acquire the output autonomic nervous balance as autonomic nervous balance information.

[0223] Alternatively, for example, the user state information generation unit 311 may obtain the user's emotional or fatigue state based on characteristic words and phrases contained in the linguistic information, using either or both of a dictionary of correspondence between words and user states and a judgment model that takes the words and phrases as input and outputs the user state.

[0224] In this case, the user state information generating unit 311, for example, refers to a dictionary of correspondence between words and emotions or fatigue states, and acquires an index value indicating the user's emotion or fatigue state corresponding to the characteristic words included in the language information.

[0225] Alternatively, for example, the user state information generation unit 311 may obtain an index value indicating the user's emotions or fatigue state based on the characteristic intonation contained in the linguistic information, using either or both of a dictionary of correspondence between intonation and user state and a judgment model that takes the intonation as input and outputs the user state.

[0226] In this case, the user state information generating unit 311 inputs, for example, characteristic intonations contained in the linguistic information into the determination model and obtains the index value indicating the user's emotion or fatigue state that is output.

[0227] Alternatively, for example, although the above description has been given of an example in which negative words and user states are associated and stored in the correspondence dictionary 331, this is not limiting. For example, positive words that indicate a feeling of joy or pleasure, or words that indicate relaxation or excitement, may be associated and stored with the user state.

[0228] Alternatively, for example, the user information acquisition unit 111 may acquire, via a camera, moving images of the user's face or still images captured continuously of the user's face as user information, the language information analysis unit 319 may acquire, as feature information, the type and intensity of the user's emotion from the shape and angle of the eyebrows, eyes, nose, or mouth contained in the moving or still images of the face, and calculate an emotion score for the user, and the user state information generation unit 311 may be configured to generate user state information using the emotion score.

[0229] Alternatively, for example, the solution determination unit 313 may be configured to determine the period of vibration based on the user state information and the desired state information.

[0230] More specifically, for example, the solution determination unit 313 determines the period of vibration based on information about the heart rate so that the period at the start of the vibration is approximately synchronized with the user's current heart rate.

[0231] Then, the solution determination unit 313 determines, for example, a pattern of change in one or both of the period and intensity after the start of the vibration based on the desired state information.

[0232] That is, for example, if the solution determination unit 313 is to guide the user to a relaxed, calm, or other state where tension is alleviated based on the desired state information, the solution determination unit 313 determines a solution such that the period is gradually lengthened after the start of vibration. This leads to the user's current autonomic nervous balance being steered toward a state in which the parasympathetic nervous system is more dominant, resulting in a relaxed, calm state.

[0233] Alternatively, for example, when the solution determination unit 313 is to guide the user to an alert state based on the desired state information, the solution determination unit 313 determines a solution such that the vibration period is gradually shortened after the start of vibration, or alternatively or in addition, the vibration intensity is gradually increased, thereby guiding the user's current autonomic nervous balance toward a state in which the sympathetic nervous system is more dominant, and bringing the user to an alert state.

[0234] Alternatively, for example, when a desired state is not input, the solution determination unit 313 determines, based on the reference state information, a vibration pattern that changes the vibration period and intensity so as to guide the user state toward the state indicated by the reference state information as the solution.

[0235] Alternatively, in the above description, the skin image analysis unit 117 of the mobile terminal 10 acquires information necessary to acquire information about the heart rate from the skin image, and the user heart rate information acquisition unit 315 of the server 30 acquires information about the heart rate based on the information necessary to acquire information about the heart rate, but the present invention is not limited to this.

[0236] That is, for example, the skin image analysis unit 117 or the heartbeat information acquisition unit 315 may acquire information about the heartbeat from the skin image. In this case, one of the skin image analysis unit 117 and the heartbeat information acquisition unit 315 is omitted.

[0237] Alternatively, for example, the user information acquisition unit 111 may acquire, as user state information, an answer to a question about the state of the user's face, which has a correlation with the emotion or fatigue state appearing on the user's face.

[0238] More specifically, the user information acquisition unit 111 first displays on the display unit 153 a moving image of the user's face captured by the camera that is the input unit 130 or a still image of the user's face captured continuously, and also displays on the display unit 153 a question about the facial condition that correlates with the emotion or fatigue state appearing on the user's face displayed on the display unit 153.

[0239] Then, the user information acquisition unit 111 accepts input of an answer to the question by the user via the input unit 130, with the image of the face being displayed on the display unit 153. In this case, the input unit 130 is placed in a position where the user can operate the input unit 130 while looking at the question.

[0240] The answers to the questions about the facial condition may be input by voice or text, or may be input by having the user select which of a five-point scale the answer corresponds to. The questions may be one or multiple.

[0241] Alternatively, for example, instead of displaying an image of the face on the display unit 153, the user information acquisition unit 111 may be configured to accept input of a user's answer to a question while showing an image of the user's face reflected in a mirror unit that reflects the user's face.

[0242] In this case, the display unit 153 is placed in a position where the user can see the user's face reflected in the mirror unit at the same time, and the input unit 130 is placed in a position where the user can operate the input unit 130 while looking at the user's face reflected in the mirror unit and the question displayed on the display unit. [Explanation of symbols]

[0243] 10...Mobile terminal, 30...Server, 111...User information acquisition unit, 113...Solution providing unit, 115...Desired state receiving unit, 117...Skin image analysis unit, 119...Situation recognition unit, 311...User state information generation unit, 313...Solution determination unit, 315...Heart rate information acquisition unit, 317...Autonomic nervous balance acquisition unit, 319...Language information analysis unit, 330...Server memory unit, 331...Corresponding dictionary, 333...Decision model, 335...Conversion model, 337...Reference state information.

Claims

1. 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information including information necessary to acquire information on the user's heart rate; a user state information generation unit that generates user state information indicating the user state of the user based on the user information acquired by the user information acquisition unit; a solution determination unit that determines vibration information as information on a solution according to the user state information; and a solution provision unit that provides the determined vibration information to the user, The solution determination unit determines, based on the user state information, information on a pattern of change in the period after the start of the vibration as the information on the vibration. A solution providing system characterized by:

2. 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information including information necessary to acquire information on the user's heart rate; a user state information generation unit that generates user state information indicating the user state of the user based on the user information acquired by the user information acquisition unit; a solution determination unit that determines a solution according to the user state information; and a solution provision unit that provides information on the determined solution to the user, the user condition information generation unit acquires autonomic nerve balance information indicating the autonomic nerve balance of the user based on information about the user's heartbeat acquired from information necessary to acquire information about the user's heartbeat, and acquires information indicating the user's fatigue state based on the information about the user's heartbeat acquired from information necessary to acquire information about the user's heartbeat; the solution determination unit determines, from the information on the plurality of solutions, information on a solution for bringing the user into a balanced state of autonomic nerves and into a state with a low level of fatigue, based on a combination of the autonomic nerve balance information and the information indicating the fatigue state; The solution providing unit provides information on the determined solution to the user. A solution providing system characterized by:

3. The solution providing system according to claim 2, the user state information generation unit acquires information indicating a position in a matrix table having one of the state of autonomic nervous balance of the user indicated by the autonomic nervous balance information and the state of fatigue of the user indicated by the information indicating the fatigue state as a vertical axis and the other as a horizontal axis; A solution providing system characterized in that the solution determination unit determines solution information for bringing the user into a balanced state of autonomic nervous system and a low level of fatigue, using information indicating the correspondence between the location acquired by the user state information generation unit and the solution.

4. 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information including information necessary to acquire information on the user's heart rate; a user state information generation unit that generates user state information indicating the user state of the user based on the user information acquired by the user information acquisition unit; a solution determination unit that determines vibration information as information on a solution according to the user state information; and a solution provision unit that provides the determined vibration information to the user, the user condition information generation unit acquires information indicating a fatigue state of the user based on information about the heart rate of the user acquired from information necessary for acquiring information about the heart rate of the user; The solution determination unit determines information about the vibration as information about the solution based on information indicating the user's fatigue state from information about the plurality of solutions, and further determines information about a pattern of change in the period after the start of the vibration as information about the vibration based on the information indicating the user's fatigue state. A solution providing system characterized by:

5. 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information; a user status information generation unit that generates user status information indicating the user status of the user based on the user information acquired by the user information acquisition unit; a solution determination unit that determines a solution according to the user status information; and a solution provision unit that provides information on the determined solution to the user; the user state information generation unit receives input of user information from the user information acquisition unit, the user information being composed of linguistic information, which is one or both of text and voice, from the user, acquires characteristic words and phrases contained in the linguistic information contained in the user information, and generates user state information indicating the user state of the user using one or both of a dictionary of correspondence between the acquired characteristic words and the user state and a determination model that uses the words and phrases as input and outputs the user state; the solution determination unit determines information on a solution according to the user state information from information on the plurality of solutions; The solution providing unit provides information on the determined solution to the user. A solution providing system characterized by:

6. The solution providing system according to claim 5 , The user condition information generation unit acquires autonomic nervous balance information indicating the autonomic nervous balance of the user using one or both of a correspondence dictionary between the acquired characteristic words and the autonomic nervous balance of the user and a determination model that inputs the words and outputs the autonomic nervous balance of the user, and generates user condition information indicating the user condition of the user based on the autonomic nervous balance information. A solution providing system characterized by:

7. 7. The solution providing system according to claim 5, the user state information generation unit acquires negative words and phrases included in the linguistic information from the linguistic information included in the user information; The solution determination unit determines, as information on the solution, a candidate positive paraphrase corresponding to the negative phrase or a candidate paraphrase that is less negative than the negative phrase, using one or both of a correspondence dictionary of the negative phrase and a positive paraphrase of the negative phrase or a paraphrase that is less negative than the negative phrase, and a conversion model that receives the negative phrase as input and outputs a positive paraphrase of the negative phrase or a paraphrase that is less negative than the negative phrase. A solution providing system characterized by:

8. 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information; a user status information generation unit that generates user status information indicating the user status of the user based on the user information acquired by the user information acquisition unit; a solution determination unit that determines a solution according to the user status information; and a solution provision unit that provides information on the determined solution to the user; the user state information generation unit receives input of user information consisting of linguistic information of the user's voice, acquires characteristic intonations contained in the linguistic information from the linguistic information contained in the user information, and generates user state information indicating the user state of the user using one or both of a dictionary of correspondence between the acquired intonations and the user state and a determination model that takes the intonations as input and outputs the user state; the solution determination unit determines information on a solution according to the user state information from information on the plurality of solutions; The solution providing unit provides information on the determined solution to the user. A solution providing system characterized by:

9. 1. A system for providing information on solutions that can be provided to a user to improve one or both of a user's emotions and fatigue state, the system comprising: a storage unit that stores information on a plurality of solutions that can be provided to the user; a user information acquisition unit that acquires user information including information necessary to acquire information on the user's heart rate; a user state information generation unit that generates user state information indicating the user state of the user based on the user information acquired by the user information acquisition unit; a solution determination unit that determines a solution according to the user state information; and a solution provision unit that provides information on the determined solution to the user, the user condition information generation unit acquires autonomic nervous balance information indicating the autonomic nervous balance of the user based on information about the user's heartbeat acquired from information necessary to acquire information about the user's heartbeat, or acquires information indicating the user's fatigue state based on information about the user's heartbeat acquired from information necessary to acquire information about the user's heartbeat; and receiving input of user information from the user information acquisition unit, the user information being composed of linguistic information such as text and / or voice, and acquiring negative words and phrases included in the linguistic information from the linguistic information included in the user information; the solution determination unit determines solution information from the plurality of solution information based on the autonomic nerve balance information or the information indicating the fatigue state, and further determines, as the solution information to be provided to the user, a candidate positive paraphrase corresponding to the negative phrase or a candidate positive paraphrase corresponding to the negative phrase, using one or both of a correspondence dictionary of the negative phrase and a paraphrase of the negative phrase or a paraphrase of the negative phrase that is less negative than the negative phrase, and a conversion model that receives the negative phrase as input and outputs a paraphrase of the negative phrase or a paraphrase of the negative phrase that is less negative than the negative phrase; The solution providing unit provides information on the determined solution to the user. A solution providing system characterized by:

10. In the solution providing system according to any one of claims 1 to 9, The user state information generation unit receives input of user information consisting of linguistic information of the user's voice, and acquires first information indicating the user state of the user using one or both of a dictionary of correspondence between the user state and characteristic intonation of the voice included in the linguistic information included in the user information and a judgment model that uses the intonation as input and the user state as output, and also acquires user information consisting of an image of the user's skin, acquires information about the user's heartbeat based on a result of analyzing the skin image, acquires second information indicating the user state of the user based on the information about the user's heartbeat, and generates the user state information of the user based on the first information and the second information. A solution providing system characterized by:

11. In the solution providing system according to any one of claims 2, 3, and 5 to 9, the solution determination unit further determines, based on the user state information, information of periodic vibrations to be provided to the user, the information being included in the solution information to be provided to the user; The solution providing unit provides information about the periodic vibration to the user. A solution providing system characterized by:

12. A solution providing system according to any one of claims 1 to 4, 8, and 10, The user state information generation unit receiving input of user information from the user information acquisition unit, the user information being composed of linguistic information such as text and / or voice, and acquiring negative words and phrases included in the linguistic information from the linguistic information included in the user information; the solution determination unit further determines, as information of the solution to be provided to the user, a candidate positive paraphrase corresponding to the negative phrase or a candidate negative paraphrase corresponding to the negative phrase, using one or both of a correspondence dictionary of the negative phrase and a positive paraphrase of the negative phrase or a paraphrase of the negative phrase that is less negative than the negative phrase, and a conversion model that receives the negative phrase as input and outputs a positive paraphrase of the negative phrase or a paraphrase of the negative phrase that is less negative than the negative phrase; The solution providing unit provides information on the paraphrase candidate phrases to the user. A solution providing system characterized by:

13. A solution providing system according to any one of claims 1 to 12, the user information acquisition unit acquires the user information again after the solution is provided to the user; the user state information generation unit regenerates the user state information based on the user information acquired after the solution is provided to the user; The solution determination unit determines a solution according to the regenerated user state information. A solution providing system characterized by:

14. In the solution providing system according to any one of claims 1 to 13, The solution determination unit is configured to determine the solution that induces the user state to a relaxed state, a calm state, or an alert state, according to the user state information. A solution providing system characterized by:

15. In the solution providing system according to any one of claims 1 to 14, a desired state receiving unit that receives input of desired state information indicating one or both of the user's desired emotion and fatigue state, The solution determination unit is configured to determine the solution that guides the user state toward a state indicated by the desired state information, based on the user state information and the desired state information. A solution providing system characterized by:

16. The solution providing system according to claim 15, the solution determined by the solution determination unit includes a predetermined periodic vibration according to the user state of the user; The solution determination unit is configured to determine a period of the vibration based on the user state information and the desired state information. A solution providing system characterized by:

17. In the solution providing system according to any one of claims 1 to 16, the storage unit stores reference state information indicating a reference state in which one or both of the user's emotion and fatigue state are improved, The solution determination unit is configured to determine, based on the user state and the reference state information, the solution that guides the user state toward a state indicated by the reference state information. A solution providing system characterized by:

18. In the solution providing system according to any one of claims 1 to 17, The solution determined by the solution determination unit is a combination of music, a recitation voice, and a predetermined periodic vibration according to the user state of the user. A solution providing system characterized by:

19. In the solution providing system according to any one of claims 1, 4, 11, 16, and 18, A vibration generating unit is provided, The solution providing unit provides the user with vibration based on information about the vibration determined by the solution determining unit via the vibration generating unit. A solution providing system characterized by:

Images