Information processing device, information processing method, and program
The information processing device addresses the challenge of evoking a sense of connection through a combination of mindfulness and connection recall modes, using targeted stimuli to reduce loneliness and enhance self-compassion and resilience.
Patent Information
- Application Number
- PCT/JP2024/016192
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-11
- Filing Date
- 2024-04-25
- Publication Date
- 2024-11-14
AI Technical Summary
There is a lack of effective methods to evoke a sense of connection in users, which is crucial for alleviating loneliness and improving mental well-being, especially in a society experiencing increased social isolation and mental health issues due to factors like VUCA and negative aspects of SNS.
An information processing device and method that includes a mindfulness mode and a connection recall mode, where the user receives a first stimulus in mindfulness mode to induce a state of mindfulness, followed by a second stimulus in connection recall mode based on recall target person information, using a combination of physical and cognitive stimuli to evoke a sense of connection.
The solution effectively reduces feelings of loneliness and tension, improves self-compassion, and enhances inner sustainability by promoting a sense of connection, leading to improved mental well-being and resilience.
Smart Images

Figure JP2024016192_14112024_PF_FP_ABST
Abstract
Description
Information processing device, information processing method, and program
[0001] The present technology relates to an information processing device, an information processing method, and a program, and particularly to an information processing device, an information processing method, and a program that can effectively evoke a sense of connection in a user.
[0002] In addition to the recent trend toward nuclear families, as we enter an era of longer lifespans, with people living to 100 years old, there is a possibility that people will experience increased or prolonged loneliness due to separation from their partners, etc. Loneliness and social isolation increase levels of stress hormones and inflammation, which in turn increase the risk of heart disease, type 2 diabetes, dementia, and suicide.
[0003] Social isolation is a state of having little social connection or interaction. Loneliness is the subjective perception of social isolation, which occurs when an individual's desired level of social connection or interaction is higher than their actual level.
[0004] For example, even if a person is socially isolated, they will not feel lonely if they prefer to be alone, and even if a person is not socially isolated, they will feel lonely if they seek further social connections and interactions. Therefore, it is difficult to determine the occurrence of loneliness from the perspective of others, and the occurrence of loneliness depends more on the person's subjective perception, i.e., state of mind, than on the situation. Therefore, in order for a person to eliminate loneliness, it is effective for that person to recognize or recall a sense of connection with people or things that they need (hereinafter referred to as a sense of connection).
[0005] However, we live in an unpredictable age of VUCA (Volatility, Uncertainty, Complexity, Ambiguity), and social networking services (SNS) have negative aspects, such as mechanisms that excessively stimulate the desire for approval and induce dependency. As a result, an increasing number of people feel lonely, find life difficult, or lack self-confidence, which in turn leads to an increase in the number of people suffering from mental illness due to stress and trauma. For example, the percentage of people suffering from depression or depressive symptoms in Japan was 7.9% in 2013, but has nearly doubled to 17.3% in 2020.
[0006] However, it is difficult to immediately improve surrounding situations and systems and eliminate the causes of stress and trauma. Therefore, it is important to cultivate a state of mind that is not overwhelmed by the current situation. Therefore, there is new value and significance in transforming people's minds themselves and improving inner mental sustainability, such as resilience, and methods to achieve this are becoming increasingly important.
[0007] Resilience is a non-cognitive ability that allows people to overcome adversity and use it as a learning experience to grow. For example, resilience allows people to recover from the shock of facing adversity and adapt to it when faced with adversity such as a harsh environment, stressful situation, or traumatic experience.
[0008] Self-compassion is effective in increasing inner sustainability, and there is a deep relationship between resilience, a sense of connection, and self-compassion (see, for example, non-patent document 1).
[0009] As mentioned above, recalling a sense of connection is important not only for eliminating feelings of loneliness, but also for improving inner sustainability.
[0010] Incidentally, there is a biometric information sharing system that detects biometric information of a subject and performs an expression operation of the biometric information in a predetermined manner (see, for example, Patent Document 1).
[0011] "Self-Compassion: How to Stay Your Best Self," by Arimitsu Koki, published in the DIAMOND Harvard Business Review, Diamond Inc., April 10, 2019, JP Patent Publication No. 2009-15449
[0012] However, no method has been devised to effectively evoke a sense of connection in users.
[0013] The present technology has been made in view of such circumstances, and is intended to enable users to effectively evoke a sense of connection.
[0014] An information processing device or program according to one aspect of the present technology includes a mindfulness control unit that controls the provision of a first stimulus to a user in a mindfulness mode, which is an operating mode that puts the user into a mindful state, and a connection recollection control unit that controls the provision of a second stimulus to the user based on recollection subject information, which is information obtained from a recollection subject who is the subject of the sense of connection, in a connection recollection mode, which is an operating mode that evokes a sense of connection in the user, and is an information processing device or a program for causing a computer to function as an information processing device configured so that the provision of the first stimulus is started before the provision of the second stimulus.
[0015] An information processing method according to one aspect of the present technology includes a mindfulness control step of controlling an information processing device to provide a first stimulus to a user in a mindfulness mode, which is an operating mode that puts the user into a mindful state, and a connection recollection control step of controlling an information processing device to provide a second stimulus to the user in a connection recollection mode, which is an operating mode that evokes a sense of connection in the user, based on recollection subject information, which is information obtained from a recollection subject who is the subject of the sense of connection, and the provision of the first stimulus is initiated before the provision of the second stimulus.
[0016] In one aspect of the present technology, a mindfulness mode is an operation mode that puts a user into a mindfulness state, and a second stimulus is provided to the user based on recollection target information that is information acquired from a recollection target who is a target for recollecting a sense of connection in the user. The provision of the first stimulus is started before the provision of the second stimulus.
[0017] 1 is a block diagram showing an example configuration of an embodiment of an experience system to which the present technology is applied. FIG. 1 is a block diagram showing an example configuration of an acquisition device. FIG. 1 is a block diagram showing an example configuration of a provision device. FIG. 2 is a diagram showing an example configuration of a recollection target person information table. FIG. 3 is a diagram showing example information registered in the recollection target person table. FIG. 4 is a top view showing an example external configuration of a part of the provision device. FIG. 5 is a block diagram showing an example configuration of a control unit. FIG. 6 is a diagram explaining the order of operation modes. FIG. 7 is a diagram explaining the oxytocin reinforcement loop. FIG. 8 is a table showing examples of physical stimuli in the active mode. FIG. 9 is a table showing examples of cognitive stimuli in the active mode. FIG. 10 is a diagram showing an example flow of stimuli. FIG. 11 is a diagram showing an example configuration of an experiencer information table. FIG. 12 is a diagram showing example information registered in the experiencer table. FIG. 13 is a table showing an example of change of stimuli in the mindfulness & relaxation mode based on a state estimation index. FIG. 14 is a flowchart explaining a transmission process. FIG. 15 is a flowchart explaining a control process. FIG. 16 is a flowchart explaining a registration process. FIG. 17 is a block diagram showing an example configuration of computer hardware.
[0018] Hereinafter, modes for carrying out the present technology (hereinafter referred to as embodiments) will be described. The description will be made in the following order: 1. One embodiment (experience system) 2. Computer
[0019] 1. One Embodiment FIG. 1 is a block diagram showing an example of the configuration of one embodiment of an experience system to which the present technology is applied.
[0020] 1 includes an acquisition device 11, a provision device 12, and a smartphone 13. The experience system 10 provides a stimulus to the experiencer, who is a user of the provision device 12, using the provision device 12 based on information acquired by the acquisition device 11 about a person to be recalled who evokes a sense of connection with the experiencer.
[0021] Specifically, the acquisition device 11 acquires information about the person to be remembered, which is time-series information about the person to be remembered. The information about the person to be remembered includes biological information about the person to be remembered, such as time-series pulse waves, heart rate, brain waves, sweat rate, body temperature, smell, and skin potential, as well as voice and text data of messages entered by the person to be remembered for the experiencer, and video images of the person to be remembered.
[0022] The person to be recalled may input the information about the person to be recalled using the acquisition device 11 alone or together with the experiencer. When the person to be recalled performs the input work together with the experiencer, the input work functions as symbol grounding, and the experiencer can feel the stimuli provided by the provision device 12 more as the person to be recalled. If the experiencer has experience performing this input work, when the stimuli are provided by the provision device 12, the input work is more likely to function as symbol grounding, even if the person to be recalled performs the input work alone. On the other hand, if the experiencer has no experience performing input work, the provision device 12 can provide the stimuli to the experiencer, giving the experiencer a fresh and moving experience.
[0023] The acquisition device 11 records information about the person to be remembered. The acquisition device 11 transmits the recorded information about the person to be remembered to the provision device 12. The acquisition device 11 receives thank-you information, such as a message to the person to be remembered and thank-you points, entered by the experiencer, transmitted from the provision device 12. The acquisition device 11 displays the message and thank-you points from the experiencer to the person to be remembered based on the thank-you information.
[0024] The acquisition device 11 receives an experiencer information table that associates the person to be remembered information with state estimation indices that indicate the degree of various states of the experiencer after a stimulus is provided based on the person to be remembered information, which is transmitted from the provision device 12. The acquisition device 11 displays the experiencer information table to the person to be remembered as necessary.
[0025] The providing device 12 (information processing device) has a database, and stores in the database the information on the person to be remembered transmitted from the acquiring device 11. Note that this database may exist on a cloud, and the providing device 12 may acquire the information on the person to be remembered from the acquiring device 11 via the database.
[0026] The providing device 12 provides stimuli to the experiencer in a mindfulness and relaxation mode, a connection recall mode, and a self-compassion mode.
[0027] Mindfulness & Relaxation Mode is an operating mode that puts the participant into a state of mindfulness and relaxation. Connection Recall Mode is an operating mode that makes the participant feel a sense of connection with the person being recalled. Self-Compassion Mode is an operating mode that promotes the improvement of the participant's self-compassion. Self-compassion means compassion for oneself, and is a psychological state and technique of caring for oneself as one cares for others. Self-compassion allows people to maintain a positive attitude even in stressful situations.
[0028] The presentation of stimuli for the mindfulness and relaxation mode begins before the presentation of stimuli for the connection and recall mode. The presentation of stimuli for the self-compassion mode begins before the presentation of stimuli for the connection and recall mode.
[0029] When the operating mode is the mindfulness and relaxation mode, the providing device 12 provides stimuli that activate the parasympathetic nervous system and lead to mindfulness as stimuli that put the user in a relaxed state. In addition, the providing device 12 also provides stimuli that promote the secretion of oxytocin. Specifically, the providing device 12 provides stimuli that induce a mindful state through audio guide messages for meditation or vibration meditation, relaxing effects through relaxing music or healing music, natural sounds, images (moving images) of natural scenery or bonfires, and the promotion of oxytocin secretion through scents such as lavender, massage, comfortable temperatures, etc.
[0030] Oxytocin is an endocrine hormone involved in trust, bonding, and love, and is thought to be an important hormone that promotes feelings of connection with attached people.
[0031] The providing device 12 also provides stimuli to deepen the "here and now" as stimuli to put the user into a mindfulness state. Specifically, the providing device 12 provides audio guide messages, vibrations, and the like for meditation, such as breathing meditation, which focuses on breathing. The user can enter a mindfulness state, for example, by meditating according to the audio guide messages or by concentrating on the vibrations. Note that the mindfulness & relaxation mode may be a mode that puts the user into a mindfulness state only.
[0032] When the operation mode is the connection recall mode, the providing device 12 provides the experiencer with a stimulus that evokes a sense of connection with the person to be recalled based on the person to be recalled. The connection recall mode is configured with a passive mode in which the stimulus is provided regardless of input from the experiencer, and an active mode in which the stimulus is provided in response to input from the experiencer.
[0033] In passive mode, the participant receives the stimulation unilaterally, but in active mode, the participant receives the stimulation by returning their feelings to the person being recalled. Examples of returning their feelings to the person being recalled include grasping or touching the person while thinking of them, or returning a message to them.
[0034] The stimulation during the connected recall mode includes physical stimulation such as vibrations corresponding to the recalling subject's heartbeat and comfortable pressure (touch) on the skin (C fibers) that replicates the feeling of a hand, as well as cognitive stimulation such as messages from the recalling subject to the experiencer. These physical and cognitive stimulations cause the release of oxytocin.
[0035] The secretion of oxytocin in response to physical stimulation (particularly skin (C fiber) stimulation) is described, for example, in Francis McGlone 1, Johan Wessberg 2, and Hakan Olausson, “Discriminative and affective touch: sensing and feeling,” Neuron, May 21, 2014.
[0036] The effect of cognitive stimulation (→ top-down effect / knowledge of who is touching you is important) on the skin (C fibers) is described, for example, in Chantal Triscoli, Hakan Olausson, Uta Sailer, Hanna Ignell, Ilona Croy, “CT-optimized skin stroking delivered by hand or robot is comparable,” Front Behav Neurosci, 7:208, 2013.
[0037] The effect of cognitive stimulation (→priming effect) on skin (C fiber) stimulation is also described in Ellingsen, Dan-Mikael Wessberg, Johan Chelnokova, Olga Olausson, Hakan Laeng, Bruno Leknes, Siri, “In touch with your emotions: Oxytocin and touch change social impressions while others' facial expressions can alter touch.” Psychineuroendocrinology, 39, 11-20, 2014.
[0038] When the operating mode is the self-compassion mode, the providing device 12 provides stimuli that promote improvement of the experiencer's self-compassion. Specifically, as described in Non-Patent Document 1, there are three elements that improve the experiencer's self-compassion. The first element is a state of mindfulness, the second element is self-kindness, and the third element is recognition of common humanity.
[0039] Here, in the mindfulness and relaxation mode, the user enters a state of mindfulness, and in the self-compassion mode, the providing device 12 provides stimuli that promote at least one of self-kindness and recognition of common humanity.
[0040] An example of a stimulus to promote self-kindness is an audio guide message for a compassion meditation, which sublimates the kindness toward the person recalled during the connected recall mode, which has matured through the sense of connection recalled by the participant, into kindness toward oneself.An example of a stimulus to promote recognition of our common humanity is an audio message that reads, "No one is perfect. Imperfection is a common human experience."
[0041] The providing device 12 acquires the experiencer's information, which includes the experiencer's time-series heart rate, autonomic nervous activity consisting of sympathetic and parasympathetic nervous activity, biological information such as brain waves, voice, images, text data, etc. The providing device 12 receives subjective indices representing the experiencer's state input by the experiencer before and after the stimulus is provided, transmitted from the smartphone 13. The providing device 12 generates a state estimation index as feedback information representing the change in the experiencer due to the stimulus, based on the experiencer information and subjective indices after the stimulus is provided.
[0042] The providing device 12 records in a database an experiencer information table that corresponds, for each experiencer, stimulus information representing the stimulus provided to the experiencer in each operating mode, the recalled person information ID of the recalled person information used for that stimulus, and the experiencer's state estimation index after the stimulus is provided.
[0043] The providing device 12 determines the stimulus to be provided in each operation mode based on the experiencer information table or the like.
[0044] For example, the providing device 12 can reinforce memories of a previously provided stimulus by selecting the stimulus to be provided this time. The providing device 12 can prevent the experiencer from getting bored by selecting a stimulus that is different from the previously provided stimulus as the stimulus to be provided this time. The providing device 12 performs an AI (Artificial Intelligence) analysis on the experiencer information table to select the stimulus to be provided this time that is optimal for the experiencer based on the experiencer information before the stimulus is provided.
[0045] The providing device 12 transmits to the smartphone 13 advice information representing a state estimation index and an advice message to the user.
[0046] The providing device 12 acquires the thank you information input by the experiencer and transmits it to the acquiring device 11. The experiencer may input the thank you information after receiving the stimulus, or may input the thank you information when registering the person to be recalled information in the database. The providing device 12 transmits the experiencer information table to the acquiring device 11.
[0047] The smartphone 13 transmits a subjective index to the providing device 12 in response to input from the experiencer before and after the stimulus is provided. The subjective index may be, for example, the UCLA Loneliness Scale, a subjective index of connectedness, a self-compassion scale, or the Mindful Attention Awareness Scale (MASS).
[0048] Details of the UCLA Loneliness Scale can be found, for example, in "Development of the Japanese Version of the UCLA Loneliness Scale (3rd Edition) for Elderly People and an Examination of Its Reliability and Validity" by Masuda Yuzuri, Tanakata Etsuko, and Tai Yukei, Journal of the Japanese Academy of Community Nursing, 2012.
[0049] Details of the Self-Compassion Scale can be found, for example, in "An attempt to create a shortened 12-item Japanese version of the Self-Compassion Scale" by Arimitsu Oki, Aoki Yasuhiko, Furukita Miyuki, Tada Ayano, and Togashi Riko, Komazawa University Journal of Psychology, No. 18, published in 2016.
[0050] Details of the MASS can be found, for example, in "Development of the Japanese Version of the Mindful Attention Awareness Scale and an Examination Using Item Response Theory" by Fujino Masahiro, Kajimura Shogo, and Nomura Michio, Personality Research, Vol. 24, No. 1, published in 2015.
[0051] The smartphone 13 displays the condition estimation index and advice information transmitted from the providing device 12 .
[0052] <Configuration Example of Acquisition Device> FIG. 2 is a block diagram showing a configuration example of the acquisition device 11 of FIG.
[0053] 2 is configured by connecting an operation unit 31, a communication unit 32, a recalled person information generation unit 33, a determination unit 34, a provision information generation unit 35, a sensor unit 36, and a provision unit 37 via an IF (Interface) unit 38. A storage unit 39 and a timing unit 40 are also connected to the recalled person information generation unit 33, and the determination unit 34 and the provision information generation unit 35 are also connected to the storage unit 39.
[0054] The operation unit 31 is composed of a touch panel 41, a keyboard 42, operation buttons 43, and a microphone 44. The touch panel 41, the keyboard 42, and the operation buttons 43 accept operations from the person to be remembered, and supply operation signals representing the operations to the IF unit 38.
[0055] For example, the person to be recalled inputs predetermined characters by operating the touch panel 41, the keyboard 42, or the operation buttons 43, and the IF unit 38 generates text data based on an operation signal representing the operation. The microphone 44 acquires voice related to the operation from the person to be recalled and supplies an operation signal corresponding to the voice to the IF unit 38.
[0056] The communication unit 32 communicates with the providing device 12 via a network or the like. For example, the communication unit 32 transmits the recollected person information supplied from the recollected person information generation unit 33 via the IF unit 38 to the providing device 12. The communication unit 32 receives the thank you information and the experiencer information table transmitted from the providing device 12 and supplies them to the IF unit 38.
[0057] The recollected subject information generating unit 33 generates recollected subject information based on the text data and voice supplied from the operation unit 31 via the IF unit 38 and the sensor information supplied from the sensor unit 36 via the IF unit 38. At this time, the recollected subject information generating unit 33 adds a recollected subject ID, which is the ID of the recollected subject, a recollected subject information ID, which is the ID of the recollected subject information, etc. to the recollected subject information.
[0058] The recalled person information generation unit 33 supplies the recalled person information to the storage unit 39 for storage together with time information indicating the current time supplied from the clock unit 40. The recalled person information generation unit 33 reads out the recalled person information stored in the storage unit 39 and supplies it to the communication unit 32 via the IF unit 38.
[0059] The determination unit 34 selects, as provided data, data to be provided to the recollection target information from the gratitude information and the experiencer information table, etc., supplied from the communication unit 32 via the IF unit 38. The determination unit 34 supplies the provided data to the storage unit 39 for storage.
[0060] The provided information generation unit 35 reads the provided data stored in the storage unit 39, and generates provided information that controls the providing unit 37 to provide the provided data to the person to be recalled. The provided information generation unit 35 supplies the provided information to the providing unit 37 via the IF unit 38.
[0061] The sensor unit 36 is composed of a pulse wave sensor 50, an RGB camera 51, a microphone 52, a pressure sensor 53, a pressure distribution sensor 54, a heart rate sensor 55, an electroencephalogram sensor 56, a sweat sensor 57, a temperature sensor 58, an odor sensor 59, and a skin potential sensor 60. At least a part of the sensor unit 36 functions as a measurement unit that measures biological information.
[0062] The pulse wave sensor 50 measures the pulse wave of the person to be recalled and acquires information representing the pulse wave as sensor information. The RGB camera 51 photographs the person to be recalled and acquires an RGB image of the person to be recalled as sensor information. The microphone 52 acquires surrounding sounds, such as messages from the person to be recalled to the experiencer, as sensor information.
[0063] The pressure sensor 53 measures the pressure of the pressure when the person to be remembered performs an action such as gripping, and acquires information representing the pressure as sensor information. The pressure distribution sensor 54 measures the pressure distribution of the pressure when the person to be remembered performs an action such as gripping, and acquires information representing the pressure distribution as sensor information. The heartbeat sensor 55 measures the heartbeat and heart rate [bpm] of the person to be remembered, and acquires information representing the heartbeat and heart rate as sensor information.
[0064] The brain wave sensor 56 measures the brain waves of the person to be remembered and acquires information representing the brain waves as sensor information. The sweat sensor 57 measures the amount of sweat produced by the person to be remembered and acquires information representing the amount of sweat produced as sensor information. The temperature sensor 58 measures the body temperature of the person to be remembered and acquires information representing the body temperature as sensor information. The odor sensor 59 measures odors around the person to be remembered and acquires information representing the odors and information representing the type of perfume corresponding to the odors as sensor information.
[0065] The skin potential sensor 60 measures the skin potential that indicates the level of tension of the person to be remembered and acquires information indicating the skin potential as sensor information. The sensor unit 36 supplies the acquired sensor information to the person to be remembered information generation unit 33 via the IF unit 38.
[0066] The providing unit 37 is composed of an oscillator 61 , headphones 62 , earphones 63 , an odor cartridge 64 , a Peltier element 65 , a speaker 66 , an amplifier 67 , a display 68 , a motor 69 , and an HMD (Head Mounted Display) 70 .
[0067] The oscillator 61 provides vibrations to the person to be remembered based on the provided information supplied from the provided information generation unit 35 via the IF unit 38. The headphones 62 and earphones 63 provide sounds to the person to be remembered based on the provided information. The scent cartridge 64 provides scents to the person to be remembered based on the provided information. The Peltier element 65 provides temperature to the person to be remembered based on the provided information. The Peltier element 65 may be made of a material other than Peltier element as long as it can provide a warm / cool sensation.
[0068] The speaker 66 provides audio to the person to be recollected based on the provided information. The amplifier 67 amplifies the audio provided to the person to be recollected from the headphones 62, earphones 63, or speaker 66 based on the provided information. The display 68 provides still images, moving images, images representing messages and sensor information, etc. to the person to be recollected based on the provided information. The motor 69 drives various mechanisms (not shown) based on the provided information to provide various pressures (tactile sensations) and humidity to the person to be recollected. Other actuators may be provided instead of the motor 69. The HMD 70 provides images to the person to be recollected based on the provided information.
[0069] The storage unit 39 stores the remembered person information supplied from the remembered person information generation unit 33 and the provided information supplied from the determination unit 34. The clock unit 40 keeps track of the current time and supplies the time information to the remembered person information generation unit 33.
[0070] In the acquisition device 11, the microphone 44 and the microphone 52 may be a common device. At least some of the microphone 44, the microphone 52, the headphones 62, the earphones 63, and the speaker 66 may be a common device. The display 68 and the HMD 70 may be a common device. The oscillator 61, the scent cartridge 64, the Peltier element 65, the motor 69, the HMD 70, etc. may not be provided.
[0071] <Configuration Example of Providing Device> FIG. 3 is a block diagram showing a configuration example of the providing device 12 of FIG.
[0072] 3, an operation unit 121, a communication unit 122, a registration unit 123, a control unit 124, a calculation unit 125, a generation unit 126, a sensor unit 127, and a provision unit 128 are connected via an IF unit 129. A database 130 is also connected to the registration unit 123, the control unit 124, the calculation unit 125, and the generation unit 126. A timer unit 131 is further connected to the calculation unit 125.
[0073] The operation unit 121 is composed of a touch panel 141, a keyboard 142, operation buttons 143, and a microphone 144. The operation unit 121 differs from the operation unit 31 in that it is operated by the experiencer, not the person being reminisced about, but is otherwise configured in the same way as the operation unit 31, and therefore a description thereof will be omitted.
[0074] The user operates the operation unit 121 to input a user ID, which is the user's ID, a desired person to be remembered ID, etc., and the IF unit 129 generates the user ID and the person to be remembered information ID based on an operation signal representing the operation. The user operates the operation unit 121 to input thank-you information, and the IF unit 129 generates thank-you information based on an operation signal representing the operation.
[0075] The communication unit 122 communicates with the acquisition device 11 via a network or the like. For example, the communication unit 122 transmits gratitude information supplied from the IF unit 129 to the acquisition device 11. The communication unit 122 transmits an experiencer information table supplied from the calculation unit 125 via the IF unit 129 to the acquisition device 11. The communication unit 122 receives the recalled person information transmitted from the acquisition device 11 and supplies it to the registration unit 123 via the IF unit 129.
[0076] The communication unit 122 also communicates with the smartphone 13 via a network or the like. For example, the communication unit 122 transmits the state estimation index and advice information supplied from the calculation unit 125 via the IF unit 129 to the smartphone 13. The communication unit 122 receives the subjective index transmitted from the smartphone 13 and supplies it to the calculation unit 125 via the IF unit 129.
[0077] The registration unit 123 registers the recalled person information supplied from the communication unit 122 via the IF unit 129 in a recalled person information table, which is a table of recalled person information stored in the database 130 .
[0078] Based on the recollection subject ID and the experiencer ID supplied from the IF unit 129, the control unit 124 reads out the state estimation index, stimulus information, and recollection subject information ID corresponding to the recollection subject ID and the experiencer ID from the experiencer information table stored in the database 130. Based on the state estimation index, stimulus information, and recollection subject information ID, the control unit 124 determines the stimulus to be provided to the experiencer in each operation mode. The control unit 124 supplies the stimulus information representing the determined stimulus for each operation mode, the recollection subject information ID of the recollection subject information used for the stimulus, and the experiencer ID to the database 130.
[0079] Based on the recalled subject information ID, the control unit 124 reads out the recalled subject information corresponding to the recalled subject information ID from the recalled subject information table stored in the database 130. Based on the recalled subject information, the control unit 124 generates stimulus control information for controlling the providing unit 128 to provide stimuli for each operation mode, and supplies the stimulus control information to the providing unit 128 via the IF unit 129.
[0080] The control unit 124 changes the stimulus in the active mode based on the user information supplied from the generation unit 126. Specifically, the control unit 124 generates stimulus control information for controlling the provision unit 128 to provide the stimulus after the change in the active mode, and supplies the stimulus control information to the provision unit 128 via the IF unit 129.
[0081] The calculation unit 125 acquires the subjective index supplied from the communication unit 122 via the IF unit 129 and the experiencer information supplied from the generation unit 126. The calculation unit 125 (generation unit) calculates a state estimation index based on the subjective index and the experiencer information.
[0082] For example, the calculation unit 125 calculates a state estimation index for recollection of a sense of connection based on the degree of synchronization between the recollection target information used in the provided stimulation and the experiencer information, or the parasympathetic nerve activity level in the experiencer information. The calculation unit 125 registers the state estimation index together with time information supplied from the timing unit 131 in the experiencer information table stored in the database 130.
[0083] The calculation unit 125 generates advice information based on the state estimation index. The calculation unit 125 supplies the state estimation index and the advice information to the communication unit 122 via the IF unit 129. The calculation unit 125 reads out an experiencer information table from the database 130 and supplies it to the communication unit 122 via the IF unit 129.
[0084] The generation unit 126 generates experiencer information based on sensor information supplied from the sensor unit 127 via the IF unit 129 , and supplies the experiencer information to the control unit 124 , the calculation unit 125 , and the database 130 .
[0085] The sensor unit 127 includes a pulse wave sensor 150, an RGB camera 151, a microphone 152, a pressure sensor 153, a pressure distribution sensor 154, and a heart rate sensor 155. The sensor unit 127 also includes an electroencephalogram sensor 156, a sweat sensor 157, a temperature sensor 158, an odor sensor 159, and a skin potential sensor 160.
[0086] The sensor unit 127 differs from the sensor unit 36 in that the subject that acquires the sensor information is the experiencer rather than the person being recalled, and that the sensor information is supplied to the generation unit 126; otherwise, it is the same as the sensor unit 36, so explanation will be omitted.
[0087] The providing unit 128 is composed of an oscillator 161 , headphones 162 , earphones 163 , an odor cartridge 164 , a Peltier element 165 , a speaker 166 , an amplifier 167 , a display 168 , a motor 169 , and an HMD 170 .
[0088] The provision unit 128 differs from the provision unit 37 in that the recipient of the provision is the experiencer rather than the person being recalled, and that the provision is based on stimulus control information supplied from the control unit 124; otherwise, the provision unit 128 is configured in the same way as the provision unit 37, so explanations will be omitted.
[0089] The database 130 stores a recollection target person information table and an experiencer information table. The database 130 registers the recollection target person information supplied from the registration unit 123 in the recollection target person information table. The database 130 registers the experiencer ID, the recollection target person ID, and the stimulus information supplied from the control unit 124 in the experiencer information table. The database 130 registers the state estimation index and the time information supplied from the calculation unit 125 in the experiencer information table. The database 130 registers the experiencer information supplied from the generation unit 126 in the experiencer information table.
[0090] The timekeeping unit 131 generates time information and supplies it to the calculation unit 125 .
[0091] In the providing device 12, the microphone 144 and the microphone 152 may be shared. At least some of the microphone 144, the microphone 152, the headphones 162, the earphones 163, and the speaker 166 may be shared. The display 168 and the HMD 170 may be shared.
[0092] In the following description, a case where sound is provided by headphones 162 will be described, but the same applies to cases where sound is provided by earphones 163 or speakers 166. In the following description, a case where moving images and still images are provided by display 168 will be described, but the same applies to cases where moving images and still images are provided by HMD 170.
[0093] <Configuration Example of Recalled Subject Information Table> FIG. 4 is a diagram showing a configuration example of a recalled subject information table stored in the database 130 of FIG.
[0094] As shown in Fig. 4, the database 130 stores a hierarchical structure of information tables for persons to be recalled. Specifically, the database 130 stores a table listing persons to be recalled as a higher layer than the table listing persons to be recalled information. The table listing persons to be recalled is a table in which personal information for each person to be recalled is registered in association with the person to be recalled's ID. This personal information includes basic information such as name, time of personal information registration, gender, date of birth, and nationality, as well as social media accounts and the number of people who have experienced the event and who consider themselves to be a recalled person.
[0095] Below the table listing the recalled persons, a recalled person table for each recalled person is stored. In the example of Fig. 4, the recalled persons who performed the work of inputting the recalled person information are three recalled persons A to C. In this case, below the table listing the recalled persons, a recalled person table for each of the recalled persons A to C is stored.
[0096] In the recollection target table for the recollection target A, the recollection target ID of the recollection target A and the experiencer ID of the experiencer who can use the recollection target information are registered in association with the recollection target information ID of each piece of recollection target information for the recollection target A. The recollection target information ID also registers a timestamp, which is time information when the recollection target information corresponding to that recollection target information ID was recorded (generated), the recording time (acquisition time) of that recollection target information, and the recollection target information. This recording time is calculated, for example, based on the times measured by the clock unit 40 at the start and end of generation of the recollection target information.
[0097] The tables of the person to be remembered for person B and person to be remembered for person C are configured in the same way as the table of the person to be remembered for person A, except that person to be remembered A is replaced by people to be remembered for B and C, respectively, so explanations will be omitted.
[0098] <Example of Information Registered in the Recalled Person Table> FIG. 5 is a diagram showing an example of information registered in the recalled person table of the recalled person A in FIG.
[0099] In the example of Fig. 5, heart rate, voice, and text data are generated seven times as the recollection target information for recollection target person A. Therefore, the recollection target person information table of Fig. 5 consists of seven entries. In the example of Fig. 5, recollection target person information IDs ranging from "001" to "0007" are assigned to the seven pieces of recollection target person information in the order of generation, and "001" to "0007" are registered as the recollection target person information IDs of the respective entries.
[0100] In the example of Fig. 5, the recollection target ID of the recollection target A is "001", and "001" is registered as the recollection target ID of each entry. In the example of Fig. 5, "001" and "002" are registered as experiencer IDs in the entry for the recollection target information ID "001". In this case, the recollection target information for the recollection target information ID "001" can be used to provide stimuli to the experiencer with the experiencer ID "001" or "002".
[0101] In the example of Fig. 5, the information on the person to be recalled with the information ID "001" was generated at 9:19:40 on March 17, 2023. Therefore, the entry for the information ID "001" has the timestamp "Timestamp(Date(17;03;2023);Time(9;19;40)) registered."
[0102] In the example of FIG. 5, the recording time of the person to be remembered information with the person to be remembered information ID "001" is 20 seconds, and the entry for the person to be remembered information ID "001" has the recording time "0;00:20" registered.
[0103] 5, the heart rate in the information of the person to be remembered with the ID "001" is 80, the file name of the audio is "xxx.mp3", and the text data is "xxx". Therefore, in the entry for the ID "001", 80 is registered as the heart rate of the person to be remembered, "xxx.mp3" as the audio, and "xxx" as the text data.
[0104] Although the description is omitted, the experiencer ID, time stamp, recording time, heart rate, voice, and text data are also registered in the entries of the person to be recalled information IDs "002" to "0007" in the same manner.
[0105] 4 and 5, information marked with "*" at the end is information that can be referenced from tables other than the user's own. Specifically, the recalled person ID in the recalled person list table, and the recalled person information ID, recalled person ID, and experiencer ID in the recalled person information table are information that can be referenced from tables other than the user's own.
[0106] The type of information about the person to be remembered that is registered in the information table about the person to be remembered is set in advance by the owner of the experience system 10 .
[0107] <External Configuration Example of Part of Providing Device> FIG. 6 is a top view showing an external configuration example of part of the providing device 12. As shown in FIG.
[0108] As shown in Fig. 6, the mechanism that is driven by the motor 169 of the providing device 12 and provides various types of pressure to the user is made up of a glove-shaped pressure providing mechanism 201. The pressure providing mechanism 201 is made up of an upper mechanism 201a and a lower mechanism 201b that are covered with cushions. The lower mechanism 201b is larger than the upper mechanism 201a, and the upper mechanism 201a and the lower mechanism 201b are partially glued together.
[0109] The user inserts his / her hand between the upper mechanism 201a and the lower mechanism 201b. When the upper mechanism 201a and the lower mechanism 201b are driven by the motor 169, they expand and contract by air pressure, thereby applying pressure to the user's hand between the upper mechanism 201a and the lower mechanism 201b.
[0110] A display 168 is provided on the top surface of the upper mechanism 201a, and an odor cartridge 164 is provided on the top surface of the lower mechanism 201b.
[0111] The pressure providing mechanism 201 may be configured integrally with the communication unit 122, registration unit 123, control unit 124, calculation unit 125, generation unit 126, IF unit 129, database 130, timing unit 131, etc. The pressure providing mechanism 201 can also be configured integrally with the oscillator 161, Peltier element 165, speaker 166, amplifier 167, motor 169, etc. The pressure providing mechanism 201 may also be configured integrally with a sensor unit 127 other than the brain wave sensor 156. Note that the following description will be given assuming that the pressure providing mechanism 201 is integrated with these units.
[0112] <Configuration Example of Control Unit> FIG. 7 is a block diagram showing a configuration example of the control unit 124 in FIG.
[0113] The control unit 124 in FIG. 7 is made up of a readout unit 230, a mindfulness and relaxation control unit 231, a connection recollection control unit 232, and a self-compassion control unit 233.
[0114] Based on the recollection subject ID and experiencer ID supplied from the IF unit 129, the reading unit 230 reads out the state estimation index, stimulus information, and recollection subject information ID corresponding to the recollection subject ID and experiencer ID from the experiencer information table of the database 130.
[0115] The reading unit 230 supplies the read state estimation index and the stimulation information for the mindfulness and relaxation mode to the mindfulness and relaxation control unit 231. The reading unit 230 supplies the read state estimation index, the stimulation information for the connected recollection mode, and the recollection target information ID to the connected recollection control unit 232. The reading unit 230 supplies the read state estimation index and the stimulation information for the self-compassion mode to the self-compassion control unit 233.
[0116] The mindfulness & relaxation control unit 231 determines a stimulus to be provided to the user in the mindfulness & relaxation mode based on the state estimation index and the stimulus information for the mindfulness & relaxation mode supplied from the reading unit 230. The mindfulness & relaxation control unit 231 supplies the stimulus information representing the stimulus and the user ID to the database 130. The mindfulness & relaxation control unit 231 generates stimulus control information that controls the provision unit 128 to provide the stimulus to the user, and supplies this to the provision unit 128 via the IF unit 129.
[0117] The connection recall control unit 232 determines a stimulus to be provided to the experiencer in the connection recall mode based on the state estimation index, the connection recall mode stimulus information, and the recollection subject information ID supplied from the reading unit 230, and the experiencer information supplied from the generation unit 126. The connection recall control unit 232 supplies the database 130 with stimulus information representing the stimulus, the recollection subject information ID of the recollection subject information used for the stimulus, and the experiencer ID.
[0118] Based on the recollection subject information ID, the connection recollection control unit 232 reads out the recollection subject information corresponding to the recollection subject information ID from the recollection subject information table stored in the database 130. Based on the recollection subject information, the connection recollection control unit 232 generates stimulus control information that controls the provision unit 128 to provide a stimulus in the connection recollection mode to the user, and supplies the stimulus control information to the provision unit 128 via the IF unit 129.
[0119] The self-compassion control unit 233 determines a stimulus to be provided to the experiencer in the self-compassion mode based on the state estimation index and the stimulus information for the self-compassion mode supplied from the reading unit 230. The self-compassion control unit 233 supplies the stimulus information representing the stimulus and the experiencer ID to the database 130. The self-compassion control unit 233 generates stimulus control information that controls the provision unit 128 to provide the stimulus to the user, and supplies the stimulus control information to the provision unit 128 via the IF unit 129.
[0120] <Description of Operation Mode Sequence> FIG. 8 is a diagram for explaining the sequence of operation modes by the control unit 124 in FIG.
[0121] As shown in Figure 8, first, the mindfulness and relaxation control unit 231 starts control so that the mindfulness and relaxation mode stimuli provision unit 128 provides the user with stimuli. This allows the user to relax both physically and mentally, easing the tension felt at the start of the experience. Furthermore, the user enters a mindfulness state, creating a foundation for promoting the recollection of a sense of connection. In other words, the user can enter a state in which they are more likely to feel a sense of connection.
[0122] Specifically, the mindfulness state is a state that embodies non-judgmental awareness of the present moment (a sense of the here and now), transitioning from a state of mind wandering or a rush of various emotions and thoughts. Therefore, the provision of stimuli in the mindfulness and relaxation mode serves as a grounding mechanism to help focus on recalling a sense of connection in the connectedness recall mode. Mind wandering is a phenomenon in which attention is diverted to thoughts unrelated to the task at hand, causing these thoughts to repeat themselves over and over in the mind.
[0123] After the mindfulness and relaxation control unit 231 starts control, the connection recollection control unit 232 starts control so that the connection recollection mode stimuli provision unit 128 provides the user with a connection recollection mode stimulus. This allows the user to recall a sense of connection with the person being recollected.
[0124] Furthermore, by recalling the sense of connection with the person being recalled, the participant recalls kindness (compassion) toward that person, making it easier for them to direct that kindness toward themselves. Physiologically, the participant's oxytocin levels increase as they recall a sense of connection with the person being recalled, making them more likely to feel kindness toward the person being recalled and themselves. As described above, participants are more likely to feel kindness toward themselves, which is an element that improves self-compassion. In other words, participants can lay the groundwork to promote the improvement of self-compassion.
[0125] After the connection recollection control unit 232 starts control, the self-compassion control unit 233 starts control so that the self-compassion mode stimuli provision unit 128 provides the stimuli to the user. This allows the user to improve their self-compassion.
[0126] Specifically, through stimulation of the mindfulness and relaxation mode, participants are placed in a mindfulness state, one of the three elements that improve self-compassion. Furthermore, through stimulation of the connected recall mode, participants are placed in a state in which they are more likely to sublimate kindness toward the person they are recalling into kindness toward themselves. Through stimulation of the self-compassion mode, participants are able to sublimate kindness toward the person they are recalling into kindness toward themselves, thereby entering a state in which they can feel kindness toward themselves, another element that improves self-compassion. Through stimulation of the self-compassion mode, participants are also able to recognize our common humanity, the final element that improves self-compassion. Therefore, participants are able to improve their self-compassion.
[0127] As described above, the mindfulness and relaxation mode stimuli are provided before the connection recollection mode stimuli, which allows the experiencer to more effectively evoke a sense of connection than if the mindfulness and relaxation mode stimuli were not provided.
[0128] Furthermore, since stimulation in the connection recall mode and mindfulness and relaxation mode is performed before stimulation in the self-compassion mode, self-compassion can be improved compared to when stimulation in the self-compassion mode alone is performed.
[0129] <Explanation of Oxytocin Reinforcement Loop> FIG. 9 is a diagram illustrating a reinforcement loop that reinforces the secretion of oxytocin in the experiencer, which is formed by the provision of stimulation by the provision device 12.
[0130] As shown in Figure 9, when the stimulus in the connection-recalling mode is provided by the providing device 12, the participant recalls a sense of connection. This physiologically causes the release of oxytocin. Then, when the stimulus in the self-compassion mode is provided, the participant's self-compassion improves. This may further increase the release of oxytocin.
[0131] As described above, oxytocin promotes the recollection of a sense of connection. Therefore, by continuously using the experience system 10, the participant can form an oxytocin reinforcing loop. In other words, an improvement in the participant's self-compassion promotes the recollection of a sense of connection the next time the participant uses the experience system 10, which in turn leads to further improvement in self-compassion. Furthermore, this reinforcing loop can be formed even with a single experience of a sense of connection. Oxytocin is secreted through physical stimulation (C fibers in the skin) during the experience of a sense of connection, thereby enhancing the cognitive stimulation effect of thinking about the person being remembered (such as a loved one or a trusted person). Furthermore, the act of remembering the person being remembered itself promotes oxytocin secretion, which further promotes oxytocin secretion through physical stimulation (a synergistic effect of top-down (cognitive stimulation) and bottom-up (physical stimulation)).
[0132] The experience system 10 can encourage continued use by the experiencer because the experiencer forms an attachment to the person being remembered by recalling a sense of connection with the person being remembered.
[0133] In contrast, when participants improve their self-compassion through a psychological clinical approach under the guidance of a specialist, such as an 8-week mindful self-compassion program, the duration of that approach is limited. When participants improve their self-compassion using a cognitive behavioral therapy app such as a mindfulness app, attachment is not formed, making it difficult for them to continue using the app. Therefore, it is difficult to achieve the medium- to long-term effects of improving self-compassion, such as self-transformation, using a psychological clinical approach or cognitive behavioral therapy app.
[0134] <Examples of Physical Stimuli in Active Mode> FIG. 10 is a table showing examples of physical stimuli in active mode.
[0135] The first row from the top of the table in Fig. 10 describes the items "Reproduced Element," "Information on Person to be Recalled," "Physical Stimulus," "Interaction of Experiencer," "Means of Acquisition," and "Changes in Physical Stimulus." The second to fifth rows from the top describe information corresponding to each item.
[0136] The information corresponding to the item "reproduced element" is an element of the person to be recalled that is reproduced by providing a physical stimulus based on the information about the person to be recalled in the active mode. The information corresponding to the item "information about the person to be recalled" is the information about the person to be recalled that is used to provide the physical stimulus, and the information corresponding to the item "physical stimulus" is the physical stimulus. The information corresponding to the item "interaction of the experiencer" is the interaction of the experiencer who received the physical stimulus in the active mode, and the item "acquisition means" is an acquisition means for acquiring sensor information corresponding to the interaction. The item "change in physical stimulus" is the change in the physical stimulus in the active mode according to the interaction.
[0137] Specifically, the information corresponding to the items "reproduced element" and "information on recalled person" in the second row from the top of the table in Figure 10 is "heartbeat" and "heartbeat and heart rate measured by heartbeat sensor," respectively. The information corresponding to the items "physical stimulus" and "interaction of the user" is "vibration by oscillator, pressure by pressure-providing mechanism," and "gripping, embracing, gazing at the pressure-providing mechanism, increasing heartbeat intensity, etc." The information corresponding to the items "acquisition means" and "changes in physical stimulus" is "pressure sensor, pressure distribution sensor, RGB camera, heartbeat sensor, etc." and "provided at an intensity according to the user's interaction," respectively.
[0138] That is, in this case, in the active mode, based on the heart rate and heart rate measured by the heart rate sensor 55 among the information of the person to be recalled, vibration by the oscillator 161 or pressure by the pressure providing mechanism 201 is provided as a physical stimulus that reproduces the heart rate of the person to be recalled.
[0139] After this physical stimulus is provided, the connection recall control unit 232 estimates the interaction of the user based on the user information corresponding to the sensor information of the pressure sensor 153 and the pressure distribution sensor 154. Specifically, the connection recall control unit 232 estimates, based on the user information, that the user is interacting by gripping the pressure-providing mechanism 201 with one hand or by wrapping it with both hands.
[0140] The connection recall control unit 232 estimates that the user is gazing at the pressure providing mechanism 201 as an interaction, based on the user information corresponding to the sensor information of the RGB camera 151. The connection recall control unit 232 estimates that the user's heartbeat strength is increasing as an interaction, based on the user information corresponding to the sensor information of the heartbeat sensor 155.
[0141] When the connection recollection control unit 232 estimates that an interaction that psychologically brings the person to be recollected has occurred, it changes the intensity of the physical stimulation to be provided based on the intensity of the interaction.
[0142] The information corresponding to the item "Reproduction element" in the third row from the top of the table in FIG. 10 is "touch (enveloping, stroking, rubbing, grasping)." The information corresponding to the item "information on the person to be recalled" is "pressure of pressure due to enveloping or stroking measured by a pressure sensor, and pressure distribution of pressure due to rubbing or grasping measured by a pressure distribution sensor." The information corresponding to the item "physical stimulus" is "pressure from a pressure-providing mechanism." The information corresponding to the items "interaction of the experiencer" and "acquisition means" is the same as in the second row from the top. The information corresponding to the item "changes in physical stimulus" is "When enveloping or stroking is reproduced: provided at an intensity according to the experiencer's interaction; when rubbing or grasping is reproduced: provided when the intensity is above a threshold."
[0143] That is, in this case, in the active mode, pressure is provided by the pressure providing mechanism 201 as a physical stimulus that reproduces the embracing or stroking of the person to be remembered, based on the pressure measured by the pressure sensor 53 in the information on the person to be remembered. Alternatively, pressure is provided by the pressure providing mechanism 201 as a physical stimulus that reproduces the stroking or squeezing of the person to be remembered, based on the pressure distribution measured by the pressure distribution sensor 54 in the information on the person to be remembered.
[0144] After this physical stimulus is provided, the connection recollection control unit 232 estimates the occurrence of an interaction that psychologically brings the person to be recollected closer, just as it does after the provision of a physical stimulus that reproduces a heartbeat. If the connection recollection control unit 232 estimates that an interaction that psychologically brings the person to be recollected has occurred after the provision of a physical stimulus that reproduces embracing or stroking, it controls the provision of a physical stimulus with an intensity that corresponds to the intensity of that interaction. If the connection recollection control unit 232 estimates that an interaction that psychologically brings the person to be recollected has occurred after the provision of a physical stimulus that reproduces stroking or grasping, it controls the provision of a physical stimulus if the intensity of the interaction is equal to or greater than a threshold.
[0145] The information corresponding to the item "Reproduced element" in the fourth row from the top of the table in Figure 10 is "Touch element (texture, temperature (human skin temperature), feel)." The information corresponding to the item "Information on recalled subject" is "Body temperature measured by temperature sensor, amount of sweat measured by sweat sensor." The information corresponding to the item "Physical stimulus" is "Temperature by Peltier, humidity by humidifier." The information corresponding to the items "Interaction of user" and "Means of acquisition" is the same as the information in the first row from the top. The information corresponding to the item "Changes in physical stimulus" is "Providing temperature and humidity according to the user's interaction."
[0146] That is, in this case, in the active mode, physical stimuli are provided that reproduce touch elements such as the texture, temperature, and feel of the person to be imagined. Specifically, temperature is provided by a Peltier element based on the temperature measured by the temperature sensor 58, which is part of the information about the person to be imagined, and humidity is provided by a humidifier (not shown) based on the amount of sweat measured by the sweat sensor 57. This humidifier is driven by a motor 169.
[0147] After this physical stimulus is provided, similar to after the provision of a physical stimulus that reproduces a heartbeat, the connection recollection control unit 232 estimates the occurrence of an interaction that psychologically brings the recollection target closer to the person. If the connection recollection control unit 232 estimates the occurrence of this interaction, it controls so that temperature and humidity corresponding to this interaction are provided as physical stimuli. For example, if the connection recollection control unit 232 estimates the occurrence of this interaction, it controls so that the provided temperature and humidity are increased.
[0148] In addition, the connection recollection control unit 232 may estimate the occurrence of an interaction that will psychologically distance the person being recollected based on the experiencer information, and if it estimates the occurrence of such an interaction, it may control the provided temperature and humidity to be lowered.
[0149] The information corresponding to the item "Reproduced Element" in the fifth row from the top of the table in Figure 10 is "Scent (Perfume, Pheromone)." The information corresponding to the item "Information on Recalled Subject" is "Information on the type of perfume determined by the scent sensor, scent measured by the scent sensor." The information corresponding to the item "Physical Stimulus" is "Scent from a Scent Cartridge." The information corresponding to the items "Interaction of the Experiencer" and "Means of Acquisition" is the same as in the second row from the top. The information corresponding to the item "Changes in Physical Stimulus" is "Provided at an intensity according to the interaction of the experiencer, provided when the intensity is above a threshold, or provided when the intensity is above a threshold."
[0150] In other words, in this case, in active mode, based on the information on the person to be recalled, such as the type of perfume determined by the odor sensor 59, and the measured odor, the odor from the odor cartridge 64 is provided as a physical stimulus that reproduces the odor of the perfume or pheromones of the person to be recalled.
[0151] After this physical stimulus is provided, similar to the case after the provision of a physical stimulus that reproduces a heartbeat, the connection recollection control unit 232 estimates the occurrence of an interaction that psychologically brings the recollection target closer to the target. If the connection recollection control unit 232 estimates the occurrence of this interaction, it controls the provision of an odor at an intensity corresponding to the intensity of the interaction. Alternatively, if the intensity of the interaction is equal to or greater than a threshold, the connection recollection control unit 232 controls the provision of an odor, or controls the provision of an odor different from the previous one.
[0152] <Examples of Cognitive Stimuli in Active Mode> FIG. 11 is a table showing examples of cognitive stimuli in active mode.
[0153] The first row from the top of the table in Fig. 11 describes the items "reproduced element," "information on the person to be recalled," "cognitive stimulus," "interaction of the experiencer," "acquisition means," and "changes to cognitive stimulus." The second and third rows from the top describe information corresponding to each item.
[0154] The information corresponding to the item "reproduced elements" is the element of the person to be recalled that is reproduced by providing a cognitive stimulus based on the information about the person to be recalled in the active mode. The information corresponding to the item "information about the person to be recalled" is the information about the person to be recalled that is used to provide the cognitive stimulus, and the information corresponding to the item "cognitive stimulus" is the cognitive stimulus. The information corresponding to the item "interaction of the experiencer" is the interaction of the experiencer who was provided with the cognitive stimulus in the active mode, and the item "acquisition means" is an acquisition means for acquiring sensor information corresponding to the interaction. The item "changes to the cognitive stimulus" is the changes to the cognitive stimulus in the active mode according to the interaction.
[0155] Specifically, the information corresponding to the item "Reproduction element" in the second row from the top of the table in FIG. 11 is "Message (voice, text)." The information corresponding to "Information on the person to be recalled" is "Speech acquired by a microphone, text data entered by a touch panel or keyboard." The information corresponding to the items "Cognitive stimulation" and "Interaction of the experiencer" is "Stereophonic sound or speech via headphones, images on a display," and "Speaking to the person to be recalled, changes in biological information due to the generation of a message in the brain, etc." The information corresponding to the items "Means of acquisition" and "Changes to cognitive stimulation" is "Microphone, heart rate sensor, brain wave sensor, sweat sensor, etc." and "Providing a new message using the voice of the person to be recalled or speech via TTS, providing an image of the new message," respectively.
[0156] That is, in this case, in the active mode, based on the voice input by the microphone 52, which is part of the information on the person to be remembered, stereophonic sounds or voices are provided by the headphones 162 as cognitive stimuli that reproduce the voice message of the person to be remembered. Alternatively, based on the text data input by the touch panel 41 or keyboard 42, which is part of the information on the person to be remembered, an image is provided by the display 168 as cognitive stimuli that reproduce the written message of the person to be remembered.
[0157] After this cognitive stimulus is provided, the connection recall control unit 232 estimates that the user is talking to the person to be recalled as an interaction, based on the user information corresponding to the sensor information of the microphone 152. The connection recall control unit 232 estimates that the user is generating a brain message as an interaction, thereby changing the biological information, based on the user information corresponding to the sensor information of the heart rate sensor 155, the brain wave sensor 156, the sweat sensor 157, etc.
[0158] When the connected recall control unit 232 estimates the occurrence of an interaction that psychologically approaches the person to be recalled after the provision of a cognitive stimulus that reproduces a voice message, it controls so that a new message is provided in the voice of the person to be recalled. Alternatively, the connected recall control unit 232 controls so that a new message is provided in voice using TTS (Text-To-Speech). When the connected recall control unit 232 estimates the occurrence of an interaction that psychologically approaches the person to be recalled after the provision of a cognitive stimulus that reproduces a text message, it controls so that an image of a new message is provided. This new message is selected, for example, from the person to be recalled information.
[0159] The information corresponding to the item "Reproduction element" in the third row from the top of the table in Figure 11 is "Image (video with audio, still image)." The information corresponding to the item "Information about the person to be recalled" is "Video with audio captured by an RGB camera and microphone, still image captured by an RGB camera." The information corresponding to the item "Cognitive stimulation" is "Video with audio via headphones and displayed, still image via display." The information corresponding to the items "Interaction of the experiencer" and "Means of acquisition" is the same as the information in the second row from the top. The information corresponding to the item "Changes to cognitive stimulation" is "When reproducing a video with audio: provide a new video or a video with a different viewpoint, or play a video with audio currently being provided; when reproducing a still image: provide a new still image or a still image with a different viewpoint."
[0160] That is, in this case, in the active mode, a cognitive stimulus that reproduces a moving image with audio of the person to be remembered is provided based on the moving image with audio captured by the RGB camera 51 and the microphone 52, which is part of the information on the person to be remembered. Specifically, audio through the headphones 162 and a moving image on the display 168 are provided as cognitive stimulus that reproduces the moving image with audio of the person to be remembered. Alternatively, a still image on the display 168 is provided as cognitive stimulus that reproduces the still image of the person to be remembered, based on a still image captured by the RGB camera 51, which is part of the information on the person to be remembered.
[0161] After this cognitive stimulus is provided, the connected recollection control unit 232 estimates the occurrence of an interaction that psychologically brings the person to be recollected, just as after the provision of a cognitive stimulus that reproduces an audio message or a text message. If the connected recollection control unit 232 estimates the occurrence of an interaction that psychologically brings the person to be recollected after the provision of a cognitive stimulus that reproduces a video with audio, it controls so that a new video or a video with a different viewpoint is provided, or so that the currently provided video with audio is played. If the connected recollection control unit 232 estimates the occurrence of an interaction that psychologically brings the person to be recollected after the provision of a cognitive stimulus that reproduces a still image, it controls so that a new still image or a still image with a different viewpoint is provided.
[0162] <Example of Flow of Stimuli Provided by Providing Device> FIG. 12 is a diagram showing an example of the flow of stimuli provided by the providing device 12. As shown in FIG.
[0163] 12, first, the mindfulness & relaxation control unit 231 of the providing device 12 causes the headphones 62 to provide a few seconds of audio guidance A. Audio guidance A consists of an experience start message that prompts the user to insert both hands into the pressure providing mechanism 201 and an introductory message for the stimulus of the mindfulness & relaxation mode.
[0164] An example of the experience start message is, "You will now participate in an experience in which you will feel a connection with Mr. / Ms. XX (name of the person to be recalled). Please place both hands on the cushion in front of you (pressure providing mechanism 201), slowly close your eyes, and relax." An example of the introductory message is, "Try to take slow breaths and focus your attention on your breathing." The audio of the introductory message is provided, for example, a predetermined time after the audio of the experience start message has finished being provided.
[0165] After providing the audio guidance A, the mindfulness & relaxation control unit 231 causes the oscillator 161 to provide simple vibrations as stimuli for the mindfulness & relaxation mode, and also causes the headphones 162 to start providing relaxing music as background music (BGM). This allows the user to focus their attention on the vibrations while listening to the relaxing music (mindfulness through vibration). Alternatively, the mindfulness & relaxation control unit 231 can provide breathing meditation with guide messages instead of simple vibrations. In this case, the user can practice mindfulness by focusing their attention on their breathing.
[0166] Sixty seconds after the start of providing the mindfulness and relaxation mode stimuli, the connected recall control unit 232 causes the headphones 62 to provide a few seconds of audio guidance B. Audio guidance B is, for example, "Next, try to feel a heartbeat message from (name of person to be recalled) to you. Then, please think of that person as well."
[0167] After providing the audio guide B, the mindfulness and relaxation control unit 231 causes the oscillator 161 to stop providing the simple vibration. The connected recall control unit 232 starts causing the oscillator 161 to provide heartbeat vibration as a physical stimulus for the passive mode of the connected recall mode, based on the information representing the heartbeat and heart rate included in the information on the person to be recalled. This allows the user to feel the heartbeat of the person to be recalled.
[0168] Sixty seconds after the start of providing this physical stimulation, the connection recollection control unit 232 causes the headphones 62 to provide a few seconds of audio guidance C. Audio guidance C is, for example, "Next, try to convey your feelings to the other person by touching them. Put out one hand and touch the person's heartbeat from above the cushion (pressure providing mechanism 201). Receive a new message by touching them."
[0169] As a result, the user removes one of his or her hands that was inserted into the pressure providing mechanism 201 and touches the top of the upper mechanism 201a. As a result, the pressure sensor 153 provided on the upper mechanism 201a measures the pressure.
[0170] Five seconds after this pressure is measured, the connected recall control unit 232 starts providing the audio of message A based on the audio of message A of the person to be recalled included in the information on the person to be recalled as a cognitive stimulus for the passive mode of the connected recall mode. This allows the user to receive the audio message of the person to be recalled and to think about the person to be recalled.
[0171] On the other hand, after providing audio guidance C, the connection recall control unit 232 ends providing the physical stimulation in the passive mode. Then, the connection recall control unit 232 starts to cause the oscillator 161 to provide heartbeat vibration as the physical stimulation in the active mode, based on the information representing the heartbeat and heart rate of the person to be recalled in the information about the person to be recalled and the user information. This allows the user to feel the heartbeat vibration corresponding to their interaction.
[0172] Specifically, the user touches the top of the upper mechanism 201a with one hand, and then, while feeling the heartbeat vibrations provided by the oscillator 161, grips the upper mechanism 201a with that hand or wraps around the upper mechanism 201a with both hands. As a result, the pressure sensor 153 provided on the upper mechanism 201a measures the pressure, and the pressure distribution sensor 154 measures the pressure distribution. Based on this pressure or pressure distribution, the connection recall control unit 232 estimates that the user is gripping the pressure-providing mechanism 201 with one hand or wrapping it with both hands as an interaction. The connection recall control unit 232 then controls the oscillator 161 so that the heartbeat vibrations are provided with an intensity corresponding to the strength of the gripping force or wrapping force based on the measured pressure or pressure distribution.
[0173] The participant can strengthen their sense of connection to the person they are recalling by interacting with the pressure-providing mechanism 201 while thinking of the person. For example, in "Illustrated Skin Therapy that Eliminates Stress from the Brain" by Hajime Yamaguchi, published by Seishun Publishing on July 1, 2018, there is a research report that shows that more oxytocin is secreted by the person giving the massage than by the person receiving the massage. In other words, acting while thinking of others increases the secretion of oxytocin. As a result, the oxytocin reinforcing loop is further strengthened.
[0174] Sixty seconds after the provision of message A for the person to be recalled begins, the self-compassion control unit 233 causes the headphones 162 to provide audio guidance D and audio such as a guide message for compassion meditation as a stimulus for the self-compassion mode.
[0175] An example of Audio Guide D is, "From here, we will begin a compassion meditation / connection of loving-kindness with others and yourself. There is no need to speak aloud, so please follow my words and speak to yourself in your mind. Now we will begin." The audio guide message for the compassion meditation is provided a predetermined time after the audio for Audio Guide D has finished. The participant practices compassion meditation following the guide message while enjoying the heartbeat vibrations and relaxing music of an intensity that corresponds to the interaction.
[0176] Loving-kindness meditation is a form of meditation that involves feeling connected to oneself and others and wishing for happiness. By practicing loving-kindness meditation, people are able to accept their own emotions as they are, increase kindness toward others, and have the space to consider the happiness of both themselves and others. The effects of loving-kindness meditation are described, for example, in Non-Patent Document 1.
[0177] The guide messages for loving-kindness meditation are composed of guide messages for loving-kindness meditation for others, guide messages for loving-kindness meditation for ourselves, guide messages for loving-kindness meditation for oneself, and a conclusion message, in that order.
[0178] Examples of guiding messages for the meditation on loving-kindness towards others are, "May you be happy. May your mind be at peace. May you be healthy. May you live in peace. May you be safe."
[0179] Examples of guide messages for loving-kindness meditation for ourselves are, "You and I, may we be happy. You and I, may our minds be at peace. You and I, may we be healthy. You and I, may we live in peace. You and I, may we be safe."
[0180] Examples of guiding messages for self-compassion meditation are, "May I be happy. May my mind be at peace. May I be healthy. May I live in peace. May I be safe." An example of a closing message is, "This concludes the self-compassion meditation."
[0181] After a predetermined time has elapsed since the start of providing the audio guide message for audio guidance D and the compassion meditation, the connection recall control unit 232 ends the provision of the active mode stimulation. Then, the connection recall control unit 232 causes the headphones 162 to provide audio guidance E for several seconds. For example, audio guidance E is, "This concludes the connection experience. Please open your eyes slowly."
[0182] After the provision of the audio guidance E is completed, the mindfulness and relaxation control unit 231 causes the headphones 62 to stop providing audio stimuli.
[0183] <Configuration Example of Experiencer Information Table> FIG. 13 is a diagram showing a configuration example of an experiencer information table stored in the database 130 of FIG.
[0184] As shown in FIG. 13 , the database 130 stores a hierarchical structure of participant information tables. Specifically, the database 130 stores a participant list table as a higher layer than the participant information table. The participant list table is a table in which the personal information of each participant is registered in association with the participant ID of that person. This personal information includes basic information such as name, time of personal information registration, gender, date of birth, and nationality, as well as social media accounts and the number of people to be recalled.
[0185] Below the experiencer list table, a participant table for each experiencer is stored. In the example of Fig. 13, there are three experiencers A to C who used the experience system 10. In this case, below the experiencer list table, a participant table for each experiencer A to C is stored.
[0186] In the experiencer table for experiencer A, the experiencer ID of experiencer A is registered in association with the experiencer information ID of each piece of experiencer information of experiencer A. The experiencer information ID is an ID unique to each piece of experiencer information. The experiencer information ID of each piece of experiencer information of experiencer A also registers a timestamp, which is time information when the experiencer information was recorded (generated), the recording time (acquisition time) of the experiencer information, and the experiencer information. This recording time is calculated, for example, based on the times measured by the timing unit 131 at the start and end of generation of the experiencer information. The experiencer information ID of each piece of experiencer information of experiencer A also registers a state estimation index corresponding to the experiencer information, a recall target information ID corresponding to a stimulus provided to the experiencer immediately before the acquisition of the experiencer information, and stimulus information of the stimulus.
[0187] The participant tables for participant B and participant C are configured in the same manner as the participant table for participant A, except that participant A replaces participant B and participant C, respectively, and therefore a description thereof will be omitted.
[0188] <Example of Information Registered in Experiencer Table> FIG. 14 is a diagram showing an example of information registered in the experiencer table of experiencer A in FIG.
[0189] In the example of Fig. 14, heart rate, voice, and text data are generated seven times as the experiencer information of experiencer A. Therefore, the experiencer information table of Fig. 14 consists of seven entries. In the example of Fig. 14, the seven pieces of experiencer information are assigned experiencer information IDs ranging from "001" to "0007" in the order in which they were generated, and "001" to "0007" are registered as the experiencer information IDs of the respective entries.
[0190] In the example of FIG. 14, the participant ID of participant A is "001", and "001" is registered as the participant ID of each entry. In the example of FIG. 14, the participant information with participant information ID "001" was generated at 9:19:40 on March 17, 2023. Therefore, the entry with participant information ID "001" has "Timestamp(Date(17;03;2023);Time(9;19;40))" registered as the timestamp.
[0191] In the example of FIG. 14, the recording time of the experiencer information of the experiencer information ID "001" is 10 seconds, and the entry for the experiencer information ID "001" has the recording time "0:00:10" registered.
[0192] 14, the heart rate in the experiencer information of the experiencer information ID "001" is 80, the file name of the audio is "xxx.mp3", and the text data is "xxx". Therefore, in the entry for the experiencer information ID "001", 80 is registered as the heart rate, "xxx.mp3" as the audio, and "xxx" as the text in the experiencer information.
[0193] In the example of Figure 14, the state estimation index representing the degree of the state of recollection of a sense of connection calculated based on the experiencer information of experiencer information ID "001" is 70, and 70 is registered as the state estimation index of recollection of a sense of connection in the entry for experiencer information ID "001."
[0194] In the example of Figure 14, the recalled subject information ID of the recalled subject information used for the stimulus immediately before acquiring the experiencer information of experiencer information ID "001" is "001", and "001" is registered as the recalled subject information ID in the entry for experiencer information ID "001".
[0195] In the example of Fig. 14, the stimulus is the stimulus shown in Fig. 12. Therefore, in the entry for the experiencer information ID "001," "relaxing music" and "simple vibration (or breathing meditation)" are registered as stimulus information for the mindfulness and relaxation mode. In the entry for the experiencer information ID "001," "heartbeat vibration" is also registered as stimulus information for the passive mode and active mode of the connection recollection mode, and "guidance message for compassion meditation" is registered as stimulus information for the self-compassion mode.
[0196] Although not explained further, the entries for experiencer information IDs "002" to "0007" also register the experiencer ID, timestamp, recording time, heart rate, voice, text data, state estimation index for recalling a sense of connection, recall target information ID, and stimulation information.
[0197] 13 and 14, information marked with "*" at the end is information that can be referenced from tables other than the one itself. Specifically, the experiencer ID in the experiencer list table, and the experiencer information ID, experiencer ID, and recalled person information ID in the experiencer information table are information that can be referenced from tables other than the one itself.
[0198] For example, when the experiencer ID "001" registered in the recalled person information table of Fig. 5 is selected, the experiencer information table of Fig. 14 can be referenced. When the experiencer information ID "007" registered in the recalled person information table of Fig. 14 is selected, the entry for the recalled person information ID "007" registered in the recalled person information table of Fig. 5 can be referenced.
[0199] The experiencer information and the type of state estimation index registered in the experiencer information table are set in advance by the owner of the experience system 10 .
[0200] <Example of Change in Stimulus in Mindfulness & Relaxation Mode> FIG. 15 is a table showing an example of change in stimulus in the mindfulness & relaxation mode based on the state estimation index.
[0201] The first row from the top of the table in Fig. 15 describes the items "Type of user information," "Changed stimulus," and "Effect." The second to fourth rows from the top describe information corresponding to each item.
[0202] The information corresponding to the item "Type of user information" is the type of user information used to calculate the state estimation index used when the mindfulness & relaxation control unit 231 determines the stimulus for the mindfulness & relaxation mode. The information corresponding to the item "Changed stimulus" is the stimulus for the mindfulness & relaxation mode that has been changed based on the state estimation index. The item "Effect" is the target effect of this change.
[0203] Specifically, the information corresponding to the item "Type of experiencer information" in the second to fourth rows from the top of the table in Figure 15 is "Heart rate (high / low)", "Autonomic nerve activity (sympathetic / parasympathetic)", and "Electroencephalogram (alpha waves and gamma waves)", respectively.
[0204] That is, the user information used to calculate the state estimation index used to determine the stimulation for the mindfulness & relaxation mode is the heart rate measured by the heart rate sensor 155. Alternatively, this user information is the autonomic nerve activity based on the pulse wave measured by the pulse wave sensor 150 or the skin potential measured by the skin potential sensor 160. Alternatively, this user information is the brain waves measured by the brain wave sensor 156.
[0205] The information corresponding to the items "Changed Stimulus" in the second to fourth rows from the top of the table in Figure 15 is all the same: "Sound," "Moving Image / Still Image," "Vibration & Pressure," "Scent," and "Temperature."
[0206] Specifically, the modified stimuli may be sounds of a certain frequency provided by headphones 162 to achieve a synchronization effect, music of a specific frequency, hypersonics, natural sounds such as rivers or waves, the audio of a reassuring guide message, or the audio of a message from a close friend.
[0207] The changed stimulus is a moving or still image of a close friend, space or natural scenery, a bonfire, etc., provided by display 168. The changed stimulus is a constant frequency vibration, a specific frequency vibration, 1 / f fluctuation, etc., provided by oscillator 161 to obtain a synchronization effect. The changed stimulus is a vibration and pressure linked to breathing, provided by oscillator 161 and pressure providing mechanism 201, massage pressure provided to various parts of the user by pressure providing mechanism 201, etc.
[0208] The changed stimuli are scents such as phytoncide, rose, orange flower, lavender, essential oil, and memorable perfumes provided by the scent cartridge 164. The changed stimuli include a temperature close to body temperature provided by the Peltier element 165.
[0209] It is known that scents such as rose and orange flower promote the secretion of oxytocin. This is described, for example, in Menard's "Scents Revitalize Stem Cells (Psychological Effects)," [April 11, 2023], searchable on the Internet at <URL: https: / / corp.menard.co.jp / research / tech / tech_05_01.html>. Therefore, the mindfulness and relaxation control unit 231 can strengthen the oxytocin reinforcement loop by having the scent cartridge 164 provide scents such as rose and orange flower.
[0210] The modified stimulus may be a still or animated image of a reassuring guide message or a message from a loved one provided by the display 168.
[0211] The information corresponding to the item "Effect" in the second to fourth rows from the top of the table in FIG. 15 is "Regulates heart rate," "Increases parasympathetic nerve activity," and "Increases alpha waves and gamma waves," respectively.
[0212] That is, the mindfulness and relaxation control unit 231 changes the stimulation based on a state estimation index calculated based on the heart rate in the user information so that the heart rate will reach a reference value or an arbitrary set value. Alternatively, the mindfulness and relaxation control unit 231 changes the stimulation based on a state estimation index calculated based on the autonomic nerve activity in the user information so that the parasympathetic nerve activity level, which indicates the degree of relaxation in the autonomic nerve activity level, will reach a reference value or an arbitrary set value. Alternatively, the mindfulness and relaxation control unit 231 changes the stimulation based on a state estimation index calculated based on the brain waves in the user information so that alpha waves and gamma waves will reach reference values or an arbitrary set value.
[0213] The mindfulness and relaxation control unit 231 may change the stimulation so that the heart rate, parasympathetic nerve activity, and alpha waves and gamma waves fall within predetermined ranges.
[0214] The mindfulness & relaxation control unit 231 can also change the stimulus in the mindfulness & relaxation mode based on a state estimation index calculated based on subjective indices before, during, and after the provision of a stimulus. The mindfulness & relaxation control unit 231 can also change the stimulus in the mindfulness & relaxation mode based on a state estimation index calculated based on tone of voice, facial expression, and the like, among the user information.
[0215] <Description of Transmission Process> FIG. 16 is a flowchart illustrating a transmission process in which the acquisition device 11 transmits the remembered person information.
[0216] In step S11 of FIG. 16, the sensor unit 36 acquires sensor information and supplies it to the recalled subject information generating unit 33 via the IF unit 38.
[0217] In step S12, the recollected subject information generation unit 33 generates recollected subject information based on the sensor information acquired by the processing of step S11. The recollected subject information generation unit 33 supplies the recollected subject information to be stored in the storage unit 39. The recollected subject information generation unit 33 reads out the recollected subject information stored in the storage unit 39 and supplies it to the communication unit 32 via the IF unit 38.
[0218] In step S13, the communication unit 32 transmits the remembered person information generated by the processing in step S12 to the provision device 12, and the processing ends.
[0219] <Explanation of Control Processing> FIG. 17 is a flowchart illustrating a control processing for controlling the provision of stimulation by the control unit 124.
[0220] In step S31 of FIG. 17, the reading unit 230 reads the recalled subject ID and the state estimation index, stimulus information, and recalled subject information ID corresponding to the recalled subject ID supplied from the IF unit 129 from the experiencer information table of the database 130.
[0221] The reading unit 230 supplies the read state estimation index and the stimulation information for the mindfulness and relaxation mode to the mindfulness and relaxation control unit 231. The reading unit 230 supplies the read state estimation index, the stimulation information for the connected recollection mode, and the recollection target information ID to the connected recollection control unit 232. The reading unit 230 supplies the read state estimation index and the stimulation information for the self-compassion mode to the self-compassion control unit 233.
[0222] In step S32, the control unit 124 determines a stimulus for each operation mode. Specifically, the mindfulness & relaxation control unit 231 determines a stimulus for the mindfulness & relaxation mode based on the state estimation index read by the processing of step S31 and the stimulus information for the mindfulness & relaxation mode. The control unit 124 supplies the stimulus information representing the stimulus and the user ID to the database 130.
[0223] The connection recall control unit 232 determines a stimulus for the connection recall mode based on the state estimation index read by the processing of step S31, the stimulus information for the connection recall mode, the recollection subject information ID, and the experiencer information supplied from the generation unit 126. The connection recall control unit 232 supplies the database 130 with the stimulus information representing the stimulus, the recollection subject information ID of the recollection subject information used for the stimulus, and the experiencer ID.
[0224] The self-compassion control unit 233 determines a stimulus for the self-compassion mode based on the state estimation index and the stimulus information for the self-compassion mode read by the processing of step S31. The self-compassion control unit 233 supplies the stimulus information representing the stimulus and the experiencer ID to the database 130.
[0225] In step S33, the mindfulness & relaxation control unit 231 starts providing stimuli for the mindfulness & relaxation mode determined by the processing in step S32. Specifically, the mindfulness & relaxation control unit 231 generates stimulus control information that controls the providing unit 128 to provide the stimuli to the user, and supplies this to the providing unit 128 via the IF unit 129.
[0226] In step S34, the link recall control unit 232 reads out, from the link recall object information table in the database 130, the link recall object information to be used for stimulation in the link recall mode determined by the process in step S32.
[0227] In step S35, the connection recall control unit 232 starts providing stimuli in the connection recall mode determined in the process of step S32, based on the recollection target information read in the process of step S34. Specifically, the connection recall control unit 232 generates stimulus control information that controls the providing unit 128 to provide the stimuli to the user, and supplies the stimulus control information to the providing unit 128 via the IF unit 129.
[0228] In step S36, the self-compassion control unit 233 starts providing the stimulus in the self-compassion mode determined by the processing in step S32. Specifically, the self-compassion control unit 233 generates stimulus control information that controls the provision unit 128 to provide the stimulus to the user, and supplies the stimulus control information to the provision unit 128 via the IF unit 129.
[0229] In step S37, the control unit 124 ends the provision of stimuli in all operation modes. Specifically, the mindfulness and relaxation control unit 231 ends the provision of stimuli that began in step S33. The connection recollection control unit 232 ends the provision of stimuli that began in step S35. The self-compassion control unit 233 ends the provision of stimuli that began in step S36. Then, the control process ends.
[0230] In the example of Figure 17, the provision of stimuli for all operation modes is terminated in step S37, but at least some of the stimuli for the mindfulness and relaxation mode and the connection recall mode may be terminated at any timing before the processing of step S37.
[0231] <Description of Registration Process> FIG. 18 is a flowchart illustrating the registration process of registering a state estimation index by the providing device 12.
[0232] 18 , the sensor unit 127 acquires sensor information and supplies it to the generation unit 126 via the IF unit 129. In step S52, the generation unit 126 generates experiencer information based on the sensor information acquired by the processing of step S51, and supplies it to the control unit 124, the calculation unit 125, and the database 130.
[0233] In step S53, the calculation unit 125 acquires the subjective index received from the smartphone 13 by the communication unit 122 via the IF unit 129. In step S54, the calculation unit 125 generates a state estimation index based on the experiencer information generated in step S52 and the subjective index acquired in step S53.
[0234] In step S55, the calculation unit 125 registers the state estimation index generated by the processing in step S54 in the experiencer information table stored in the database 130 together with the time information supplied from the timing unit 131. Then, the registration processing ends.
[0235] The subjective index may be input by the user operating the operation button 143 while the stimulus is being provided. In this case, the user inputs the subjective index at that time by pressing the operation button 143 a number of times or for a period of time corresponding to the subjective index.
[0236] The amount of oxytocin measured in the experiencer's saliva or the like may be input to the providing device 12, and the providing device 12 may calculate a state estimation index based on the amount of oxytocin. Because oxytocin is directly related to the experiencer's sense of connection, the providing device 12 can accurately calculate a state estimation index for the recollection of a sense of connection based on the measured amount of oxytocin. Because oxytocin is released by pleasant pressure (touch) on the skin, the providing device 12 can confirm the effect of physical stimulation that reproduces the touch of the recollection target based on the measured amount of oxytocin.
[0237] The control unit 124 may randomly determine the stimulus for each operation mode without referring to the user information table.
[0238] The control unit 124 may generate candidate stimuli for each operation mode based on the user information table and display multiple menus consisting of combinations of candidate stimuli for each operation mode on the display 168, etc. In this case, the user selects a desired menu from the multiple menus, and the control unit 124 controls so that the stimuli for each operation mode that make up the selected menu are provided. Note that the user may select a desired menu from the multiple menus by specifying conditions.
[0239] The information on the person to be remembered may be a video of memories of the person to be remembered and the experiencer. The stimulation information for each operation mode may include the duration of the stimulation for each operation mode. In this case, the control unit 124 may also change the duration of the stimulation for each operation mode based on the experiencer information table.
[0240] The acquisition device 11 and the provision device 12 may be the same. That is, the person to be recalled may use the device that the experiencer uses when enjoying the stimulation for inputting the person to be recalled information.
[0241] The providing device 12 may use AI technology or the like to generate current information about the person to be remembered based on past information about the person to be remembered and register it in the database 130. In this case, the experiencer can recall a sense of connection with the person to be remembered who has already passed away based on this information about the person to be remembered.
[0242] The sounds and images used as stimuli in the mindfulness and relaxation mode are registered in the database 130 and can be automatically updated at any time.
[0243] The providing device 12 may generate resilience (tolerance area) as experiencer information using, for example, the method described in International Publication No. 2022 / 124085 filed by the applicant.
[0244] The connection recall control unit 232 does not need to control the provision of both stimuli as long as it controls the provision of at least one of the stimuli in the active mode and the passive mode of the connection recall mode.
[0245] As described above, the mindfulness & relaxation control unit 231 controls to provide stimuli to the user in the mindfulness & relaxation mode, and the connected recollection control unit 232 controls to provide stimuli to the user based on the recollected person information in the connected recollection mode. The provision of stimuli by the mindfulness & relaxation control unit 231 begins before the provision of stimuli by the connected recollection control unit 232. This makes it possible to effectively evoke in the user a sense of connection with the recollected person. As a result, the user's sense of loneliness and tension is reduced, and well-being is realized.
[0246] The self-compassion control unit 233 controls the self-compassion mode to provide a stimulus to the user, and the provision of this stimulus is performed before the provision of a stimulus in the connection recall mode, thereby effectively improving self-compassion.
[0247] This ultimately enables participants to strengthen their inner strength without relying on external stimuli such as science and technology. In other words, participants can achieve a transformation of their mind and inner sustainability. As a result, this can contribute to the realization of a vibrant life through sustainable well-being in an age of longer lifespans, such as the 100-year lifespan era.
[0248] As described above, the experience system 10 can reduce the participant's feelings of loneliness and tension in the short term. In the medium to long term, the participant's sense of connection with the person they are recalling can make them feel more positive. By improving self-compassion, the participant can be encouraged to transform themselves and achieve inner sustainability. The participant can be encouraged to explore the value of oxytocin-induced happiness. As a result, it can contribute to the realization of sustainable well-being.
[0249] In contrast, many existing technologies externalize human abilities and do not foster the inherent, internal, non-cognitive abilities, such as resilience. Some of the causes of mental health problems are due to technological advances, and currently, technological development is not highly compatible with improving mental health problems. For example, technological developments that attract attention, such as social media, increase people's stress and feelings of loneliness.
[0250] Mindfulness and self-compassion are backed by academic and scientific evidence, and the effectiveness of the experience system 10 is highly reliable.
[0251] The control unit 124 determines the stimulus for each operation mode based on the state estimation index, and therefore can select a more effective stimulus.
[0252] 2. Computer The above-described series of processes can be executed by hardware or software. When the series of processes are executed by software, the programs that make up the software are installed on a computer. Here, the term "computer" includes computers built into dedicated hardware, and general-purpose personal computers, for example, that can execute various functions by installing various programs.
[0253] FIG. 19 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.
[0254] In the computer, a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903 are interconnected by a bus 904.
[0255] An input / output interface 905 is also connected to the bus 904. An input unit 906, an output unit 907, a storage unit 908, a communication unit 909, and a drive 910 are connected to the input / output interface 905.
[0256] The input unit 906 includes a keyboard, a mouse, a microphone, etc. The output unit 907 includes a display, a speaker, etc. The storage unit 908 includes a hard disk, a non-volatile memory, etc. The communication unit 909 includes a network interface, etc. The drive 910 drives removable media 911 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
[0257] In a computer configured as described above, the CPU 901 performs the above-described series of processes by, for example, loading a program stored in the memory unit 908 into the RAM 903 via the input / output interface 905 and the bus 904 and executing it.
[0258] The program executed by the computer (CPU 901) can be provided by being recorded on a removable medium 911 such as a package medium, for example. The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
[0259] In a computer, the program can be installed in the storage unit 908 via the input / output interface 905 by inserting the removable medium 911 into the drive 910. The program can also be received by the communication unit 909 via a wired or wireless transmission medium and installed in the storage unit 908. Alternatively, the program can be installed in the ROM 902 or the storage unit 908 in advance.
[0260] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.
[0261] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology.
[0262] For example, it is possible to adopt a configuration in which all or part of the above-described embodiments are combined.
[0263] For example, the present technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by a plurality of devices via a network.
[0264] Furthermore, each step described in the above flowchart can be executed by one device, or can be shared and executed by a plurality of devices.
[0265] Furthermore, when one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices.
[0266] The effects described in this specification are merely examples and are not limiting, and there may be effects other than those described in this specification.
[0267] The present technology can be configured as follows: (1) An information processing device comprising: a mindfulness control unit that controls to provide a first stimulus to a user in a mindfulness mode that is an operation mode for putting the user into a mindfulness state; and a connection recollection control unit that controls to provide a second stimulus to the user based on recollected subject information that is information acquired from a recollected subject who is a subject for recollecting a sense of connection in a connection recollection mode that is an operation mode for recollecting a sense of connection in the user, wherein the provision of the first stimulus is started before the provision of the second stimulus. (2) The information processing device according to (1), wherein the recollected subject information is chronological information of the recollected subject. (3) The information processing device according to (1) or (2), wherein the connection recall mode is configured to include a passive mode in which the second stimulus is provided regardless of input from the user, and an active mode in which the second stimulus is provided in response to input from the user, and the connection recall control unit is configured to control the provision of the second stimulus to the user based on the recollected person information in at least one of the passive mode and the active mode. (4) The information processing device according to any of (1) to (3), further comprising: a self-compassion control unit that controls the provision of a third stimulus to the user in a self-compassion mode that is an operation mode that promotes improvement of self-compassion of the user, and wherein the provision of the second stimulus is started before the provision of the third stimulus. (5) The information processing device according to any of (1) to (4), further comprising: a generation unit that generates feedback information representing a change in the user due to the first stimulus and the second stimulus. (6) The information processing device according to (5), wherein the generation unit is configured to generate the feedback information based on time-series biological information measured by a measurement unit that measures biological information of the user. (7) The information processing device according to (5) or (6), wherein the generation unit is configured to generate the feedback information based on an input from the user.(8) The information processing device according to any of (5) to (7), wherein the mindfulness control unit is configured to determine the first stimulus to be provided to the user based on the feedback information. (9) The information processing device according to any of (5) to (8), wherein the connection recollection control unit is configured to determine the second stimulus to be provided to the user based on the feedback information. (10) The information processing device according to any of (1) to (9), wherein the second stimulus is a physical stimulus or a cognitive stimulus. (11) An information processing method, comprising: a mindfulness control step of controlling the information processing device to provide a first stimulus to the user in a mindfulness mode that is an operation mode for putting the user into a mindfulness state; and a connection recollection control step of controlling the information processing device to provide a second stimulus to the user based on recollection target information that is information acquired from a recollection target who is a target for reminiscing about a sense of connection in the user, wherein the provision of the first stimulus is started before the provision of the second stimulus. (12) A program for causing a computer to function as an information processing device, comprising: a mindfulness control unit that controls a computer to provide a first stimulus to a user in a mindfulness mode, which is an operating mode that puts the user into a mindful state; and a connection recollection control unit that controls a computer to provide a second stimulus to the user based on recollection subject information, which is information obtained from a recollection subject who is an object of recollection of a sense of connection, in a connection recollection mode, which is an operating mode that evokes a sense of connection in the user, wherein the provision of the first stimulus is started before the provision of the second stimulus.
[0268] 12 Providing device, 125 Calculation unit, 127 Sensor unit, 231 Mindfulness control unit, 232 Connection recollection control unit, 233 Self-compassion control unit
Claims
1. An information processing device comprising: a mindfulness control unit that controls the provision of a first stimulus to a user in a mindfulness mode, which is an operating mode that puts the user into a mindfulness state; and a connection recollection control unit that controls the provision of a second stimulus to the user based on recollection subject information, which is information obtained from a recollection subject who is the subject of the sense of connection, in a connection recollection mode, which is an operating mode that evokes a sense of connection in the user, wherein the provision of the first stimulus is configured to be started before the provision of the second stimulus.
2. The information processing device according to claim 1, wherein the information on the person to be recalled is chronological information on the person to be recalled.
3. The information processing device of claim 1, wherein the connection recall mode is configured to include a passive mode in which the second stimulus is provided regardless of input from the user, and an active mode in which the second stimulus is provided in response to input from the user, and the connection recall control unit is configured to control the provision of the second stimulus to the user based on the recollection subject information in at least one of the passive mode and the active mode.
4. The information processing device of claim 1, further comprising a self-compassion control unit that controls the provision of a third stimulus to the user in a self-compassion mode, which is an operating mode that promotes improvement of the user's self-compassion, and is configured so that the provision of the second stimulus is started before the provision of the third stimulus.
5. The information processing device according to claim 1, further comprising a generation unit that generates feedback information representing a change in the user due to the first stimulus and the second stimulus.
6. The information processing device according to claim 5, wherein the generating unit is configured to generate the feedback information based on time-series bioinformation measured by a measuring unit that measures the bioinformation of the user.
7. The information processing device according to claim 5, wherein the generation unit is configured to generate the feedback information based on an input from the user.
8. The information processing device according to claim 5, wherein the mindfulness control unit is configured to determine the first stimulus to be provided to the user based on the feedback information.
9. The information processing device according to claim 5, wherein the connection recall control unit is configured to determine the second stimulus to be provided to the user based on the feedback information.
10. The information processing device of claim 1, wherein the second stimulus is configured to be a physical stimulus or a cognitive stimulus.
11. An information processing method comprising: a mindfulness control step of controlling an information processing device to provide a first stimulus to a user in a mindfulness mode, which is an operating mode that puts the user into a mindfulness state; and a connection recollection control step of controlling an information processing device to provide a second stimulus to the user based on recollection subject information, which is information obtained from a recollection subject who is an object of recollection of a sense of connection, in a connection recollection mode, which is an operating mode that evokes a sense of connection in the user, wherein the provision of the first stimulus is commenced before the provision of the second stimulus.
12. A program for causing a computer to function as an information processing device comprising: a mindfulness control unit that controls a computer to provide a first stimulus to a user in a mindfulness mode, which is an operating mode that puts the user into a mindfulness state; and a connection recollection control unit that controls a computer to provide a second stimulus to the user based on recollection subject information, which is information obtained from a recollection subject who is the subject of the sense of connection, in a connection recollection mode, which is an operating mode that evokes a sense of connection in the user, wherein the provision of the first stimulus is started before the provision of the second stimulus.
Citation Information
Patent Citations
Valentine pillow
JP2009521165A
Server device, system and program
JP2023012396A
Systems and methods for providing remote touch
US20200316784A1
