Information processing device, method for processing information, and program

Abstract

To provide an information processing device from which a feeling of accomplishment of mental healthcare can be acquired, and to provide a method for processing information and a program.SOLUTION: An information processing device includes a controller. The controller changes an object image that expresses a psychological state of a user and is presented to the user toward extinction on the basis of respiration length of the user calculated using output results that are output from a sensor for detecting respiration of the user with the lapse of time.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program relating to mental health care. [Background technology]

[0002] In recent years, the proportion of people who feel work-related stress, worries, and anxiety has been increasing, and mental health measures such as stress check tests have been implemented. Patent Document 1 describes a breathing confirmation system that controls changes in the user's breathing state as shape changes between dispersion and convergence of multiple seed figures. In this breathing confirmation system, a target (target time) is set for the duration of the user's exhalation period, and an image is generated to be presented to the user so that the user achieves the target time. Specifically, when the exhalation period begins, the diverging seed figures begin to converge, and when the exhalation period reaches a period specified as the target time, an image is generated so that the seed figures are arranged in an orderly manner. This induces the user to breathe deeply so as to reach the target time, and leads to a relaxed state. In the breathing confirmation system of Patent Document 1, a breathing induction mode is executed until the exhalation period reaches the target time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-228540 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the breathing confirmation system of Patent Document 1, the breathing induction mode is executed until the expiration period reaches a target time, so that depending on the user, the user may be restrained for a long period of time and may not feel relaxed.

[0005] The present invention relates to an information processing device, an information processing method, and a program that provide a sense of accomplishment in mental health care. [Means for solving the problem]

[0006] According to an aspect of the present invention, there is provided an information processing device including a control unit that changes an object image, which is presented to a user and represents the mental state of the user, toward disappearance at a degree of change based on a breathing length of the user calculated using output results output over time from a sensor that detects breathing of the user.

[0007] An information processing method according to one embodiment of the present invention is an information processing method executed by an information processing device, which presents to the user an object image representing the psychological state of the user, which changes toward disappearance with a degree of change based on the breathing length of the user calculated using output results output over time from a sensor that detects the user's breathing.

[0008] A program according to one embodiment of the present invention is a program for presenting to a user an object image representing the psychological state of the user, the display size of which changes toward disappearance with a degree of change based on the user's breathing length calculated using output results output over time from a sensor that detects the user's breathing, and causes an information processing device to execute the steps of: updating a reduction ratio of the display size of the object image so that the degree of change is large when the breathing length is relatively long and so that the degree of change is small when the breathing length is relatively short; and, if the updated reduction ratio is less than a threshold, terminating the generation and presentation of the object image, and, if the updated reduction ratio is equal to or greater than the threshold, generating the object image based on the reduction ratio and presenting the generated object image. Effect of the Invention

[0009] According to the present invention, it is possible to give a user a sense of accomplishment in mental health care. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing how stress care is carried out using an information processing device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of an information processing system including the information processing device. [Diagram 3] FIG. 2 is a hardware configuration diagram of the information processing device. [Figure 4] 13 is an example of an input display image that is displayed based on an image signal generated by the information processing device and that allows a user to select and input his / her own psychological state. [Diagram 5] 1 is an example of a display image for mental health care that is displayed based on an image signal generated by the information processing device. [Figure 6] 1A to 1C are diagrams illustrating examples of object images of various display sizes. [Figure 7] 11A and 11B are conceptual diagrams illustrating an example of change over time in size of an object image in a display image for mental health care that is displayed based on an image signal generated by the information processing device. [Figure 8] 11 is a diagram for explaining how the size of an object image in a mental health care display image displayed based on an image signal generated by the information processing device changes during presentation time. FIG. [Figure 9] (A) is a conceptual graph showing an example of change in the display size of an object image when the vertical axis shows the display size value of the object image and the horizontal axis shows time, and (B) is a conceptual graph for explaining that the presentation time of the object image differs depending on the user's breathing length when the vertical axis shows the display size value of the object image and the horizontal axis shows time. [Figure 10] 13 is a conceptual graph showing normalized angle values ​​obtained by normalizing the detection values ​​of the tilt sensor on the vertical axis and time on the horizontal axis, illustrating that the volume is determined based on the normalized angle values. FIG. [Figure 11]13 is an example of a display image for mental health care, including ripples indicating the timing of starting to inhale, which is displayed based on an image signal generated by the information processing device. [Figure 12] 10 is a flowchart showing an information processing method for generating a display image for mental health care by the information processing device. FIG. [Figure 13] 4 is an example of an angle information array indicating information (detection information) related to a detection value of a tilt sensor. [Figure 14] 13 is an example of an angle information array after detection values ​​are normalized and converted into normalized angle values. [Figure 15] 13 is a diagram for explaining that the amount of reduction in the basic size, the number of breaths, and the number of seconds required to reduce the basic size to 0 or less differ depending on the user's breathing length. FIG. [Figure 16] The top three graphs show when the breathing length is 8 seconds, and the bottom three graphs show when the breathing length is 4 seconds. These are conceptual graphs to explain that the presentation time and degree of change in basic size (reduction amount) of the object image differ depending on the user's breathing length, that the waveform of the normalized angle value differs, and that the change in the display size of the object image differs. [Figure 17] FIG. 11 is a diagram for explaining a first modified example of the present invention. [Figure 18] FIG. 2 is a diagram illustrating an image configuration of a display image for mental health care. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following description, the same reference numerals are used to designate configurations that have already been described, and descriptions thereof may be omitted.

[0012] The information processing system of this embodiment is a system that performs self-mental health care for a user by presenting to the user a mental health care display image, which is a display image (visual information) including an object image that represents the user's psychological state, as a mental health measure (measure to ensure mental health).

[0013] In the mental health care display image, an object image representing the user's psychological state is displayed using breathing information including the user's breathing length, and the display is stopped. In general, when a user has negative emotions such as stress (uneasy feelings), anxiety, or depression, the sympathetic nerves are dominant, and the user naturally tends to breathe shallowly and quickly (breathing with a short breathing length). On the other hand, when the user is in a relaxed state, the parasympathetic nerves are dominant, and the user tends to breathe deep and slowly (breathing with a long breathing length). In this embodiment, the object image in the mental health care display image changes toward disappearance at a degree of change based on the user's breathing length. When the object image representing a negative psychological state visually disappears, the user feels a sense of disappearance of negative emotions such as stress, anxiety, and depression, and feels a positive and liberated feeling, and a sense of accomplishment in mental health care is obtained. In addition, the object image changes toward disappearance at a degree of change according to the breathing length, in other words, the breathing length is reflected in the degree of change of the object image, and the user becomes more conscious of his or her own breathing, and as a result, a sense of accomplishment in mental health care is effectively obtained. Furthermore, in this embodiment, the presentation time from when the presentation of the object image starts to when it disappears (presentation ends) is controlled based on the user's breathing length. With this configuration, the user becomes more conscious of his / her own breathing in order to adjust the breathing length in order to adjust the presentation time, and as a result, is more likely to feel a sense of accomplishment in mental health care. Note that the object image that represents the user's psychological state refers to an object image selected by the user that matches the image of a negative emotion such as stress (uneasy feeling), anxiety, or depression, and may be simply referred to as an "object image." A detailed explanation is given below.

[0014] Hereinafter, the mental health care display image may be simply referred to as the "care display image," and "mental health care" may be simply referred to as "care." Additionally, the time when the presentation of an object image starts is referred to as the "presentation start," and the time when the object image disappears from the screen of the display device is referred to as the "presentation end."

[0015] In addition, in this specification, the "degree of change" refers to a value that indicates the proportion of the change made to the object image toward disappearance. Specifically, it is a value obtained by dividing the difference between a parameter indicating the current state of the image, such as the size, color, or contrast of the object image, and a parameter indicating the next state, by a parameter indicating the current or next state, preferably the current state. In this specification, "determining the degree of change" includes not only the case where the degree of change is directly determined, but also the case where the degree of change is substantially determined, for example, the case where the difference is determined, or the case where the degree of change is determined by determining a magnification factor that is the ratio of the next parameter to the current parameter. Therefore, the contents of "using the determined degree of change" or "based on the determined degree of change" include not only the case where the degree of change is calculated and used, but also the case where the difference or magnification factor is used or based on them. In this embodiment, an example will be described in which the degree of change is the rate at which the display size of an object image is changed.

[0016] <<Overall configuration of information processing system>> As shown in FIG. 1, in this embodiment, mental health care is performed using an information processing system 100. More specifically, mental health care is performed in a place (for example, a dedicated room such as a relaxation room) where a chair 6 on which a user U sits, a respiratory information acquisition device 2 with a built-in tilt sensor 22 for acquiring respiratory information of the user U, a display device 3 having a display unit 32 for presenting a care display image to the user U, and a speaker 4 are provided. As shown in FIG. 1 and FIG. 2, the information processing system 100 of the first embodiment includes a respiratory information acquisition device 2, an information processing device 1, a display device 3 having a display unit 32, and a speaker 4. The display unit 32 and the speaker 4 are output units that output presentation information to be presented to the user as an image (visual information) and a sound (auditory information), respectively. The display device 3 is a visual information presentation device that presents information visually, and the speaker 4 is an auditory information presentation device that presents information auditorily. Hereinafter, the configurations of the information processing device 1, the respiratory information acquisition device 2, the display device 3, and the speaker 4, and an example of a care display image displayed on the display unit 32 will be described.

[0017] "Information processing device" [Hardware configuration of information processing device] As shown in FIG. 3, the information processing device 1 includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM (Random Access Memory) 53, an input / output interface 55, and a bus 54 connecting these to each other.

[0018] The CPU 51 appropriately accesses the RAM 53 etc. as necessary, and performs various arithmetic processing while controlling all the blocks of the information processing device 1. The ROM 52 is a non-volatile memory that stores firmware such as the OS program and various parameters to be executed by the CPU 51. The RAM 53 is used as a working area for the CPU 51, and temporarily stores the OS, various applications being executed, various data being processed, etc.

[0019] The input / output interface 55 is connected to the tilt sensor 22, the display unit 56, the speaker 57, the input unit 13, the storage unit 14, the communication unit 11, and the like.

[0020] The display unit 56 is an image display panel using, for example, an LCD (liquid crystal display), an OLED (organic electroluminescence display), or the like.

[0021] The input unit 13 is, for example, a pointing device such as a mouse, a keyboard, a touch panel, or other input device. When the input unit 13 is a touch panel, the touch panel can be integrated with the display unit 56.

[0022] The storage unit 14 is a non-volatile memory such as an HDD (hard disk drive) or a flash memory (SSD; Solid State Drive). The storage unit 14 stores programs and the like for executing various processes performed by the control unit 12. For example, the storage unit 14 stores a program for causing the information processing device 1 to execute various processes related to care display image generation and the like. The processes related to care display image generation and the like include, for example, an acquisition process of a tilt angle value, a conversion process of converting a tilt angle value into a normalized angle value, a calculation process of a breathing length, a detection process of detecting one breath, a size calculation process of an object image, a volume determination process of a first sound effect, a generation process of a display image and sound, and the like.

[0023] The communication unit 11 is, for example, a NIC (Network Interface Board) for Ethernet or various modules for wireless communication such as wireless LAN, and is responsible for communication processing between the respiratory information acquisition device 2, the display device 3, etc. The communication network connecting the information processing device 1 to the respiratory information acquisition device 2 and the display device 3 may be wireless or wired.

[0024] [Function block configuration of information processing device] As shown in Fig. 2, the information processing device 1 includes a control unit 12. The control unit 12 includes a respiratory information acquisition unit (hereinafter referred to as "acquisition unit") 120, an angle value normalization calculation unit 121, a respiratory detection unit 122, a respiratory length calculation unit 123, a basic size storage unit 127, a basic size determination unit 128, a display size calculation unit 124, an object image storage unit 129, an object image generation unit 126, an object image storage unit 129, an image synthesis unit 131, a sound data generation unit 130, and a sound volume determination unit 125. These units function in cooperation with each other, so that the information processing device 1 generates a display image (image signal) to be displayed on the display unit 32 and a sound (sound signal) to be output from the speaker 4 as presentation information to be presented to the user U, based on the respiratory information of the user U acquired using the respiratory information acquisition device 2.

[0025] (Control unit) The control unit 12 mainly includes a CPU 51 and a RAM 53, a storage unit 14, a communication unit 11, and a bus 54 connecting them. In the information processing device 1, the CPU 51 loads a program stored in the storage unit 14 into the RAM 53 and executes it, thereby performing processing related to care display image generation. The program may be stored in a non-transitory recording medium readable by a computer, for example, and the program may be installed in the information processing device 1 using the recording medium. Alternatively, the program may be installed in the information processing device 1 via the Internet or the like. Examples of recording media for supplying the program include magnetic disks such as hard disks, optical disks such as DVD-ROMs, CD-ROMs, and CD-Rs, USB memories, memory cards, non-volatile memories such as ROMs, and the like.

[0026] The control unit 12 controls the presentation time from the start of presentation of the object image to the user to the end of presentation when the object image disappears, based on the user's breathing information (specifically, breathing length) acquired over time. The control unit 12 also determines the display size of the image object, and generates the object image based on the display size.

[0027] The control unit 12 functions as an acquisition unit 120, an angle value normalization calculation unit (angle value calculation unit) 121, a breathing detection unit 122, a breathing length calculation unit 123, a basic size determination unit 128, a basic size memory unit 127, a display size calculation unit 124, a volume determination unit 125, a sound data generation unit 130, an object image generation unit 126, an object image memory unit 129, and an image synthesis unit 131 by the CPU 51 loading into the RAM 53 a program stored in the memory unit 14 and executing it.

[0028] ((Acquisition Department)) The acquisition unit 120 sequentially acquires detection values ​​(also called "tilt angle values") from the tilt sensor 22 of the respiratory information acquisition device 2 at 0.05 second intervals (tilt angle value acquisition process). The acquisition unit 120 stores information on the acquired tilt angle values ​​in an internal storage area (RAM) as an angle information array. The angle information array is made up of a total of 250 pieces of numerical information stored in each of Index 0 to Index 249, and the tilt angle value for every 0.05 seconds is stored in each Index.

[0029] 13, when the acquisition unit 120 acquires a tilt angle value, it inserts it at the beginning (Index0) of the angle information array, and the tilt angle value that was at Index0 until then is moved to Index1, the tilt angle value that was at Index2 until then is moved to Index2, and so on, successively transferring information to the adjacent Index. In other words, Index0 is the latest tilt angle value detected after 0.00 seconds, and Index249 is the tilt angle value detected 12.5 seconds ago. When a new tilt angle value is acquired, the angle information array Index249 is stored in Index250, but this Index250 (data of the 251st tilt angle value) is deleted as soon as it is created, and the length of the angle information array is maintained at 250.

[0030] The tilt angle values ​​acquired by the acquisition unit 120 are output to the angle value normalization calculation unit 121. More specifically, when 250 tilt angle values ​​(data information on tilt angle values ​​for 12.5 seconds) are collected, an angle information array including information related to the tilt angle values ​​is output to the angle value normalization calculation unit 121, and thereafter, the latest angle information array is sequentially output to the angle value normalization calculation unit 121 every 0.05 seconds.

[0031] In this embodiment, as described later, 250 inclination angle values ​​are acquired every 0.05 seconds from the start of detection, and then calculation processes such as conversion to normalized values, detection of one breath, calculation of the breathing length, and calculation of the display size of the object image are performed. In other words, when data on the inclination angle values ​​up to 12.45 seconds ago is collected, calculation processes related to the display size of the object image are started. A typical breathing length is about 3 to 5 seconds, and in the case of a person with a long breathing length, it may be 10 seconds. In order to reliably obtain data on the inclination angle value for one breath even for such a person with a long breathing length, the calculation processes are started after data on 250 inclination angle values ​​is collected.

[0032] ((Angle value normalization calculation section)) When the angle value normalization calculation unit 121 acquires 250 tilt angle values ​​from the tilt sensor 22, it uses these 250 tilt angle values ​​to convert each tilt angle value into a normalized angle value (normalized value) that is normalized to be in the range of 0 to 1 (conversion process). In detail, from the 250 tilt angle values, the tilt angle value having the maximum tilt angle (maximum angle value) and the tilt angle value having the minimum tilt angle (minimum angle value) are extracted, and the normalized angle value of each of the 250 tilt angle values ​​is calculated using the following formula (1).

[0033] Normalized angle value = (tilt angle value - minimum angle value) ÷ (maximum angle value - minimum angle value) ... (1) In formula (1), the "tilt angle value" indicates the tilt angle value to be normalized (the detection value that is the output result output over time from the tilt sensor 22).

[0034] The maximum and minimum angle values ​​in the angle information array of the latest 250 tilt angle values ​​may differ from the maximum and minimum angle values ​​in the angle information array of the 250 tilt angle values ​​obtained immediately before (0.05 seconds ago). Therefore, the normalized angle values ​​are recalculated for the latest 250 every 0.05 seconds, that is, every time the latest angle information array is obtained.

[0035] The tilt angle value detected by the tilt sensor 22 and the normalized angle value obtained by normalizing the tilt angle value are the user's breathing information. The control unit 12 acquires the tilt angle values ​​detected by the tilt sensor 22 at time intervals of 0.05 seconds over time. After 250 tilt angle values ​​are collected, the control unit 12 calculates the normalized angle values ​​over time at time intervals of 0.05 seconds.

[0036] Here, the behavior of the tilt angle value and the angle information array will be different if the user changes his / her posture or if the care target is changed to another user. In this embodiment, the tilt angle value is normalized, so that the respiration information of the user can be obtained in a form converted into a numerical value within a certain range, regardless of the posture of the user or who the user is.

[0037] The normalized angle value, which is normalized breathing information, is expressed as a numerical value ranging from 0 to 1. Note that the detection value (tilt angle value) of the tilt sensor 22 depends on the orientation of the tilt sensor, but in this explanation, the most exhaled state is 0 and the most inhaled state is 1. In this case, the normalized angle value is also 0 for the most exhaled state and 1 for the most inhaled state.

[0038] Specifically, when the normalized angle value increases, it can be determined that the person is breathing in (inhalation period), whereas when the normalized angle value decreases, it can be determined that the person is breathing out (exhalation period).

[0039] ((Respiration detection section)) When the breath detection unit 122 detects the start of inhalation using information on the change over time of the normalized angle value calculated by the angle value normalization calculation unit 121, it detects the "breath" immediately before the detection (detection process for detecting a breath). The information on the change over time of the normalized angle value is information on the change over time of the detection value. In detail, the breath detection unit 122 detects the current time as the "start of inhalation" when the normalized angle value at the current time (0.00 seconds ago) calculated by the angle value normalization calculation unit 121 increases from the normalized angle value immediately before (0.05 seconds ago) and exceeds the start of inhalation threshold (set to 0.20 in this embodiment). Note that the "start of inhalation" of a certain breath is the timing at which the exhalation action of the immediately previous breath is switched to the inhalation action of the certain breath, and the "start of inhalation" of a certain breath can be said to be the "end of exhalation" of the immediately previous breath. Here, the detection time of the start of inhalation of a certain breath is the same as the detection time of the end of exhalation of the immediately previous breath. It should be noted that the device may be configured to detect not the "start of inhalation" but the "end of inhalation", i.e., the "start of exhalation".

[0040] In reality, since there is a range of abdominal and thoracic movement even for the same user, there are breathing cycles in which the normalized angle value does not fall completely to 0 or does not rise completely to 1. Therefore, a start-of-inhalation threshold value that exceeds 0 and is less than 1 is set. In this embodiment, the start-of-inhalation threshold value is set to 0.20 as described above. In other words, in this embodiment, the breathing detection unit 122 determines the current time as "start of inhalation" when the normalized angle value at the current time changes from less than 0.20 to 0.20 or more.

[0041] ((Respiration length calculation part)) The respiration length calculation unit 123 calculates the respiration length of one breath by determining the time difference between the detection time of the most recent inhalation start (or end) detected by the breathing detection unit 122 and the detection time of the previous inhalation start (or end) (respiration length calculation process). The respiration length is the user's respiration information. Each time a breath is detected, the respiration length of that breath is calculated, and the control unit 12 acquires the user's respiration length over time.

[0042] The two graphs of normalized angle values ​​in the center of Fig. 16 plot the calculated normalized angle values ​​with time on the horizontal axis and normalized angle values ​​on the vertical axis, conceptually showing the displacement of the abdominal-thoracic tilt during breathing, and correspond to the waveform representing the user's breathing. As mentioned above, the "breathing length" corresponds to the distance between the adjacent inhalation start times of the waveform (the time when the normalized angle value changes from less than 0.2 to 0.2 or more). It can be seen from this graph that the normalized angle value indicates a value equivalent to the sine or cosine of the phase angle at the fundamental frequency of the breathing cycle.

[0043] ((Basic size determination unit and basic size storage unit)) The basic size storage unit 127 stores the basic size used when calculating the display size of the object image. When a breath is detected by the breathing detection unit 122, the basic size determination unit 128 recalculates the basic size based on the previous basic size and the length of one breath stored in the basic size storage unit 127, as described in detail later, and writes the newly calculated basic size into the basic size storage unit 127 for updating. The new basic size written is used for subsequent size calculations. The basic size becomes smaller every time it is updated, so that there is an upper limit to the presentation time of the object image. Since the maximum presentation time is thus regulated, for example, for a user who is not good at adjusting the breathing length to be longer, it is unlikely that the time required for care will be too long and cause stress. In this embodiment, the basic size is recalculated for each breath, but it may be recalculated for every few breaths. In this case, the basic size may be recalculated based on the breathing length of the most recent breath, based on some breathing lengths selected from the few breaths, or based on the breathing length (total or average) of the entire few breaths.

[0044] ((Display size calculation part)) The display size calculation unit 124 uses the user's breathing information to calculate the display size of the object image 7 in the care display image based on the basic size stored in the basic size storage unit 127 (object image size determination process). The determined display size information is output to the object image generation unit 126.

[0045] Although details will be described later, the display size calculation unit 124 calculates and determines the display size of the object image 7 using the basic size and the normalized angle value. Furthermore, every time one breath is detected, the display size calculation unit 124 reduces the basic size by a degree of change (amount of reduction) according to the breathing length of that one breath, and updates the basic size used when calculating the display size (reduction, update process).

[0046] As described later, the basic size updated for each breath is calculated by subtracting the reduction amount according to the detected breathing length from the previous basic size. In the reduction and update process, if the breathing length calculated by the breathing length calculation unit 123 is less than a threshold value, the basic size is reduced by a degree of change (reduction amount) according to the calculated breathing length. In detail, the relatively longer the breathing length of one breath, the larger the reduction amount, and the relatively shorter the breathing length, the smaller the reduction amount. In other words, the longer the breathing length, the faster the object image 7 disappears from the care display image, and the shorter the presentation time of the object image becomes. On the other hand, if the breathing length is equal to or greater than the threshold value, the degree of change (reduction amount) is made uniform, and the basic size is reduced by the degree of change.

[0047] In this manner, in this embodiment, for each breath, the basic size of the object image used to calculate the display size is reduced and updated by an amount corresponding to the detected breathing length of one breath, and the object image gradually reduces overall within the presentation time, eventually becoming too small to be displayed, i.e., disappearing from the screen. In other words, since the amount of reduction in the basic size of the object image changes according to the user's breathing length, the presentation time from presentation of the object image to its disappearance is controlled according to the breathing length.

[0048] ((Sound data generator)) The sound data generating unit 130 generates sound data representing a first sound effect to be presented to a user in a time series. In this embodiment, the sound data generating unit 130 stores time series sound data that generates Brownian noise, and transmits the time series sound data to the volume determining unit 125 in sequence.

[0049] ((Volume determination section)) The volume determination unit 125 determines the volume of the first sound effect to be presented to the user according to the normalized angle value (volume determination process), and drives the speaker 4. Brownian noise sound data provided by the sound data generation unit 130 is used as the first sound effect, and an appropriate initial volume value is set to 1. The volume determination unit 125 multiplies the initial volume value provided by the sound data generation unit 130 by a correction value obtained by adding 0.02 (or a value greater than or equal to) the normalized angle value, and determines the sound data to be output. The speaker 4 is driven by the sound data determined by the volume determination unit 125, and a sound of a volume according to the display size is output from the speaker 4.

[0050] Here, there is a time when the normalized angle value is 0 or a value close to 0. When the normalized angle value has such a value, if the volume is calculated without correcting the normalized angle value, the multiplication result of the volume initial value and the normalized angle value will be 0 or a value close to 0. Therefore, if the volume is determined based on the calculated value, the volume effect output from the speaker will be extremely small, and the user will not be able to recognize it as auditory information and will likely feel uncomfortable. In contrast, in this embodiment, the volume is calculated using a correction value obtained by adding 0.02 (or a value greater than this) to the normalized angle value, making it easier for the user to recognize the sound effect as auditory information.

[0051] ((Object image storage unit)) The object image storage unit 129 stores in advance time-series video data of object images (e.g., video data of a flame) associated with a numerical value or a numerical range within a range of a display size that can be calculated from the basic size of an object image, with the basic size of the object image being 1 when the display size is maximum. When the maximum value of the display size input value calculated based on the "basic size of 1" is 1.3, the object image storage unit 129 stores in advance time-series video data of object images corresponding to a numerical value or a numerical range within a range of more than 0 and not more than 1.3. For example, video data according to the numerical range of the display size input value is stored, such as the first video data for a display size input value of more than 0 and not more than 0.1, the second video data for a display size input value of more than 0.1 and not more than 0.2, the third video data for a display size input value of more than 0.2 and not more than 0.3, and so on. An "object image with a basic size of 1" corresponds to an object image with a check box label of 10 on the input display image 65. Furthermore, for example, an "object image of size 0.5" corresponds to an object image with a check box label of 5 on the input display image 65, and the numerical value normalized by dividing the label (numbers 1 to 10) on the check box on the input display image 65 by 10 corresponds to the numerical value representing the size of the object image stored in the object image memory unit 129.

[0052] When multiple types of object images are prepared, the object image storage unit 129 stores in advance, for each type, time-series moving image data of object images linked to a numerical value or a numerical range within the range of the display size that can be calculated from the basic size of the object image. Note that, although an example in which the object image is a moving image is given here, the same applies to still images, and still image data corresponding to the numerical range of the display size value calculated based on the basic size is stored in advance.

[0053] The object image storage unit 129 sends information (time-series video data) regarding the type and size (starting basic size) of the object image selected by the user to the object image generation unit 126 based on input operation information on the input display image 65 (see FIG. 4) that the user selected from multiple images because he or she felt that it represented his or her psychological state. The object image generation unit 126 converts (reduces) the size of the sent video data based on the size value sent from the display size calculation unit 124. The image signal of the generated display image is sent to the display device 3, and the input display image 65 is displayed on the display unit 32 of the display device 3.

[0054] In this way, in the object image storage unit 129, the type and size of the object image to be used are selected by the user's operation, and information on the size of the selected object image is sent as the initial size (initial basic size) to the basic size storage unit 127. The object image storage unit 129 sends the stored data to the object image generation unit 126 in response to a request from the object image generation unit 126.

[0055] ((Object image generation unit and image synthesis unit)) As described above, the input information (evaluation numerical information) evaluated and input by the user from the input display image 65 is psychological state information that represents the subjective psychological state of the user. The psychological state information is reflected in the basic size of the object image at the start of presentation of the care display image 60 (start basic size 70 in FIG. 7). Here, the label (numbers 1 to 10) attached to the check box is normalized (here, the value divided by 10) and used as a numerical value representing the size of the start basic size 70. That is, when the check box labeled 10 is checked by the user, the start basic size 70 becomes "1", and when the check box labeled 1 is checked, the start basic size 70 becomes "0.1". This numerical value of the start basic size is stored in the basic size storage unit 127 and is used when calculating the display size and updating the basic size.

[0056] The object image generating unit 126 generates the object image 7 based on the calculated size information determined by the display size calculating unit 124, and the image combining unit 131 generates a care display image 60 by superimposing the object image 7 on the background image 10. An image signal of the generated care display image is transmitted to the display device 3 via the communication unit 11. As shown in Fig. 1 and Fig. 5, in the display device 3, the care display image 60 is displayed on the display unit 32 based on the image signal.

[0057] As shown in FIG. 11, when the image synthesis unit 131 detects that the user has started to inhale, it generates a care display image 60 on which a ripple 5 representing the user's start to inhale is superimposed.

[0058] 《Respiration information acquisition device》 As shown in FIGS. 1 and 2, the respiratory information acquisition device 2 includes a communication unit and a tilt sensor 22.

[0059] The communication unit can be connected to the information processing device 1 via a wireless or wired communication network, and transmits the detection value detected by the tilt sensor 22 to the information processing device 1 via the communication network. The communication unit transmits the detection value of the tilt sensor 22 to the information processing device 1 at a predetermined time interval (0.05 seconds in this embodiment).

[0060] The tilt sensor 22 built into the respiratory information acquisition device 2 detects the tilt of the user's body parts, and thus detects the user's breathing. Specifically, the tilt sensor 22 detects the displacement information of the body parts, such as the chest and / or abdomen (hereinafter referred to as "abdominal chest"), which are displaced by the user U's breathing, as a tilt angle value (detection value). One cycle of inhalation and exhalation is called "one breath". The period of inhalation is called "inhalation period", and the period of exhalation is called "exhalation period". The detection value (tilt angle value) of the tilt sensor 22 is detected over time every 0.05 seconds. The control unit 12 of the information processing device 1 can acquire and calculate the user's respiratory information, including the user's breathing length, and information related to the detection value, such as the tilt angle value and its normalized angle value, using the acquired detection value of the tilt sensor 22. The normalized angle value is expressed as a numerical value in the range of 0 to 1. Here, the most exhaled state is designated as 0, and the most inhaled state is designated as 1.

[0061] The respiratory information acquisition device 2 has, for example, a cushion shape. The cushion shape allows the user to hold the device in contact with the abdomen and chest without feeling uncomfortable. The shape is not limited to a cushion, and may be a stuffed toy or any other shape. In the example shown in FIG. 1, the user U sitting on a chair with a backrest holds the cushion-shaped respiratory information acquisition device 2 so that the respiratory information acquisition device 2 is in contact with the abdomen of the user U, and the tilt sensor 22 can detect the displacement of the user U's body part.

[0062] In this embodiment, a tilt sensor is used as a sensor for detecting the displacement of a body part due to the user's breathing, but the present invention is not limited to this. For example, a sensor for detecting the expansion and contraction of a body part such as the abdomen and chest due to breathing (displacement of a body part) may be used. For example, a pressure sensor may be used that is installed on the seat or back of a chair on which the user sits and continuously acquires a change in pressure caused by the displacement of the abdomen and chest due to breathing. In addition to contact-type sensors such as a tilt sensor and a pressure sensor, a non-contact type distance sensor or the like may be used as a sensor for detecting the displacement of a body part due to breathing. The distance between the distance sensor and the measurement part (abdomen and chest) of the user U is continuously measured using a distance sensor, and the change in the distance can be acquired as breathing information. As the distance sensor, for example, a known sensor such as an infrared sensor, a microwave sensor (Doppler sensor), an ultrasonic sensor, a ToF (Time of Flight) camera, a stereo camera, or the like may be used. The distance may be measured using a dual camera. The displacement of a body part may be detected using an acceleration sensor. Furthermore, a camera may be used as a sensor for detecting changes in body parts due to breathing of the user, and breathing information such as the start of inhalation, the length of the expiratory period and the inhalation period, and breathing length may be estimated from changes in the abdomen and chest and facial movements by analyzing the video captured by the camera. For example, breathing information can be obtained by tracking facial movements and changes with a camera, and detecting changes particularly around the nose and mouth. Breathing information can also be obtained by tracking the expansion and contraction of the abdomen and chest from the video of the abdomen and chest. Breathing information can also be obtained by placing a wind speed sensor around the nose and mouth.

[0063] 《Display device》 1 and 2, the display device 3 includes a communication unit and a display unit 32. The communication unit is connectable to the information processing device 1 via a wireless or wired communication network, and receives an image signal generated by the information processing device 1 from the information processing device 1 via the communication network. The display unit 32 displays a display image based on the image signal. The display unit 32 is configured with an image display panel such as an LCD (liquid crystal display) or an OELD (organic electroluminescence display).

[0064] The display unit 32 displays, based on the image signal received from the information processing device 1, a care display image including an object image for the purpose of mental health care, an input display image for the user U to input his / her own psychological state, etc. The control unit 12 of the information processing device 1 determines the size of the object image at the start of presentation of the care display image, using psychological state information (input operation information) input by the user U from the input display image. When there is no need to distinguish between a care display image and an input display image, the image displayed on the display unit 32 is referred to as a display image.

[0065] Speaker The speaker 4 outputs various sounds based on the sounds generated by the information processing device 1. For example, the speaker 4 outputs a first sound effect presented while the care display image is displayed, a second sound effect and a third sound effect indicating the start of inhalation, etc. As the first sound effect, for example, natural sounds such as the sound of wind, rustling trees, and tidal sounds, or sounds reminiscent of these, such as Brown noise and pink noise, can be used. In this embodiment, an example using Brown noise is given.

[0066] 10, the volume of the first sound effect output from the speaker 4 is determined based on the breathing information of the user (specifically, a normalized angle value obtained by normalizing the tilt angle value). In this embodiment, the volume is typically adjusted so that the volume increases during the inhalation period and decreases during the exhalation period. In addition to presenting the user with an object image that repeatedly expands and contracts in conjunction with the inhalation and exhalation of the breath, the first sound effect that repeatedly increases and decreases in volume in conjunction with the inhalation and exhalation of the breath allows the user to visually and audibly recognize information such as the user's own stress level and the degree of relief thereof, and the user's awareness of his or her own breathing can be further enhanced, making it easier for the user to feel a sense of accomplishment in care.

[0067] In this way, in the information processing system 100, in addition to the care display image information described below, audio information can be presented as presentation information presented to a user who is taking mental health measures. This can further increase awareness of breathing from both visual and audio senses, and a greater sense of accomplishment in care can be obtained. In addition, in this embodiment, the display size of the object image and the volume of the sound effect are adjusted based on the normalized angle value for both the care display image information and the audio information. Specifically, during the inhalation period, the display size of the object image increases, and the volume increases. On the other hand, during the exhalation period, the display size of the object image decreases, and the volume decreases. In this way, the visual presentation information and the audio presentation information are presented to the user in conjunction with each other, so that awareness of breathing can be further increased. Note that sound effects do not need to be output, and the user may determine whether or not to output audio depending on the environment in which the user is placed. However, from the viewpoint of increasing the sense of immersion in the care display image and increasing awareness of one's own breathing, it is preferable that sound effects are output. The volume and type of the sound effect may be changed according to an increase or decrease in breathing length or the number of breaths per unit time, or according to the number of seconds elapsed since the start of the presentation of audio information.

[0068] <Example of care display image> [Image composition] 1 and 5, in the information processing system 100, a care display image 60 is displayed on the display unit 32 of the display device 3. The care display image 60 is an image in which an object image 7 representing the psychological state of the user is superimposed on a background image 10 located in the entirety of the display unit 32. In the care display image 60, in the portion where the object image 7 is located, the object image 7 may be generated so that the background image 10 behind it can be seen through, or may be generated so that it is not see-through.

[0069] The care display image 60A shown in FIG. 18 is an image of only the background image 10 with no object image 7 displayed. As shown in FIG. 18, the background image 10 may be an image in which the first background image 8 is superimposed on the second background image located in the entire surface of the care display image 60A. The first background image 8 is located in front of the second background image 9. The background image 10 has a first region AR1 in which the first background image 8 is located and a second region AR2 in which the first background image 8 is not located. In FIG. 18, the first region AR1 is shown as a solid color, and the second region AR2 is shown as a dot. In the first region AR1, the first background image 8 and the second background image 9 are superimposed. In the first region AR1, the first background image 8 may be generated so that the second background image 9 behind it can be seen through the first background image 8, or may be generated so that it is not seen through. As shown in FIG. 18, the outer contour of the first background image 8 coincides with the boundary 19 between the first region AR1 and the second region AR2. In this embodiment, the first area AR1 and the first background image 8 have a circular shape and are located almost at the center of the display unit 32. The second area AR2 is located so as to surround the first area AR1. In this embodiment, the positions, sizes, positional relationships, and shapes of the first area AR1 and the second area AR2 are not changed. In this embodiment, an example is given in which the first area AR1 in which the first background image 8 is located is located almost at the center of the care display image 60A, but this is not limited to this, and the position, shape, size, etc. of the first background image 8 in the care display image 60A can be set appropriately. From the viewpoint of allowing the user to feel a sense of accomplishment in mental health care, it is preferable that the position of the center of the first background image is within a range of 30% of the size of the care display image 60A in both the vertical and horizontal directions. In addition, from the viewpoint of allowing the user to feel a sense of accomplishment in mental health care and avoiding the user feeling a sense of tension, the shape is preferably a perfect circle, an ellipse, a square or a rectangle with R processing applied to the four corners. As for size, from the viewpoint of providing a sense of accomplishment in mental health care and ease of visibility, it is preferable that the ratio of the area occupied by the second area AR2 to the first area AR1 be set to a lower limit of about 5% and an upper limit of about 45%.

[0070] The first background image 8 and the second background image 9 may each be a moving image or a still image. The first background image 8 and the second background image 9 are preferably displayed in colors that allow the shape change of the object image 7 to be visually recognized. In this embodiment, an example is given in which the first background image 8 is a still image and the second background image 9 is a moving image. The colors will be described later.

[0071] Here, an example is given in which the background image 10 is composed of a plurality of background images, the first background image 8 and the second background image 9, but it may be composed of one background image. In this case, the background image may be a moving image or a still image, and it is preferable that the color of the background image is a color that allows the shape change of the object image 7 to be visible. From the viewpoint of guiding the gaze to the object image 7 and giving the user a sense of accomplishment in caring, it is preferable that the first background image 8 is superimposed on the second background image 9. In other words, by providing the first background image 8, the gaze of the user can be guided to the first background image 8, and the attention to the object image 7 superimposed and displayed on the first background image 8 can be further increased, which in turn makes it easier to give the user a sense of accomplishment in caring.

[0072] The size (outline) of the first background image 8 displayed in the first area AR1 represents the size of the user's mental capacity (the size of receptivity). The first background image 8 and the second background image 9 are generated so that the boundary 19 between the first area AR1 and the second area AR2 is visible to the user as the outline of the first background image 8.

[0073] The object image 7 represents a negative psychological state of the user, for example, one or more psychological states selected from a stress level, an anxiety level, and a depression level. The object image 7 is located within the first area AR1, or is superimposed on the background image 10 so that a part of the object image 7 is located within the first area AR1 and another part is located within the second area AR2.

[0074] From the viewpoint of making it easier to guide the user's gaze to the object image 7 while creating a care display image that does not cause a sense of pressure, it is preferable that the area occupied by the first area AR1 relative to the combined area of ​​the first area AR1 and the second area AR2 (corresponding to the display area of ​​the display unit 32) be approximately 5% to 45%.

[0075] In this embodiment, an example is given in which background image 10 is an image in which first background image 8 is superimposed on second background image 9 displayed across the entire surface of display unit 32 so that second background image 9 can be seen through to the background. By configuring the image in this manner, it is possible to make background image 10 as a whole an image with a sense of unity, which is preferable.

[0076] Further, in this embodiment, an example is given in which the care display image 60 is an image in which the object image 7 is superimposed on the background image 10 so that the background image 10 is not visible behind it. With such an image configuration, the presence of the object image 7 superimposed on the background image 10 is easily noticeable, and the user's gaze is easily guided to the object image 7 that represents the user's psychological state, so that the user can feel a sense of accomplishment in care. As shown in FIG. 6(C), the object image 7 may be displayed so as to be positioned beyond the first area AR1 and into the second area AR2. In such a case, it is preferable that the object image 7 is displayed so that the outer contour of the first background image 8 is visible in the portion where the object image 7 and the outer contour of the first background image 8 (in other words, the boundary 19 between the first area AR1 and the second area AR2) overlap. This makes it easy for the user to recognize how much the object image 7 protrudes from the outer contour of the first background image 8, which indicates the size of the user's own mental capacity, and makes it easy to intuitively grasp his or her own psychological state.

[0077] In this embodiment, an example is given in which the shape of the object image 7 is a flame, but the shape of the object image 7 is not limited to a flame and may be any shape that matches the user's own psychological state. For example, a thread-like image such as a thread, a string, a ball of thread, or a tangled string; a cloud-like image such as ice fog, mist, nebula, or haze; an image related to ice such as frost or snow crystals; an image of light such as fireworks, sparklers, or radial rays; an image of floating in the air such as a cloud, a soap bubble, a dandelion fluff, a balloon, or a paper airplane; an image of floating in water such as a jellyfish, squid, fish, or seaweed; an image of energy such as a volcano, lightning, or explosives with a fuse. The object image may be an object image consisting of a single object, or may be an object image in which a collection of multiple objects is considered to be a single object image as a whole. The object image may also be a still image or a moving image. In this way, the object image may have various shapes. Also, the user may select an object image that matches the user's own psychological state from a plurality of object images. For example, a plurality of types of object images, such as a flame shape, a cloud shape, a shape that evokes the light of fireworks, etc., may be prepared, or only one type of object image, such as a flame shape, may be prepared in advance. By providing a plurality of types of object images for the user to select, the user can select a preferred object image that is more in line with his or her own feelings, which further enhances the sense of immersion in the care display image and makes it easier to obtain a sense of accomplishment in care. In this embodiment, a flame shape is selected by the user as an object image, and the flickering of the flames is expressed by using animation (moving image) program data. By using a moving image such as an object image with a flickering flame expression, it is possible to visually express, for example, a vague feeling, and to create a dynamic moving image of an object image whose shape and size change continuously.

[0078] As already described, the display size of the object image is determined based on the basic size. In this embodiment, the basic size is updated successively so as to be gradually reduced every time a breath is detected. Until the next breath is detected, the display size of the object image is calculated based on the current basic size. In this embodiment, a flame animation program is used to input a numerical value (sometimes called a "display size value") that represents a display size calculated based on a basic size, and the flickering of the flame is expressed at a size that corresponds to the input display size value. In other words, by inputting one display size value, a flame object image is displayed that grows and shrinks continuously in size according to this display size value. The larger the display size value, the larger the overall display size of the object image.

[0079] If the object image is a still image, the initial diameter may be regarded as the basic size. If the object image is a moving image (such as a flame) whose shape is constantly fluctuating, the initial diameter also changes during the moving image, so that the maximum value of all the initial diameters during the moving image may be regarded as the basic size. The "initial diameter" refers to the diameter at the basic size when the object image starts to be presented or immediately after the basic size is updated. The "diameter" refers to the diameter of the smallest perfect circle that encloses an object image consisting of a single object or an object image consisting of a collection of multiple objects.

[0080] Moreover, the object image is adjusted in advance so that it is displayed on the display screen at an appropriate size according to the size of the display screen when its basic size is 1. Here, the appropriate size means, specifically, that the area of ​​the object image when surrounded by the smallest perfect circle is about 2% to 75% of the background image 10, and preferably about 2% to 20%.

[0081] In order to express the flickering of the flame, a known flame flickering animation (moving image) creation program can be used to generate moving image data of the object image. In this program, by inputting a display size value of the object image, the flickering of the flame can be expressed in a size according to the display size value. The flickering of the flame is typically expressed by changing the shape and size over time. In this embodiment, the display size of the object image is determined based on the user's breathing information (specifically, the breathing length of one breath) acquired over time so that the display size gradually shrinks from the start of presentation and disappears at the end of presentation. In detail, the display size (display magnification) of the object image is calculated using the basic size (basic magnification) and a normalized angle value (the relative value of the angle value detected within one breathing cycle; specifically, as described above, it is obtained from the detection value of the tilt sensor and the most recent one breathing cycle) obtained from the user's breathing information, and further, the basic size used for calculating the display size is reduced and updated every time one breath is detected. In the above-mentioned flame flickering animation program, the calculated display size value is input, and an object image expressing the flickering of the flame is generated.

[0082] In this embodiment, in the process related to the generation of the care display image, the basic size when the display in the care display image is maximized is set to "1", and the basic size is expressed in a numerical range of more than 0 and not more than 1 based on this. The "basic size" indicates the basic size that is the calculation standard for the display size at the start of the presentation of the object image (corresponding to the "start basic size" in FIG. 7), or the basic size that is set by updating (corresponding to the "first basic size", "second basic size", "third basic size", "fourth basic size", and "fifth basic size" in FIG. 7). The "basic magnification" indicates the ratio to the size of an object image with a basic size of 1. A numerical value (more than 0 and less than 1) indicating the size of an object image with a basic size of more than 0 and less than 1 can be said to be the magnification (reduction magnification) with respect to the "object image with a basic size of 1". The "display magnification" is calculated using the basic size, and is calculated as the magnification with respect to the "object image with a basic size of 1".

[0083] It is not necessary to use a program that transforms such an object image. For example, an object image may be an image whose size changes based on a display size calculated based on breathing information while maintaining its shape, that is, an image whose size changes based on an original still image.

[0084] Furthermore, in this embodiment, the basic size (starting basic size) that serves as the basis for calculating the display size at the start of presenting the object image is determined based on input operation information selected and input by the user from the input display image 65 (see FIG. 4) prior to the display of the care display image.

[0085] In the example of the input display image 65 shown in FIG. 4, first, the user uses an input device to select an object image that the user feels represents his / her own mental state from among a plurality of object image candidates with different display sizes. Specifically, ten check boxes are displayed at the bottom of the screen for the user to evaluate his / her own mental state (for example, stress level is taken as an example here) on a 10-point scale with an evaluation value of 1 to 10. Each check box is labeled with a number from 1 to 10 (evaluation value). A higher evaluation value indicates a higher stress level, and a lower evaluation value indicates a lower stress level. In addition, a first background image 8 expressing the size of the user's mental capacity and an object image 7 corresponding to the evaluation value selected by the user are displayed approximately at the center of the input display image 65. In the input display image 65, the display size of the object image 7 changes depending on the evaluation value selected by the user. For example, the display size of the object image 7 is displayed to be larger as the evaluation value is larger (higher stress level) and smaller as the evaluation value is smaller (lower stress level). For example, Figure 6(A) shows object image 7 displayed when evaluation value 1 is selected, Figure 6(B) shows object image 7 displayed when evaluation value 5 is selected, and Figure 6(C) shows object image 7 displayed when evaluation value 10 is selected.

[0086] The label (numbers 1 to 10) on the checkbox on the input display image 65 is divided by 10 to normalize the value, which indicates the base size (expressed as a numerical range greater than 0 and less than 1) used to calculate the display size (input display size value). In other words, the evaluation numerical value selected by the user divided by 10 becomes the starting base size to be input. An object image with an evaluation numerical value of 10 is the object image with the largest diameter on the screen, and corresponds to the above-mentioned "object image with a base size of 1."

[0087] The user selects and inputs an evaluation value given to an object image of a size that corresponds to the size of the user's uneasy feeling, for example, on the input display image 65. Based on the input operation information (evaluation value information) by the user from this input display image 65, a basic size (start basic size) that is the basis for calculating the display size at the start of presentation of the object image is determined. Here, an example has been given in which only one type of object image is prepared prior to displaying the care display image, and only the size of the object image (the magnitude of the user's negative emotion) is selected, but it is also possible for the user to select one object image from multiple types of object images, and also to select the size of the object image (the magnitude of the user's negative emotion).

[0088] The display example of the input display image 65 shown in Fig. 4 is just one example. Although Fig. 4 shows an example in which the user's stress level evaluation is selected digitally using checkboxes, for example, a slide bar may be displayed instead of the checkboxes, and the stress level may be determined by moving the slide bar, allowing the stress level to be selected in an analog manner. In this case, the object image is displayed so that the size of the object image changes depending on the position of the slide bar selected by the user.

[0089] As shown in Figs. 6(A) to (C), in this embodiment, the shape and size of the object image 7 in the care display image 60 change over time. The object image 7 may be generated in a size and shape that fits within the first region AR1 as shown in Figs. 6(A) and (B), or may be generated in a size and shape that exceeds the first region AR1 and the first region AR1 and protrudes into the second region AR2 as shown in Fig. 6(C). Since the shape and size of the outline of the first background image 8 that represents the user's mental capacity and is displayed in the first region AR1 do not change, the user can intuitively and objectively recognize whether or not the user is in a psychological state that exceeds the capacity by looking at the care display image 60. For example, in the example shown in Figs. 6(A) and (B), since the object image 7 fits within the first region AR1, the user is reminded of a stable psychological state, for example, a psychological state in which the stress level is low, the anxiety level is low (feeling of anxiety is weak), and the depression level is low. 6(C), the object image 7 protrudes from the first area AR1, which evokes in the user an unstable psychological state, such as a high level of stress, a high level of anxiety (strong sense of anxiety), or a high level of depression. In this way, by providing the first background image 8 that represents the user's mental capacity, the user can intuitively and objectively visually grasp his or her own psychological state from the positional relationship between the first background image 8 and the object image 7.

[0090] In the following explanation of the display size of the object image, for the sake of clarity, no specific mention will be made of the animation that expresses the flickering of the flames, but the explanation will focus on the fact that the display size is determined based on the basic size and the detection value of the tilt sensor, and that each time a breath is detected, the basic size is reduced and updated based on the length of that breath, and finally it is no longer displayed, i.e., disappears from the screen.

[0091] [Object image details] The display size of the object image 7 is calculated using the basic size and the user's normalized respiration angle value information. Typically, the detection value of the tilt sensor 22 changes over time, so the display size calculated using the detection value changes over time, and the object image is displayed so as to repeatedly expand and contract in conjunction with the inhalation and exhalation of the breath. Furthermore, the basic size that determines the display size of the object image is reduced and updated every time one breath is detected (reducing and updating process). For this reason, in this embodiment, as shown in Figs. 7 and 9(A), the display size of the object image 7 is gradually reduced overall from the start of presentation to the end of presentation while repeatedly expanding and contracting, and the object image changes so as to disappear eventually. By presenting an object image whose size changes in this way, it is possible to allow the user to recognize information such as the level and degree of relief of the user's own stress, and further, by changing the display size of the object image in accordance with the breathing, it is easy to visually recognize the user's own breathing. In Fig. 7, for ease of explanation, the shapes of the object images 7 expressing flames are all illustrated to be similar.

[0092] See Figures 7 and 9(A). The basic size of the object image at the start of presentation is referred to as the start basic size 70. When the first breath (referred to as the "first breath") is detected, the display size is calculated using the start basic size 70 and the normalized angle value according to equation (3) described below. Examples of the display size calculated using equation (3) are denoted by symbols 70A and 70B. The inhalation size 70A is a larger display size than the exhalation size 70B. The reduction and update process is performed when the next breath (referred to as the "second breath") is detected, and the resultant reduced and updated starting basic size 70 is referred to as a first basic size 71. Moreover, the display sizes calculated by equation (3) using the first basic size and the normalized angle value are denoted by symbols 71A and 71B. The first basic size 71 is reduced and updated by the reduction and update process performed when the next breath (referred to as the "third breath") is detected, and the result is referred to as the second basic size 72. Moreover, the display sizes calculated by the second basic size and the normalized angle value according to equation (3) are denoted by symbols 72A and 72B. Similarly, when the fourth breath is detected, the second basic size 72 is reduced and updated to become the third basic size 73, and display sizes 73A and 73B based on the third basic size 73 are referred to as the third basic size 73. When the fifth breath is detected, the third basic size 73 is reduced and updated to become the fourth basic size 74, and display sizes 74A and 74B based on the fourth basic size 74, etc.

[0093] 7, the first basic size 71 is smaller than the starting basic size 70, the second basic size 72 is smaller than the first basic size 71, the third basic size 73 is smaller than the second basic size 72, and so on. Each time a breath is detected, the basic size of the object image 7 is gradually reduced and updated, and the object image 7 eventually disappears. The degree of change (reduction amount) of reduction in the basic size in the reduction and update process is controlled so that it is larger the longer the breathing length and smaller the shorter the breathing length. In other words, the longer the breathing length, the earlier the object image can disappear.

[0094] In this way, the object image 7 representing a negative psychological state is presented, and the display size is changed while the object image 7 is generated so as to eventually disappear, so that the user feels the sensation of the negative emotion disappearing (self-purification effect), feels positive, and can obtain a sense of accomplishment in caring for the user. Furthermore, in this embodiment, the object image gradually shrinks, so that the user can more easily feel the sensation of the visualized negative emotion that the user has let out being gradually purified and disappearing, and can more easily obtain a sense of accomplishment in caring for the user.

[0095] In addition, the object image 7 displayed on the care display image 60 is reduced and updated every time a breath is detected, and the amount of reduction in its basic size is changed according to the breathing length. This controls the presentation time from the start of presentation to the end of presentation when the image disappears according to the user's breathing length, making it easier for the user to be aware of their own breathing in order to adjust the breathing length, and as a result makes it easier for the user to feel a sense of accomplishment in care.

[0096] In this embodiment, the longer the breathing length, the greater the reduction amount of the basic size, so that the presentation time (the time from when the object image is presented to when it disappears) is shorter when the user's breathing length is relatively long, and the presentation time is longer when the user's breathing length is relatively short. With this configuration, the user is more likely to be conscious of taking deep breaths (long breathing) so that the object image 7, which represents a negative psychological state, disappears quickly. Taking deep breaths allows the user to calm down, and makes it easier for the user to feel a sense of accomplishment in care.

[0097] In this embodiment, the presentation time of the object image is controlled to be within a certain period of time, which allows effective care in a short period of time. The certain period of time is preferably within a maximum of 7 minutes.

[0098] 7, from the start of presentation until the first breathing is detected, the display size of the object image 7 is determined based on the start basic size 70. From the detection of the first breathing until the detection of the second breathing, the display size of the object image 7 is determined based on the start basic size 70 and the normalized angle value. Similarly, from the detection of the second breathing until the detection of the third breathing, the display size of the object image 7 is determined based on the first basic size 71 and the normalized angle value, from the detection of the third breathing until the detection of the fourth breathing, the display size of the object image 7 is determined based on the second basic size 72 and the normalized angle value, and so on.

[0099] The start basic size 70 is used to determine the display size of the object image 7 at the start of presentation of the care display image 60. The start basic size 70 may be determined in advance, and presentation may be started with the object image 7 having a display size based on the same start basic size. Alternatively, the start basic size 70 may be determined by the information processing device 1 according to the breathing length calculated based on the detection value of the tilt sensor 22 before the start of display. However, as described above, it is more preferable to determine the start basic size 70 based on the input operation information selectively input from the input display image 65 (see FIG. 4), in other words, based on the user's psychological state information (subjective psychological state information) evaluated by the user himself. In this embodiment, an example is given in which the start basic size 70 is determined based on the user's psychological state information.

[0100] By determining the initial basic size 70 based on the user's psychological state information, the object image 7 can be displayed at the start of presentation of the care display image 60 in a size that reflects the user's subjective information and is natural to the user and matches the user's psychological state. For example, the detection value of the tilt sensor 22 may indicate a low stress level by general standards, but the user may actually feel strong stress. In such a case, if an object image with a size reflecting the detection value is displayed at the start of presentation, the object image may be displayed small even though the user feels strong stress, and the user may easily feel a mismatch between the user's psychological state and the size of the object image. In contrast, in this embodiment, a care display image having an object image with a size reflecting the user's subjective information is generated, so that the user is less likely to feel a mismatch or discomfort between the user's psychological state and the size of the object image. The user can feel that his or her stress is released by the object image in which the user's stress is visualized at a size reflecting the stress level, and that the object image in which the stress is visualized disappears, resulting in a positive feeling. In addition, by displaying the object image in a size that matches the user's psychological state, the user's immersion in the care display image can be enhanced, and the object image can be more prominently displayed. This makes it easier for the user to feel a greater sense of accomplishment in care.

[0101] In this manner, in this embodiment, the display size of the object image 7 in the care display image 60 is determined by the control unit of the information processing device as described above, using information based on the user's subjective opinion at the start of presentation of the object image, and using the user's objective information from the start of presentation of the object image to the end of presentation (disappearance of the object image). The user's subjective information is psychological state information that the user evaluates his / her own psychological state and determines and inputs by himself / herself. On the other hand, the user's objective information is information from the autonomic nerves, that is, the user's breathing information based on the detection result of the tilt sensor.

[0102] In addition, along with the presentation of the care display image 60, a first sound effect having a volume corresponding to the detection value of the tilt sensor may be presented to the user, as already described.

[0103] Also, when the start of inhalation (start of breathing) of the user is detected during care, the user may be notified of the start of inhalation by image presentation and / or audio presentation. For example, as an image presentation with a visual effect, an image representing the start of inhalation other than the object image 7 representing the psychological state may be superimposed and displayed on the care display image 60. For example, as shown in the example of FIG. 11, when the start of inhalation is detected, an image of a circular ripple (water ripple) 5 that appears in the center of the care display image 60 and expands in all directions may be displayed. The ripple 5 is displayed so that it gradually expands toward the outside of the screen at a certain speed over about 6 seconds from the appearance of the ripple 5 and then disappears. The speed and size of the expanding ripple 5 do not need to be linked to the breathing length, but it is preferable that they are linked to the breathing length. The speed at which the ripples 5 expand is preferably 1 second or more from the viewpoint of visibility and avoiding visual clutter, and is preferably 12 seconds or less from the viewpoint of preventing dozens of ripples 5 rings from being displayed on the care display image 60, making the background image difficult to see, and avoiding visual clutter. The image representing the start of inhalation is not limited to ripples, and various shapes can be used. For example, it may be something like a fountain that arises from the bottom of the screen and disappears off the screen after a certain time, something like rain that falls from the top of the screen and disappears off the screen after a certain time, or something like wind that flows from the right side of the screen and disappears to the left side of the screen after a certain time. In this embodiment, an example in which ripples 5 are displayed will be given.

[0104] In addition, in order to notify the user of the start of inhalation, in addition to or instead of the image presentation, a sound with an auditory effect may be presented to notify the user of the start of inhalation. A second sound effect that can be recognized as a sound different from the first sound effect may be used as the sound to notify the user of the start of inhalation. For example, the sound of a water drop landing on the water surface may be used as the second sound effect. Furthermore, a third sound effect different from the second sound effect may be used to notify the first start of inhalation, and the second sound effect may be used to notify the second and subsequent starts of inhalation. For example, a sound such as "I will start care" may be used as the third sound effect. By notifying the user of the start of inhalation using the second sound effect, third sound effect, etc. in this way, it becomes easier to guide the user to pay more attention to his / her breathing, and the user can feel a sense of accomplishment in care.

[0105] <<Example of color of care display image>> The following describes preferred colors to be used in the care display image, but is not limited to the colors described below. The care display image is generated so that the outer contour of the object image can be visually recognized when the presentation of the object image begins.

[0106] [Background image color] Colors can be expressed by hue, brightness, and saturation. Here, 20 types of videos were shown to 100 people in their 20s to 50s, and the relationship between the color of the video and the psychological state was investigated. It was found that videos with a lot of green colors overall, such as forest scenery, have a self-purifying effect and a healing effect that reduces feelings such as stress, anxiety, and depression. In consideration of the results, from the viewpoint of making a care display image that further enhances the self-purifying effect and the healing effect, in the background image 10 excluding the area where the object image 7 is displayed, the hue angle in the HSB color space of 70% or more of the display area ratio is preferably within the range of yellow-green to blue-green to blue-magenta colors from more than 60 degrees to less than 300 degrees, more preferably from more than 60 degrees to less than 180 degrees, and even more preferably within the range of yellow-green to green colors from 65 degrees to 145 degrees. By making 70% or more of the display area ratio have a hue in such a hue angle range, the background image 10 can be an image with a high self-purifying effect and a healing effect. Furthermore, by superimposing an object image having a self-purifying effect on such an image, a synergistic effect can be achieved to create a care display image with a higher self-purifying effect. The lower the saturation value, the whiter the image becomes. From the viewpoint of the self-purifying effect and the healing effect, the saturation is preferably 15% or more, and more preferably 50% or more. The lower the brightness value, the blacker the image becomes. From the viewpoint of the self-purifying effect and the healing effect, the brightness is preferably 30% or more, and more preferably 50% or more. A method for calculating the hue angle and a method for calculating the display area ratio of the area of ​​the hue within a predetermined hue angle range in the background image not including the area where the object image is displayed will be described later.

[0107] In the HSB hue wheel, at a hue angle of 0 degrees and at a hue angle of 360 degrees, the color is almost the same color red. At a hue angle between 60 degrees and 180 degrees, the color is yellow, yellow-green, or blue-green. At a hue angle of 60 degrees, the color is yellow. At a hue angle of 120 degrees, the color is green. At a hue angle between 180 degrees and 300 degrees, the color is cyan (blue-green close to light blue), blue, or magenta (reddish purple). At a hue angle of 240 degrees, the color is blue. At a hue angle of 300 degrees, the color is magenta. For example, yellow (hue angle 60 degrees) and green (hue angle 120 degrees) are analogous colors, yellow and blue-green (hue angle 150 degrees) are mid-contrast hues, yellow and cyan (hue angle 180 degrees) are contrasting hues, and yellow and blue (hue angle 240 degrees) are complementary colors.

[0108] In addition, the care display image may be generated so that, in the background image 10 excluding the area in which the object image 7 is displayed, one of the first area AR1 and the second area AR2 includes an area in which the hue angle in the HSB color space is in the range of 60 degrees or more and less than 180 degrees, in terms of display area ratio, of 70% or more, more preferably 75% or more, and even more preferably 80% or more, and the other includes an area in which the hue angle in the HSB color space is in the range of 180 degrees or more and 300 degrees or less, in terms of display area ratio, of 70% or more, more preferably 75% or more, and even more preferably 80% or more.

[0109] With this configuration, it becomes easier to set the hue selected from the range of 60 degrees or more and less than 180 degrees and the hue selected from the range of 180 degrees or more and 300 degrees or less to have a complementary color, contrasting hue color scheme, or intermediate contrast hue color scheme relationship, which increases the sense of immersion and therefore increases the attention to the object image. This makes it easier for the user to feel a sense of accomplishment in caring for the object.

[0110] Here, in the care display image 60, the object image 7 is displayed so as to overlap the boundary 19 between the first region AR1 in which the first background image 8 is located and the second region AR2 in which the first background image 8 is not located, or to be located near the boundary 19. By making the color of the first region AR1 and the color of the second region AR2 have a relationship of approximately complementary colors, contrasting hue color scheme, or intermediate difference hue color scheme, it becomes easier to guide the user's gaze to the vicinity of the boundary 19, and by making it easier to guide the user's gaze to the object image 7 overlapping the boundary 19 or located near the boundary 19, it is possible to increase the sense of immersion and thus to increase the attention to the object image. This makes it easier for the user to feel a sense of accomplishment in care.

[0111] 70% or more of the first background image 8 located in the first region AR1 may be greenish (hue angle is 60 degrees or more and less than 180 degrees) and 70% or more of the second background image 9 located in the second region AR2 may be blueish (hue angle is 180 degrees or more and 300 degrees or less), or vice versa. From the viewpoint of enhancing the self-purification effect and the healing effect, it is preferable to set so that the proportion of greenish areas in the entire displayed image is large, and it is preferable that 70% or more of the first background image 8 located in the first region AR1 is blueish and 70% or more of the second background image 9 located in the second region AR2 is greenish.

[0112] Furthermore, it is preferable that the color of the boundary 19 between the first region AR1 and the second region AR2 is clearly visible on the displayed image. The saturation and / or brightness of the boundary 19 may be set to have a large difference from the saturation and / or brightness of the first background image 8 located in the first region AR1 and the second background image 9 located in the second region AR2. For example, the saturation and brightness of the boundary 19 may be set to be approximately the same as the saturation and brightness of the object image 7, and the boundary 19 may be set to a color close to white.

[0113] [Object image color] It is preferable that the object image 7 has a color that allows the object image 7 to be prominently recognized when superimposed on the background image 10. The saturation and / or brightness of the object image 7 may be set so that the difference in saturation and / or brightness between the background image 10 and the object image 7 is large, which makes it easier for the object image 7 to be prominently recognized on the background image 10 and makes it easier to guide the user's gaze to the object image 7. For example, the saturation of the object image 7 may be set sufficiently lower than the saturation of the background image 10 and the brightness of the object image 7 may be set sufficiently higher than the brightness of the background image 10 to make the object image 7 a color close to white.

[0114] [Method of calculating the hue angle and the display area ratio of a specified hue area in a background image] In this specification, the hue angle of a background image (background image 10, first background image 8 or second background image 9) and the display area ratio of the area of ​​the hue within a specified hue angle range in the background image excluding the area in which the object image is displayed (hereinafter simply referred to as the "display area ratio") are calculated by the following method.

[0115] The image processing software ImageJ (version 1.53t) was used to calculate the above hue angle and display area ratio. In detail, the still image to be analyzed is imported into the image processing software ImageJ, and an image showing color information is displayed. Next, for the displayed Hue screen, a histogram is displayed for the entire image, with the horizontal axis showing the hue angle (corresponding to 0 to 360 degrees) and the vertical axis showing the intensity. The ratio of pixels having a hue angle within the range of 60 to 180 degrees, that is, the display area ratio, is calculated. Similarly, the ratio of pixels having a hue angle within the range of 180 to 300 degrees, that is, the display area ratio, is calculated.

[0116] When a video is used as the background image, still images are extracted from the background image in the care display image at a fixed interval from the start of the presentation of the object image, the hue angle and display area ratio of each of the still images are calculated using the above-mentioned calculation method, and the average of the hue angle and display area ratio of each of the still images is set as the hue angle and display area ratio of the background image. Regarding the interval for the image extraction, there is a method of extracting at a fixed time interval such as 5 seconds, 7 seconds, 10 seconds, etc., or a method of extracting by dividing the entire video into equal parts such as 3 equal parts, 10 equal parts, 20 equal parts, etc., but regarding the time range of the video to be targeted, it is more preferable to set the extraction timing for color analysis, excluding parts that are not essentially related to psychological care, such as the start and end of the video. In this specification, the 4 seconds from the start of the presentation of the moving image of the object image and the 4 seconds immediately before the end of the presentation of the moving image are not the target time for extracting still images, but a still image is extracted every 5 seconds, such as 5 seconds, 10 seconds, 15 seconds, etc., from the start of the presentation of the moving image of the object image, and the hue angle and display area ratio are calculated using the extracted still images. On the other hand, when a still image is used as the background image, the hue angle and display area ratio calculated for the still image by the above-mentioned calculation method are used as the hue angle and display area ratio of the background image.

[0117] <<Information Processing Method>> The information processing method of the present invention is an information processing method executed by an information processing device, which presents the user with an object image representing the user's psychological state, which changes toward disappearance with a degree of change based on the user's breathing length calculated using output results output over time from a sensor that detects the user's breathing. The flow of information processing related to the generation of a care display image in the information processing device 1 will be described below according to the flow of FIG. 12. In FIG. 12, "ST" means "step". The information processing shown in FIG. 12 is processing mainly executed by the control unit 12. More specifically, the information is transferred from the storage unit 14 to the RAM 53 and is executed by the CPU 51 operating according to the stored program. That is, all the descriptions including the preferred embodiments described above apply to the program as far as the contents and results are related to information processing. The description here also includes a detailed description of the operation of each of the above-mentioned units.

[0118] First, when the process for generating a care display image starts, the control unit 12 causes the display unit 32 of the display device 3 or the display unit 56 of the information processing device 1 to display an input display image 65 for selecting a candidate object image that expresses the user's current psychological state, as shown in Figure 4, and after allowing the user to select an object image, displays a check box.

[0119] When the user performs an input operation to select a check box on the input display image 65, the control unit 12 acquires the input operation information (ST1). The input operation information is the user's subjective psychological state information. The control unit 12 normalizes the numerical value (input operation information) selected from the check box labels 1 to 10 acquired as the psychological state information by dividing it by 10. The control unit 12 determines this normalized value as the basic size (start basic size 70) used to calculate the display size of the object image 7 to be displayed on the care display image at the start of presentation.

[0120] Next, the control unit 12 instructs the user by visual and / or audio presentation to sit on a chair, hold the cushion-shaped respiratory information acquisition device 2 against the chest and abdomen, and assume a relaxed posture.

[0121] Next, the control unit 12 sequentially acquires the tilt angle value detected by the tilt sensor 22 at predetermined time intervals (every 0.05 seconds in this embodiment) (ST2). The control unit 12 stores the sequentially acquired tilt angle value in the RAM 53 as an angle information array.

[0122] Next, the control unit 12 determines whether or not 250 pieces of tilt angle value data have been collected (ST3). If the control unit 12 determines that 250 pieces of tilt angle value data have not been collected (NO in ST3), the control unit 12 returns to ST2. If the control unit 12 determines that 250 pieces of tilt angle value data have been collected (YES in ST3), the control unit 12 proceeds to step ST4.

[0123] Each diagram in FIG. 13 shows a schematic diagram of information (storage contents) inside the angle information array. The upper left diagram in FIG. 13 shows information at the time when detection by the tilt sensor 22 started, and indicates that the tilt angle acquired 0.00 seconds ago was A degrees, and that there is no data of tilt angle values ​​acquired 0.05 seconds ago to 12.45 seconds ago. The lower left diagram in FIG. 13 shows information 0.05 seconds after the start of detection, and indicates that the tilt angle acquired 0.00 seconds ago was B degrees, the tilt angle acquired 0.05 seconds ago was A degrees, and that there is no data of tilt angle values ​​acquired 0.10 seconds ago to 12.45 seconds ago. In the two diagrams on the left in FIG. 13, 250 tilt angle values ​​are not complete, and in such a case, the control unit 12 judges NO in ST3.

[0124] 13 shows information at the time when 250 tilt angle values ​​are collected for the first time since the start of detection. When 250 tilt angle value data are collected, the control unit 12 judges YES in ST3, and performs conversion processing to normalized angle values ​​using the 250 tilt angle value data in ST4.

[0125] The bottom right diagram in Fig. 13 shows information obtained 0.05 seconds after the top right diagram. As shown in the bottom right diagram, the control unit 12 deletes the tilt angle value obtained 12.50 seconds ago and stores the latest 250 tilt angle values. Since 250 tilt angle values ​​are available, the control unit 12 determines YES in ST3 and performs conversion processing to normalized angle values ​​using these 250 tilt angle values ​​in ST4.

[0126] In this embodiment, as shown in FIG. 7, when data of 250 inclination angle values ​​is collected, presentation of the object image 7 with a display size calculated based on the basic size is started.

[0127] Here, every time the control unit 12 acquires an inclination angle value every 0.05 seconds, it deletes the inclination angle value acquired 12.50 seconds ago, and performs the processes from ST4 onward using the latest 250 inclination angle values.

[0128] In ST4, the control unit 12 converts the data of the 250 tilt angle values ​​into normalized angle values ​​that normalize each tilt angle value to be in the range of 0 to 1 based on the above formula (1).

[0129] Fig. 14 shows an example in which the tilt angle values ​​of the angle information array shown in Fig. 13 are converted by the normalization process in ST4 into normalized angle values ​​in the range of 0 to 1. Using these normalized angle values, the start of inhalation is determined (ST5 described later), breathing length is calculated (ST8 described later), and the display size and sound volume are calculated (ST11 described later), etc.

[0130] Next, the control unit 12 judges whether the latest normalized angle value (the normalized angle value of the tilt angle value acquired 0.00 seconds ago in the table of FIG. 14) represents the start of inhalation (ST5). Specifically, the control unit 12 judges that the latest (current) normalized angle value represents the "start of inhalation" when the latest normalized angle value (the normalized angle value of the tilt angle value acquired 0.00 seconds ago) is increased from the normalized angle value acquired immediately before (the normalized angle value of the tilt angle value acquired 0.05 seconds ago) (Condition 1) and exceeds a threshold value (set to 0.2 in this embodiment) (Condition 2). On the other hand, if either one of the above Conditions 1 and 2 is not satisfied, it is judged that the "start of inhalation" is not present. In the example shown in FIG. 14, the latest normalized angle value is 0.28, which is increased from the normalized angle value of 0.19 acquired immediately before and exceeds the threshold value (0.2), and therefore it is judged that the "start of inhalation" is present. In this embodiment, the period during which the normalized angle value increases corresponds to the user's inhalation period, and the period during which the normalized angle value decreases corresponds to the user's exhalation period.

[0131] If the control unit 12 determines that this is not the start of a puff (NO in ST5), it proceeds to ST13. On the other hand, if the control unit 12 determines that this is the start of a puff (YES in ST5), it determines whether this is the start of the first puff (ST6). The control unit 12 also temporarily stores in RAM 153 the detection time when the current start of a puff was detected.

[0132] If the control unit 12 determines that this is not the first inhale (NO in ST6), the process proceeds to ST9. If the control unit 12 determines that this is the first inhale (YES in ST6), the control unit 12 generates presentation information to notify the user of the first inhale, and the notification is performed based on the presentation information (ST7). Here, the "first inhale" refers to the first inhale detected after 250 tilt angle values ​​are acquired for the first time.

[0133] The notification of the start of the first inhale may be made by image presentation and / or sound presentation. For example, the control unit 12 may present a sound presentation using a third sound effect, which is a sound different from the first sound effect (Brown noise) and the second sound effect (the sound of a water drop hitting the water surface, "splash"), as a sound indicating the start of the first inhale, in addition to the image display of the ripples 5 on the display unit 32. For example, a sound presentation such as "Starting care" may be presented as the third sound effect only at the start of the first inhale. This allows the user to change his / her mind and concentrate on care, making it easier to focus on breathing. As a result, a sense of accomplishment in care is more easily obtained.

[0134] The same ripple 5 may be displayed each time the start of a puff is detected, including the first one, or the ripple 5 may be displayed only when the first one is detected. The image presented to represent the first start of a puff may be different from the image presented to represent other starts of puffs (starts of the second and subsequent puffs). Alternatively, the ripples representing the first start of a puff and the ripples representing the second and subsequent starts of puffs may be displayed in such a way that it is clear at a glance that they are different, for example by displaying them in different colors. Although ripples have been given as an example of the image presented to represent the start of a puff, other shapes may also be used.

[0135] After the control unit 12 issues the first inhalation start notification (ST7), it proceeds to ST13 without calculating the breathing length or reducing / updating the basic size, which will be described below.

[0136] On the other hand, if it is not the first inhalation start, the control unit 12 detects a "breath" whose exhalation ends at the time (0.00 seconds before) when the inhalation start is detected in ST5 (ST8). In this embodiment, there is no programmatic entity of the one-breath detection (ST8), i.e., no instruction to the CPU 51. The operation of the control unit 12 in ST8 is that the program counter of the CPU 51 changes to an address where the process at the time of the one-breath detection is stored, in other words, the top address of ST9. Next, the control unit 12 calculates the difference between the detection time of the inhalation start of the detected "one breath" and the detection time of the current inhalation start as the respiration length of the detected "one breath" (ST9). In detail, the respiration length of one breath is calculated from the difference between the detection time of the previous inhalation start, which is temporarily stored in the RAM 53, and the detection time of the current inhalation start. Strictly speaking, it is necessary to detect "one breath" in which the time when the start of inhalation is detected in ST5 (0.00 seconds ago) is the end of exhalation, but as described above, the breathing length of one breath may be calculated using the previous inhalation start detection time temporarily stored in RAM 53. Note that the previous inhalation start detection time temporarily stored in RAM 53 is replaced by the control unit 12 with the current inhalation start detection time after the breathing length is calculated.

[0137] Next, the control unit 12 determines whether the calculated respiration length is less than a threshold value (ST10). Here, the threshold value is set to 10 seconds.

[0138] When the control unit 12 determines that the threshold is less than 10 seconds (YES in ST10), it reduces the basic size of the object image 7 by an amount of reduction according to the respiration length using the following formula (2), and updates the basic size (ST11, "reduction and update process"), and then proceeds to ST13.

[0139]

number

[0140] In the above formula (2), the "basic size to be updated" indicates the "basic size to be updated when one breath is detected", and the "basic size before update" indicates the "basic size before one breath is detected". In the above formula (2), "basic size" refers to the "basic size of the object image." In formula (2), the amount subtracted from the basic size up until just before the detection of one breath is the degree of change (reduction amount) from the basic size of the object image just before the detection of one breath. The value of the reduction amount varies depending on the breathing length; the longer the breathing length, the greater the reduction amount, and the shorter the breathing length, the smaller the reduction amount. The attenuation amount (attenuation amount d when the breathing length is long, and attenuation amount e when the breathing length is short) in the waveform shown in Figure 9 (B), which shows the change in display size over time, corresponds to the above "reduction amount."

[0141] When the control unit 12 determines that the breathing length is not less than 10 seconds, that is, that it is 10 seconds or more (NO to ST10), it reduces the basic size of the object image 7 by setting the degree of change (reduction amount) to a uniform 0.19956, and updates the basic size (ST12, "reduction, update process"). That is, it updates the basic size to a value obtained by subtracting 0.19956 from the basic size of the object image immediately before the detection of one breath. This reduction amount of "0.19956" is the same as the subtraction amount (corresponding to the reduction amount) subtracted from the basic size up to immediately before the detection of a breath in the above formula (2) when the breathing length is 10 seconds. Then, it proceeds to ST13.

[0142] Fig. 15 shows that the reduction amount differs according to the breathing length, and the number of breaths and the number of seconds required to reduce the basic size of the object image to 0 or less, i.e., to make it disappear, differ. In Fig. 15, values ​​are calculated assuming that the initial value of the basic size of the object image is 1.0. As shown in Fig. 15, the longer the breathing length, the greater the reduction amount of the basic size of the object image. Also, the longer the breathing length, the fewer the number of breaths and the shorter the number of seconds until the object image disappears.

[0143] As a specific example, when breathing is repeated with a breathing length of 4 seconds, 17.71 or more breaths (i.e., 18 breaths) are required to reduce the basic size of the object image to 0 or less, and the time required is calculated to be 72 seconds (=4 seconds x 18 breaths). On the other hand, when the breathing length is 8 seconds, 6.39 or more breaths (i.e., 7 breaths) are required, and the time required is calculated to be 56 seconds (=8 seconds x 7 breaths).

[0144] In ST13, the control unit 12 uses the basic size and the normalized angle value based on the following formula (3) to determine the display size of the object image 7, and also uses the normalized angle value to determine the volume of the first sound effect.

[0145]

number

[0146] In the above formula (3), "display size" refers to the "display size of the object image" and "basic size" refers to the "basic size of the object image." As shown in the above formula (3), the display size of the object image is calculated by multiplying the basic size of the object image to which 0.3 has been added as a correction by multiplying the normalized angle value by 0.7 as a correction and then adding 0.3. In this way, the display size of the object image is determined by changing the corrected basic size (the value obtained by adding 0.3 to the basic size in formula (3)) at a rate of change according to the normalized angle value.

[0147] In this way, by determining the display size using a normalized angle value that reflects the user's inhalation and exhalation, the user's inhalation and exhalation can be represented by enlarging or reducing the object image, making it easier for the user to visually recognize their own breathing.

[0148] Here, there are times when the basic size and normalized angle value of the object image both produce values ​​of 0 or close to 0. If the basic size value of the object image and the normalized angle value are multiplied without the correction shown in the above formula (3), the multiplication result will be a value of 0 or close to 0. In this case, if the calculated value is used as the actual display size of the object image to be displayed on the display unit 32, the object image may become extremely small and the user may not be able to recognize it as visual information, resulting in an inappropriate display. In contrast, in this embodiment, the display size is calculated by making corrections as shown in the above formula (3), so that an appropriate display that can be recognized by the user is possible.

[0149] Here, the inclination angle value (detection value of the inclination sensor) is acquired every 0.05 seconds, and 20 inclination angle values ​​are acquired per second. In other words, the display size of the object image is calculated 20 times per second using the normalized angle value converted from the inclination angle value. In contrast, if the image display on the display unit 32 operates at, for example, 60 frames per second, and a moving image is used for the background image 10, the size change of the object image relative to the background image will be sluggish. Therefore, from the viewpoint of smoothing the size change of the object image and creating a moving image that does not look unnatural overall, it is preferable to perform frame interpolation processing.

[0150] Next, the control unit 12 generates a care display image in which an object image of the display size determined in ST13 is displayed, transmits it to the display device 3, and generates a first sound effect at the volume determined in ST13, and transmits it to the speaker 4 (ST14). The care display image is displayed on the display unit 32 of the display device 3, and the first sound effect is output from the speaker 4 at a volume corresponding to the normalized angle value, i.e., the user's exhalation and inhalation.

[0151] The processes of ST2 to ST14 are repeated every time the tilt angle value is obtained from the tilt sensor 22, and are performed until the object image 7 disappears, that is, until the object image 7 reaches a predetermined size of one pixel or a few pixels in terms of calculation. In other words, the processes of ST2 to ST14 are steps in which the reduction ratio of the object image is updated so that the degree of change in the display size is large when the breathing length is relatively long, and the degree of change is small when the breathing length is relatively short. And, "the processes of ST2 to ST14 are performed until the object image disappears (until the object image reaches a predetermined size of one pixel or a few pixels in terms of calculation)" may be determined not only when the display size is equal to or smaller than a threshold value as a result of the calculation using the formula (3), but also using the basic size as a result of the calculation using the formula (2). That is, when the basic size is equal to or smaller than a threshold value, for example, zero, the display size of the object image 7 is forcibly set to zero or an extremely small value, and the object image 7 reaches a predetermined size of 0 pixels or a few pixels in terms of calculation. If the reduction ratio of the updated object image is equal to or greater than a threshold, the object image is generated and presented based on that reduction ratio, and if it is less than the threshold, the generation and presentation of the object image is terminated. Note that, in addition to making the display size zero or an extremely small value, other means for expressing the disappearance of an object image can be used, such as making the object image 7 colorless and transparent, or moving it behind the background image.

[0152] As shown in Fig. 9(A), the waveform expansion / contraction cycle curve showing the time-dependent change in the change in the display size of the object image generated by the flow of Fig. 12 attenuates every time a new breath is detected, and the amplitude of the waveform decreases over time, eventually becoming 0. For example, as shown in Fig. 8, the object image 7 gradually shrinks in the order of (A), (B), and (C), and finally the object image 7 disappears.

[0153] As described above, the basic size, which is the reference for calculating the display size of the object image, is reduced and updated every time one breath is detected. As shown in the two left graphs in FIG. 16, the longer the breathing length of the detected breath, the larger the reduction amount (degree of change) of the basic size, the shorter the time (presentation time) until the object image disappears, and the fewer the number of reductions (the fewer the number of reduction and update processes). That is, as shown in the two right graphs in FIG. 9(B) and FIG. 16, the presentation time of the object image 7 is shorter for a user with a long breathing length than for a user with a short breathing length. By controlling the presentation time according to the breathing length in this way, the user is more conscious of taking a deeper breath and having a longer breathing length so that the object image disappears sooner. Taking a deep breath can calm the user's mind, making it easier for the user to feel a sense of accomplishment in care.

[0154] In the present embodiment, in the process of reducing and updating the basic size, if the breathing length of one breath is less than the threshold, the basic size is reduced and updated by a reduction amount (degree of change) according to the breathing length of one breath, and an object image is generated with a display size based on the basic size. On the other hand, if the breathing length of one breath is equal to or greater than the threshold, the reduction amount (degree of change) is set to a uniform amount (0.19956 in the present embodiment), the basic size is reduced and updated by this reduction amount (degree of change), and an object image is generated with a display size based on the basic size.

[0155] In this way, the basic size of the object image is gradually reduced every time one breath is detected, and furthermore, by setting the above threshold value, the object image is controlled to disappear within a certain time. In other words, the presentation time of the object image is controlled to be within a certain time. For example, in this embodiment, the time from the detection of the first breath to the disappearance of the object image can be set to a short time such as about 0.5 minutes to about 7 minutes. By setting the presentation time to about 0.5 minutes or more, the user is unlikely to feel anxious that the care is not being performed sufficiently because the object image disappears early. Moreover, by setting it to about 7 minutes or less, the user is unlikely to feel stressed because the time required for care is too long. Note that the above presentation time is one example and can be set appropriately.

[0156] By setting the presentation time of the object image to a short time in this way, it is unlikely that the object image will not disappear easily, which will cause the user to feel stressed. For example, if a user has difficulty in taking deep breaths (increasing the length of breathing), the object image will not disappear easily, especially if it does not disappear until the end, which can cause stress. However, in this embodiment, the object image will always disappear within a certain time, so effective care can be provided in a short time, and the user can feel a sense of accomplishment in the care in a short time. Furthermore, by shortening the time required for care, the user can receive care easily without being bound by time, and the mental burden is reduced. In addition, even when the user does not have much time, the user can select the care timing according to his / her own convenience, so there is less hassle in adjusting the time, making it easier to continue the care. This makes it easier to release chronic stress periodically, and makes it easier for the user to maintain a good mental health state.

[0157] In addition, the presentation time of the object image can be set to a short time, thereby shortening the overall time required for care. For example, the time from the preparation for generating the care display image, such as the user evaluating his / her own stress level and inputting it into the input display image, to the generation and display of the care display image, to the disappearance of the object image and the end of care, can be set to 3 minutes, and the object image can be disappeared in half that time, 90 seconds, for example.

[0158] In the above example, the threshold value of the breathing length of one breath is set to 10 seconds in the basic size reduction and update process, but the threshold value is not limited to this and can be set appropriately. The breathing length threshold value may be set by the user. With this configuration, for example, a user who has difficulty breathing deeply can set a target breathing length to be shorter, and mental health care using the care display image can be performed with less stress.

[0159] The above formula (2) used in the reduction and update process is an example, and the method of calculating the reduction amount at the change degree according to the breathing length of the basic size updated every time one breath is detected is not limited to formula (2). For example, the numerical values ​​used in the calculation formula for calculating the reduction amount are not limited to the numerical values ​​of formula (2) and can be set appropriately.

[0160] Also, the maximum presentation time may be set by the user, and a calculation formula for reducing the basic size and / or a threshold value for the breathing length may be set so that the object image disappears within the maximum presentation time. For example, the maximum presentation time of the object image (for example, 1 minute, 2 minutes, 3 minutes, 4 minutes, 5 minutes, 6 minutes, 7 minutes, etc.) and the calculation formula for the reduction amount and the threshold value for the breathing length so that the object image always disappears within the above-mentioned maximum presentation time may be associated with each other and stored in advance in a database (not shown). Then, when the user selects and sets the maximum presentation time (for example, the maximum presentation time is selected and set from options such as 1 minute, 2 minutes, 3 minutes, 4 minutes, 5 minutes, 6 minutes, 7 minutes, etc.), the display size may be determined using the calculation formula for the reduction amount and the threshold value for the breathing length used in the reduction and update process of the basic size based on the above-mentioned database.

[0161] Although the embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiment, and various modifications can be made without departing from the spirit and scope of the present invention.

[0162] <First Modification> In the above embodiment, an example was given in which the tilt angle value (detection value) of the tilt sensor 22 is acquired by the information processing device, but the tilt sensor 22 may be connected to a microcomputer such as Arduino (registered trademark), and the microcomputer may be connected to the information processing device. The microcomputer may read the tilt angle value from the tilt sensor and continuously transmit it to the information processing device by serial communication. Also, the tilt sensor may be configured as a part of the control unit in the present invention, and, for example, the CPU and RAM of the microcomputer may operate, and the microcomputer may perform, for example, normalized angle value calculation and even calculation of respiration length, that is, the normalized angle calculation unit, and in addition thereto, the respiration detection unit and the respiration length calculation unit may be realized on the microcomputer side.

[0163] In addition, in the above-described embodiment, a tilt sensor is used as an example of a sensor used to acquire the user's respiratory information, and an example is given in which the tilt sensor is built into the cushion-shaped respiratory information acquisition device, but the type of sensor and its installation form are not limited to this.

[0164] For example, as in the information processing system 100A shown in FIG. 17(A), a sensor 23 such as a distance sensor or a camera may be installed in the dedicated room. The distance sensor is placed at a position where it can detect changes in the abdomen and chest of the user. The camera is placed at a position where it can acquire a video of the face or chest and abdomen, and the video detected by the camera can be analyzed to estimate respiratory information. In order to enhance the user's sense of relaxation, a scent diffuser 18 may be installed in the dedicated room, and a scent may be diffused from the scent diffuser 18 in accordance with the presentation of the care display image. In this way, the user's respiratory information may be acquired using a non-contact sensor 23.

[0165] In addition, in the above-mentioned information processing systems 100 and 100A, an example was given in which mental health hair was performed in a dedicated room, but a dedicated room may not be provided. In addition, in the above-mentioned information processing systems 100 and 100A, an example was given in which a display device having a display unit 32 and a speaker 4 were provided separately from the information processing device 1, but as in the information processing system 100B in FIG. 17(B) and the information processing system 100C in FIG. 17(C), a display unit and / or speaker mounted on an information processing device such as a personal computer 1B or a mobile terminal (e.g., a smartphone) 1C may be used. In other words, the personal computer 1B or the smartphone 1C as an information processing device may be configured to play the role of a display device and / or a speaker. With such a configuration, the user can minimize the equipment required for care and can easily perform care at a convenient time. In addition, since the installation of a dedicated care room is unnecessary, there are fewer restrictions on the place where care is performed, and care can be performed in a short time, care can be performed without changing the line of movement, mental burden is reduced, and it is easy to continue. As described later, the respiratory information of the user may be acquired using a sensor mounted on the personal computer 1B or the smartphone 1C, and care can be easily performed without the need to prepare a separate respiratory information acquisition device 2 as in the above embodiment. The personal computer 1B and the smartphone 1C as information processing devices each include a control unit 12 that performs processing related to the generation of a care display image, similar to the information processing device 1 of the above embodiment.

[0166] In the information processing system 100B of Fig. 17(B), the camera 24 mounted on the personal computer 1B may be used as a sensor for acquiring the respiratory information of the user, and the respiratory information may be acquired by analyzing the image acquired by the camera 24. In other words, the personal computer 1B as the information processing device may be configured to play the role of the respiratory information acquiring device. Alternatively, the respiratory information of the user U may be acquired using the respiratory information acquiring device 2 as in the above-mentioned information processing system 100, or using a non-contact type sensor 23 as in the information processing system 100A.

[0167] In the information processing system 100C of FIG. 17(C), a camera, a gyro sensor, an acceleration sensor, etc. mounted on the smartphone 1C can also be used as a sensor for acquiring the user's respiratory information. That is, the smartphone 1C as an information processing device may be configured to play the role of the respiratory information acquisition device 2. When the respiratory information is acquired using the gyro sensor and the acceleration sensor built into the smartphone 1C, typically, the smartphone 1C is brought into contact with the abdominal chest of the user to detect the displacement of the abdominal chest due to breathing, so it is preferable to display a care display image on a display unit other than the display unit equipped in the smartphone 1C, specifically, on a display unit of a display device prepared separately from the smartphone 1C. In addition, the smartphone may be equipped with an infrared sensor for face recognition, etc., and the respiratory information of the user U may be acquired from a change in the distance between the smartphone and the abdominal chest of the user using the infrared sensor. In addition, since the smartphone is typically equipped with a dual camera, the respiratory information of the user U may be acquired from a change in the distance between the smartphone and the abdominal chest of the user acquired using the dual camera. When using such a sensor that can acquire respiratory information without contact, the user can display a care display image on the display unit of the smartphone 1C. Alternatively, the respiratory information of the user U may be acquired using a tilt sensor built into the respiratory information acquisition device 2 as in the above-described information processing system 100, or using a non-contact sensor 23 as in the information processing system 100A.

[0168] In this way, an information processing device having a control unit 12 may serve one or more roles selected from the role of a respiratory information acquisition device having a sensor that acquires the user's respiratory information, the role of a display device having a display unit, and the role of a speaker.

[0169] Furthermore, in the information processing system 100 according to the embodiment described above, the control unit 12 is configured by one information processing device, but may be configured by a plurality of information processing devices.

[0170] <Second Modification> In the above-described embodiment, the information processing device 1 may further include an erroneous detection prevention switch.

[0171] For example, if a movement not related to breathing, such as heartbeat, occurs in the abdomen and chest at an inopportune time, it may be erroneously detected as the start of inhalation (start of breathing). In order to reduce the frequency of such erroneous detection, it is preferable to provide a false detection prevention switch.

[0172] Specifically, the first switch A and the second switch B are set as erroneous detection prevention switches. The first switch A is set to be on when the normalized angle value is 0.7 or more, and the second switch B is set to be on when the normalized angle value is less than 0.18. The control unit 12 determines that an inhalation has started only when the first switch A and the second switch B are both on and the normalized angle value is 0.2 or more. When the control unit 12 determines that an inhalation has started, the first switch A and the second switch B are simultaneously turned off, returning to the initial state.

[0173] If the user's breathing is disturbed and the inhalation or exhalation action is insufficient, the first switch A and the second switch B do not turn on, and the timing of breathing (start of inhalation or start of exhalation) is not detected. In other words, if the first switch A and the second switch B repeat normal on-off and are detected as the timing of breathing, it can be said that the user's breathing is stable. By using this, the user can recognize whether the user's breathing is stable or not, and the user can be encouraged to breathe voluntarily. For example, when the start of inhalation is detected, the start of inhalation can be indicated by an image different from the object image (ripples in the above embodiment) and / or a sound (the second sound effect and the third sound effect in the above embodiment) to draw the user's attention to breathing.

[0174] <Third Modification> In the above embodiment, an example was given in which the object image is in the shape of a flame and a flame flickering animation is used, but the animation may not be used. For example, the object image may be in the shape of a perfect circle, and the display size calculated based on the basic size of the perfect circle object image may be enlarged and reduced in response to the inhalation and exhalation of a breath, while the basic size may be reduced and updated each time a breath is detected. In this case, the object image always shows a perfect circle shape, and is displayed so as to gradually reduce overall and disappear while repeatedly enlarging and reducing. Also, only the reduction and update processing may be performed without performing the enlargement and reduction processing in response to the inhalation and exhalation of a breath. In this case, for example, the display size of the object image is reduced stepwise each time a breath is detected, and is displayed so as to finally disappear. In this way, the object image may be deformed stepwise, not continuously.

[0175] Furthermore, in the above embodiment, an example of a display form in which the change in an object image until it disappears is represented by the display size has been given, but the display form for expressing the change from the presentation of an object image until it disappears is not limited to this.

[0176] For example, the color of the object image or the internal pattern may be gradually brought closer to the background image, and the color tone, color density (saturation or brightness) and / or pattern shape of the object image may be gradually changed continuously or stepwise so that the object image and the background image have an integrated color or pattern when the presentation is terminated, thereby making the object image disappear as a care display image. Note that "a color or pattern in which the object image and the background image are integrated" refers to a state in which there is no boundary between the object image and the background image, and the color or pattern is continuous and gives an overall sense of unity.

[0177] As another example, the color or pattern of the background image may be gradually brought closer to that of the object image, and the background image may be gradually changed continuously or in stages so that the color or pattern of the object image and the background image become integrated when the presentation is terminated, thereby causing the object image to disappear.

[0178] As another example, the object image and the background image may be generated by gradually changing the colors, patterns, etc. of both the object image and the background image so that they approach each other gradually, continuously or in stages, and the object image and the background image have an integrated color and pattern when presentation is terminated.

[0179] As another example, an object image may be generated so that it gradually becomes more transparent in a continuous or step-by-step manner, so that the color or pattern of the background image gradually becomes clearer in a continuous or step-by-step manner in the area of ​​the background image where it overlaps with the object image, and so that the object image disappears, becoming completely colorless and transparent, when presentation is terminated.

[0180] In any display form, the disappearance of the object image gives the user a sensation that negative emotions are disappearing. [Explanation of symbols]

[0181] 1...Information processing device 7. Object image 12...Control section U...User

Claims

1. The device includes a control unit that changes an object image representing the user's psychological state, which is presented to the user, toward disappearance based on the degree of change derived from the user's breathing length, calculated using output results from a sensor that detects the user's breathing over time. Information processing device.

2. The control unit determines the degree of change to be larger when the breathing length is long and smaller when the breathing length is short. The information processing apparatus according to claim 1.

3. The control unit controls the presentation time from the presentation to the disappearance of the object image based on the breathing length. The information processing apparatus according to claim 1 or 2.

4. The control unit changes the display size of the object image, The degree of change is the percentage by which the display size is changed. The information processing apparatus according to claim 1 or 2.

5. The display size of the object image is determined based on the base size. The control unit, The sensor that detects the displacement of the user's body parts due to the user's breathing acquires the detected values ​​at predetermined time intervals. Using the time-series information of the detected value, one breath is detected. Each time a breath is detected, the breathing length of that breath is calculated as the breathing length. In determining the display size, each time a breath is detected, the degree of change is calculated, the base size is reduced and updated by the calculated degree of change, and the display size is determined based on the base size. The information processing apparatus according to claim 4.

6. The control unit, in reducing and updating the basic size, increases the degree of change if the calculated breathing length is relatively long, and decreases the degree of change if it is relatively short, thereby reducing and updating the basic size. The information processing apparatus according to claim 5.

7. The control unit, in reducing or updating the basic size, If the calculated respiratory length of one breath is less than the threshold, the basic size is reduced and updated according to the degree of change corresponding to the calculated respiratory length. If the calculated respiratory length of one breath is greater than or equal to a threshold, the degree of change is made uniform, and the basic size is reduced and updated according to that degree of change. The information processing apparatus according to claim 5.

8. The control unit converts the detected value into a normalized value and determines the display size using the normalized value and the base size. The information processing apparatus according to claim 5.

9. The control unit determines the volume of the sound effect to be presented to the user according to the normalized value obtained by normalizing and converting the detected value. The information processing apparatus according to claim 5.

10. The control unit, The psychological state information of the user entered by the user is acquired. Based on the aforementioned psychological state information, the base size is determined to determine the display size of the object image at the start of presentation. The information processing apparatus according to claim 1 or 2.

11. The aforementioned psychological state information includes at least one of the stress level, anxiety level, and depression level. The information processing apparatus according to claim 10.

12. The control unit presents a display image in which the object image is superimposed on the background image. The control unit presents the display image such that, in the background image excluding the area where the object image is displayed, the hue angle in the HSB color space of the area accounting for 70% or more of the display area is within the range of 60 degrees to 300 degrees. The information processing apparatus according to claim 1 or 2.

13. The aforementioned background image is an image in which the first background image is superimposed on a second background image that is located across the entire surface of the display image. The background image has a first region where the first background image is located and a second region where the first background image is not located. The object image is superimposed on the background image such that it is located within the first region, or that a portion of it is located within the first region and the other portion is located within the second region. The control unit generates the display image such that, in the background image excluding the area in which the object image is displayed, one of the first background image located in the first area and the second background image located in the second area includes at least 70% of the display area ratio of an area with a hue angle in the HSB color space between 60 degrees and less than 180 degrees, and the other includes at least 70% of the display area ratio of an area with a hue angle in the HSB color space between 180 degrees and 300 degrees. The information processing apparatus according to claim 12.

14. An information processing method performed by an information processing device, An object image representing the user's psychological state is presented to the user, which changes toward disappearance based on the degree of change derived from the user's breathing length, calculated using the output results output over time from a sensor that detects the user's breathing. Information processing methods.

15. A program that presents to a user an object image representing the user's psychological state, the display size of which changes towards disappearance based on the degree of change in the user's breathing length, which is calculated using output results output over time from a sensor that detects the user's breathing, In an information processing device, The steps include updating the scaling factor of the object image such that the degree of change increases when the breathing length is relatively long, and decreases when the breathing length is relatively short, If the reduction ratio after updating is less than a threshold, the generation and presentation of the object image are terminated; if the reduction ratio after updating is greater than or equal to the threshold, the object image is generated based on the reduction ratio and the generated object image is presented. A program that executes the command.

Images