Information processing system, information processing method, and program

Abstract

In order to solve the problem of assisting childcare actions to help an infant to stop crying or to sleep, the present invention comprises: a sensor information acquisition unit (101) that acquires sensor information from a sensor that detects the state of an infant; a calculation unit (103) that calculates at least one of heartbeat information (IBI) and an infant state score (ISS) on the basis of the sensor information; an output unit (104) that outputs information indicating at least one of the IBI and the ISS in real time; and a notification unit (105) that, on the basis of at least one of the elapsed time since detection of the infant being held while walking, the IBI, and the ISS, outputs notification information for notifying a user of a childcare action to be performed to help the infant to stop crying or to sleep.

Description

[Technical Field]

[0001] The present invention relates to a technology for supporting caregivers based on the condition of an infant. [Background technology]

[0002] There are known technologies for supporting caregivers based on the state of an infant. For example, Patent Document 1 describes a system that includes a detection means for detecting and recording at least one signal related to oral sucking behavior, a positioning means for positioning the detection means in the infant's oral cavity, and, optionally, a sleep stage determination system for determining the sleep stage of the infant from the recorded data. Patent Document 1 also describes a pacifier for use with infants as an example of the positioning means. In this case, the system displays the sleep stage using a color code or numbers on a small display included in the pacifier. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japan Special Publication No. 2014-530735 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, infant crying and nighttime awakenings are a major source of stress for caregivers. Even if caregivers hold a crying infant and walk around with them until the infant stops crying, and then try to put the infant down and get them to sleep, the crying often starts again. In such cases, the caregiver's stress increases.

[0005] Although the system described in Patent Document 1 can indicate an infant's sleep stage, it does not reduce the stress on caregivers until the infant stops crying or falls asleep, as it is difficult for a crying infant to use a pacifier.

[0006] One aspect of the present invention has been made to solve the above-mentioned problems, and aims to provide a technology that supports parenting behavior to stop an infant from crying or promote sleep. [Means for solving the problem]

[0007] In order to solve the above problem, an information processing system according to one embodiment of the present invention includes a sensor information acquisition unit that acquires sensor information from a sensor that detects the state of an infant; a calculation unit that calculates, based on the sensor information, at least one of heart rate information regarding the infant's heart rate and an infant state score that indicates whether the infant is in a state ranging from crying to sleeping; an output unit that outputs information indicating at least one of the heart rate information and the infant state score in real time; and a notification unit that outputs notification information that notifies the user of childcare actions that should be taken to stop the infant crying or promote sleep, based on at least one of the time elapsed since the user started walking while holding the infant, the heart rate information, and the infant state score.

[0008] In order to solve the above problem, an information processing method according to one aspect of the present invention includes a sensor information acquisition step of acquiring sensor information from a sensor that detects the state of an infant; a calculation step of calculating, based on the sensor information, at least one of heart rate information regarding the infant's heart rate and an infant state score indicating whether the infant is in a state ranging from crying to sleeping; an output step of outputting information indicating at least one of the heart rate information and the infant state score in real time; and a notification step of outputting notification information that notifies the user of childcare actions that should be taken to stop the infant crying or promote sleep, based on at least one of the time elapsed since the user started walking while holding the infant, the heart rate information, and the infant state score. [Effects of the Invention]

[0009] According to one aspect of the present invention, it is possible to support parenting behaviors to stop an infant from crying or promote sleep. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating analysis result 1 of an experiment from which the knowledge that forms the basis of the present invention was obtained. [Figure 2] FIG. 10 is a diagram illustrating analysis result 2 of the above-mentioned experiment. [Figure 3] FIG. 10 is a diagram illustrating analysis result 3 of the above-mentioned experiment. [Figure 4] 1 is a block diagram illustrating an example of a hardware configuration of an information processing system according to an embodiment of the present invention. [Figure 5] 1 is a block diagram showing an example of a functional configuration of an information processing system according to an embodiment of the present invention. [Figure 6] FIG. 1 is a flowchart illustrating a flow of an information processing method according to an embodiment of the present invention. [Figure 7] FIG. 10 is a diagram showing an example of a screen for selecting an assistance mode in one embodiment of the present invention. [Figure 8] 10A and 10B are schematic diagrams illustrating a specific example of a soothing support mode according to an embodiment of the present invention. [Figure 9] FIG. 7 is a flowchart illustrating a detailed flow of a notification process in the crying cessation support mode shown in FIG. 6. [Figure 10] 7 is a flowchart illustrating a detailed flow of a notification process in the sleep assistance mode shown in FIG. 6.

[0023] FIG. [Figure 11] 10A and 10B are schematic diagrams illustrating a specific example of a sleep assistance mode according to an embodiment of the present invention. [Figure 12] 7 is a flowchart illustrating a detailed flow of a notification process of the awakening prediction mode shown in FIG. 6. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0011] [Findings underlying the present invention] The inventors of the present application have discovered a method for helping crying infants stop crying and effectively putting them to sleep. The method involves (Step 1) walking around without stopping while holding the crying infant until the infant goes from drowsy to asleep (approximately 3 to 10 minutes, which may vary between individuals and / or within individuals depending on the infant's prior condition), and (Step 2) then inducing a deeper sleep state by holding the infant in a low-stimulation sitting position for a certain period of time (approximately 3 to 10 minutes, which may vary between individuals and / or within individuals depending on the infant's prior condition). If the infant does not open its eyes, the time required for each of Steps 1 and 2, which varies between individuals and / or within individuals depending on the infant's prior condition, can be optimized by predicting the time required using heart rate information and the infant's condition score.

[0012] The experiment that yielded these findings and its analytical results are described below. The experiment involved 20 infants aged 7 months or less. In the experiment, each caregiver performed childcare activities, such as walking while holding the infant (walk-hold), sitting while holding the infant (sit-hold), and laying the infant down in a crib (cot), according to the experimenter's instructions. While the caregivers were performing these activities, the infants' electrocardiograms and the state of these childcare activities were recorded using a Holter monitor and video. Based on the recordings, the interbeat interval (IBI) and infant status score (ISS) were calculated.

[0013] (IBI: Interbeat interval) The IBI value increases as the infant's state approaches sleep. The IBI can be calculated based on electrocardiograms, and it has been shown that similar results can be obtained using pulse waves.

[0014] (ISS: Infant Status Score) The ISS is a score indicating the infant's transition from crying to sleep. In the analysis results, the ISS is calculated based on the infant's negative vocalizations, body movements, eye movements, etc. In this experiment, the theoretical ISS value ranges from -1 to 1, with the higher value indicating the infant's sleepiness. Specifically, an ISS of -1 indicates that the infant is crying 100% of the time. A 100% crying state means that the infant vocalizes 100% of the time. An ISS of 0 indicates that the infant is awake and has stopped crying. An ISS of 1 indicates that the infant is in deep sleep. For example, an ISS greater than 0 indicates that the infant is in a state of drowsiness to deep sleep. An ISS greater than -0.5 but less than 0 indicates that the infant is fussy. An ISS of -0.5 or less indicates that the infant is crying intensely.

[0015] (Analysis result 1) Analysis Result 1 on Carrying a Baby While Walking Will Be Described with Reference to FIG. 1. FIG. 1 is a diagram illustrating Analysis Result 1 on Carrying a Baby While Walking. As shown in FIG. 1, in graph G101, the horizontal axis indicates the elapsed time since the caregiver began carrying a baby while walking, and the vertical axis indicates the ISS. Also, broken line G101a indicates the average ISS for 18 infants (32 measurements). Also, in graph G102, the horizontal axis indicates the elapsed time since the caregiver began carrying a baby while walking, and the vertical axis indicates the change in IBI (ΔIBI) from the start. Also, broken line G102a indicates the average ΔIBI for 18 infants (32 measurements). These graphs and data not included in this specification show that when a caregiver carries a crying infant while walking, the infant effectively stops crying within 30 seconds (ISS approaches 0) and significantly increases ΔIBI. Furthermore, it was found that if the caregiver continued to carry the baby while walking without stopping, the baby would go from drowsiness to sleep (ΔIBI and ISS increased) within about 300 seconds of starting to walk while carrying the baby.

[0016] (Analysis result 2) Analysis result 2 of the process of walking with a crying infant while holding the infant, until the infant falls asleep, and then sitting up while holding the infant, and finally putting the infant to sleep will be described with reference to FIG. 2. FIG. 2 is a diagram explaining analysis result 2 of the process of walking with a crying infant while holding the infant, until sitting up while holding the infant, and finally putting the infant to sleep. As shown in FIG. 2, graph G201 is a graph of the change in IBI from when the caregiver walked with the infant while holding the infant, until the caregiver fell asleep, and then started sitting up while holding the infant. The horizontal axis represents elapsed time, and the vertical axis represents IBI. Line G201a represents the IBI of a certain infant. Line G201b represents ISS. Period G201c is the period of walking with the infant while holding the infant. Period G201d is the period of sitting with the infant while holding the infant. Period G201e is the period from when the caregiver stood up while holding the infant, walked to the bed, and put the infant down. Period G201f is the period when the infant was away from the caregiver and on the bed. As can be seen from this graph, the infant's IBI gradually increases during the holding-walking period G201c. The ISS also changes to 1, indicating that the infant has fallen asleep. The infant's IBI also shows a tendency to decrease in the period G201e until the infant is placed in bed, compared to the holding-sitting period G201d. However, the IBI then recovers in the period G201f on the bed, and is even higher than during the holding-sitting period G201d. In other words, it can be seen that infants who have gone from somnolent to asleep have a significantly higher IBI and sleep more deeply when they are placed in bed rather than held and sat.

[0017] (Analysis result 3) Analysis result 3 on the length of time spent holding the infant will be described with reference to FIG. 3. FIG. 3 is a diagram illustrating analysis result 3 on the length of time spent holding the infant. As shown in FIG. 3, in graph G301, the vertical axis indicates the length of time from when the infant fell asleep until when the infant was put to bed. Furthermore, as shown on the horizontal axis, the infants were classified as either waking up within 20 seconds of being put to bed (wake-up) or not (stay-asleep). As can be seen from this graph, infants who woke up again after being put to bed took a shorter time to be put to bed than infants who remained asleep even after being put to bed. Furthermore, in graph G302, the vertical axis indicates the length of time from when the infant fell asleep until when the infant was put to bed. The horizontal axis indicates the percentage of time the infant was awake from the time the caregiver began putting the infant to bed until 40 seconds after being put to bed. The circular marker G302a indicates the data of infants who remained asleep from the time the caregiver began putting the infant to bed until 40 seconds after being put to bed. Triangular marker G302b indicates data for an infant who woke up while being placed in bed, but fell asleep afterwards. Square marker G302c indicates data for an infant who fell asleep while being placed in bed, but woke up afterwards. Diamond marker G302d indicates data for an infant who woke up both while being placed in bed and afterwards. As shown above, when the time between when an infant fell asleep and when they were put to bed was 5 minutes or less, many infants woke up again while being placed in bed or afterwards. On the other hand, when the time between when an infant fell asleep and when they were put to bed was 7 minutes or more, all infants remained asleep. This shows that waiting 5 to 7 minutes after an infant fell asleep before putting them to bed reduces the chances of them waking up again and crying resuming after being put to bed.

[0018] From analysis result 1, the inventors derived the above-mentioned procedure 1 for promoting an infant's stopping of crying. Furthermore, from analysis results 2 and 3, they derived procedure 2 for promoting an infant's sleep. Furthermore, they derived a method of putting a crying infant to sleep by performing procedure 2 after procedure 1. Below, an embodiment of the present invention that supports child-rearing behavior based on these findings will be described.

[0019] [Embodiment] An embodiment of the present invention will now be described in detail.

[0020] (Hardware configuration of information processing system 1) The configuration of an information processing system 1 according to one embodiment of the present invention will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the hardware configuration of the information processing system 1. As shown in Fig. 4, the information processing system 1 includes a user terminal 10, a wearable terminal 20, and an audio output device 30. The user terminal 10 is connected to the audio output device 30 and the wearable terminal 20 so that they can communicate with each other. In this embodiment, an example will be described in which these terminals are capable of wireless communication.

[0021] The user terminal 10 is a terminal used by a user U who performs childcare activities for an infant T. The user terminal 10 is configured, for example, by a smartphone. However, the computer configuring the user terminal 10 is not limited to this. The user terminal 10 includes a processor 11, a memory 12, a network interface 13, and a touch panel 14. The processor 11 executes at least a part of an information processing method S1 (described later) by reading and executing a program stored in the memory 12. The memory 12 stores a program for causing the processor 11 to execute at least a part of the information processing method S1. The network interface 13 connects to a network for wireless communication between the wearable terminal 20 and the audio output device 30. The network interface 13 is, for example, an interface for connecting to a wireless LAN (Local Area Network) or a short-range wireless communication network. Specific examples of short-range wireless communication networks include NFC (Near Field Communication) and Bluetooth (registered trademark). However, the network to which the network interface 13 connects is not limited to the above. The touch panel 14 displays information output by the processor 11. The touch panel 14 also accepts operations by the user U. The operations by the user U include, for example, touching the touch panel 14 with a finger, a touch pen, or the like.

[0022] The wearable terminal 20 is configured, for example, by a small computer that can be worn by the infant T. The body part to which the wearable terminal 20 is worn may be, for example, the ankle, calf, or dorsum of the foot. The attachment member may be, for example, an elastic band (not shown). However, the body part to which the wearable terminal 20 is worn and the attachment member are not limited to those described above. The wearable terminal 20 includes a processor 21, a memory 22, a network interface 23, a pulse wave sensor 24, a body movement sensor 25, and a voice sensor 26. The processor 21 executes at least a part of an information processing method S1 (described later) by reading and executing a program stored in the memory 22. The memory 22 stores a program for causing the processor 21 to execute at least a part of the information processing method S1. The network interface 23 is connected to a network for wireless communication with the user terminal 10. A specific example of the network interface 23 is the same as the specific example of the network interface 13 described above.

[0023] Pulse wave sensor 24 is a sensor that detects the pulse wave of infant T. For example, pulse wave sensor 24 is an optical pulse wave sensor, but is not limited to this. Body movement sensor 25 is a sensor that detects the body movement of infant T. For example, body movement sensor 25 is an acceleration sensor, a gyro sensor, etc., but is not limited to these. Vocalization sensor 26 is a sensor that detects the vocalization of infant T. Vocalization sensor 26 is a microphone, etc., but is not limited to these. Pulse wave sensor 24, body movement sensor 25, and vocalization sensor 26 are examples of "sensors that detect the condition of an infant" and examples of "sensors that detect at least one of pulse wave, body movement, and vocalization" as defined in the claims. Furthermore, information indicating pulse wave, body movement, and vocalization obtained from these sensors is an example of "sensor information" as defined in the claims.

[0024] The audio output device 30 outputs the audio output from the user terminal 10. For example, the audio output device 30 is configured by headphones or earphones that can be worn on the ears of the user U, but is not limited to this. (Functional configuration of information processing system 1) The functional configuration of the information processing system 1 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of the functional configuration of the information processing system 1. As shown in Fig. 5, in the information processing system 1, the user terminal 10 includes a sensor information acquisition unit 101, a start information acquisition unit 102, a calculation unit 103, an output unit 104, and a notification unit 105. Each functional block is realized by the above-mentioned processor 11 executing the above-mentioned program stored in the memory 12. In this embodiment, these functional blocks are arranged in the user terminal 10. However, some or all of these functional blocks may be arranged in the wearable terminal 20. Furthermore, some or all of these functional blocks may be arranged in a server (not shown) (for example, a server on the cloud). In this case, each functional block arranged in the user terminal 10, the wearable terminal 20, or the server realizes its function by transmitting and receiving necessary information to and from each other.

[0025] The sensor information acquisition unit 101 acquires sensor information from a sensor that detects the state of infant T. The start information acquisition unit 102 acquires information indicating that user U has started walking while holding infant T. The calculation unit 103 calculates, based on the sensor information, at least one of heart rate information regarding the heart rate of infant T and an infant condition score indicating whether infant T is in a state ranging from crying to sleeping. The output unit 104 outputs information indicating at least one of the heart rate information and the infant condition score in real time. The notification unit 105 outputs notification information that notifies user U of childcare actions that should be taken to stop infant T crying or promote sleep based on at least one of the time elapsed since user U started walking while holding infant T. Details of each of these units will be described below in the "Flow of information processing method S1."

[0026] (Flow of information processing method S1) The flow of the information processing method S1 executed by the information processing system 1 configured as above will be described with reference to Fig. 6. Fig. 6 is a flow diagram illustrating the flow of the information processing method S1. As shown in Fig. 6, the information processing method S1 includes steps S101 to S109.

[0027] In step S101, processor 11 acquires information indicating the support mode selected by the operation of user U. The support mode is a mode that supports user U's child-rearing behavior for infant T. Here, the support modes include a crying cessation support mode, a sleep-putting support mode, and a wake-up prediction mode.

[0028] The crying stop support mode is a mode that promotes the stopping of crying infant T. This support mode supports the childcare behavior of the user U, for example, when infant T is crying in a situation (e.g., daytime) where it is okay for the user U to be awake as long as infant T has stopped crying. Childcare behaviors that should be performed to promote the stopping of crying of infant T include behaviors related to walking while holding infant T. Details of this support mode will be described later.

[0029] The sleep support mode is a mode for promoting sleep for a crying infant T. This support mode supports the childcare behavior of the user U, for example, when the infant T is crying in a situation where it is desirable for the infant T to sleep (for example, during nap time or at night). Childcare behaviors that should be performed to promote the putting of the infant T to sleep include walking while holding the infant T, sitting while holding the infant T, and actions related to putting the infant T to sleep. Details of this support mode will be described later.

[0030] The awakening prediction mode is a mode for predicting the awakening of a sleeping infant T. This support mode supports the child-rearing behavior of the user U before and after the awakening of the sleeping infant T, for example, by predicting the awakening of the sleeping infant T. Details of this support mode will be described later.

[0031] A specific example of step S101 will be described with reference to FIG. 7. FIG. 7 is a diagram showing an example of a screen for selecting an assistance mode. As shown in FIG. 7, processor 11 displays user interface (UI) objects D1 to D3 on touch panel 14. Each of UI objects D1 to D3 is an object that accepts an operation to select an assistance mode. Each of UI objects D1 to D3 corresponds to an assistance mode (stop crying assistance mode, put-to-sleep assistance mode, or awakening prediction mode) displayed within the object. Processor 11 acquires information indicating the assistance mode corresponding to the object that accepted the operation.

[0032] 6, the processor 11 (start information acquisition unit 102) acquires information indicating that the user U has started walking while holding the infant T. This step is executed in the stop crying support mode or the put-to-sleep support mode, and is omitted in the awakening prediction mode.

[0033] A specific example of step S102 will be described with reference to FIG. 8. FIG. 8 is a schematic diagram illustrating a specific example of the crying cessation support mode. As shown in schematic diagram EX1 in FIG. 8, the processor 11 displays a UI object D4 on the touch panel 14. The UI object D4 is an object that accepts an operation to start the support mode. The user U puts the wearable device 20 on the crying infant T in bed B and operates the UI object D4. Furthermore, upon accepting the operation on the UI object D4, the processor 11 outputs notification information N1 to the audio output device 30. The notification information N1 is information that notifies the user U to start walking while holding the baby, and is, for example, audio information such as "Let's walk while holding the baby." However, the content and output destination of the notification information N1 are not limited to the above example. As a result, as shown in schematic diagram EX2, the user U starts walking while holding the infant T. In this specific example, the processor 11 accepts the operation on the UI object D4, thereby obtaining information indicating the start of walking while holding the infant T.

[0034] In step S103 of FIG. 6, the processor 21 of the wearable terminal 20 acquires sensor information (information indicating pulse waves, body movements, and voice) detected by the pulse wave sensor 24, body movement sensor 25, and voice sensor 26. The processor 21 also transmits the acquired sensor information to the user terminal 10. The processor 21 repeatedly transmits the sensor information to the user terminal 10. The processor 21 may transmit the sensor information in response to a request from the user terminal 10. The processor 21 may also transmit the sensor information to the user terminal 10 at predetermined intervals.

[0035] In step S104 (sensor information acquisition step, calculation step), the processor 11 (sensor information acquisition unit 101) of the user terminal 10 acquires sensor information from the wearable terminal 20. The processor 11 (calculation unit 103) calculates at least one of the IBI and the ISS based on the acquired sensor information. The IBI is an example of "heart rate information related to the heart rate of infant T" as claimed in the patent claims. The ISS is an example of "infant condition score indicating the state of infant T, from crying to sleeping." The processor 11 repeatedly calculates at least one of the IBI and the ISS.

[0036] (7-level ISS) Here, in the initial setting, the processor 11 calibrates (adjusts) the relationship between the ISS and the IBI and sensor information so as to represent the characteristics of the individual infant T of interest. Details of the initial setting will be described later. In this embodiment, a calibrated 7-level ISS is used instead of the theoretical ISS values ​​ranging from -1 to 1 described above. Specifically, the processor 11 associates, for example, the 7-level ISS values ​​with the IBI, sensor information, etc.

[0037] A concrete example of the seven stages is shown below. Stage 1: 100-51% crying (the proportion of infant T's vocalization time per unit time is 100-51%) Stage 2: 1-50% crying (the proportion of the above is 1-50%) Stage 3: No crying, active wakefulness (more body movement than stage 4) Stage 4: No crying, inactive wakefulness (less movement than Stage 3) Stage 5: Drowsy (sleepy, yawning, eyes closing and opening) Stage 6: Light sleep (eyes closed, but occasional eye twitching or body movement) Stage 7: Deep sleep (eyes closed, limbs and facial expression not moving) However, specific examples of the seven stages are not limited to those described above. For example, the range of crying that defines stage 1 and stage 2 is not limited to the range described above, and may be another range. For example, the value of 50% (51%) of crying that separates stage 1 and stage 2 may be another value. Furthermore, the lower limit of crying that defines stage 2 may be a value greater than 1%. Furthermore, the range or threshold that defines each stage may be changeable.

[0038] In step S105 (output process, output step), the processor 11 (output unit 104) outputs information indicating at least one of the IBI and the ISS in real time. Thereafter, the processor 11 continues the process of outputting the IBI and the ISS in real time. The output destination is, for example, one or both of the touch panel 14 and the audio output device 30.

[0039] A specific example of step S105 will be described with reference to Fig. 8. As shown in schematic diagram EX2 in Fig. 8, processor 11 outputs time-varying information D5 indicating changes in IBI and ISS over time to touch panel 14. In this example, time-varying information D5 is a graph with the horizontal axis representing time and the vertical axis representing IBI and ISS. Processor 11 also updates time-varying information D5 in real time.

[0040] In step S106 of FIG. 6, processor 11 determines which assistance mode has been selected, and branches the subsequent processing depending on the determination result.

[0041] Step S107 (notification process, notification step) is executed when the crying cessation support mode is selected. In step S107, processor 11 (notification unit 105) executes notification process in the crying cessation support mode. Specifically, processor 11 outputs notification information that notifies user U of child-rearing actions that should be taken to promote infant T's cessation of crying, based on at least one of the time elapsed since user U started walking while holding the infant T, IBI, and ISS. The notification information includes first notification information, second notification information, and fourth notification information, which will be described later. Details of this step will be described later with reference to a different drawing.

[0042] Step S108 (notification process, notification step) is executed when the sleep-putting support mode is selected. In step S108, processor 11 (notification unit 105) executes notification process in the sleep-putting support mode. Specifically, processor 11 outputs notification information that notifies user U of child-rearing actions that should be taken to promote sleep of infant T, based on at least one of the elapsed time since user U started walking while holding infant T, IBI, and ISS. The notification information includes first notification information, second notification information, third notification information, and fourth notification information, which will be described later. Details of this step will be described later with reference to a different drawing.

[0043] Step S109 (notification process, notification step) is executed when the awakening prediction mode is selected. In step S109, the processor 11 (notification unit 105) executes the notification process in the awakening prediction mode. Details of this step will be described later with reference to another drawing.

[0044] (Notification process flow in soothing support mode) Details of step S107 (notification process in the crying cessation support mode) will be described with reference to Fig. 9. Fig. 9 is a flow diagram illustrating the detailed flow of step S107. As shown in Fig. 9, the process of step S107 includes steps S201 to S207.

[0045] In step S201, the processor 11 (notification unit 105) determines whether to output notification information N2 based on at least one of the time elapsed since the start of holding the baby and walking, the IBI, and the ISS. The notification information N2 will be described in detail later.

[0046] As a specific example, processor 11 determines whether (i) the elapsed time since the start of holding the baby while walking has exceeded a predetermined time (threshold T1), (ii) whether IBI has exceeded a set value (threshold IBI1), and (iii) whether ISS has exceeded a set value (threshold ISS1). In this case, processor 11 may determine "Yes" if at least one of (i), (ii), and (iii) is satisfied, and "No" if none is satisfied. Alternatively, processor 11 may determine "Yes" if all of (i), (ii), and (iii) are satisfied, and "No" if at least one of them is not satisfied.

[0047] The thresholds T1, IBI1, and ISS1 are initially set to values, the details of which will be described later.

[0048] If the determination in step S201 is No, the processor 11 repeats this step until the determination is Yes. As a result, the user U continues walking while holding the infant T while checking the changes over time in the IBI and ISS displayed on the touch panel 14.

[0049] If the determination in step S201 is Yes, step S202 is executed. In step S202, processor 11 outputs notification information N2. Notification information N2 is information notifying user U to stop walking while holding infant T, and is an example of the first notification information described in the claims. Note that notification information N2 may further include a notification to check the condition of infant T. Furthermore, notification information N2 may further include a notification to check the IBI and ISS displayed on touch panel 14.

[0050] In this way, the notification information output by processor 11 in information processing method S1 includes notification information N2 (first notification information). Furthermore, processor 11 outputs notification information N2 (first notification information) (step S202) based on at least one of the time elapsed since user U started walking while holding the user U, IBI, and ISS (the determination results of (i), (ii), and (iii) in step S201 are Yes).

[0051] A specific example of step S202 will be described with reference to Fig. 8. As shown in schematic diagram EX2 of Fig. 8, the processor 11 outputs audio information "Stop and check on the baby" as notification information N2 to the audio output device 30. However, the content and output destination of the notification information N2 are not limited to the above example. As a result, as shown in schematic diagram EX3, the user U stops while holding the infant T and checks on the baby.

[0052] In step S203 of FIG. 9, processor 11 determines whether or not crying of infant T has resumed. For example, processor 11 can determine whether or not crying has resumed based on sensor information acquired from vocalization sensor 26. For example, processor 11 may determine that crying has resumed when the proportion of the time during which infant T vocalizes per unit time is equal to or greater than threshold value SEN1. Here, in this embodiment, an initially set value is used as threshold value SEN1. Details of the initial setting will be described later.

[0053] If the determination in step S203 is Yes, step S205 (described later) is executed, whereas if the determination in step S203 is No, the next step S204 is executed.

[0054] In step S204, processor 11 determines whether the baby is in a stable state or not based on at least one of the time elapsed since output of notification information N2, IBI, and ISS.

[0055] As a specific example, processor 11 determines whether (i) the elapsed time since outputting notification information N2 (in other words, since stopping holding the baby while walking) exceeds a predetermined time (threshold T2), (ii) whether the IBI has subsided, and (iii) whether the ISS has subsided. In this case, processor 11 may determine "Yes" if at least one of (i), (ii), and (iii) is satisfied, and "No" if none is satisfied. Alternatively, processor 11 may determine "Yes" if all of (i), (ii), and (iii) are satisfied, and "No" if at least one of them is not satisfied.

[0056] The threshold value T2 is an initially set value. Details of the initial setting will be described later. Furthermore, "the IBI (or ISS) calms down" may mean, for example, "the IBI (or ISS) in the most recent predetermined period has not decreased since the comparison point when the notification information N2 was output, and the fluctuation range is within a predetermined range."

[0057] If the determination in step S204 is No, the processor 11 repeats the process from step S203. As a result, the user U stands still holding the baby T and watches the situation, as shown in schematic diagram EX3.

[0058] If the answer to step S204 is Yes, the baby T has stopped crying and is calm. In this case, the process in the crying-stop support mode ends.

[0059] On the other hand, if the determination in step S203 is Yes, the crying of the infant T has resumed. In this case, in step S205, the processor 11 determines whether the total time of walking while holding the infant T has exceeded the threshold value T3. If the determination in this step is Yes, step S207, which will be described later, is executed. If the determination in this step is No, the next step S206 is executed. Here, an initially set value is used as the threshold value T3. Details of the initial setting will be described later.

[0060] In step S206, the processor 11 outputs notification information N3 to the audio output device 30. The notification information N3 is information that notifies the user U to resume holding the user U while walking. After executing step S206, the processor 11 repeats the process from step S201. As a result, in the specific example of FIG. 8, the user U returns to the schematic diagram EX2, and repeatedly resumes and stops holding the user U while walking while walking.

[0061] If the answer to step S205 is Yes, the total time spent holding the baby while walking exceeds the threshold value T3. In this case, the next step S207 is executed.

[0062] In step S207, processor 11 outputs notification information N4 to audio output device 30. Notification information N4 is information that notifies user U to check the health condition of infant T, and is an example of the fourth notification information described in the claims. In other words, the notification information output by processor 11 in information processing method S1 includes notification information N4 (fourth notification information). Furthermore, when the total time spent walking while holding the baby exceeds threshold T3 (Yes in step S205), processor 11 outputs notification information N4 (fourth notification information) (step S207). This allows user U to stop using the stop crying support mode and pay attention to the health condition of infant T.

[0063] In this way, in the crying cessation support mode, the user U can efficiently encourage the crying baby T to stop crying by starting and stopping walking while holding the baby in his / her arms in response to the output of the notification information N1 to N4.

[0064] (Notification process flow in sleep assistance mode) Details of step S108 will be described with reference to FIG. 10. FIG. 10 is a flow diagram illustrating the detailed flow of step S108 (notification process in sleep support mode). As shown in FIG. 10, the process of step S108 includes steps S201 to S212. Steps S201 to S207 are as described with reference to FIG. 9 in the process in the stop crying support mode. However, the determination in step S201 in the sleep support mode uses a threshold IBI2 different from the threshold IBI1 in the stop crying support mode, and a threshold ISS2 different from the threshold ISS1. Furthermore, the determination in step S203 in the sleep support mode uses a threshold SEN2 different from the threshold SEN1 in the stop crying support mode. Here, steps S208 to S212 will be described.

[0065] Step S208 is executed when the determination in step S204 is Yes. In this case, infant T remains calm while being held by user U who has stopped standing. Therefore, in step S208, processor 11 (notification unit 105) outputs notification information N5. Notification information N5 is information that notifies user U to start holding and sitting, and is an example of the second notification information described in the claims. In other words, the notification information output by processor 11 in information processing method S1 includes notification information N5 (second notification information). Furthermore, processor 11 outputs notification information N5 (second notification information) based on at least one of the time elapsed since output of notification information N2 (first notification information), IBI, and ISS (the determination results of (i), (ii), and (iii) in step S204 are Yes) (step S208).

[0066] A specific example of step S208 will be described with reference to FIG. 11. FIG. 11 is a schematic diagram illustrating a specific example of the sleep-putting support mode. In the specific example of FIG. 11, diagrams EX1 to EX3 are schematic diagrams similar to the schematic diagrams EX1 to EX3 shown in FIG. 8. Schematic diagram EX4 of FIG. 11 is a schematic diagram continuing from schematic diagram EX3. As shown in schematic diagram EX4 of FIG. 11, processor 11 outputs audio information "Sit down while holding your baby" as notification information N5 to audio output device 30. However, the content and output destination of notification information N5 are not limited to the above example. As a result, user U starts to hold infant T and sit up.

[0067] 10, the processor 11 determines whether or not the crying of the baby T has resumed. Details of this step are the same as those of step S203.

[0068] If the determination in step S209 is No, the next step S210 is executed. In this case, the infant T is being held and sitting, and crying has not resumed. In step S210, the processor 11 determines whether to output the notification information N6 (third notification information) based on at least one of the time elapsed since the output of the notification information N5, the IBI, and the ISS. The notification information N6 will be described in detail later.

[0069] As a specific example, processor 11 determines whether (i) the elapsed time since output of notification information N5 (in other words, since the start of hugging and sitting) exceeds a predetermined time (threshold T4), (ii) whether the IBI has subsided, and (iii) whether the ISS has subsided. In this case, processor 11 may determine "Yes" if at least one of (i), (ii), and (iii) is satisfied, and "No" if none is satisfied. Alternatively, processor 11 may determine "Yes" if all of (i), (ii), and (iii) are satisfied, and "No" if at least one of them is not satisfied.

[0070] The threshold value T4 is set to an initially set value. Details of the initial setting will be described later. The "IBI (or ISS) calms down" is as explained in step S204. However, the point in time when the notification information N5 is output is used as the comparison point in time for calming down.

[0071] If the determination in step S210 is No, the processor 11 repeats the process from step S206, thereby allowing the user U to continue holding the baby T while sitting.

[0072] If the determination in step S210 is Yes, the next step S211 is executed. In step S211, the processor 11 outputs notification information N6. The notification information N6 is information that notifies the user U to put their child to sleep, and is an example of the third notification information described in the claims. In other words, the notification information output by the processor 11 in the information processing method S1 includes notification information N6 (third notification information). Furthermore, the processor 11 outputs the notification information N6 (third notification information) based on at least one of the elapsed time since the output of the notification information N5 (second notification information), the IBI, and the ISS (the determination results of (i), (ii), and (iii) in step S210 are Yes) (step S211).

[0073] A specific example of step S211 will be described with reference to Fig. 11. As shown in schematic diagram EX5, the processor 11 outputs audio information "Let's put him to sleep" as notification information N6 to the audio output device 30. However, the content and output destination of the notification information N6 are not limited to the above example. As a result, as shown in schematic diagram EX6, the user U places the baby T away from his body on the bed B in order to put the baby T to sleep.

[0074] 10, the processor 11 determines whether or not the crying of the baby T has resumed. Details of this step are the same as those of step S203.

[0075] If the determination in step S212 is No, that is, the crying of the infant T has not resumed, the infant T is asleep and in a desirable state. Therefore, in this case, the process in the sleep assistance mode ends.

[0076] On the other hand, if the answer to step S212 is Yes, the infant T that was supposed to have been put to sleep has started crying again. Also, if the answer to step S209 is Yes, the crying of the infant T that was being held and sat has started again. In this case, the above-mentioned steps S205 to S207 are executed in the same way as when the crying started again in the crying cessation support mode. This causes the user U to return to schematic diagram EX2, and to repeat the process of restarting walking while holding the infant, stopping walking while holding the infant, starting sitting while holding the infant, putting the infant to sleep, etc. Also, if the total time spent walking while holding the infant exceeds threshold T3, the user U can stop using the sleep support mode and turn their attention to the health of the infant T.

[0077] In this way, in the sleep assistance mode, the user U can efficiently promote sleep for the crying infant T by starting and stopping walking with the infant, sitting with the infant, and putting the infant to sleep in accordance with the output of notification information N1 to N6.

[0078] (Flow of notification process in awakening prediction mode) Details of step S109 (notification processing in the awakening prediction mode) will be described with reference to Fig. 12. Fig. 12 is a flow chart illustrating the detailed flow of step S109. As shown in Fig. 12, the processing of step S109 includes steps S301 to S304.

[0079] In step S301, the processor 11 (notification unit 105) determines whether or not awakening of the infant T is predicted based on at least one of the body movement and the IBI.

[0080] As a specific example, processor 11 determines (i) whether the amount of body movement based on the sensor information obtained from body movement sensor 25 exceeds threshold value SEN3, and (ii) whether IBI exceeds threshold value IBI3. In this case, processor 11 may determine "Yes" if at least one of (i) and (ii) is satisfied, and "No" if neither is satisfied. Alternatively, processor 11 may determine "Yes" if both (i) and (ii) are satisfied, and "No" if at least one of them is not satisfied.

[0081] The thresholds SEN3 and IBI3 are initially set to values, the details of which will be described later.

[0082] If the determination in step S301 is No, step S303, which will be described later, is executed. If the determination in step S301 is Yes, the next step S302 is executed.

[0083] In step S302, the processor 11 outputs notification information N7. The notification information N7 is information that notifies the user U that the awakening of the infant T is predicted. By outputting the notification information N7, the user U can predict the awakening and take childcare actions even if the user U is in a location far away from the sleeping infant T.

[0084] On the other hand, if the determination in step S301 is No, in step S303, processor 11 determines whether to issue a warning that infant T may have stopped breathing. For example, processor 11 makes this determination based on (i) whether body movement due to breathing has stopped (whether the amount of body movement based on the sensor information obtained from body movement sensor 25 is below threshold SEN4), and (ii) whether IBI has exceeded threshold IBI4. Note that processor 11 may determine Yes in this step if both (i) and (ii) are Yes, and may determine No in this step if at least one of them is No. Processor 11 may also determine Yes in this step if at least one of (i) and (ii) is Yes, and may determine No in this step if both are No. Initially set values ​​are used as threshold SEN4 and threshold IBI4. Details of the initial setting will be described later.

[0085] If the determination in step S303 is No, the processor 11 repeats the process from step S301. If the determination in step S303 is Yes, the next step S304 is executed.

[0086] In step S304, the processor 11 outputs notification information N8. The notification information N8 is information that warns that breathing of the infant T may have stopped. By outputting the notification information N8, the user U can be aware that breathing of the infant T may have stopped even when the user U is in a location far away from the sleeping infant T, and can prevent sudden infant death syndrome (SIDS).

[0087] [Initial Settings] The following describes the initial setting of the information processing system 1. The initial setting is performed at least once before the information processing method S1 is executed for the first time for the infant T. It is also desirable that the initial setting be performed again at any time thereafter. For example, the initial setting may be performed about once a month in consideration of changes due to the growth of the infant T.

[0088] The initial setting includes the following steps S11 to S15. Note that the wearable terminal 20 is already attached to the baby T when the initial setting is performed.

[0089] In step S11, the processor 11 of the user terminal 10 establishes a connection with the wearable terminal 20 via the network interface 13. The establishment of the connection may be performed manually based on an operation by the user U, or may be performed automatically without an operation by the user U.

[0090] In step S12, processor 11 acquires sensor information (pulse wave, body movement, and voice) for each state of infant T (crying state, awake state, and deep sleep state) two to three times for 20 seconds, and stores the information in association with each state. Note that the period and number of times for acquiring sensor information are not limited to 20 seconds and two to three times. Here, the crying state is a state in which infant T is crying violently. The awake state is a state in which infant T is calmly and clearly awake. The deep sleep state is a state in which infant T is sleeping soundly and not visibly moving.

[0091] For example, processor 11 displays UI objects indicating each state on touch panel 14. For example, when infant T is in a crying state, user U operates the UI object corresponding to the crying state. When processor 11 accepts the operation, it acquires sensor information for 20 seconds. After 20 seconds have elapsed, processor 11 outputs information inquiring of user U as to whether or not there has been a change in infant T's state during recording. When processor 11 receives input indicating no change, it associates the sensor information with the crying state and saves it.

[0092] In step S13, the processor 11 sets the above-mentioned thresholds (T1 to T4, IBI1 to IBI4, ISS1 to ISS2, and SEN1 to SEN4) based on the sensor information associated with each state.

[0093] In step S14, the processor 11 calibrates the relationship between each stage of the ISS and the IBI and sensor information based on the sensor information associated with each state.

[0094] In step S15, the processor 11 outputs the IBI and ISS to the touch panel 14 in real time.

[0095] Below, preferred examples of the thresholds set by the initial setting will be described. As described above, the threshold T1, thresholds IBI1 to IBI2, and thresholds ISS1 to ISS2 are set to determine whether or not to notify the user to stop walking while holding the baby.

[0096] The threshold value T1 is the value of the elapsed time (the time elapsed since the start of carrying and walking) at which it is preferable to stop carrying and walking. For example, the threshold value T1 is desirably set to 5 minutes based on the above-mentioned "findings that form the basis of the present invention." It is desirable to set a maximum value (for example, 15 minutes) for the threshold value T1. This is because if the infant T does not stop crying even after continuing to carry and walk, health-related factors may be a factor. However, the threshold value T1 and its maximum value are not limited to the above-mentioned example.

[0097] The threshold value IBI1 is an IBI value at which walking while holding the baby may be stopped in the crying cessation support mode, and the threshold value IBI2 is an IBI value at which walking while holding the baby may be stopped in the sleep-putting support mode.

[0098] The threshold ISS1 is a value (stage) of ISS at which walking while holding the baby may be stopped in the crying cessation support mode, and the threshold ISS2 is a value (stage) of ISS at which walking while holding the baby may be stopped in the sleep-putting support mode.

[0099] The threshold value SEN1 is a value of sensor information that is set in the crying cessation support mode to determine whether or not the crying of infant T has resumed. The threshold value SEN2 is a value of sensor information that is set in the sleep-putting support mode to determine whether or not the crying of infant T has resumed. The threshold values ​​SEN1 and SEN2 may be, for example, the proportion of the time that infant T is vocalizing per unit time.

[0100] As described above, the threshold T2 is set to determine whether the baby is calm or not, and is the value of the elapsed time after the baby stops walking while being held in the arms. For example, the threshold T2 may be about 30 seconds, or may be several minutes depending on the childcare environment, but is not limited to these.

[0101] As described above, the threshold T3 is set to determine whether or not to issue a notification to check the health status of the infant T. The threshold T3 is the maximum total time for which it is preferable to stop the crying or promote sleep by walking while holding the infant T. It is desirable to set a value of 10 minutes, for example, as the threshold T3. However, the threshold T3 is not limited to the above example. This is because if the crying does not stop even after continuing to walk while holding the infant T, health issues may be a factor.

[0102] As described above, the threshold T4 is set to determine whether or not to notify the user to put the baby to sleep. The threshold T4 is the value of the elapsed time (the time elapsed since the user started holding the baby and sitting) at which it is preferable to put the baby to sleep. For example, based on the above-mentioned "findings that form the basis of the present invention," it is desirable to set the threshold T4 to a value between 5 minutes and 8 minutes. However, the threshold T4 is not limited to the above-mentioned example.

[0103] As described above, thresholds SEN3 and IBI3 are set to determine whether or not awakening of infant T is predicted. Threshold SEN3 can be calculated from the amount of body movement when infant T is awake. Threshold IBI3 can be calculated from IBI when infant T is awake. Thresholds SEN4 and IBI4 are set to determine the possibility that breathing of infant T has stopped, as described above. Threshold SEN4 can be calculated from the amount of body movement during deep sleep. Threshold IBI4 may be the upper limit or lower limit of a range that can be adopted as such a threshold.

[0104] <Effects of this embodiment> In this embodiment, notification information is output to notify the user U of the child-rearing behavior that should be performed to stop the crying or encourage the infant T to sleep, based on at least one of the IBI and ISS, the time elapsed since the user U started walking while holding the infant T. Therefore, the user U can perform the child-rearing behavior based on the notification information, and can efficiently encourage the infant T to stop crying or encourage the infant T to sleep.

[0105] Furthermore, this embodiment outputs in real time at least one of the IBI and ISS from when the user U starts walking around holding the infant T. This allows the user U to quantitatively grasp the changes in the state of the infant T caused by walking around holding the infant T, and can provide feedback on childcare actions to stop the crying or promote sleep, such as improving the way the infant T is held.

[0106] Here, the advantages of this embodiment will be explained in comparison with the system described in Patent Document 1. The system described in Patent Document 1 is based on the premise that the system detects a dozing state before sleep and prompts the caregiver to remove the pacifier from the infant's mouth at that timing. As described in this patent document, there is a risk of choking on a pacifier by a sleeping infant. Furthermore, there is a risk that the pacifier sensor may malfunction or the caregiver may fail to remove the pacifier from the infant during the dozing state before sleep. Therefore, using the system described in Patent Document 1 to put an infant to sleep is undesirable or requires careful attention. Furthermore, as mentioned above, it is difficult for crying infants to use a pacifier. Furthermore, some infants do not like pacifiers. Therefore, using the system described in Patent Document 1 does not reduce the stress on the caregiver until the infant stops crying or falls asleep.

[0107] Compared to the system described in Patent Document 1, this embodiment can provide consistent support, from stopping an infant's crying to promoting sleep, through the caregiver's child-rearing actions.

[0108] [Variation 1] Modification 1, which is a modification of the above-described embodiment, will be described. In the information processing system 1 according to Modification 1, the processor 11 (notification unit 105) outputs notification information based on information obtained from the support model. The support model is a model that receives at least one of elapsed time, IBI, and ISS as input, and outputs the success rate of the child-rearing behavior of the user U based on the notification information. In other respects, it is configured in the same way as the above-described embodiment.

[0109] Here, the assistance model is configured, for example, by a neural network that handles time-series data (specifically, a recurrent neural network (RNN), a long short-term memory (LSTM), etc.). In this case, the time-series data of the IBI and the ISS are input to the assistance model. However, the assistance model may also be configured by another neural network, a machine learning algorithm other than a neural network, or a rule-based model other than machine learning.

[0110] Furthermore, the "success rate of user U's child-rearing behavior based on notification information" is the probability that infant T will be in a desirable state when user U performs child-rearing behavior based on notification information from the information processing system 1. Hereinafter, the "success rate of user U's child-rearing behavior based on notification information" will also be simply referred to as the "success rate of notification information." Furthermore, the desirable state is, for example, "a state in which crying does not resume for a predetermined period of time," but is not limited to this.

[0111] As a more specific example, the support models include a first support model, a second support model, and a third support model. The first support model outputs a success rate of notification information N2 (first notification information). The second support model outputs a success rate of notification information N5 (second notification information). The third support model outputs a success rate of notification information N6 (third notification information). Each support model is generated using learning data. Details of the learning data will be described in Modification 2 below.

[0112] In this modification, the operation of the information processing system 1 is modified as follows: The other steps are as described above.

[0113] In step S105 of FIG. 6, the processor 11 calculates the IBI and ISS, and also inputs the time-series data of the calculated IBI and ISS into the first support model, the second support model, and the third support model.

[0114] 9 and 10, the processor 11 determines whether or not the success rate output from the first support model exceeds a threshold value.

[0115] Furthermore, in step S204 in FIGS. 9 and 10, the processor 11 determines whether or not the success rate output from the second support model exceeds a threshold value.

[0116] Furthermore, in step S210 of FIG. 10, the processor 11 determines whether or not the success rate output from the third support model exceeds a threshold value.

[0117] In this way, the information processing system 1 of this modified example outputs notification information when the success rate output from the assistance model exceeds the threshold value, and therefore, the success rate of the notification information can be made higher.

[0118] [Variation 2] Next, a second modification will be described, which is a further modification of the first modification. In the information processing system 1 according to the second modification, the processor 11 (notification unit 105) outputs notification information by referring to information obtained from a modified support model. The modified support model is the above-described modified model modified using (i) information indicating the success or failure of a child-rearing behavior based on the notification information, and (ii) at least one of the elapsed time until the notification information is output, heart rate information, and infant condition score, which have been accumulated up to that point. For example, the processor 11 accumulates information indicating the success or failure of a child-rearing behavior based on the notification information, and at least one of the elapsed time until the notification information is output, IBI, and ISS. The processor 11 also uses the accumulated information to modify the support model. In other respects, the configuration is the same as that of the first modification.

[0119] Specifically, at any point after outputting the notification information, the processor 11 acquires information indicating the success or failure of the notification information based on an operation by the user U. For example, if the user U stops walking while holding the infant T based on the notification information N2 and then the infant T starts crying again, the user U performs an operation to input information indicating "failure." Also, for example, if the user U starts sitting while holding the infant T based on the notification information N5 and the infant T does not start crying again, the user U performs an operation to input information indicating "success." Also, for example, if the user U puts the infant T to sleep based on the notification information N6 and the infant T starts crying again, the user U performs an operation to input information indicating "failure."

[0120] The processor 11 re-learns and corrects the first support model using learning data that associates the elapsed time from outputting the notification information N1 to outputting the notification information N2, the IBI and ISS for this period, and information indicating the success or failure of the notification information N2.

[0121] In addition, processor 11 re-learns and corrects the second support model using learning data that associates the elapsed time from outputting notification information N2 to outputting notification information N5, the IBI and ISS for this period, and information indicating the success or failure of notification information N5.

[0122] In addition, processor 11 re-learns and corrects the third support model using learning data that associates the elapsed time from outputting notification information N5 to outputting notification information N6, the IBI and ISS for this period, and information indicating the success or failure of notification information N6.

[0123] Such correction of the assistance model may be performed for each infant T. This allows the information processing system 1 to output notification information at a timing that provides a higher success rate for each infant T.

[0124] Furthermore, such correction of the support model may be performed using learning data obtained from multiple infants T. This allows the information processing system 1 to output notification information at a timing with a higher success rate even when sufficient learning data has not been accumulated for the target infant T.

[0125] Furthermore, such correction of the support model may be performed using learning data obtained from multiple infants T with similar attributes. Examples of attributes may include, but are not limited to, age in months, sibling composition, room environment, gender, and attributes of user U. Even when sufficient learning data has not been accumulated for the target infant T, notification information can be output at a timing with a higher success rate.

[0126] [Other Modifications] (Modification of system configuration) In the present embodiment, an example in which the information processing system 1 includes the user terminal 10, the wearable terminal 20, and the audio output device 30 has been described.

[0127] Furthermore, the information processing system 1 may include a server. The server may be, for example, a server located in a cloud. In this case, the server may perform a process of calculating the IBI and ISS. The server may also perform a process of determining whether to output notification information based on at least one of the elapsed time, the IBI, and the ISS.

[0128] Furthermore, the information processing system 1 may include an external display such as a television. In this case, the processor 11 may output the IBI and ISS in real time to the external display instead of or in addition to the audio output device 30.

[0129] Furthermore, the information processing system 1 may include a wearable terminal for the user U (for example, a smart watch) instead of or in addition to the user terminal 10.

[0130] The user terminal 10 is not limited to the above-mentioned smartphone, but may be a tablet, a notebook personal computer, a desktop personal computer, a smart speaker, or any other type of computer. The user terminal 10 may also include an audio output device 30. However, the user terminal 10 only needs to include at least a processor 11, a memory 12, and a network interface 13, and some or all of the input device, the display device, and the audio output device may be external devices.

[0131] (Variation of IBI) In the above-described embodiment, an example has been described in which IBI is used as heart rate information, but the heart rate information may be information related to heart rate other than IBI.

[0132] (ISS variant) In the above-described embodiment, an example has been described in which a seven-level ISS is used. However, the number of levels is not limited to seven. The theoretical value of the ISS may also be used as is.

[0133] Furthermore, the theoretical ISS value may be prioritized over the seven-level ISS depending on the situation. For example, calculation unit 103 may calculate the seven-level ISS when the sensor information matches the theoretical ISS value, and use the theoretical ISS value when the sensor information does not match. For example, the sensor information from body movement sensor 25 is likely to be inconsistent with the theoretical ISS value in a situation where infant T is walking while being held in one's arms. Furthermore, the sensor information from vocalization sensor 26 is likely to be inconsistent with the theoretical ISS value in a situation where there is environmental noise (e.g., television noise, rustling of clothes). In this way, by using either the seven-level ISS or the theoretical ISS value depending on the situation, an ISS that more accurately represents the state of infant T can be used.

[0134] (Modified sensor) In the above-described embodiment, the pulse wave sensor 24 is used as the sensor for detecting heartbeat information. However, the sensor for detecting heartbeat information may be another sensor (for example, an electrocardiogram Holter).

[0135] In the above-described embodiment, an example has been described in which the wearable terminal 20 includes various sensors. However, the sensor for detecting the state of the infant T may be installed externally to the wearable terminal 20. Examples of such sensors include, but are not limited to, a sensor installed in a room where the infant T is being raised, a sensor worn by the user U, and the like. In this case, the processor 11 may acquire sensor information by directly communicating with the external sensor.

[0136] (Modification of sensor information) In the above-described embodiment, an example has been described in which the sensor information includes information indicating pulse waves, body movements, and vocalizations. In addition to these, the sensor information may also include information indicating whether the eyes are open or closed. For example, information indicating whether the eyes are open or closed can be detected by a ring-type sensor worn on the finger of the user U. In this case, the user U operates the ring-type sensor upon confirming whether the eyes of the infant T are open or closed. When the ring-type sensor is operated, the processor 11 determines that the eyes have been detected as being open or closed. Furthermore, for example, the sensor information may also include information indicating body temperature, skin conductance, or oxygen partial pressure. This sensor information can be detected by, for example, a body temperature sensor, a skin conductance sensor, or an oxygen partial pressure sensor. Note that the sensor information is not limited to these, and may also include other information indicating the state of the infant T.

[0137] (Real-time output variation 1) In the above-described embodiment, an example has been described in which time-varying information D5 indicating changes in IBI and ISS over time is output. In addition, processor 11 may output predicted values ​​predicted from changes in IBI and ISS over time. Known techniques can be used to calculate predicted values ​​from changes in time-series data over time. This allows user U to know predicted changes in infant T's condition (such as whether crying is likely to resume or whether the infant is likely to calm down) while walking (or sitting) with infant T in his / her arms.

[0138] (Real-time output variation 2) In the above-described embodiment, an example has been described in which a graph with the horizontal axis representing time and the vertical axis representing IBI and ISS is used as a real-time output mode of IBI and ISS. This is not a limitation, and the processor 11 may use other output modes as the output mode. For example, the processor 11 may fill a predetermined area of ​​the touch panel 14 with a color associated with each stage of the ISS. Furthermore, for example, the processor 11 may display an icon (e.g., a face mark) associated with each stage of the ISS on the touch panel 14. Furthermore, for example, the processor 11 may output a ring tone of a pattern associated with each stage of the ISS to the audio output device 30.

[0139] (Modification of notification information) Furthermore, the notification information output by the information processing system 1 is not limited to the notification information N1 to N8 described above, and may include other notification information.

[0140] For example, the information processing system 1 may output notification information notifying key points for carrying and walking. The notification information may include, for example, information such as (i) supporting infant T with the caregiver's hand to prevent the head from shaking, (ii) increasing the area where infant T's abdomen is pressed against the caregiver's body, (iii) using a baby carrier, back carrier, sling, etc. to reduce the caregiver's burden, (iv) since it tends to get hot, in hot weather infant T should be dressed lightly, such as by removing socks, (v) walking in a well-tidy place without steps (such as a hallway), and (vi) walking at a steady pace, with fewer changes in direction if possible.

[0141] Furthermore, for example, the information processing system 1 may output notification information notifying a predicted time until the notification information N1, N2, or N6 is output. The notification information may be, for example, audio information such as "You are 80% asleep, please walk for one more minute," but is not limited to this.

[0142] Furthermore, for example, if the information processing system 1 determines that the condition of the infant T is likely to change more favorably (for example, the crying will decrease, the IBI will increase, etc.) before outputting the notification information N1, N2, or N6, it may output notification information encouraging the user U. The notification information may be, for example, audio information such as "The crying will stop soon, so please hang in there," but is not limited to this.

[0143] (Modification of notification information output destination) Furthermore, the output destination of the notification information is not limited to the audio output device 30. For example, the processor 11 may display the notification information on the touch panel 14. Furthermore, for example, the processor 11 may output the notification information by displaying the notification information on the wearable terminal for the user U or vibrating the wearable terminal for the user U.

[0144] (Modification of the save function) This embodiment may also have a storage function for storing sensor information acquired in each mode and information indicating the success or failure of childcare behaviors. The information may be stored in the memory 12 of the user terminal 10 or in cloud storage. Accordingly, this embodiment may also have a function for viewing and printing the stored information.

[0145] (Variation with optional recording mode) This embodiment may further include an optional recording mode in which at least one of the sensor information, IBI, and ISS is recorded under any circumstances. In the optional recording mode, the processor 11 acquires sensor information and calculates the IBI or ISS from the start to the end specified by the user U's operation. The processor 11 also saves at least one of the sensor information, IBI, and ISS as recorded information. The processor 11 may also save the recorded information in association with a comment or timing marker entered by the user U. This allows the user U to check the state of the baby T in any situation. For example, by using the optional recording mode, the user U can check which music the baby T is listening to calmly, whether the baby T sleeps better in a futon or in a bed, etc.

[0146] (Mode selection variation) Furthermore, although this embodiment has been described as including a crying cessation support mode, a sleep-putting support mode, and an awakening prediction mode, it is not limited to including all of these modes, and may include some of the modes.

[0147] [Software or hardware implementation examples] In the above-described embodiment, an example was described in which the functions of the information processing system 1 are realized by a program (software) stored in the memory of each device constituting the information processing system 1, which causes the processor of each device to execute each of the steps described above.

[0148] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0149] Note that each functional block of the information processing system 1 (sensor information acquisition unit 101, start information acquisition unit 102, calculation unit 103, output unit 104, and notification unit 105) is not limited to being realized by the above-mentioned program. For example, some or all of each functional block described above may be realized by a logic circuit (hardware). Also, an integrated circuit in which such a logic circuit is formed is included in the scope of the present invention. In addition, the above functions can also be realized by, for example, a quantum computer.

[0150] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

[0151] 〔summary〕 The information processing system according to aspect 1 of this embodiment includes a sensor information acquisition unit that acquires sensor information from a sensor that detects the infant's condition; a calculation unit that calculates, based on the sensor information, at least one of heart rate information regarding the infant's heart rate and an infant condition score that indicates whether the infant is in a state ranging from crying to sleeping; an output unit that outputs information indicating at least one of the heart rate information and the infant condition score in real time; and a notification unit that outputs notification information that notifies the user of childcare actions that should be taken to stop the infant crying or promote sleep based on at least one of the time elapsed since the user started walking while holding the infant, the heart rate information, and the infant condition score.

[0152] With the above configuration, after the user starts walking while holding the baby who has stopped crying, the user can perform the childcare action that should be taken to encourage the baby to stop crying or to sleep in response to the output of notification information. This allows the baby to stop crying or to sleep efficiently. As a result, the user's stress is also reduced.

[0153] The information processing system according to aspect 2 of this embodiment is the same as in aspect 1 above, and further includes a start information acquisition unit that acquires information indicating that the user has started walking while holding the infant, and the notification information includes first notification information that notifies the user to stop walking while holding the infant.

[0154] With the above configuration, the user can stop walking while holding the baby in his / her arms at an appropriate timing in response to the output of the first notification information in order to stop the baby from crying or promote sleep.

[0155] In the information processing system according to aspect 3 of this embodiment, in aspect 2 above, the notification information includes second notification information notifying the infant to start holding the baby in a sitting position, and the notification unit outputs the second notification information based on at least one of the elapsed time since the output of the first notification information, the heart rate information, and the infant condition score.

[0156] With the above configuration, the user can start holding the baby and sitting it up at an appropriate time to promote sleep in response to the output of the second notification information.

[0157] In the information processing system of aspect 4 of this embodiment, in aspect 3 above, the notification information further includes third notification information that notifies the user to put the baby to sleep, and the notification unit outputs the third notification information based on at least one of the elapsed time since the second notification information was output, the heart rate information, and the infant condition score.

[0158] With the above configuration, the user can put the baby to sleep at an appropriate time in response to the output of the third notification information to promote sleep of the baby.

[0159] The information processing system according to aspect 5 of this embodiment is any one of aspects 1 to 4 above, wherein the notification information further includes fourth notification information that notifies the user to check the health status of the infant, and the notification unit outputs the fourth notification information when the total time of carrying the infant while walking exceeds a threshold.

[0160] With the above configuration, if repeated carrying and walking does not result in the baby stopping crying or helping the baby to sleep, the user can focus their attention on the health of the baby.

[0161] The information processing system according to aspect 6 of this embodiment is any one of aspects 1 to 5 above, wherein the notification unit outputs the notification information by referring to information obtained from an assistance model, and the assistance model is a model that takes as input at least one of the elapsed time, the heart rate information, and the infant condition score, and outputs the success rate of the user's childcare behavior based on the notification information.

[0162] With the above configuration, it is possible to notify the user of the childcare actions that should be taken to stop the baby from crying or promote sleep at a timing based on the success rate.

[0163] In the information processing system according to aspect 7 of this embodiment, in aspect 6 above, the notification unit refers to information obtained from the support model modified based on information indicating the success or failure of the childcare behavior based on the notification information, and at least one of the elapsed time until the notification information is output, the heart rate information, and the infant condition score.

[0164] With the above configuration, the accuracy of the corrected model can be improved by providing feedback on the success or failure of the child-rearing behavior based on the notification information.

[0165] An information processing system according to an eighth aspect of the present embodiment is any one of the first to seventh aspects, wherein the sensor includes a sensor that detects at least one of the pulse wave, body movement, and vocalization of the infant.

[0166] With the above configuration, the condition of the infant can be detected based on the pulse wave, body movement, and vocalization.

[0167] The information processing method according to aspect 9 of this embodiment includes the steps of: acquiring sensor information from a sensor that detects the infant's condition; calculating, based on the sensor information, at least one of heart rate information regarding the infant's heart rate and an infant condition score indicating whether the infant is in a state ranging from crying to sleeping; outputting, in real time, information indicating at least one of the heart rate information and the infant condition score; and outputting, based on at least one of the time elapsed since the user started walking while holding the infant, the heart rate information, and the infant condition score, notification information that notifies the user of childcare actions that should be taken to stop the infant crying or promote sleep, based on the time elapsed since the user started walking while holding the infant.

[0168] The above configuration provides the same effects as in the first aspect.

[0169] A program according to a tenth aspect of this embodiment is a program for causing a computer to function as the information processing system according to any one of claims 1 to 8, and causes the computer to function as each of the above-mentioned units.

[0170] Some or all of the above-described embodiments can also be expressed as follows: An information processing system including one or more processors, the one or more processors executing a sensor information acquisition process for acquiring sensor information from a sensor that detects an infant's condition, a calculation process for calculating, based on the sensor information, at least one of heart rate information related to the infant's heart rate and an infant condition score that indicates whether the infant is in a state ranging from crying to sleeping, an output process for outputting information indicating at least one of the heart rate information and the infant condition score in real time, and a notification process for outputting notification information that notifies the user of child-rearing actions that should be taken to stop the infant crying or promote sleep, based on at least one of the time elapsed since the user started walking while holding the infant. The above configuration achieves the same effects as aspect 1.

[0171] The above configuration provides the same effects as in the first aspect. [Explanation of symbols]

[0172] 1. Information Processing Systems 10 User terminal 20 Wearable devices 11, 21 processors 12, 22 memory 13, 23 Network Interface 14 Touch Panel 24 Pulse wave sensor 25 Body movement sensor 26 Sensors 26 Voice Sensor 30 Audio output device

Claims

1. a sensor information acquisition unit that acquires sensor information from a sensor that detects the state of the infant; a calculation unit that calculates at least one of heart rate information related to the heart rate of the infant and an infant condition score that indicates whether the infant is in a state ranging from crying to sleeping, based on the sensor information; an output unit that outputs information indicating at least one of the heart rate information and the infant condition score in real time; a notification unit that outputs notification information that notifies the user of child-rearing actions that should be taken to stop the crying of the infant or promote sleep, based on at least one of the time that has elapsed since the user started walking while holding the infant, the heart rate information, and the infant condition score; An information processing system comprising:

2. a start information acquisition unit that acquires information indicating that the user has started walking while holding the infant; The notification information includes first notification information notifying the user to stop walking while holding the baby. The information processing system according to claim 1 .

3. the notification information includes second notification information notifying the user to start hugging and sitting, the notification unit outputs the second notification information based on at least one of the elapsed time since the output of the first notification information, the heart rate information, and the infant condition score. The information processing system according to claim 2 .

4. The notification information further includes third notification information that notifies the user to put the baby to sleep, the notification unit outputs the third notification information based on at least one of the elapsed time since the second notification information was output, the heart rate information, and the infant condition score. The information processing system according to claim 3 .

5. the notification information further includes fourth notification information that notifies the user to check the health status of the infant; The notification unit outputs the fourth notification information when the total time of the holding-walking exceeds a threshold.

3. The information processing system according to claim 1.

6. the notification unit outputs the notification information by referring to information obtained from the assistance model; The support model is At least one of the elapsed time, the heart rate information, and the infant condition score is input, a model that outputs a success rate of the user's child-rearing behavior based on the notification information; 3. The information processing system according to claim 1.

7. The notification unit Information indicating the success or failure of the childcare behavior based on the notification information; and At least one of the elapsed time until the notification information is output, the heart rate information, and the infant condition score; The information processing system according to claim 6 , wherein the information processing system refers to information obtained from the assistance model that has been modified based on the above formula.

8. The sensor includes a sensor for detecting at least one of a pulse wave, a body movement, and a vocalization of the infant.

3. The information processing system according to claim 1.

9. a sensor information acquisition step of acquiring sensor information from a sensor that detects the state of the infant; a calculation step of calculating at least one of heart rate information relating to the heart rate of the infant and an infant condition score indicating whether the infant is in a state ranging from crying to sleeping, based on the sensor information; an output step of outputting information indicating at least one of the heart rate information and the infant condition score in real time; a notification step of outputting notification information to notify the user of childcare actions to be taken to stop the crying of the infant or promote sleep of the infant, based on at least one of the time elapsed since the user started walking while holding the infant, the heart rate information, and the infant condition score; 2. An information processing method, comprising:

10. One or more 3. A program for causing a computer to function as the information processing system according to claim 1 or 2, the program causing the computer to function as each of the above units.

Images