Information processing device and information processing method
The system addresses limitations in infant emotion inference by generating comprehensive feedback using attribute and behavior data from multiple infants, enhancing childcare through tailored advice and alerts.
Patent Information
- Application Number
- JP2023095321
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-09
- Publication Date
- 2024-12-19
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing systems for inferring infant emotions from crying provide limited information to users, primarily focusing on individual infants without considering broader context or trends among multiple infants.
An information processing system that acquires attribute and behavior information from multiple infants, generates feedback information based on comparisons, and provides it to guardians or third parties, including alerts and advice tailored to individual infants' conditions and environmental factors.
Enhances the usefulness of feedback by considering broader trends and environmental factors, reducing user input burden, and providing timely, accurate advice and alerts for improved childcare.
Smart Images

Figure 2024176615000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device and an information processing method. [Background technology]
[0002] Conventionally, a system is known that uses an algorithm to infer an infant's emotions (reason for crying), such as "lonely" or "angry," by analyzing the infant's crying (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2023-56870 A Summary of the Invention [Problem to be solved by the invention]
[0004] According to the above system, the diagnosis result of the crying of the infant can be utilized for childcare. However, the information provided to the user in the above system is only about the target infant. Therefore, the above system has room for improvement in terms of providing more useful information to the user.
[0005] An object of one aspect of the present disclosure is to provide an information processing device and an information processing method that are capable of providing more useful information regarding infants and young children. [Means for solving the problem]
[0006] An information processing device according to one aspect of the present disclosure includes a first acquisition unit that acquires attribute information indicating attributes of each of a plurality of infants, a second acquisition unit that acquires behavioral information regarding the behavior of each of the plurality of infants, a generation unit that generates feedback information for one of the plurality of infants based on the attribute information and behavioral information of each of the plurality of infants, and a provision unit that provides the feedback information to a guardian of the infant or a third party having a specified relationship with the infant. Effect of the Invention
[0007] According to one aspect of the present disclosure, it is possible to provide an information processing device and an information processing method capable of providing more useful information regarding infants and young children. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of an overall configuration and processing of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a functional configuration of each element constituting the information processing system. [Diagram 3] FIG. 3 is a diagram showing an example of attribute information, facility information, and rental information. [Figure 4] FIG. 4 is a diagram illustrating an example of the behavior information and the environment information. [Diagram 5] FIG. 5 is a diagram illustrating an example of a hardware configuration of the management server. [Figure 6] FIG. 6 is a flowchart showing an example of the operation of the management server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] The present disclosure includes at least the following [1] to
[13] .
[0010] [1] An information processing device comprising: a first acquisition unit that acquires attribute information indicating attributes of each of a plurality of infants; a second acquisition unit that acquires behavioral information regarding the behavior of each of the plurality of infants; a generation unit that generates feedback information for one of the plurality of infants based on the attribute information and behavioral information of each of the plurality of infants; and a provision unit that provides the feedback information to a guardian of the infant or a third party having a specified relationship with the infant.
[0011] According to the information processing device, it is possible to generate and provide more useful feedback information for a single infant that takes into account information on other infants, based not only on attribute information and behavior information about a single infant, but also on attribute information and behavior information about each of a plurality of infants, including infants other than the single infant. This makes it possible to provide more useful information about infants.
[0012] [2] The information processing device of [1], wherein the first acquisition unit acquires information about the infant managed in a facility related to the infant as attribute information.
[0013] According to the above-mentioned configuration [2], accurate information on infants can be easily obtained as attribute information. Also, by obtaining information that is already managed in this way, the guardians of infants can be saved from the trouble of inputting new attribute information.
[0014] [3] An information processing device according to [1] or [2], wherein the first acquisition unit further acquires contact information of a person in charge of a facility related to the infant or young child, and the provision unit provides feedback information to the third-party person in charge based on the contact information.
[0015] According to the configuration of [3] above, by providing feedback information to a third party related to the infant, rather than to the infant's guardian, the third party can first confirm the content of the feedback information, and then provide the feedback information together with the third party's knowledge to the guardian. This makes it possible to provide the third party with information (feedback information) that is useful for the third party to give advice to the guardian, and also to provide the guardian with useful information (feedback information appropriately modified or supplemented by the third party) via the third party.
[0016] [4] The second acquisition unit is an information processing device according to any one of [1] to [3], which acquires, as behavioral information, information relating to the behavior of an infant detected by a sensor device loaned to a guardian of the infant.
[0017] [5] The information processing device of [4], wherein the information regarding the infant's behavior detected by the sensor device includes audio data of the infant's crying.
[0018] According to the above-mentioned configurations [4] and [5], the guardian does not need to manually input and transmit behavioral information about the infant's behavior, which reduces the guardian's work. In addition, when a mechanism for manually inputting and transmitting behavioral information is adopted, guardians may miss inputting information. However, according to the above-mentioned configurations, there is no need to worry about such inputting information.
[0019] [6] The information processing device of [4] or [5], wherein the first acquisition unit further acquires rental information including a date set in relation to the rental of the sensor device, and the provision unit provides feedback information based on the date included in the rental information.
[0020] According to the above configuration [6], the timing for providing the feedback information can be appropriately set based on the date set in relation to the rental of the sensor device.
[0021] [7] An information processing device according to any one of [4] to [6], wherein the second acquisition unit further acquires environmental information regarding the environment in which the infant is placed, the environmental information being acquired by a sensor device, and the generation unit generates feedback information based on the environmental information of each of the multiple infants.
[0022] According to the configuration of [7] above, by taking into account environmental information in addition to behavioral information of infants, it is possible to generate feedback information that is more useful for improving the childcare environment for infants.
[0023] [8] An information processing device according to any one of [1] to [7], wherein the generation unit generates, as feedback information for the infant, information including information indicating the state of the infant identified based on a comparison of behavioral information about the infant with behavioral information about other infants.
[0024] According to the configuration of [8] above, by generating feedback information indicating the state of a specific infant by comparing it with the tendencies of other infants, it is possible to provide useful feedback information to guardians or third parties.
[0025] [9] An information processing device according to any one of [1] to [8], wherein the generation unit generates, as feedback information for the infant, information including alert information indicating that an indicator regarding the condition of the infant, which is identified based on a comparison of behavioral information about the infant with behavioral information about other infants, has exceeded a predetermined threshold.
[0026] According to the configuration [9] above, when it is determined that the condition of a certain infant deviates to a certain extent from the tendencies of other infants, alert information indicating this is generated as feedback information, making it possible to provide useful feedback information to guardians or third parties.
[0027]
[10] The information processing device according to any one of [1] to [9], wherein the generation unit generates information including advice for a guardian of an infant as feedback information for the infant.
[0028] According to the above configuration
[10] , appropriate advice information according to the condition of a particular infant can be provided to a guardian or a third party.
[0029]
[11] An information processing device according to any one of [1] to
[10] , wherein a generation unit generates information including effectiveness information indicating the effectiveness of a prescription as feedback information for an infant based on a condition of the infant identified based on behavioral information acquired about the infant and prescription information indicating the contents of a prescription implemented for the infant, and a provision unit provides the feedback information for the infant to a person in charge of the prescription.
[0030] According to the configuration
[11] above, by providing the person in charge of the prescription with efficacy information, the person in charge can properly understand whether the prescription was effective or not.
[0031]
[12] The information processing device of
[11] , wherein, when the effectiveness information indicates that the content of the prescription is not appropriate, the generation unit further generates candidate information indicating other prescription candidates for the infant as part of the feedback information for the infant.
[0032] According to the configuration of
[12] above, when it is determined that the prescription is ineffective, by including candidate information in the feedback information, it is possible to provide more useful information to the person in charge of considering the prescription contents for an infant.
[0033]
[13] An information processing method, comprising: causing a computer to execute a first acquisition step of acquiring attribute information indicating the attributes of each of a plurality of infants; a second acquisition step of acquiring behavioral information relating to the behavior of each of the plurality of infants; a generation step of generating feedback information for one of the plurality of infants based on the attribute information and behavioral information of each of the plurality of infants; and a provision step of providing the feedback information to a guardian of the infant or a third party having a predetermined relationship with the infant.
[0034] [Embodiment] Hereinafter, an embodiment of the present disclosure will be described in detail with reference to the drawings. In the following description, the same or corresponding elements are designated by the same reference numerals, and duplicated description will be omitted.
[0035] [1. Overall composition] With reference to FIG. 1, an example of the overall configuration and processing of an information processing system 1 according to an embodiment will be described. As shown in FIG. 1, the information processing system 1 has a management server 10 (information processing device), a facility terminal 20 installed in a facility L1, a sensor device 30 installed in a home L2 where an infant is present, an analysis server 40, and a guardian terminal 50 held by the guardian of the infant. The management server 10 is communicably connected to the facility terminal 20, the sensor device 30, the analysis server 40, and the guardian terminal 50 via any wired or wireless communication network N. The management server 10 is communicable with each of the sensor devices 30 in a plurality of homes L2, and manages each of the infants in the plurality of homes L2. The information processing system 1 may also include a plurality of facilities L1.
[0036] The facility L1 is a facility that has a certain relationship with infants (for example, a facility that provides some kind of treatment, care, advice, etc. regarding infants). Examples of the facility L1 include a postpartum care center, a maternity hospital, a midwifery clinic, and an infant sleep consultant. In this embodiment, the facility L1 has a role of lending (renting) the sensor device 30 to the guardian of an infant.
[0037] A home L2 is a home environment in which there are infants who are the targets of management by the management server 10. In this embodiment, a sensor device 30 is installed for each infant in each home L2. The sensor device 30 is configured to acquire (detect) the crying voice of the infant (audio data) and environmental information (temperature, humidity, air cleanliness, etc.) of the environment in which the infant is placed.
[0038] An example of the overall processing of the information processing system 1 will be described with reference to Fig. 1. First, a person in charge of a facility L1 lends a sensor device 30 to a guardian of an infant in a certain home L2 (step S1). At that time, the person in charge of the facility L1 operates the facility terminal 20 to transmit attribute information on the attributes of the infant to whom the sensor device 30 is to be loaned, facility information on the facility L1, rental information for managing the loan of the sensor device 30, and the like to the management server 10 (step S2). The information transmitted to the management server 10 (basic information, described later) is stored and managed in the management server 10.
[0039] The sensor device 30 rented in step S1 is placed near an infant in home L2. The infant's crying (audio data) and environmental information detected by the sensor device 30 are transmitted to the management server 10 at any time (step S3). The transmission of the audio data or environmental information from the sensor device 30 to the management server 10 is performed, for example, periodically at a predetermined time interval.
[0040] When the management server 10 acquires the voice data from the sensor device 30, it transmits the voice data to the analysis server 40 and causes the analysis server 40 to analyze the voice data. The analysis server 40 analyzes the voice data to acquire an estimation result (analysis result) of the infant's emotion and returns it to the management server 10 (step S4).
[0041] By carrying out steps S1 to S4 for a plurality of homes L2 (i.e., a plurality of infants), the management server 10 accumulates basic information (in this embodiment, attribute information, facility information, and rental information) on each of the plurality of infants, behavioral information (in this embodiment, information including the above-mentioned voice data and analysis results) and environmental information on each of the plurality of infants. The management server 10 generates feedback information for each infant based on this information (step S5). The management server 10 provides the feedback information generated for one infant to the guardian of the infant (for example, the guardian terminal 50 of the guardian) (step S6). Alternatively (or in addition to providing the information to the guardian in step S6), the management server 10 provides the information to a third party having a predetermined relationship with the infant (in this embodiment, the person in charge of the facility L1 that lent the sensor device 30 to the guardian of the infant) (step S7).
[0042] The above steps S1 to S7 realize a system that can appropriately provide useful information (feedback information) about an infant to a guardian or a person in charge of the facility L1. That is, the guardian or a person in charge of the facility L1 can appropriately use the feedback information to help with raising an infant.
[0043] [2. Information Processing System Configuration] Next, each element constituting the information processing system 1 will be described with reference to FIG.
[0044] (Facility terminal) The facility terminal 20 is a terminal installed in the facility L1 and used by a person in charge of the facility L1. The occupation of the person in charge of the facility L1 may differ for each facility L1. For example, if the facility L1 is a postpartum care center, the person in charge of the facility L1 may be a nursery teacher working at the facility L1. If the facility L1 is a maternity hospital, midwifery clinic, or the like, the person in charge of the facility L1 may be a doctor, midwife, or the like working at the facility L1. The facility terminal 20 is not limited to a specific type of terminal, but may be configured, for example, by a desktop PC, a laptop PC, a tablet terminal, or the like. The facility terminal 20 includes a registration unit 21, a transmission / reception unit 22, and a notification unit 23.
[0045] The registration unit 21 registers basic information (attribute information, facility information, and rental information) on the infant to whom the sensor device 30 is to be loaned. The registration unit 21 may acquire the attribute information, facility information, and rental information to be registered by accepting an input operation from a person in charge of the facility L1, or may acquire a part or all of the attribute information and facility information to be registered by referring to a database or the like managed by the facility L1.
[0046] Fig. 3 is a diagram showing an example of basic information (attribute information, facility information, and rental information). As shown in Fig. 3, the basic information about a certain infant is associated with uniquely identifiable identification information. In the present embodiment, as an example, a rental ID issued in response to rental of the sensor device 30 to the infant functions as the above-mentioned identification information.
[0047] The attribute information is information on the attributes of the infant to whom the sensor device 30 is to be lent, and includes, for example, the name, sex, date of birth, age (months), weight, height, prescription information, guardian information, and the like. The prescription information is information that records a prescription given to an infant by a person in charge of the facility L1. In this embodiment, the term "prescription" broadly means any treatment, advice, prescription, and the like for improving some symptoms of an infant (e.g., sleep disorder, and the like), and may include anything other than medical procedures (e.g., advice from an infant sleep consultant, and the like). The prescription information includes information indicating the contents of the prescription and the date of implementation. The guardian information is information on the guardian of the infant, and includes, for example, information indicating the guardian's contact information (the recipient of feedback information). The facility information includes information indicating the name (facility name) of the facility L1, the name (name of the person in charge) of the person in charge, and the contact information (the recipient of feedback information), and the like. The rental information includes the rental date, return date, advice date, and the like of the sensor device 30. The advice date is the date on which the person in charge of the facility L1 gives advice to the guardian to whom the sensor device 30 is to be lent. The advice date is set, for example, based on the rental date. The advice here is based on the condition of the baby (crying time, crying analysis result, etc.) detected by the sensor device 30, and is implemented based on the professional knowledge of the person in charge at the facility L1.
[0048] The transmitting / receiving unit 22 has a function of transmitting information registered by the registration unit 21 (in this embodiment, the attribute information, facility information, and rental information shown in FIG. 3) to the management server 10. The transmitting / receiving unit 22 also has a function of receiving feedback information transmitted from the management server 10 to the facility terminal 20.
[0049] Notification unit 23 notifies the user of facility terminal 20 (i.e., the person in charge of facility L1) of the feedback information received by transmission / reception unit 22. Notification unit 23 notifies the user of facility terminal 20 of the feedback information, for example, by displaying the content of the feedback information (e.g., information shown by characters, images, etc.) on the display of facility terminal 20 or by outputting the content of the feedback information as audio from a speaker of facility terminal 20.
[0050] (Sensor device) The sensor device 30 is placed near the baby in the baby's home L2. As an example, the sensor device 30 is a dedicated device configured to detect and acquire the baby's crying sound. The sensor device 30 includes a voice acquisition unit 31, an environmental information acquisition unit 32, and a transmission unit 33.
[0051] The voice acquisition unit 31 detects the crying of an infant and acquires the voice data (behavioral information) of the crying. The environmental information acquisition unit 32 acquires environmental information related to the environment in which the infant is placed (i.e., the environment in which the sensor device 30 is placed).
[0052] Fig. 4 is a diagram showing an example of behavioral information including voice data acquired by the voice acquisition unit 31 and environmental information acquired by the environmental information acquisition unit 32. As shown in Fig. 4, the behavioral information includes the crying start time, crying end time, and voice of a series of crying actions of an infant detected by the sensor device 30 (i.e., actions during the period from when the crying starts to when the crying stops). The analysis results included in the behavioral information shown in Fig. 4 are supplemented by the processing of the analysis server 40 described later. That is, when crying actions are detected by the sensor device 30, the data corresponding to the analysis results is blank. The environmental information also includes the acquisition time indicating the time when the environmental information was acquired (detected), room temperature, humidity, air cleanliness, etc.
[0053] The voice acquisition unit 31 acquires the above behavioral information for each series of crying behavior, for example. For example, consider a case where an infant starts crying at 15:00, stops crying at 15:05, starts crying again at 15:15, and stops crying at 15:20. In this case, first behavioral information associated with crying start time "15:00", crying end time "15:05", and crying voice data from "15:00 to 15:05" and second behavioral information associated with crying start time "15:15", crying end time "15:20", and crying voice data from "15:15 to 15:20" are acquired separately. Meanwhile, the environment information acquisition unit 32 acquires the above environment information, for example, at a predetermined interval (for example, 5 minutes).
[0054] The voice acquisition unit 31 may generate behavioral information in a format that can be transmitted to the management server 10 by the transmission unit 33 described later even during the series of crying actions (i.e., the time when the "crying end time" has not been determined). For example, with respect to the above-mentioned first behavioral information, the voice acquisition unit 31 may generate behavioral information (part of the first behavioral information) for example, in one-minute units after the crying action starts at 15:00, and combine the newly generated behavioral information with the previously generated behavioral information until the crying action is completed. According to such a mechanism, the behavioral information can be generated even while the series of crying actions are continuing, and the behavioral information can be transmitted to the management server 10 in real time by the transmission unit 33 described later. Note that blank information (or information indicating that the crying action is continuing) may be stored in the "crying end time" of such behavioral information.
[0055] The transmission unit 33 transmits the above-mentioned behavioral information and environmental information to the management server 10. As shown in Fig. 4, the information (behavioral information + environmental information, or only environmental information) transmitted from the transmission unit 33 to the management server 10 is associated with a rental ID. This makes it possible for the management server 10 to manage attribute information, facility information, rental information, behavioral information, and environmental information for each infant (i.e., for each rental ID).
[0056] (Analysis server) The analysis server 40 is a server that provides an external service of analyzing voice data (voice of an infant crying). In this embodiment, the management server 10 is configured to use the analysis server 40 through API linkage. The analysis server 40 includes an analysis unit 41 that estimates the emotion of an infant by analyzing the voice data (voice of an infant crying) acquired by the sensor device 30. The analysis unit 41 acquires voice data from the management server 10 and performs a known analysis process (for example, a process using an emotion estimation algorithm disclosed in Non-Patent Document 1) on the voice data to estimate the reason for the crying (i.e., the emotion of the infant), such as "I'm hungry" or "I'm sleepy." The analysis unit 41 returns the analysis result indicating the emotion of the infant thus estimated to the management server 10.
[0057] (Parent device) The parent terminal 50 is a terminal used by a parent of an infant. The parent terminal 50 is not limited to a specific type of terminal, but may be configured, for example, as a desktop PC, a laptop PC, a tablet terminal, a smartphone, etc. The parent terminal 50 includes a receiving unit 51 and a notifying unit 52.
[0058] The receiving unit 51 has a function of receiving feedback information transmitted from the management server 10 to the parent terminal 50. The notifying unit 52 notifies the user of the parent terminal 50 (i.e., the parent of the infant) of the feedback information received by the receiving unit 51. The notifying unit 52 notifies the feedback information by, for example, displaying the contents of the feedback information on the display of the parent terminal 50 or outputting the contents of the feedback information as audio from the speaker of the parent terminal 50. Alternatively, a dedicated app (application software) may be installed in the parent terminal 50, and the parent terminal 50 may be configured to be able to receive and view the feedback information via the dedicated app. In this case, the dedicated app may function as the receiving unit 51 and the notifying unit 52 described above.
[0059] (Management Server) The management server 10 cooperates with the above-mentioned facility terminal 20, sensor device 30, analysis server 40, and parent terminal 50, and is a device that constitutes the core of the information processing system 1. The management server 10 may be physically configured by one or more computer devices.
[0060] Fig. 5 is a diagram illustrating an example of a hardware configuration of the management server 10. As illustrated in Fig. 5, the management server 10 includes, as hardware components, a processor 101, a memory 102, an auxiliary storage device 103, a communication device 104, an input device 105, and an output device 106.
[0061] The processor 101 is a computing device that executes an operating system and application programs. Examples of the processor 101 include a central processing unit (CPU) and a graphics processing unit (GPU).
[0062] The memory 102 is a device that stores programs for implementing the management server 10, calculation results output from the processor 101, etc. The memory 102 is configured, for example, by a ROM (Read Only Memory) or a RAM (Random Access Memory).
[0063] The auxiliary storage device 103 is generally a device capable of storing a larger amount of data than the memory 102. The auxiliary storage device 103 is configured by a non-volatile storage medium such as a hard disk, a flash memory, etc. The auxiliary storage device 103 stores a program P (information processing program) for causing a computer to function as the management server 10 and various data.
[0064] The communication device 104 is a device that executes data communication with other computers via the communication network N. The communication device 104 is configured by, for example, a network card or a wireless communication module.
[0065] The input device 105 is a device that accepts input operations by a user (an operator of the management server 10). The input device 105 is configured by, for example, a keyboard, a mouse, and the like.
[0066] The output device 106 is a device that outputs data processed or managed (stored) by the management server 10. The output device 106 is configured by, for example, a display device (display) such as a monitor or a touch panel, a speaker that outputs sound, and the like.
[0067] 2 is realized by loading program P into processor 101 or memory 102 and executing program P. Program P includes code for realizing each functional element of management server 10. Processor 101 operates communication device 104 in accordance with program P, and reads and writes data in memory 102 or auxiliary storage device 103. Each functional element of management server 10 is realized by such processing.
[0068] 2, the management server 10 includes a first acquisition unit 11, a second acquisition unit 12, a generation unit 13, a provision unit 14, and a storage unit 100. Fig. 6 is a flowchart showing an example of the operation of the management server 10 (an example of an information processing method).
[0069] The first acquisition unit 11 acquires attribute information indicating the attributes of each of a plurality of infants (step S11 in FIG. 6: first acquisition step). As described above, in this embodiment, the first acquisition unit 11 acquires attribute information by receiving basic information (i.e., information in which the rental ID, attribute information, facility information, and rental information are associated with each other) transmitted from the transmission / reception unit 22 of the facility terminal 20. That is, every time a sensor device 30 is lent to a guardian of an infant in a certain home L2 by a person in charge of the facility L1, the first acquisition unit 11 receives (acquires) basic information related to the infant from the facility terminal 20 of the facility L1. That is, in this embodiment, the first acquisition unit 11 acquires, in addition to the attribute information of the infant, contact information of a person in charge of the facility L1 related to the infant, and rental information including dates set in relation to the rental of the sensor device 30 (rental date, return date, and advice date in the example of FIG. 3) from the facility terminal 20. The basic information of each infant (see FIG. 3) acquired by the first acquisition unit 11 is stored in the storage unit 100.
[0070] In this embodiment, the attribute information is information about an infant managed by a facility L1 related to the infant. Usually, a database owned by the facility L1 (e.g., a data storage device accessible from the facility terminal 20) stores basic registration information such as the name and sex of an infant related to the facility L1 (e.g., an infant who is the subject of postpartum care or infant sleep consulting), as well as information (e.g., a medical record) indicating the prescription contents performed for the infant. The first acquisition unit 11 can easily acquire accurate information about an infant as attribute information by acquiring information stored in such a database as attribute information of the infant. Also, by acquiring information that has already been managed in this way, it is possible to save the trouble of the person in charge of the facility L1 or the guardian who is lent the sensor device 30 from newly inputting attribute information.
[0071] The second acquisition unit 12 acquires behavioral information on the behavior of each of the multiple infants (step S12 in FIG. 6: second acquisition step). As described above, in this embodiment, the second acquisition unit 12 acquires information on the behavior of the infant detected by the sensor device 30 lent to the guardian of the infant (information including audio data of the infant's crying in this embodiment) as behavioral information. That is, the second acquisition unit 12 acquires behavioral information of the infant by receiving data on the crying of the infant automatically detected by the sensor device 30 from the sensor device 30. With this configuration, the guardian does not need to manually input and transmit behavioral information on the behavior of the infant, so the guardian's work can be reduced. In addition, when a mechanism for manually inputting and transmitting behavioral information is adopted, there is a possibility that the guardian will miss inputting information, but with the above configuration, there is no need to worry about such a miss. Furthermore, since it is difficult to input behavioral information while the infant is crying, even if the guardian registers the behavioral information without missing anything, the behavioral information is transmitted to the management server 10 after the period during which the infant was actually active. That is, a large time lag may occur between the actual behavioral period of the infant (period during which the infant was crying) and the timing when behavioral information regarding the behavior is transmitted to the management server 10. In contrast, according to the present embodiment, the behavioral information is automatically uploaded (transmitted) to the management server 10 via the sensor device 30, so that the behavioral information can be automatically and timely registered in the management server 10.
[0072] The second acquisition unit 12 transmits the voice data included in the behavioral information acquired from the sensor device 30 as described above to the analysis server 40, and causes the analysis server 40 to analyze the voice data. Then, the second acquisition unit 12 acquires the analysis result (information indicating the emotion of the infant estimated from the voice data) of the analysis server 40. The behavioral information (including the analysis result) acquired by the second acquisition unit 12 in this manner is stored in the storage unit 100 in association with the rental ID.
[0073] The second acquisition unit 12 further acquires environmental information (see FIG. 4) related to the environment in which the infant is placed, which is acquired by the sensor device 30. For example, the second acquisition unit 12 acquires environmental information from the sensor device 30 at a predetermined interval (for example, 5 minutes). The environmental information acquired by the second acquisition unit 12 in this manner is stored in the storage unit 100 in association with the rental ID.
[0074] The generation unit 13 generates feedback information for one of the multiple infants (hereinafter referred to as the "target infant") based on the attribute information (see FIG. 3) and behavioral information (see FIG. 4) of each of the multiple infants (step S13: generation step in FIG. 6). A specific example of the feedback information generation process will be described later. The generation unit 13 generates feedback information for each of the multiple infants to whom the sensor device 30 is loaned. In other words, each infant to whom the sensor device 30 is loaned corresponds to the above-mentioned target infant. The following description focuses on one infant (target infant) for whom feedback information is to be generated.
[0075] The providing unit 14 provides the feedback information generated by the generating unit 13 to the guardian of the infant or a third party having a predetermined relationship with the infant (step S14 in FIG. 6: providing step). The manner in which the providing unit 14 provides the feedback information is not limited to a specific form. For example, when providing the feedback information to the guardian of the target infant, the providing unit 14 may refer to guardian information (information including the guardian's contact information) included in the attribute information (see FIG. 3) corresponding to the lending ID of the target infant, and provide the feedback information based on the guardian's contact information. For example, when the guardian's contact information included in the guardian information is the guardian's email address, the providing unit 14 may transmit the feedback information to the email address. Alternatively, when the guardian's contact information included in the guardian information is the ID of the guardian's dedicated app, the providing unit 14 may register the feedback information so that the feedback information is presented on a screen on the dedicated app of the user of the ID (i.e., so that the guardian of the target infant can view the feedback information by opening the dedicated app installed in the guardian terminal 50). Alternatively, if the sensor device 30 is provided with a display or the like for displaying feedback information, the providing unit 14 may transmit the feedback information to the sensor device 30 loaned to the infant or young child in question, and cause the sensor device 30 to display the feedback information.
[0076] In addition, when providing the feedback information to a third party, a person in charge of the facility L1, the providing unit 14 may refer to a contact included in the facility information (see FIG. 3) corresponding to the lending ID of the target infant, and provide the feedback information based on the contact. For example, when the contact is an email address of the person in charge, the providing unit 14 may transmit the feedback information to the email address. In addition to the above, the providing unit 14 may provide the feedback information to the person in charge of the facility L1 in a manner similar to the manner of providing the feedback information to the guardian described above. In this way, by providing the feedback information to a third party related to the target infant (in this embodiment, the person in charge of the facility L1) rather than the guardian of the target infant, it becomes possible for the person in charge to first confirm the contents of the feedback information, and then provide the feedback information to the guardian together with the professional knowledge of the person in charge. This allows the person in charge to provide information (feedback information) that is useful for giving advice to the guardian to the person in charge, and also makes it possible to provide useful information (feedback information appropriately corrected or supplemented by the person in charge) to the guardian via the person in charge. In addition, by notifying a third party of the feedback information, the following effects can be obtained. For example, if an infant is left behind at home L2 and starts crying for an abnormally long period of time because it is "hungry," feedback information indicating this (corresponding to the "alert information" described below) can be sent to a third party, a staff member at facility L1, to appropriately inform the third party that the infant is in danger.
[0077] The providing unit 14 may provide the feedback information based on a date included in the rental information (see FIG. 3) corresponding to the rental ID of the target infant. For example, the providing unit 14 may provide the feedback information to the person in charge of the facility L1 a predetermined day (e.g., one day) before the advice date on which the person in charge will give advice (e.g., a medical examination) to the guardian of the target infant. Alternatively, in order to allow the guardian to quickly understand the convenience of the sensor device 30, for example, the providing unit 14 may provide the guardian with the feedback information at a fixed time every day during a period shortly after the rental date (e.g., within one week from the rental date). According to the above configuration, the timing of providing the feedback information can be appropriately set based on a date set in relation to the rental of the sensor device 30.
[0078] Hereinafter, some examples of processing by the generation unit 13 (that is, some examples of feedback information generated by the generation unit 13) will be described.
[0079] (First processing example) The generating unit 13 may generate, as feedback information for the target infant, information including information indicating the state of the target infant identified based on a comparison between behavioral information about the target infant and behavioral information about other infants.
[0080] First, the generating unit 13 refers to the attribute information of the target infant and extracts the loan ID of the infant having attribute information similar to the attribute information of the target infant. Here, an example of "attribute information similar to the attribute information of the target infant" is attribute information that is the same as the gender of the target infant and the difference from the age (months) of the target infant is equal to or less than a predetermined threshold. Another example is attribute information that includes prescription information with the same content as the prescription information of the target infant.
[0081] Next, the generation unit 13 statistically analyzes behavioral information for a predetermined period (e.g., the most recent week) corresponding to each of the extracted one or more rental IDs to obtain trend information indicating the period of crying and the reason (emotion) for crying of the infant corresponding to the extracted rental ID (hereinafter, "extracted infant"). As an example, the trend information is assumed to be a statistical value (e.g., average number of times, average duration) of crying behavior for each reason (emotion) in a day (24 hours). For example, the generation unit 13 obtains, for multiple extracted infants, a statistical value of crying behavior corresponding to the reason "sleepy", a statistical value of crying behavior corresponding to the reason "hungry", and a statistical value of crying behavior corresponding to the reason "my diaper is wet and I feel uncomfortable" as trend information of the extracted infants.
[0082] Next, the generating unit 13 compares the statistical value of the crying behavior for each reason calculated from the behavior information of the target infant during the predetermined period with the above-mentioned tendency information to grasp the difference (deviation) between the behavior information of the target infant and the above-mentioned tendency information. For example, if the statistical value of the crying behavior corresponding to the reason "sleepiness" of the target infant is larger than the tendency information of the extracted infant (the statistical value of the crying behavior corresponding to the reason "sleepiness"), the target infant may not be getting enough good quality sleep. In this case, the generating unit 13 generates information indicating that the target infant may not be getting enough good quality sleep (i.e., information indicating the target infant's state of "poor sleep") as feedback information.
[0083] According to the first processing example, by generating information indicating the condition of the target infant identified by comparing it with the tendencies of other infants as feedback information, it is possible to provide useful feedback information to guardians or staff at facility L1.
[0084] (Second processing example) The generation unit 13 may generate information as feedback information for the target infant, including alert information indicating that an indicator regarding the condition of the target infant identified based on a comparison of behavioral information about the target infant with behavioral information about other infants has exceeded a predetermined threshold.
[0085] For example, as in the first processing example, the generating unit 13 calculates the tendency information of the extracted infant, and then compares the tendency information with the statistical value of the crying behavior for each reason calculated from the behavior information of the target infant in the predetermined period. For example, when the statistical value of the crying behavior corresponding to the reason "sleepiness" of the target infant is greater than the tendency information of the extracted infant (the statistical value of the crying behavior corresponding to the reason "sleepiness") by a predetermined threshold, the generating unit 13 may determine that the index related to "poor sleep" of the target infant has exceeded the predetermined threshold, and generate alert information indicating that as feedback information.
[0086] According to the second processing example, when it is determined that the condition of the target infant deviates from the tendencies of other infants by a certain amount or more, alert information indicating that is generated as feedback information, making it possible to provide useful feedback information to the guardian or the person in charge of facility L1. For example, when the condition of the target infant deviates significantly from a healthy state (i.e., when there is a possibility that immediate action is required), alert information indicating that can be appropriately provided to the guardian or the person in charge of facility L1.
[0087] (Third processing example) The generating unit 13 may generate information including advice for the guardian of the target infant as feedback information for the target infant. For example, as in the above-mentioned first processing example or second processing example, when the condition of the target infant is determined to be "poor sleep", the generating unit 13 may include advice information indicating measures for resolving the poor sleep in the feedback information. Such advice information according to the condition of the target infant may be stored in the storage unit 100 in advance. In this case, the generating unit 13 can generate feedback information including the advice information by acquiring the advice information corresponding to the determined condition of the target infant from the storage unit 100.
[0088] According to the third processing example, appropriate advice information according to the condition of the target infant can be provided to the guardian or the person in charge of the facility L1. When the feedback information is provided directly to the guardian by the providing unit 14, it is advantageous that the advice information can be provided to the guardian in a timely manner. On the other hand, when the feedback information is provided to the person in charge of the facility L1 by the providing unit 14, the person in charge of the facility L1 first judges whether or not the advice information is appropriate for the target infant based on expert knowledge (and adds / changes the content of the advice, if necessary), and then the person in charge of the facility L1 can provide the information to the guardian more appropriately.
[0089] (Fourth Processing Example) Although the environmental information is not necessarily the entire cause of the crying behavior of an infant, it is considered that the environmental information constitutes at least one of the causes of the crying behavior of an infant. Based on the above-mentioned concept, the generating unit 13 may generate feedback information based on the environmental information of each of the plurality of infants. The above-mentioned second acquiring unit 12 periodically acquires behavioral information (not included when the infant is not crying) and environmental information of the plurality of infants from the plurality of sensor devices 30 corresponding to the plurality of infants including the target infant, and accumulates them in the storage unit 100. Thus, for example, the generating unit 13 may acquire a correlation between the environmental information and the crying behavior by referring to the behavioral information and environmental information of the plurality of infants accumulated in the storage unit 100. For example, the generating unit 13 calculates a first statistical value (e.g., an average value) of the environmental information (e.g., at least one of temperature, humidity, and air cleanliness) when the infant is crying, and a second statistical value of the environmental information when the infant is not crying. Next, the generating unit 13 determines whether the statistical value of the environmental information when the target infant is crying is closer to the first statistical value or the second statistical value. When it is determined that the statistical value is closer to the first statistical value than to the second statistical value, the generating unit 13 may generate, as feedback information, advice information indicating to bring the environmental information closer to the second statistical value.
[0090] According to the fourth processing example, by taking into consideration environmental information in addition to behavioral information of an infant, it is possible to generate feedback information that is more useful for improving the childcare environment of an infant.
[0091] (Fifth Processing Example) The generating unit 13 may generate information including effectiveness information indicating the effectiveness of the prescription as feedback information for the target infant, based on the condition of the target infant identified based on the behavioral information acquired about the target infant and prescription information indicating the contents of the prescription administered to the target infant. For example, the generating unit 13 acquires information on the contents of the prescription for the target infant and the date of administration by referring to the prescription information (see FIG. 3) included in the attribute information of the target infant. Here, as an example, it is assumed that the contents of the prescription are prescriptions for improving the infant's sleep disorder (night crying). In this case, for example, the generating unit 13 calculates the average value of the time during which the target infant cried in the nighttime (e.g., 11:00 PM to 3:00 AM) during a predetermined period (e.g., one week) before the date of administration of the prescription (hereinafter referred to as "night crying time before prescription"). In addition, the generating unit 13 calculates the average value of the time during which the target infant cried in the nighttime (e.g., 11:00 PM to 3:00 AM) during a predetermined period (e.g., one week) after the date of administration of the prescription (hereinafter referred to as "night crying time after prescription"). Next, the generating unit 13 compares the post-prescription crying time with the pre-prescription crying time, and if the post-prescription crying time is shorter than the pre-prescription crying time by a predetermined threshold or more, generates efficacy information indicating that the prescription contents were effective as feedback information. On the other hand, if the post-prescription crying time is not shorter than the pre-prescription crying time by the threshold or more, the generating unit 13 generates efficacy information indicating that the prescription contents were not effective as feedback information. In addition, in the fifth processing example, it is preferable that the providing unit 14 provides feedback information including the efficacy information to a third party (a person in charge at facility L1) who prescribed the medication for the target infant.
[0092] According to the fifth processing example, when a prescription (a prescription to eliminate "sleep disorders" in the above example) is given to a target infant, it is possible to automatically determine whether the prescription was effective by referring to behavioral information acquired about the target infant before and after the prescription. Furthermore, such a determination result is generated as feedback information and provided to the person in charge of the prescription for the target infant, so that the person in charge can appropriately understand whether the prescription was effective. As a result, the person in charge can appropriately decide whether to continue the same prescription or switch to another prescription depending on the contents of the effectiveness information (feedback information).
[0093] Furthermore, in the fifth processing example, when the effectiveness information indicates that the prescription contents are not appropriate, the generating unit 13 may further generate candidate information indicating other prescription candidates for the target infant as part of the feedback information for the target infant. For example, the generating unit 13 may refer to one or more prescription information indicating the prescription contents (history) that have been implemented so far for the target infant, and generate the prescription contents that have not been implemented as the candidate information. In this way, when the prescription is determined to be ineffective, by including the candidate information in the feedback information, it is possible to provide useful information to the person in charge of considering the prescription contents for the target infant.
[0094] According to the management server 10 described above, it is possible to generate and provide more useful feedback information for a target infant that takes into account information about other infants, based not only on attribute information and behavioral information about the target infant, but also on attribute information and behavioral information about each of a plurality of infants, including infants other than the target infant. This makes it possible to provide more useful information about infants.
[0095] [Variations] The present disclosure is not limited to the above embodiment. Each component according to the above embodiment may be omitted or modified as appropriate. For example, in the above embodiment, some characteristic configurations included in the information processing system 1 and some effects exerted by each configuration have been described, but the information processing system 1 according to the present disclosure does not necessarily need to be configured to exert all the effects described in the above embodiment, and may be configured to exert only some of the effects described in the above embodiment. In the latter case, the information processing system 1 only needs to have a configuration essential for exerting at least some of the effects, and configurations that are not essential for exerting the effects may be omitted or modified as appropriate. In addition, when focusing on one effect, the configuration essential for exerting the effect should be reasonably understood based on technical common sense and the description of this specification, based on the standard of a person skilled in the art. Below, some specific modified examples of the information processing system of the present disclosure are illustrated, but it goes without saying that the modified information processing system is not limited to only the specific forms exemplified below.
[0096] In the above embodiment, the voice data of the crying sound of the infant and the analysis result thereof are acquired as the behavioral information of the infant, but the behavioral information of the infant may be information indicating the behavior of the infant other than the crying motion. In that case, a sensor device according to the content of the behavior of the infant to be detected may be installed in the home L2. Alternatively, the behavioral information of the infant may be manually input by the guardian and transmitted to the management server 10. For example, the guardian may input behavioral information indicating the behavior of the infant grasped by his / her own observation or the behavior of the infant grasped from the output of the sensor device 30 to the guardian terminal 50 in order to consult a third party such as a postpartum care center, a maternity hospital, a midwifery hospital, or an infant sleep consultant. In this way, the behavioral information of the infant may be transmitted to the management server 10 via the guardian terminal 50. In addition, the guardian may transmit so-called childcare logs (for example, meal, excretion, sleep time, crying period, etc.) as the behavioral information of the infant to the management server 10. For example, a childcare log input by the guardian to a childcare app installed in the guardian terminal 50 may be transmitted to the management server 10 as the behavioral information of the infant.
[0097] Furthermore, the data flow in the above embodiment may be changed as appropriate. For example, in the above embodiment, the management server 10 requests the analysis server 40 to analyze the voice data included in the behavioral information, but the sensor device 30 may request the analysis server 40 to analyze the voice data. In this case, the sensor device 30 may transmit the analysis result returned from the analysis server 40 to the management server 10.
[0098] In addition, some of the components in the above embodiment may be omitted as appropriate. For example, in the above embodiment, the analysis server 40 analyzes the voice data (estimates the emotion of a crying baby), but the management server 10 or the sensor device 30 may have the analysis function. In that case, the analysis server 40 may be omitted.
[0099] In the above embodiment, the sensor device 30 is lent to the guardian of the infant by the person in charge at the facility L1, but the sensor device 30 may be purchased (obtained) by the user (guardian) at a location other than the facility L1. However, by adopting a form in which the sensor device 30 is lent from the facility L1 to the guardian as in the above embodiment, basic information of the infant can be appropriately and easily registered in the management server 10 via the facility L1 when the sensor device 30 is lent. [Explanation of symbols]
[0100] 10: management server (information processing device), 11: first acquisition unit, 12: second acquisition unit, 13: generation unit, 14: provision unit.
Claims
1. A first acquisition unit that acquires attribute information indicating attributes of each of a plurality of infants; A second acquisition unit that acquires behavioral information regarding behavior of each of the plurality of infants; a generation unit that generates feedback information for one of the plurality of infants based on the attribute information and the behavior information of each of the plurality of infants; a providing unit that provides the feedback information to a guardian of the infant or a third party having a predetermined relationship with the infant; An information processing device comprising:
2. The information processing device according to claim 1 , wherein the first acquisition unit acquires, as the attribute information, information about the infant managed in a facility related to the infant.
3. The first acquisition unit further acquires contact information of a person in charge of a facility related to the infant, The information processing device according to claim 1 , wherein the providing unit provides the feedback information to the person in charge who is the third party based on the contact information.
4. The information processing device according to claim 1 , wherein the second acquisition unit acquires, as the behavior information, information on the behavior of the infant detected by a sensor device lent to a guardian of the infant.
5. The information processing device according to claim 4 , wherein the information relating to the behavior of the infant detected by the sensor device includes audio data of the infant's crying.
6. The first acquisition unit further acquires rental information including a date set in relation to the rental of the sensor device, The information processing device according to claim 4 , wherein the providing unit provides the feedback information based on the date included in the rental information.
7. The second acquisition unit further acquires environmental information regarding an environment in which the infant is placed, the environmental information being acquired by the sensor device; The information processing device according to claim 4 , wherein the generation unit generates the feedback information also based on the environmental information of each of the plurality of infants.
8. The information processing device according to claim 1 , wherein the generation unit generates, as feedback information for the infant, information including information indicating a state of the infant identified based on a comparison of the behavioral information about the infant with the behavioral information about other infants.
9. The information processing device of claim 1, wherein the generation unit generates, as feedback information for the infant, information including alert information indicating that an indicator regarding the condition of the infant, identified based on a comparison of the behavioral information about the infant with the behavioral information about other infants, has exceeded a predetermined threshold.
10. The information processing device according to claim 1 , wherein the generating unit generates information including advice for a guardian of an infant as feedback information for the infant.
11. the generation unit generates, as feedback information for the infant, information including effectiveness information indicating effectiveness of the prescription based on a state of the infant identified based on the behavioral information acquired for the infant and prescription information indicating the content of a prescription implemented for the infant; The information processing device according to claim 1 , wherein the providing unit provides feedback information for the one infant to a person in charge of the prescription.
12. The information processing device according to claim 11 , wherein when the efficacy information indicates that the contents of the prescription are not appropriate, the generating unit further generates candidate information indicating other prescription candidates for the infant as part of feedback information for the infant.
13. On the computer, A first acquisition step of acquiring attribute information indicating attributes of each of a plurality of infants; A second acquisition step of acquiring behavioral information regarding behavior of each of the plurality of infants; generating feedback information for one of the plurality of infants based on the attribute information and the behavior information of each of the plurality of infants; providing the feedback information to a guardian of the infant or a third party having a predetermined relationship with the infant; An information processing method.
Citation Information
Patent Citations
Report program, report device, and report method
JP2023056870A
