Information processing system, information processing device, information processing method, and program

Abstract

To collect excretion information indicating a content of excretion into a toilet bowl without the need to hear from a user of a toilet, and to prevent foreign matters from being flushed even when the foreign matters other than the excrement is present in the toilet bowl.SOLUTION: An information processing system (1) comprises: an acquisition unit (1a) that obtains excretion information based on image data captured by an imaging device installed so as to include an excrement range of excrement on a toilet bowl in an imaging range, a generation unit (1b) that generates presentation information based on the excretion information, an output unit (1c) that outputs the presentation information, and a flushing control unit (1d) that controls a flushing function of the toilet bowl. The acquisition unit (1a) acquires, as at least a part of the excretion information, information indicating whether or not the image data includes foreign matters which are objects other than excreta, as a subject other than the toilet bowl and its cleaning liquid. When information including the foreign matters is obtained, the flushing control unit (1d) outputs a stop instruction for stopping the cleaning function to the toilet bowl side, and the generation unit (1b) generates warning information as at least a part of the presentation information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system, an information processing device, an information processing method, and a program. [Background technology]

[0002] Caregivers who provide toileting assistance in nursing care settings are expected to maintain the dignity of those in need of care, reduce incontinence, and encourage independence. Because providing toileting assistance in nursing care settings can sometimes hurt the dignity of those in need of care, it places a heavy burden on caregivers, and support is needed to reduce the workload.

[0003] The caregiver's duties also include creating a toilet diary when assisting the person requiring care with toileting. Therefore, caregivers obtain information to record in the toilet diary by either entering the toilet with the person requiring care and observing the person's excretory behavior, or by interviewing the person requiring care.

[0004] In the former case, this is primarily done for care recipients who are unable to hear accurate information due to dementia or other factors. Furthermore, in the former case, being observed while defecates is embarrassing for the care recipient, which can easily lead to situations that violate the care recipient's dignity, and observation in such situations can also be a burden on the caregiver. On the other hand, in the latter case, the care recipient's sense of embarrassment can lead to inaccurate reports, which means that defecation records are subject to personalization. As a result, the contents of the defecation diary will vary even if the care recipient performs the same defecation activity. Therefore, defecation diaries created through interviews are less accurate, despite the significant burden on the caregiver.

[0005] Furthermore, if the person requiring care has dementia, they may mistake a urine pad for toilet paper when using the toilet, or flush it down the toilet as an attempt to intentionally hide evidence of an incontinence (fecal or urinary incontinence) out of embarrassment. In such cases, or periodically, nursing care facilities must not only hire a contractor to clean the drains and remove foreign objects, but also unclog the drainage system, preventing the operation of drainage-related facilities during this process.

[0006] In relation to recording the number of times a toilet is used, Patent Document 1 describes a safety determination information generating device that uses a contact sensor in a flushing operation unit to detect when a person being monitored uses the toilet, and transmits fixture use information indicating the toilet use to a remote monitoring device as safety determination information. This safety determination information generating device stores a threshold value for the number of times the toilet is used per day, and is also capable of displaying a warning message such as "The number of excretory acts is abnormal" if the number of times the person uses the toilet per day exceeds this threshold value.

[0007] Patent Document 2 describes a system including a subject-side device installed in a toilet room and a server capable of communicating with the subject-side device. The subject-side device includes a sulfur-containing gas sensor that reacts to sulfur-containing gas and outputs detection data, and a transceiver that transmits measurement data, including the detection data of the sulfur-containing gas detected by the sulfur-containing gas sensor, to the server. The server includes a database that stores and records measurement data, including the detection data of the sulfur-containing gas detected by the sulfur-containing gas sensor, along with the date and time of defecation, in association with subject identification information. The server also includes server-side data analysis means that analyzes the subject's physical condition based on the trend of temporal fluctuations in the measurement data stored and recorded in the database. The system described in Patent Document 2 can also be equipped with an input device that accepts input of defecation history information, allowing doctors and other medical professionals to accurately diagnose whether a patient is constipated based on the analysis results of the measurement data and the defecation history information.

[0008] Patent document 3 describes a system that detects excretory activity based on a human body detection signal from a human sensor installed in the toilet, stores the scheduled excretory activity, and alerts the user that they have forgotten to excrete if the excretory activity is not detected at the scheduled time.

[0009] Patent Document 4 describes a toilet with an alarm device that includes a sensor that detects whether a user is seated on the toilet seat, a timer that starts operating based on a signal from the sensor, and alarm means that issues an alarm based on an output signal after the timer has operated for a predetermined period of time. This toilet with an alarm device can detect and issue an alarm if a user remains seated for a long period of time, and can also be configured to alert a nurse station of such an abnormal condition.

[0010] Patent Document 5 describes a flush toilet that includes a toilet bowl, a determination unit, and a water supply control unit. In this flush toilet, the judgment unit judges whether the discharge is feces or urine based on the detection result of the H2S sensor, and the water supply control unit controls the amount of water supplied for feces or urine based on the judgment result. Patent Document 5 also describes that the judgment unit makes a judgment based on the presence or absence of foreign matter (feces, toilet paper roll, etc.) in the water in the toilet bowl, either based on the result of visual detection by a vision sensor element, or based on the result of optical detection by a light-emitting element and a light-receiving element. [Prior art documents] [Patent documents]

[0011] [Patent Document 1] International Publication No. 2009 / 016727 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-145808 [Patent Document 3] Japanese Patent Application Laid-Open No. 2010-220761 [Patent Document 4] Japanese Patent Application Publication No. 08-052097 [Patent Document 5] Japanese Patent Application Publication No. 07-119190 Summary of the Invention [Problem to be solved by the invention]

[0012] However, since the technology described in Patent Document 1 is primarily intended to determine safety, it can only determine the number of excretory actions, but cannot obtain information indicating the content of excretion required for an excretion diary.Furthermore, the technology described in Patent Document 2 uses a sulfur-containing gas sensor, so it cannot determine the subject's physical condition based on the appearance of the excreta, and also requires the subject to be questioned and manually input to obtain bowel movement history information.

[0013] Furthermore, although the technologies described in Patent Documents 3 and 4 can each alert users when they have forgotten to defecate or when they have been sitting for a long period of time, neither of these technologies can provide information indicating the details of defecation, which is necessary for a defecation diary.

[0014] Furthermore, the technologies described in Patent Documents 1 to 4 are unable to detect foreign objects other than excrement when they are present in the toilet bowl, and the user will flush the object down the toilet, making it impossible to inspect the object.

[0015] Furthermore, the technology described in Patent Document 5 only detects the presence or absence of foreign objects, and since the foreign objects to be detected include feces, it is not possible to distinguish between excrement and other substances. Furthermore, even if the technology described in Patent Document 5 detects, for example, a toilet paper roll, it controls the water supply to an appropriate amount so that no water is left behind, and does not take into consideration stopping the water supply. Therefore, with the technology described in Patent Document 5, even if a foreign object such as vomited blood or vomit is present in the water in the toilet, the user will flush it, making it impossible to inspect the foreign object.

[0016] An object of the present disclosure is to provide an information processing system, an information processing device, an information processing method, and a program that solve the above-mentioned problem, which is to collect excretion information indicating the contents of excrement excreted into a toilet bowl without the need to ask the toilet user, and to prevent foreign objects other than excrement from being flushed even if they are present in the toilet bowl. [Means for solving the problem]

[0017] An information processing system according to a first aspect of the present disclosure comprises an acquisition unit that acquires excretion information indicating the content of excretion based on imaging data captured by an imaging device installed so as to include within its imaging range the excretion range of a toilet bowl, a generation unit that generates presentation information based on the excretion information, an output unit that outputs the presentation information, and a flushing control unit that controls the flushing function of the toilet bowl, wherein the acquisition unit acquires, as at least part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object, which is an object other than feces or urine, as a subject excluding the toilet bowl and the flushing liquid for the toilet bowl, and when the acquisition unit acquires information including the foreign object as the excretion information, the flushing control unit outputs a stop instruction to the toilet bowl to stop the flushing function, and when the acquisition unit acquires information including the foreign object as the excretion information, the generation unit generates warning information as at least part of the presentation information.

[0018] An information processing device according to a second aspect of the present disclosure is an information processing device that includes an imaging device and is installed on a toilet bowl so that the imaging device is positioned so that the imaging range includes the excrement excretion range in the toilet bowl, and further includes an acquisition unit that obtains excretion information indicating the content of the excretion based on imaging data captured by the imaging device, a generation unit that generates presentation information based on the excretion information, an output unit that outputs the presentation information, and a flushing control unit that controls the flushing function of the toilet bowl, wherein the acquisition unit obtains, as at least part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object that is an object other than feces or urine as a subject excluding the toilet bowl and the flushing liquid for the toilet bowl, and when the acquisition unit obtains information including the foreign object as the excretion information, the flushing control unit outputs a stop instruction to the toilet bowl to stop the flushing function, and when the acquisition unit obtains information including the foreign object as the excretion information, the generation unit generates warning information as at least part of the presentation information.

[0019] An information processing method according to a third aspect of the present disclosure comprises an acquisition step of obtaining excretion information indicating the content of excretion based on imaging data captured by an imaging device installed so as to include the excretion range in a toilet bowl in its imaging range; a generation step of generating presentation information based on the excretion information; an output step of outputting the presentation information; and a cleaning control step of controlling the cleaning function of the toilet bowl, wherein the acquisition step obtains, as at least part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object, which is an object other than feces and urine, as a subject excluding the toilet bowl and the cleaning liquid for the toilet bowl; the cleaning control step outputs a stop instruction to the toilet bowl to stop the cleaning function when information including the foreign object is obtained as the excretion information in the acquisition step; and the generation step generates warning information as at least part of the presentation information when information including the foreign object is obtained as the excretion information in the acquisition step.

[0020] A program according to a fourth aspect of the present disclosure is a program for causing a computer to execute an acquisition step of obtaining excretion information indicating the content of excretion based on imaging data captured by an imaging device installed so as to include the excretion range in a toilet bowl in its imaging range; a generation step of generating presentation information based on the excretion information; an output step of outputting the presentation information; and a cleaning control step of controlling the cleaning function of the toilet bowl, wherein the acquisition step obtains, as at least part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object that is an object other than feces or urine as a subject excluding the toilet bowl and the cleaning liquid for the toilet bowl; the cleaning control step outputs a stop instruction to the toilet bowl to stop the cleaning function when information including the foreign object is obtained as the excretion information in the acquisition step; and the generation step generates warning information as at least part of the presentation information when information including the foreign object is obtained as the excretion information in the acquisition step. [Effects of the Invention]

[0021] The present disclosure provides an information processing system, an information processing device, an information processing method, and a program that solve the above-mentioned problems. That is, the present disclosure makes it possible to collect excretion information indicating the contents of excrement excreted into a toilet bowl without having to ask the toilet user, and to prevent foreign objects other than excrement from being flushed even if they are present in the toilet bowl. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a block diagram showing an example of the configuration of an information processing system according to a first embodiment. [Figure 2] FIG. 10 is a diagram illustrating an example of the configuration of an information processing system according to a second embodiment. [Figure 3] 3 is a block diagram showing an example of the configuration of an information processing device in the information processing system of FIG. 2. FIG. [Figure 4] 3 is a conceptual diagram showing an example of a user detection range of an information processing device in the information processing system of FIG. 2. FIG. [Figure 5] 3 is a diagram for explaining an example of a notification made by a terminal device in the information processing system of FIG. 2. FIG. [Figure 6] 3 is a diagram for explaining an example of a notification made by a terminal device in the information processing system of FIG. 2. FIG. [Figure 7] 3 is a diagram for explaining an example of a notification made by a terminal device in the information processing system of FIG. 2. FIG. [Figure 8] 3 is a diagram for explaining an example of a notification made by a terminal device in the information processing system of FIG. 2. FIG. [Figure 9] 3 is a diagram for explaining an example of a notification made by a terminal device in the information processing system of FIG. 2. FIG. [Figure 10] FIG. 10 is a conceptual diagram showing another example of the information processing system according to the second embodiment. [Figure 11] 11 is a diagram showing an example of information recorded in the information processing system of FIG. 2 or FIG. 10. [Figure 12] FIG. 11 is a diagram showing an example of a daily excretion diary for a certain person, generated in the information processing system of FIG. 2 or FIG. 10. [Figure 13] FIG. 11 is a diagram showing an example of an excretion diary for a certain person, which is generated in the information processing system of FIG. 2 or FIG. 10. [Figure 14] FIG. 14 is a diagram showing a continuation of the excretion diary of FIG. 13. [Figure 15] FIG. 11 is a diagram showing an example of a daily excretion diary for a plurality of people, generated in the information processing system of FIG. 2 or FIG. 10. [Figure 16] 11 is a flowchart illustrating an example of processing in the information processing system of FIG. 2 or FIG. 10. [Figure 17] This is a flow chart continuing from FIG. 16. [Figure 18] 11 is a flow chart for explaining an example of a defecation promotion process in the information processing system of FIG. 2 or FIG. 10. FIG. [Figure 19] 11 is a flowchart illustrating an example of a warning process related to urination intervals in the information processing system of FIG. 2 or FIG. 10. FIG. [Figure 20]FIG. 2 illustrates an example of a hardware configuration of the apparatus. DETAILED DESCRIPTION OF THE INVENTION

[0023] Hereinafter, embodiments will be described with reference to the drawings. In the embodiments, the same or equivalent elements may be denoted by the same reference numerals, and redundant description will be omitted as appropriate.

[0024] <Embodiment 1> FIG. 1 is a block diagram showing an example of the configuration of an information processing system according to the first embodiment. As shown in FIG. 1, the information processing system 1 according to this embodiment can include an acquisition unit 1a, a generation unit 1b, an output unit 1c, and a cleaning control unit 1d.

[0025] The acquisition unit 1a acquires excretion information indicating the details of excretion based on image data captured by an imaging device (hereinafter, exemplified as a camera) installed so as to include the excretion range in the toilet bowl within its imaging range. Therefore, a camera installed in this manner is connected to or included in the information processing system 1. This camera is not limited to a visible light camera, but may be an infrared camera or the like, or may be a video camera as long as it can extract still images.

[0026] The excretion range can be an area including the water-filled portion of the toilet bowl, and can also be referred to as the expected excretion range. By installing the camera so that such an excretion range is included in the imaging range, the captured imaging data will include excrement and the like as a subject. Of course, it is preferable that the excretion range be an area that does not capture the user, and it is also preferable that the camera be installed so that the camera lens is not visible to the user. Furthermore, when the information processing system 1 is used in a hospital or a care facility, for example, the user is mainly a patient or other person requiring care.

[0027] Excretion information is information indicating the content of excretion, and in a simpler example, it can be information indicating whether the excretion is feces (feces) or urine (urine). The excretion information can also include other information such as information indicating the color of the excretion, or its shape if it is solid.

[0028] The acquisition unit 1a can obtain the excretion information, for example, by using a trained model or by performing a comparison using image matching or the like. This trained model may be any model that outputs excretion information based on image data captured by a camera, and may be stored in a storage unit (not shown). For example, the trained model may be a model that inputs the image data, or inputs data obtained by performing preprocessing on the image data, and outputs excretion information (which may be multiple types of information). Note that the algorithm (machine learning algorithm) and hyperparameters such as the number of layers are not important, as long as the trained model is generated by machine learning. In this way, the acquisition unit 1a can obtain excretion information using the trained model based on the image data.

[0029] On the other hand, in a configuration in which the acquisition unit 1a performs comparison such as image matching, various image data to be compared or their feature data may be associated with excretion information indicating the content of excretion and stored in a storage unit (not shown).The acquisition unit 1a then inputs image data from the camera, extracts its features, and then compares it with the data stored in the storage unit, and outputs excretion information indicated by the data to be compared that matches or has the highest matching rate.

[0030] In addition, this imaging data can include additional information such as the imaging date and time, imaging conditions, etc., and this trained model can also be a model in which not only imaging data but also other information is input as parameters. For example, imaging conditions can include the resolution if the camera has a configurable resolution, and the zoom magnification if the camera has a zoom function.

[0031] Furthermore, the imaging data used to acquire excretion information can be data obtained when, for example, an object is detected as a subject in the excretion area or when a change such as a change in the color of accumulated water is detected. These detections can be performed, for example, by capturing images continuously or periodically using a camera, and using the captured image data. Alternatively, images can be captured based on the user detection results from a separately provided user detection sensor (such as a load sensor on the toilet seat or other human presence sensor), and the captured image data can be used to acquire excretion information.

[0032] The generating unit 1b generates presentation information based on the excretion information acquired by the acquiring unit 1a. In the simplest example, this presentation information may be the excretion information itself, or may be information that has been processed for presentation. If the excretion information does not include date and time information indicating the acquisition date and time of the imaging data, the presentation information may include the excretion information and date and time information. Of course, the presentation information may include other information.

[0033] Furthermore, as can be understood from the above simplest example, the acquisition unit 1a and the generation unit 1b can be configured to obtain excretion information and presentation information using a trained model that outputs excretion information and presentation information based on imaging data captured by a camera. The trained model in this example can also be a model that inputs not only imaging data but also other data. Furthermore, the trained model in this example can output excretion information as the output of a certain intermediate layer and presentation information as the output of an output layer. Note that the trained model in this example can also be generated by machine learning, regardless of its algorithm (machine learning algorithm) or hyperparameters such as the number of layers.

[0034] The output unit 1c outputs the presentation information. The output unit 1c may be, for example, a communication unit configured with a wired or wireless communication interface. The output unit 1c may, for example, transmit the presentation information to an external alarm device (not shown) via the communication unit, thereby enabling the alarm device to issue an alarm based on the presentation information. The output unit 1c may, for example, transmit the presentation information to an external server (not shown) via the communication unit, thereby enabling the server to store the presentation information. The output unit 1c may, for example, output print data (print job) for printing the presentation information to a printing device built into or externally connected to a device constituting the information processing system 1 via the communication unit. This allows the printing device to print the presentation information.

[0035] The flushing control unit 1d controls the flushing function of the toilet. For this reason, the flushing control unit 1d is connected or connectable to a device with a flushing function for the toilet (for example, a warm-water washing toilet seat such as a Washlet (registered trademark) that has the function of flushing the toilet) via, for example, the communication unit. The target of cleaning by the warm-water washing toilet seat is the user's buttocks, etc. The information processing system 1 can also include such a device or a toilet with an integrated warm-water washing toilet seat.

[0036] In the above-described configuration, this embodiment is particularly characterized when an object other than feces and urine (hereinafter referred to as a foreign object) is included in the subject of the imaging data. This characteristic will be explained below. The foreign object can also be called a "other object," and may be liquid or solid as long as it is something other than feces and urine, and may include, for example, one or more of vomit, bloody stool, vomited blood (hematemesis), urine absorption pads, toilet paper rolls, etc.

[0037] The acquisition unit 1a acquires, as at least a part of the excretion information, information indicating whether or not foreign matter, i.e., an object other than feces and urine, is included in the image data captured by the camera as a subject other than the toilet bowl and the toilet bowl cleaning liquid. As described above, the excretion information can also include information indicating whether or not feces and urine are included.

[0038] When the acquisition unit 1a obtains information containing a foreign object as excretion information, the flushing control unit 1d outputs a stop instruction to the toilet bowl to stop the flushing function. Furthermore, when the acquisition unit 1a obtains information containing a foreign object as excretion information, the generation unit 1b generates warning information as at least part of the presentation information. Here, the warning information can refer to information for presenting a warning, that is, information for issuing a warning sound or displaying a warning. This allows the output unit 1c to output the warning information. The output destination can be, for example, a terminal device or alarm device that allows a supervisor, such as a caregiver, who is caring for the user, to recognize the warning information.

[0039] The information processing system 1 may have the above-mentioned storage unit and control unit (not shown), and this control unit may include the above-mentioned acquisition unit 1a, generation unit 1b, output unit 1c (or part thereof), and cleaning control unit 1d. This control unit may be realized, for example, by a CPU (Central Processing Unit), a working memory, and a non-volatile storage device storing a program. This program may be a program that causes the CPU to execute the processing of each unit 1a to 1d. Furthermore, the control unit provided in the information processing system 1 may also be realized, for example, by an integrated circuit.

[0040] Furthermore, the information processing system 1 according to this embodiment can be configured as a single information processing device, or as multiple devices with distributed functions. In the latter case, each device is provided with a control unit, a communication unit, and, if necessary, a storage unit, etc., and these multiple devices can be connected via wireless or wired communication as necessary to cooperate and realize the functions of the information processing system 1.

[0041] Furthermore, the information processing system 1 can be configured to include the above-mentioned camera, and when configured as a standalone information processing device, the camera will be included in the information processing device. In this way, when the information processing system 1 is configured as a standalone information processing device, the information processing device preferably includes the above-mentioned camera and is installed on the toilet bowl so that the camera is positioned so that the imaging range of the excrement on the toilet bowl is included. In this case, the information processing device can also be called an excretion information acquisition device.

[0042] As described above, in this embodiment, when a foreign object other than excrement is detected, warning information is output (notified) to a caregiver or the like, and the flushing function for cleaning the toilet bowl is stopped to prevent the foreign object from being flushed. Therefore, in this embodiment, even if the user uses the flushing function, the flushing function is stopped, so the foreign object can be left as is without being flushed, and the foreign object can be later tested as a specimen or the like. Furthermore, because the foreign object is not flushed and warning information indicating the detection of the foreign object is output, a person supervising the user can rush to the toilet, thereby preventing the user from feeling embarrassed that they cannot flush the foreign object.

[0043] Furthermore, the output destination of the warning information is not limited to one location, and it can be configured to be executed simultaneously from, for example, a terminal device or alarm device outside the toilet and an alarm device installed somewhere inside the toilet. In this case, the above-mentioned confusion can be prevented by outputting a voice message inside the toilet such as "A foreign object has been detected, so the flushing function has been stopped."

[0044] In this way, according to this embodiment, it is possible to collect excretion information indicating the contents of the excrement excreted into the toilet bowl without having to ask the toilet user, and it is also possible to prevent foreign objects other than excrement from being flushed even if they are present in the toilet bowl.

[0045] <Embodiment 2> The second embodiment will be described with a focus on the differences from the first embodiment, with reference to Figures 2 to 19, but the various examples described in the first embodiment can also be applied. Figure 2 is a diagram showing an example of the configuration of an information processing system according to the second embodiment, and Figure 3 is a block diagram showing an example of the configuration of an information processing device in the information processing system of Figure 2. Figure 4 is a conceptual diagram showing an example of a user detection range by the information processing device in the information processing system of Figure 2.

[0046] The information processing system according to this embodiment (hereinafter referred to as the present system) can be a system that is partly installed in a toilet and records and presents excretion information and performs excretion prediction, and will be specifically described below.

[0047] This system can include an information processing device 10 attached to the toilet bowl 20, a server 40 wirelessly connected to the information processing device 10, and a terminal device 50 wirelessly connected to the server 40. These connections can be made, for example, within a single wireless local area network (LAN). In the following description, the information processing device 10 is described as being installed in the toilet bowl 20, but it is sufficient if at least a part of it, such as a camera for capturing image data, is installed in the toilet bowl 20. The toilet bowl 20 can be provided with a toilet seat 22 equipped with a warm water flushing function for user washing, and a toilet seat cover 23 for covering the toilet seat 22, on its main body 21.

[0048] The information processing device 10 can be a device installed in a toilet (installed in a toilet in this example), and records excrement, presents excrement information (notification, etc.), and predicts excretion in cooperation with a server 40 and a terminal device 50. The information processing device 10 and the toilet 20 can, for example, constitute a toilet 30 with a function to output excretion information. This function is mainly executed by the information processing device 10 in cooperation with the server 40, etc., and will be described later.

[0049] 2, the shape of the information processing device 10 is not limited to that shown in FIG. 2, and it may be configured such that all or part of its functions are embedded in the toilet seat 22 or the like. Also, part of the functions of the information processing device 10 may be provided on the toilet seat 22 side. For example, instead of providing the distance sensor 16a described below in the information processing device 10, it is also possible to adopt a configuration in which a weight sensor is provided on the toilet seat 22 and the information processing device 10 receives information from the weight sensor via wireless or wired communication. Similarly, instead of providing the first camera 16b described below in the information processing device 10, it is also possible to adopt a configuration in which a camera is provided on the toilet seat 22 side and the information processing device 10 receives image data from the camera via wireless or wired communication.

[0050] The server 40 may include a control unit 41 and a storage unit 42 that stores the trained model. The control unit 41 may be realized, for example, by a CPU, a working memory, and a non-volatile storage device that stores a program. The control unit 41 may also be realized, for example, by an integrated circuit. This storage device may also serve as the storage unit 42, and this program may be a program that causes the CPU to realize the functions of the server 40.

[0051] The terminal device 50 is a terminal device held by a person supervising the toilet user, and can be a portable information processing device, but it can also be a stationary device. In the former case, the terminal device 50 can be a mobile phone (including what is called a smartphone), a tablet, a mobile PC, or the like. Although not shown, the terminal device 50 can also include a control unit that performs overall control and a storage unit, and this control unit, like the control unit 41, can be realized by, for example, a CPU, a working memory, a storage unit, etc. Furthermore, the program stored in this storage unit can be a program that causes the CPU to realize the functions of the terminal device 50.

[0052] Next, a detailed example of the information processing device 10 will be described. The information processing device 10 can be composed of two devices, for example, as shown in FIGS. 2 and 3. More specifically, the information processing device 10 can have two boxes, for example, a first external box 13 and a second external box 11, as its housing. The information processing device 10 can also have an inter-box connector (inter-box connection structure) 12 that connects the first external box 13 and the second external box 11. The information processing device 10 in this example can be installed in the main body 21 of the toilet 20, for example, as follows. That is, the information processing device 10 can be installed in the toilet 20 by placing the inter-box connector 12 on the edge of the main body 21 so that the first external box 13 is located inside the main body 21 (the side where excrement is excreted) and the second external box 11 is located outside the main body 21.

[0053] The first external box 13 may house, for example, a distance sensor 16a and a first camera 16b. The second external box 11 may house, for example, a CPU 11a, a connector 11b, USB I / Fs 11c and 11d, a WiFi module 14a, a Bluetooth module 14b, a human presence sensor 15a, and a second camera 15b. Note that USB is an abbreviation for Universal Serial Bus, and USB, WiFi, and Bluetooth are all registered trademarks (the same applies hereinafter).

[0054] The second external box 11 may not be provided with various I / Fs or connectors and may be directly connected to the CPU 11a. The information processing device 10 may not be provided with the CPU 11a and may simply be provided with sensors and cameras that obtain various data and a function for transmitting various data to the server 40.

[0055] As shown in Figure 3, the first external box 13 and the second external box 11 are connected by an interface exemplified by connector 11b and USB I / F 11c, and the connection line is provided inside the box-to-box connection unit 12 to form a single information processing device 10.

[0056] The first external box 13 will now be described. Distance sensor 16a is a sensor that measures the distance to an object (the buttocks of the user of toilet bowl 20) and detects that the user has sat on toilet seat 22, and detects that the object has sat on toilet seat 22 when a certain time has passed since the distance exceeds a threshold value. Furthermore, distance sensor 16a detects that the user has left toilet seat 22 when the distance to the object changes after sitting down.

[0057] The distance sensor 16a may be, for example, an infrared sensor, an ultrasonic sensor, or an optical sensor. When an optical sensor is used as the distance sensor 16a, a transmitting / receiving element may be disposed so as to transmit and receive light (not limited to visible light) through a hole provided in the first external box 13. The transmitting / receiving element here may be configured as a separate transmitting element and a receiving element, or may be integrated. The distance sensor 16a is connected to the CPU 11a via the connector 11b, and is capable of transmitting the detection result to the CPU 11a.

[0058] The first camera 16b is an example of a camera that captures image data that is the basis for acquiring excretion information in the acquisition unit 1a in Fig. 1, and can be an optical camera with a lens portion disposed in a hole provided in the first external box 13. As described in the first embodiment, the first camera 16b is installed so that the imaging range includes the excrement excretion range on the toilet bowl 20. The first camera 16b is connected to the CPU 11a via the USB I / F 11c, and transmits the imaging data to the CPU 11a.

[0059] The second external box 11 will now be described. The CPU 11a is an example of a main control unit of the information processing device 10 and controls the entire information processing device 10. The connector 11b connects the human presence sensor 15a and the distance sensor 16a to the CPU 11a. The USB I / F 11c connects the first camera 16b to the CPU 11a, and the USB I / F 11d connects the second camera 15b to the CPU 11a.

[0060] The human presence sensor 15a is a sensor that detects the presence of a person (entering or leaving a room) in a specific area (measurement area range of the human presence sensor 15a) such as the shaded area in FIG. 4. The shaded area in FIG. 4 is part of the toilet room R. The human presence sensor 15a can employ any detection method, such as an infrared sensor, an ultrasonic sensor, or an optical sensor. The human presence sensor 15a is connected to the CPU 11a via the connector 11b, and when it detects a person in the specific area, it transmits the detection result to the CPU 11a. The detection result can be transmitted by the CPU 11a to the server 40 via the WiFi module 14a.

[0061] The second camera 15b may be an optical camera with a lens portion disposed in a hole provided in the second external box 11, and is an example of a camera that captures a facial image of a user to obtain facial image data in order to identify the user of the toilet. The second camera 15b may be installed on the toilet 20 so that the user's face is included in the imaging range, or may be installed in the toilet room where the toilet 20 is installed.

[0062] The Bluetooth module 14b is an example of a receiver that receives identification data for identifying a user from a Bluetooth tag held by the user, and can be replaced with a module based on other short-range communication standards. The Bluetooth tag held by the user can have a unique ID for each user and can be embedded in a wristband or the like so that the user can carry it.

[0063] The WiFi module 14a is an example of a communication device that transmits various acquired data to the server 40, and can be replaced with a module that employs other communication standards. The facial image data acquired by the second camera 15b and the identification data obtained by the Bluetooth module 14b can be transmitted by the CPU 11a to the server 40 via the WiFi module 14a.

[0064] The CPU 11a, USB I / F 11c, WiFi module 14a, and server 40 can be an example of the acquisition unit 1a in FIG. 1, and obtains excretion information based on image data captured by the first camera 16b. In this case, the server 40 can be mainly responsible for the process of obtaining the excretion information from the image data. In the example of FIG. 2, the server 40 inputs the image data into a trained model to obtain the excretion information. The server 40 then mainly obtains, as at least a part of the excretion information, information indicating whether the image data includes any foreign matter, i.e., an object other than feces or urine, as a subject other than the toilet bowl and its cleaning liquid.

[0065] The CPU 11a, the WiFi module 14a, and the server 40 may be an example of the generator 1b in FIG. 1. In this case, the server 40 may be responsible for the main process of generating presentation information from excretion information. In the example of FIG. 2, the server 40 inputs imaging data into a trained model and acquires presentation information along with the excretion information. Then, when information containing a foreign object is obtained as excretion information (this is the same as when the information is obtained), the server 40 mainly generates warning information as at least part of the presentation information.

[0066] Note that, although the description is based on an example in which the trained model outputs both excretion information and presentation information, each piece of information can also be obtained by two separate trained models as described in embodiment 1. In this case, the case in which information containing the above-mentioned foreign object is obtained is synonymous with the case in which the input imaging data is such that information containing the above-mentioned foreign object is obtained.

[0067] The CPU 11a, the WiFi module 14a, the server 40, and the terminal device 50 can be an example of the output unit 1c in Fig. 1. In this case, the main process of outputting warning information as presentation information when a foreign object is found can be performed by the terminal device 50, and the terminal device 50 receives the presentation information generated by the server 40 and outputs it as a display and / or a sound.

[0068] Furthermore, the server 40 can store presentation information other than the warning information in the storage unit 42 or the like, and can output the information in response to access from the terminal device 50, for example. In particular, it is desirable to adopt such an output example for the excretion diary, which will be described later, and this allows the user to view the excretion diary from the terminal device 50 whenever they wish.

[0069] The CPU 11a and the interface (not shown) between the toilet seat 22 and the CPU 11a can be an example of the flushing control unit 1d in Fig. 1. The flushing function can be controlled by using existing technology to control the amount of water flowing into the toilet bowl 20 (in this example, the toilet seat 22 controls it). The CPU 11a receives excretion information from the server 40 via the WiFi module 14a, and if the excretion information contains information that a foreign object is included, it outputs a stop instruction to the toilet bowl (in this example, the toilet seat 22) to stop the flushing function, which stops the flushing function.

[0070] For example, a power-off notification is sent to a remotely operable power tap connected to the power cord of the toilet seat 22 to stop the flushing function of the toilet bowl 20. More specifically, power can be supplied to the toilet seat 22 via an IoT (Internet of Things) tap, and a stop instruction can be output to the IoT tap to turn off the power. In this case, the stop instruction can be sent by the CPU 11a via the Bluetooth module 14b, for example.

[0071] In this way, the system can input the image data obtained by first camera 16b capturing an image of the imaging range into a trained model (or compare it with other data) to determine whether the object is excrement or something other than excrement. If the object is excrement, the system can also determine the shape, color, and amount of the excrement, and this determination becomes more accurate by using a trained model that has been particularly well-trained. If the system determines that the captured object is not excrement, it notifies a supervisor, such as a caregiver, with a warning (alarm) and stops the flushing function of the toilet 20.

[0072] The server 40 receives the facial image data acquired by the second camera 15b via the WiFi module 14a, compares the facial image data with pre-stored authentication data, for example, by comparing its feature points, and obtains identification data associated with the matching authentication data. In this way, the server 40 can obtain identification data (identification data that identifies the user), that is, identify the user.

[0073] The server 40 can then obtain from the information processing device 10, along with the imaging data, facial image data of the user of the toilet 20 at the time the imaging data was acquired, and can identify the user based on that facial image data, thereby generating presentation information for each user. This facial recognition process allows the most similar user to be identified as the current toilet user. In this way, the above-mentioned identification data can be used to identify the user by performing facial recognition processing based on facial image data captured by the second camera 15b in the toilet 20 or the room in which the toilet 20 is installed (the toilet stall). It is preferable that the facial image data captured by the second camera 15b not be stored for privacy reasons.

[0074] The terminal device 50 can then output the presentation information for each user. Furthermore, if the server 40 predetermines one or more presentation recipients for each user (for example, a supervisor in charge if the user is a care recipient), the server 40 can output the presentation information to the terminal device 50 used by the presentation recipient. Examples of the supervisor include a caregiver and, in some cases, a doctor, but it can also include a caregiver other than a caregiver. Furthermore, depending on the application environment of this system, the supervisor may be someone other than a caregiver.

[0075] Furthermore, the server 40 receives the identification data (personal authentication data) obtained by the Bluetooth module 14b via the WiFi module 14a and compares it with pre-stored identification data for authentication to perform user authentication. For example, if a caregiver carrying his own Bluetooth tag and a person requiring care who also carries his own Bluetooth tag enter the restroom together, the latter may be selected as the user. In this way, the server 40 can obtain the identification data (identification data that identifies the user), that is, identify the user.

[0076] The server 40 can obtain, from the information processing device 10, identification data that identifies the user of the toilet 20 at the time the imaging data was acquired, along with the imaging data, and can generate presentation information for each user based on that identification data. The terminal device 50 can then output that presentation information for each user. Furthermore, if the server 40 predetermines one or more presentation recipients for each user, it can output the presentation information to the terminal device 50 used by those presentation recipients.

[0077] In this example, the user is identified from two types of data, face image data and identification data, and it can be said that the system has two identification functions, but it is of course possible to identify the user using either one. For example, the system can be equipped with both identification functions, and one of them can be selected during operation. Alternatively, the system can be equipped with only one of the identification functions.

[0078] Furthermore, if the presented information is warning information when a foreign object is detected, the following processing can also be performed: After outputting warning information to the terminal devices 50 of multiple caregivers, if the server 40 receives a notification from the terminal device 50 of a certain caregiver that the caregiver will assist the person requiring care, the server 40 can be configured to output subsequent warning information only to the terminal device 50 of the caregiver who made such a declaration. The subsequent warning information can also be the period from when entry is detected until when exit from the room is detected, as will be described later.

[0079] As described above, the detection result of the human presence sensor 15a can be transmitted to the server 40. This detection result can be used to determine entry and exit into the toilet, and therefore, the server 40 is able to obtain this information even when detection is no longer present. When the server 40 receives the detection result from the information processing device 10, it associates it with the identification data of the user identified as described above and stores data indicating entry and exit into the toilet where the toilet 20 is installed (entry and exit data) in the storage unit 42 or the like. Note that the entry and exit data may also include the identification data.

[0080] The server 40 then generates presentation information for each user based on the identification data and the entry / exit data. This allows the server 40 to output presentation information for each user, and by using the entry / exit data, even if there are multiple defecations, they can be handled as excretion information and presentation information for a series of defecation processes.

[0081] Furthermore, in this system, when the motion sensor 15a detects a person, the second camera 15b can be configured to take a picture of the person entering the restroom. This allows face authentication to be performed only when a person is detected.

[0082] Furthermore, the server 40 can grasp when a user enters or leaves the toilet alone based on the data acquired from the human presence sensor 15a and the identification data that identifies the user, and can notify the terminal device 50 of presentation information that includes only such entry and exit. In this case, if one or more notification recipients (for example, if the user is a person requiring care, a supervisor such as a caregiver in charge) are predetermined for each user, notification can be sent to the terminal device 50 used by the notification recipients.

[0083] The same concept can also be applied to processing based on data detected by the distance sensor 16a. That is, the server 40 can refer to the data acquired from the distance sensor 16a, check if the person has been in close proximity for a certain period of time or if the distance exceeds a set threshold, and detect whether the person has been sitting on the toilet seat for a long time or has left the toilet seat 22. The server 40 can then notify each terminal device 50 used by one or more notification recipients of presentation information indicating whether the person has been sitting on the toilet seat for a long time or has left the toilet seat 22.

[0084] Furthermore, after notifying the terminal devices 50 of multiple caregivers, if the server 40 receives a notification from a certain caregiver's terminal device 50 that the server will assist the care-requiring person, the server 40 can be configured to subsequently notify only the terminal device 50 of the caregiver who made such a declaration. The subsequent notification here can be until the caregiver's departure from the room is detected.

[0085] The server 40 can also calculate the timing of excretion based on the excretion information and the date and time of the excretion act, and generate information notifying the timing of excretion as at least a part of the presentation information. The date and time of the excretion act can be obtained from any of the image capture date and time of the image data, the identification date and time of the subject, the entry and exit date and time, the sitting date and time, the leaving date and time, the date and time between sitting and leaving, etc.

[0086] In this case, the notification destination of the presented information can also be, for example, one or more predetermined monitors. Furthermore, this calculation process can be a process of predicting the timing of excretion, so that when the timing of excretion approaches (a predetermined time before the timing of excretion), a prompt to excrete at the scheduled time can be given.

[0087] The excretion timing can be calculated assuming that the cycle of the defecation urge is constant throughout the day, or assuming a constant cycle from an initial time (the time of waking up or the time of the first defecation of the day). In this case, in a simpler example, the excretion timing can be the average interval time, or the average interval time from the initial time. However, the excretion timing can also be obtained by using a trained model to determine the timing of the user's defecation urge according to the time period. Furthermore, it is preferable to calculate and notify the excretion timing separately for urination and defecation based on the excretion information. Furthermore, by notifying the excretion timing to a terminal device held by the care recipient, it is possible to reduce incontinence, etc., of the care recipient and support their independence.

[0088] Next, examples of notification of presentation information to the terminal device 50 will be described with reference to Fig. 5 to Fig. 9. Fig. 5 to Fig. 9 are diagrams for explaining examples of notification in the terminal device in the information processing system of Fig. 2. Note that the presentation information described below is presented in a timely manner, and although not specifically described, can be updated as soon as the information is obtained.

[0089] As shown in FIG. 5, the terminal device 50 can timely notify presentation information 52 to 54 on its display screen 51. Presentation information 54 is an example of information that, when a person is detected by the motion sensor 15a, identifies the user and notifies the user (in this example, PA) of their entry into the restroom. The user's identification can be obtained as a result of performing face authentication processing based on facial image data acquired by the second camera 15b or identification processing received by the Bluetooth module 14b when the motion sensor 15a detects a person. By recording care recipients who require care from multiple people in the face authentication list or the identification list, if the user is one of those people, the presentation information 54 can include information indicating that the user is a recipient of care from multiple people next to the name (in this example, PA). The presentation information 54 can also include a button 54a for selecting notification that assistance will be provided to the care recipient.

[0090] The present system can be configured to, for example, display presentation information 53 on the terminal devices 50 of other caregivers (and the terminal device 50 of the caregiver CA) when the caregiver CA selects button 54a on the terminal device 50. The presentation information 53 can include information that CA will respond to PA. In particular, in the case of a person receiving care from multiple people, as in the case of PA, the present system can also be configured to notify the terminal devices 50 used by the other caregivers of the response to the person requiring care when button 54a is selected. In addition, the presentation information 52 is an example of information notifying PA to leave the toilet when the detected state changes from the non-detected state to the non-detected state.

[0091] As shown in FIG. 6, the terminal device 50 can timely notify the user of presentation information 55 and 56 on its display screen 51. The presentation information 56 is an example of information that identifies a user and notifies the user (PA in this example) that the user has sat on the toilet seat 22 when the distance sensor 16a detects the user sitting on the toilet seat 22. Identification of the user is unnecessary, for example, after the presentation information 54 has been presented, because the process has already been completed. In an example in which the presentation information 54 is not presented, the user can be identified as follows: When the distance sensor 16a detects the user sitting, the user can be identified as a result of performing face recognition processing based on face image data acquired by the second camera 15b or identification processing received by the Bluetooth module 14b. Furthermore, the presentation information 55 is an example of information that notifies the user that the user has left the toilet seat 22 when the detection state for PA changes from a non-detection state to a non-detection state.

[0092] 7, terminal device 50 can timely notify presentation information 57 and 58 on its display screen 51. Presentation information 58 is an example of information that identifies a subject from imaging data acquired by first camera 16b, and if the subject is excrement, identifies the user and notifies the user that the user (in this example, PA) is currently urinating. Identification of the user is unnecessary, for example, after presentation information 54 and 56 has been presented, because the process has already been completed. In an example in which neither presentation information 54 nor 56 is presented, the following may be performed. That is, when a subject is identified from imaging data acquired by first camera 16b, user identification can be obtained as a result of performing face authentication processing based on facial image data acquired by second camera 15b or identification processing received by Bluetooth module 14b.

[0093] Moreover, presented information 57 is an example of information that notifies PA of the completion of excretion when a certain time has passed since the end of excrement identification. Furthermore, instead of determining whether a certain time has passed, the present system can also be configured to obtain new image information from first camera 16b and notify PA of the completion of excretion when no excrement or other foreign objects are present.

[0094] As shown in FIG. 8, the terminal device 50 can notify the user of presentation information 59 on its display screen 51 as appropriate. As described above, the server 40 can be configured to receive and record the image capture date and time of the image data obtained by the first camera 16b (or the date and time when the excrement was identified, etc.) from the information processing device 10. As described above, the server 40 can calculate and record the scheduled date and time of an excretion action (excretion timing) for each user. The presentation information 59 is an example of information that is notified when the scheduled date and time of the user (PA in this example) approaches, based on the calculated excretion timing for each user. Furthermore, the present system can also register the terminal device used by the user (PA in this example) in the server 40. In this case, it is preferable that the notification of the excretion schedule, as exemplified by the presentation information 59, is also notified to the terminal device.

[0095] As shown in FIG. 9 , the terminal device 50 can timely notify presentation information 61-64 on its display screen 51. Presentation information 64 is an example of information that identifies a user when a certain period of time has passed since detection by the distance sensor 16a or the motion sensor 15a, and notifies the user that some abnormality is assumed to have occurred and that the user has been sitting on the toilet seat for a long period of time. This information can also be considered a type of warning information. User identification is unnecessary after presentation information 54, 56, and 57 has been presented, for example, because the process has already been completed. In an example where none of presentation information 54, 56, and 57 is presented, the following procedure may be used. That is, the user can be identified as a result of performing face authentication processing based on face image data obtained by the second camera 15b or identification processing received by the Bluetooth module 14b when a certain period of time has passed since detection by the distance sensor 16a or the motion sensor 15a.

[0096] In addition, the presentation information 63 is an example of warning information that identifies the subject from the image data obtained by the first camera 16b, and if it is a foreign object other than excrement, identifies the user and notifies the user (in this example, Mr. PA) that a foreign object has been mixed in (detected). Similarly, user identification is unnecessary because processing has already been performed, and if processing has not already been performed, it can be obtained as a result of performing face authentication processing or identification processing when the subject is identified from the image data obtained by the first camera 16b. Also, at the same time as outputting the presentation information 63, the information processing device 10 notifies the remotely operable power tap connected to the power cord of the toilet to turn off the power, thereby stopping the toilet's flushing function.

[0097] Furthermore, in this system, the date and time when excrement was identified from the image data obtained by the first camera 16b can be recorded in the server 40. Presentation information 62 is an example of information that notifies that the care recipient has not defecated for a long time, since it is assumed that the care recipient is constipated if there has been no bowel movement record for a certain period of time since the last bowel movement. Presentation information 61 is an example of information that notifies that the care recipient has stayed in the toilet for a long time, if the distance sensor 16a reacts for more than a certain period of time even though excretion and urination have ended. These pieces of presentation information 62 and 61 can also be considered types of warning information.

[0098] Furthermore, it is preferable that the present system be configured so that the content of the presentation process (e.g., notification of warning information) can be set by the user (e.g., the monitor) from, for example, the terminal device 50. For this reason, for example, the server 40 can be configured to store settings for each monitor, and the server 40 can perform processing in accordance with these settings. This allows each monitor to enable or disable the display of various alarms and notifications. To cite a more detailed example, it is preferable that the present system be configured so that a setting such as "a certain monitor CA receives warning information for a certain care-requiring person PA, but does not receive any other information" can also be made.

[0099] The above explanation of this system is based on the assumption that there is only one toilet 20 (only one toilet room). However, it is preferable that this system collects image data from multiple toilets to obtain excretion information. This makes it possible to apply this system to cases where a user may use more than one toilet.

[0100] Next, a system with a distributed server and an example of processing in the system will be described with reference to the above-mentioned example of the excretion diary, together with Fig. 10 and Fig. 11. Fig. 10 is a conceptual diagram showing another example of the information processing system according to this embodiment, and is a diagram showing an example of a system with a distributed server. Fig. 11 is a diagram showing an example of information recorded in the information processing system of Fig. 10.

[0101] The information processing system shown in Fig. 10 includes a toilet 30 with an information processing device 10, a server 40, and a terminal device 50 for recording and notification, as well as a server 70 for prediction. In other words, the information processing system shown in Fig. 10 is a distributed system in which the prediction function of the server 40 in the example described above is provided in the server 70. The server 40 in Fig. 10 has functions such as recording excretion information and an excretion diary generated based on that information.

[0102] The server 40 receives information about the user P in the toilet collected by the information processing device 10 or the like via wireless LAN and records it as excretion information about the user P. The excretion information may include, for example, the date and time of occurrence, the subject, the location of occurrence, the type of subject (mainly the type of excrement), the amount of urination, the shape of the stool, the color of the stool, the number of times of defecation and urination, and any special notes, as illustrated in FIG. 11 . The excretion information may also include the amount of stool, and if a caregiver is present, the name of the caregiver (or the caregiver's ID). Note that the special notes can be separately input from the terminal device 50 or the like. Note that this example also applies to the present system illustrated in FIG. 2. It is desirable that the excretion information be recorded in a database format.

[0103] Furthermore, the excretion information recorded in this manner can be used as data for constructing a trained model, and it can be said that the accuracy of the trained model can basically be improved as the amount of data increases, except in the case of overfitting. Of course, the trained model in this system can be said to be a learning model to be operated, and if it is operated while learning, that learning model is also included in the concept.

[0104] The server 40 also notifies the terminal device 50 used by the monitor C of the user P of presentation information based on the excretion information. Furthermore, the server 40 can also generate an excretion diary as at least a part of the presentation information based on the excretion information. The format of the excretion diary is not important, and examples will be described later. Furthermore, the server 40 can also output a print job (print data) for printing the target excretion diary to, for example, a printing device (not shown) in accordance with a print instruction from the terminal device 50 or the like.

[0105] The server 40 can calculate the urinary flow rate (average, maximum, etc.) or the urination volume (per urination or per unit time) based on the excretion information, and generate information indicating a decrease in the urinary flow rate or urination volume as at least part of the presentation information. In fact, imaging data during urination not only colors the accumulated water, but also includes, as a subject, at least temporarily increased or wavy accumulated water. Therefore, differences occur in the imaging data before urination and during or after urination, and information such as the urination volume can be output as information that reflects this difference using a trained model. Of course, even without using a trained model, as mentioned in the first embodiment, information such as the urination volume can be obtained by comparing the difference. The units of the urinary flow rate and urination volume are not important, and can be ml / sec and ml, respectively, for example. Furthermore, a decrease in the urinary flow rate can be expressed as the percentage of decrease per urination, and information indicating the decrease can be generated, for example, as information indicating whether the decrease exceeds a set threshold.

[0106] The server 40 can also calculate the number of defecations or the amount of defecation per unit period based on the excretion information, and generate information indicating the status of a decrease in the number of defecations as at least part of the presented information. In fact, the imaging data at the time of defecation includes at least the stool as a subject. Therefore, a difference occurs in the imaging data before defecation and during or after defecation, and information such as the amount of defecation can be output as information that reflects this difference using a trained model. Of course, even if a trained model is not used, as mentioned in the first embodiment, information such as the amount of defecation can be obtained by comparing the difference. The unit of the amount of defecation is not important, but it can be ml or cm, for example. 3 For example, the decrease in the number of defecations and the decrease in the amount of stool can be expressed as the rate of decrease in the frequency of defecation and the amount of stool, respectively, and information indicating the decrease status can be generated as information on whether or not a set threshold is exceeded. Note that while it is possible to use only one of these calculations regarding defecation and urination, it is preferable to use both.

[0107] The server 70 also obtains the collected information or information recorded as the excretion diary from the server 40, and predicts excretion timing by extracting and analyzing that information. The excretion timing can include defecation timing and urination timing, and can also include constipation timing and urinary disorder timing, which are obtained by adding a predetermined time to each of these. The server 70 can then notify the corresponding terminal device 50 when the excretion timing arrives or a predetermined time before it.

[0108] Note that the notification destination may be, in addition to or instead of the terminal device 50, a notification device of a nurse call system, another terminal device (e.g., a PHS: Personal Handy-phone System) owned by the monitor other than the terminal device 50, an intercom 80, etc. Also, as described above, if the toilet user has a terminal device, that terminal device can also be included in the notification destinations.

[0109] The server 40 can be installed within a facility such as a hospital, or in a private home or apartment complex for personal use. In either case, the server 40 can be a cloud server. The same is true for the server 70, but the server 70 can be connected to multiple servers 40, and the number of servers 70 can be fewer than the number of servers 40.

[0110] The program of the terminal device 50 can be executable and embedded in the terminal device 50 as care software including a function of presenting the presentation information. In addition to the presentation information, the terminal device 50 can also directly receive and store information obtained on the toilet side of the information processing device 10, etc., and can also receive and store various information recorded in the servers 40, 70 in the same way.

[0111] Next, various examples of the excretion diary will be described with reference to FIGS. 12 to 15, taking as an example a case where the user is a person requiring care and the monitor is a caregiver.

[0112] Fig. 12 is a diagram showing an example of a daily excretion diary for a certain person, generated in the information processing system of Fig. 2 or 10. The excretion diary shown in Fig. 12 is a daily diary specified by an individual (in this example, PA) and a day, and includes time on the vertical axis and facility name, type, amount, shape, color, number of excretions, caregiver name, and special notes on the horizontal axis. The terminal device 50 can read and display an excretion diary in this format from the server 40 by specifying a toilet user and date.

[0113] Figure 13 is a diagram showing an example of an excretion diary for a certain person, generated in the information processing system of Figure 2 or Figure 10, and Figure 14 is a diagram showing a continuation of the excretion diary of Figure 13. The excretion diary shown in Figures 13 and 14 is a one-week diary specified by an individual (in this example, PA) and week, with the vertical axis indicating time and the horizontal axis indicating the type, amount, shape, color, number of excretions, and special notes of urine and stool. The terminal device 50 can read and display an excretion diary in this format from the server 40 by specifying a toilet user and a week.

[0114] Fig. 15 is a diagram showing an example of a daily excretion diary for multiple individuals, generated in the information processing system of Fig. 2 or 10. The excretion diary shown in Fig. 15 is a daily diary specified by multiple individuals (in this example, PA, PB, and PC) and days, and includes time on the vertical axis and type, amount, shape, color, number of excretions, and special notes of urine and feces on the horizontal axis. The terminal device 50 can read and display the excretion log in such a format from the server 40 by specifying multiple toilet users and dates.

[0115] The server 40 can be configured to be able to switch between these excretion diaries and output them in response to a display switching instruction from the terminal device 50 or the like.

[0116] With the above configuration, in the present system, such as the information processing system in Fig. 10, it becomes possible to easily view information for assisting toilet users and view (and add information to) the excretion diary from the terminal device 50. Of course, it is also possible to record and display the excretion diary in a format other than the one exemplified here.

[0117] Next, an example of processing by the information processing system of Fig. 2 or 10 will be described, taking as an example a case where the user is a person requiring care and the monitor is a caregiver, with reference to Fig. 16 to Fig. 19. Fig. 16 is a flow diagram for explaining an example of processing by the information processing system of Fig. 2 or 10, and Fig. 17 is a flow diagram continuing from Fig. 16.

[0118] 16 and 17 are examples of recording, notification, and excretion prediction processes that are performed from when a care-requiring person enters the toilet, excretes, until when he or she leaves the toilet. The processing in the information processing device 10 is mainly executed by the CPU 11a, and the processing in the server 40 (and server 70) is mainly executed by its control unit. Furthermore, the processing exemplified below can be appropriately repeated after completion, thereby performing processing for each excretion act, etc.

[0119] First, the server 40 checks whether or not there is a reaction from the human presence sensor 15a transmitted from the information processing device 10 (step S1), and if there is no reaction (NO), ends the process without any notification. When the care-requiring person enters the toilet, the human presence sensor 15a reacts, and the result in step S1 is YES. In this case, the information processing device 10 inputs face image data captured by the second camera 15b and transmits it to the server 40. The server 40 performs face authentication processing (step S2). It is checked whether or not the person is registered in the list of registered users, and determines whether or not the authentication was successful (step S3). In either case, the server 40 returns the result to the information processing device 10.

[0120] If the answer is YES in step S3 (if the user is a registered user), the server 40 notifies the terminal device 50 that the user has entered the room (step S4). If the answer is NO in step S3 (if the user is an unregistered user), the server 40 notifies the terminal device 50 of this fact (step S5) and ends the process. The warning that the user is an unregistered user enables the owner of the terminal device 50 to recognize, for example, the possibility that the user is a suspicious person.

[0121] Following step S4, the server 40 checks whether there is a reaction from the distance sensor 16a transmitted from the information processing device 10 (step S6), and if there is a reaction (YES), sends a seating notification to the terminal device 50 (step S7). If the result of step S6 is NO (no reaction), the server 40 checks whether there is a reaction from the human presence sensor 15a transmitted from the information processing device 10 (step S8).

[0122] If there is no reaction from the human sensor 15a (NO in step S8), the server 40 notifies the terminal device 50 of the person leaving the room (step S18) and ends the process. If there is a reaction from the human sensor 15a (YES in step S8), the server 40 notifies the terminal device 50 of warning information indicating an abnormality in the person entering the room, as exemplified by the presented information 61 in FIG. 9 (step S19). This warning information is notified because there is a possibility that something abnormal has occurred in the care-requiring person in the toilet. After the process of step S19, the process ends.

[0123] Following step S7, the server 40 performs a subject identification process from the image data acquired by the first camera 16b and transmitted from the information processing device 10, and determines whether or not an identifiable object is present (step S9). If the answer is NO in step S9 (i.e., if no subject is captured), the server 40 proceeds to step S19 and issues a warning because there is a possibility that something abnormal has occurred with the person requiring care in the toilet.

[0124] If the answer is YES in step S9, the server 40 determines whether the subject is excrement (a foreign object) (step S10). If the answer is YES in step S10 (if the subject is excrement), the server 40 notifies the terminal device 50 of the excrement (step S11).

[0125] On the other hand, if step S10 returns NO (the subject is not excrement), there is a possibility that a foreign object has been dropped into the toilet. Therefore, in this case, the server 40 notifies the terminal device 50 of warning information notifying the detection of a foreign object, as exemplified by the presentation information 63 in FIG. 9, and instructs the information processing device 10 to issue an instruction to stop the flushing function of the toilet 20 (step S12). This stops the flushing function, allowing a caregiver to go to the location where the toilet 20 is installed and remove the foreign object, preventing the foreign object from getting into the drainpipe and, if the foreign object requires inspection, handing it over to an inspection agency. After step S12 is processed, the process ends.

[0126] Following step S11, the server 40 determines whether or not an identification object (excrement or foreign object) has been detected for a certain period of time based on the image data transmitted from the information processing device 10 (step S13). If there is no reaction (YES), the server 40 notifies the terminal device 50 that excretion has been completed (step S14). If the result in step S13 is NO (if the reaction continues), the server 40 waits until the result in step S13 becomes YES.

[0127] Following step S14, the server 40 checks whether the distance sensor 16a responds to the information transmitted from the information processing device 10 for a certain period of time (step S15). If the certain period of time has passed since the distance sensor 16a responded (YES in step S15), the care-requiring person may have been sitting on the toilet for a long period of time, which may indicate that something abnormal has occurred. Therefore, in this case, the server 40 proceeds to step S19, issues a warning to the terminal device 50, and ends the process. If the distance sensor 16a does not respond for a certain period of time (NO in step S15), the server 40 notifies the terminal device 50 to leave the seat (i.e., stand up) (step S16).

[0128] Following step S16, the server 40 checks whether or not there is a reaction from the human presence sensor 15a transmitted from the information processing device 10 (step S17). If there is no reaction from the human presence sensor 15a (NO in step S17), the server 40 proceeds to step S18, notifies the terminal device 50 of the user's exit, and ends the process. If there is a reaction from the human presence sensor 15a (YES in step S17), the server 40 proceeds to step S19, notifies the terminal device 50 of warning information indicating an abnormality in the person entering the room, and ends the process.

[0129] An example of the defecation promotion processing will be described with reference to Fig. 18. Fig. 18 is a flow chart for explaining an example of the defecation promotion processing in the information processing system of Fig. 2 or Fig. 10. Here, an example mainly processed by the server 40 of Fig. 10 will be described.

[0130] The server 40 refers to the recorded excretion information for each user, for example, the recorded time of defecation identified by the first camera 16b, and determines whether a certain period (time threshold) has passed without defecation (step S41). Note that this threshold can be changed as appropriate, and it is preferable that it can be changed for each user. If the answer is NO in step S41, the server 40 ends the process. If the answer is YES, the server 40 notifies the terminal device 50 of warning information indicating this (step S42) and ends the process. In this example, the simplest example is given, where the defecation timing is a timing when a certain period has passed since the previous defecation, but the present invention is not limited to this.

[0131] An example of a warning process regarding urination intervals will be described with reference to Fig. 19. Fig. 19 is a flow chart for explaining an example of a warning process regarding urination intervals in the information processing system of Fig. 2 or 10.

[0132] The server 40 determines whether the interval between urinations is shorter than a certain period (time threshold) by referring to the recorded excretion information for each user, for example, the recording time of urination identified by the first camera 16b (step S45). Note that this threshold can be changed as needed, and it is preferable that it can be changed for each user. If the answer is NO in step S51, the server 40 ends the process. If the answer is YES, the server 40 notifies the terminal device 50 of warning information indicating this (step S52) and ends the process. In this example, the urination decline status is determined to be declining if a certain period has not passed since the last urination, but the present invention is not limited to this.

[0133] As described above, the present system can achieve the effects described in embodiment 1. In particular, the present system achieves the following effects, for example.

[0134] The first effect is that by automatically recording the contents of excrement identified by the combination of the first camera and machine learning, it is possible to eliminate the need for manual procedures such as listening to the excrement, measuring urine volume, checking the feces, and creating an excretion diary, which were previously required. In particular, when assisting excretion of a caregiver, it is possible to prevent situations where the caregiver, who needs assistance, continues to sit on the toilet seat after excretion because they are unable to notify the caregiver that they have finished, and this can be prevented. This reduces the administrative work time of the caregiver and other supervisors.

[0135] The second effect is that when the first camera identifies something other than excrement, it issues a warning to the monitor and stops the flushing function, preventing accidents where solid objects such as urine pads are flushed down the toilet drain. This eliminates the need for drainage pipe construction, which has previously been done by contractors, and reduces maintenance costs.

[0136] The third effect is that even if a care-requiring person is in a dangerous state in the toilet, it can be remotely detected by information from distance sensors, human presence sensors, face recognition processing using a second camera, or identification processing using Bluetooth tags, etc. This eliminates the need for a supervisor to monitor the person in front of the toilet, as was previously required, and reduces the time the supervisor spends assisting with excretion.

[0137] The fourth effect is that the possibility of constipation or urinary disorders can be identified from the information recorded (which can be stored as information in a database, for example) that records the contents of excrement identified by the first camera. This eliminates the need to administer laxatives even when unnecessary for safety reasons, as was previously done because the presence or absence of stool was unreliable, thereby reducing medication costs. In addition, by sending a notification to the terminal device held by the toilet user, it is possible to identify trends such as urinary disorders and encourage early medical examination.

[0138] The fifth effect is that the urination intervals of each individual can be determined from the information recorded by the first camera, which means that care recipients do not need to use diapers or urine pads on a regular basis, reducing costs and allowing supervisors to understand the condition of each care recipient and easily provide support for their independence.

[0139] The sixth effect is that the toilet user can be identified using the distance sensor, the motion sensor, and facial image data captured by the second camera. Therefore, the monitor can receive notifications of when the caregiver is absent, when the user enters the toilet alone, when the user leaves the toilet alone, when the user sits on the toilet alone, when the user leaves the toilet alone, and when the user sits alone for a long period of time. This notification allows the caregiver or other monitor to perform other tasks while assisting the care-requiring person with toileting, thereby improving the efficiency of the caregiving work.

[0140] The seventh effect is that by being able to individually select whether to display or hide various notifications, caregivers can delete unnecessary notifications and display only the necessary notifications, which reduces the chance of overlooking notifications and improves the efficiency of assistance work.

[0141] <Other embodiments> [a] In each embodiment, the functions of the information processing system and each device included in the system have been described, but each device is not limited to the configuration example shown in the figure, and it is sufficient if each device can realize these functions.

[0142] [b] Each of the devices according to the first and second embodiments may have the following hardware configuration. Fig. 20 is a diagram showing an example of the hardware configuration of the device. The same applies to the other embodiment [a].

[0143] The device 100 shown in FIG. 20 may have a processor 101, a memory 102, and a communication interface (I / F) 103. The processor 101 may be, for example, a microprocessor, an MPU (Micro Processor Unit), or a CPU. The processor 101 may include multiple processors. The memory 102 is configured, for example, by a combination of a volatile memory and a non-volatile memory. The functions of each device described in the first and second embodiments are realized by the processor 101 reading and executing a program stored in the memory 102. In this case, information can be sent and received with other devices via the communication interface 103 or an input / output interface (not shown).

[0144] In the above examples, the program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives) and magneto-optical recording media (e.g., magneto-optical disks). Further examples include CD-ROMs (Read Only Memory), CD-Rs, and CD-R / Ws. Further examples include semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can be supplied to a computer via wired communication paths such as electrical wires and optical fibers, or wireless communication paths.

[0145] [c] Furthermore, just as the above-described embodiments illustrate the steps of an information processing method in an information processing system, the present disclosure may also be embodied as an information processing method. This information processing method may include the following acquisition step, generation step, output step, and flushing control step. The acquisition step obtains excretion information indicating the details of excretion based on imaging data captured by an imaging device installed so as to include the excretion area of the toilet bowl in its imaging range. The generation step generates presentation information based on the excretion information. The output step outputs the presentation information. The flushing control step controls the flushing function of the toilet bowl. Furthermore, the acquisition step obtains, as at least part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object, which is an object other than feces and urine, as a subject excluding the toilet bowl and the flushing liquid for the toilet bowl. Furthermore, the flushing control step outputs a stop instruction to the toilet bowl to stop the flushing function if information indicating the foreign object is obtained as the excretion information in the acquisition step. Furthermore, in the generating step, if information including the foreign object is obtained as the excretion information in the acquiring step, warning information is generated as at least a part of the presentation information. Note that other examples are as described in the above-mentioned embodiments. Furthermore, it can be said that the program is a program for causing an information processing device (computer) to execute the acquiring step, the generating step, the output step, and the cleaning control step.

[0146] [d] Furthermore, while the various embodiments described above are based on the premise of performing cleaning control, obtaining information on whether foreign matter is present, and stopping the cleaning function based on that information, the present disclosure does not exclude information processing systems, information processing devices, information processing methods, and programs that are configured to not include these processes or functions.

[0147] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0148] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. <Additional Notes>

[0149] (Appendix 1) an acquisition unit that acquires excretion information indicating the content of the excretion based on image data captured by an imaging device installed so as to include the excretion area in the toilet bowl within its imaging range; a generation unit that generates presentation information based on the excretion information; an output unit that outputs the presentation information; a flushing control unit that controls the flushing function of the toilet; Equipped with the acquisition unit acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and a cleaning liquid for the toilet bowl; the flushing control unit outputs a stop instruction to stop the flushing function to the toilet bowl when the acquisition unit obtains information including the foreign matter as the excretion information; the generation unit generates warning information as at least a part of the presentation information when the acquisition unit obtains information including the foreign object as the excretion information. Information processing system.

[0150] (Appendix 2) the acquisition unit acquires the excretion information using a trained model that outputs the excretion information based on the imaging data captured by the imaging device. 10. The information processing system of claim 1.

[0151] (Appendix 3) the acquisition unit and the generation unit obtain the excretion information and the presentation information using a trained model that outputs the excretion information and the presentation information based on the imaging data captured by the imaging device. 10. The information processing system of claim 1.

[0152] (Appendix 4) the generation unit generates an excretion diary as at least a part of the presentation information based on the excretion information. An information processing system according to any one of appendices 1 to 3.

[0153] (Appendix 5) the generation unit calculates a urinary flow rate or a urination volume based on the excretion information, and generates information indicating a decrease in the urinary flow rate or the urination volume as at least a part of the presentation information. An information processing system according to any one of appendices 1 to 4.

[0154] (Appendix 6) The information processing system according to any one of appendices 1 to 5, wherein the generation unit calculates the number of bowel movements or the amount of stool per unit period based on the excretion information, and generates information indicating a decrease in the number of bowel movements as at least a part of the presented information.

[0155] (Appendix 7) the generation unit calculates an excretion timing based on the excretion information and a date and time of the excretion behavior, and generates information notifying the excretion timing as at least a part of the presentation information. An information processing system according to any one of appendices 1 to 6.

[0156] (Appendix 8) 8. The information processing system according to claim 1, wherein the acquisition unit collects the imaging data for a plurality of toilets and obtains the excretion information.

[0157] (Appendix 9) the generation unit generates the presentation information for each user based on identification data that identifies a user of the toilet. An information processing system according to any one of appendices 1 to 8.

[0158] (Appendix 10) the generation unit generates the presentation information for each user based on the identification data and entry / exit data that records entry and exit to a toilet where the toilet is installed. 10. The information processing system of claim 9.

[0159] (Appendix 11) The identification data is data that identifies the user by performing a facial authentication process based on facial image data captured by another imaging device installed in the toilet or in the room where the toilet is installed so that the user's face is included in the imaging range. 11. The information processing system according to claim 9 or 10.

[0160] (Appendix 12) Further comprising the other imaging device, 12. The information processing system of claim 11.

[0161] (Appendix 13) The imaging device further comprises: An information processing system according to any one of appendices 1 to 12.

[0162] (Appendix 14) An information processing device that includes an imaging device and is installed on a toilet bowl such that the imaging device is positioned so that an imaging range of the toilet bowl includes an excrement excretion range, an acquisition unit that acquires excretion information indicating the details of excretion based on the image data captured by the imaging device; a generation unit that generates presentation information based on the excretion information; an output unit that outputs the presentation information; a flushing control unit that controls the flushing function of the toilet; Furthermore, the acquisition unit acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and a cleaning liquid for the toilet bowl; the flushing control unit outputs a stop instruction to stop the flushing function to the toilet bowl when the acquisition unit obtains information including the foreign matter as the excretion information; the generation unit generates warning information as at least a part of the presentation information when the acquisition unit obtains information including the foreign object as the excretion information. Information processing device.

[0163] (Appendix 15) an acquisition step of acquiring excretion information indicating the content of the excretion based on image data captured by an imaging device installed so as to include the excretion area in the toilet bowl within an imaging range; a generation step of generating presentation information based on the excretion information; an output step of outputting the presentation information; a flushing control step for controlling a flushing function of the toilet bowl; Equipped with the acquiring step acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and the flushing liquid for the toilet bowl; The flushing control step outputs a stop instruction to the toilet bowl to stop the flushing function when information including the foreign matter is obtained as the excretion information in the acquisition step, the generating step generates warning information as at least a part of the presentation information when information including the foreign object is obtained as the excretion information in the obtaining step; Information processing methods.

[0164] (Appendix 16) On the computer, an acquisition step of acquiring excretion information indicating the content of the excretion based on image data captured by an imaging device installed so as to include the excretion area in the toilet bowl within an imaging range; a generation step of generating presentation information based on the excretion information; an output step of outputting the presentation information; a flushing control step for controlling a flushing function of the toilet bowl; A program for executing the acquiring step acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and the flushing liquid for the toilet bowl; The flushing control step outputs a stop instruction to the toilet bowl to stop the flushing function when information including the foreign matter is obtained as the excretion information in the acquisition step, the generating step generates warning information as at least a part of the presentation information when information including the foreign object is obtained as the excretion information in the obtaining step; program.

[0165] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

[0166] This application claims priority based on Japanese Patent Application No. 2019-146294, filed on August 8, 2019, the disclosure of which is incorporated herein in its entirety.

[0167] 1. Information Processing Systems 1a Acquisition part 1b Generator 1c Output section 1d Cleaning control section 10. Information processing equipment 11 Second external box 11a CPU 11b connector 11c, 11d USB I / F 12 Box-to-box connection 13 First external box 14a WiFi module 14b Bluetooth module 15a Human sensor 15b Second Camera 16a Distance sensor 16b First Camera 20 Toilet 21 Main Unit 22 toilet seat 23 Toilet seat cover 30 Toilet with information processing device 40, 70 servers 41 Control Unit 42 Storage section 50 Terminal Equipment 51 Display screen 52, 53, 54, 55, 56, 57, 58, 59, 61, 62, 63, 64 Presentation information 54a Button 80 Intercom 100 devices 101 processors 102 memory 103 Communication Interface

Claims

1. an acquisition means for acquiring excretion information indicating the content of the user's excretion based on image data captured by an imaging device installed so as to include the excretion area of the toilet bowl in its imaging range; a generating means for generating presentation information based on the excretion information; Equipped with the acquiring means acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and the flushing liquid for the toilet bowl; When the acquisition means acquires information including the foreign object as the excretion information, the generation means generates, as at least a part of the presentation information, warning information including information indicating detection of the foreign object. Information processing system.

2. The information processing system according to claim 1 , wherein the warning information includes information that the foreign object is vomit or vomited blood.

3. The information processing system according to claim 1 , wherein the warning information includes information that the foreign object is a urine absorption pad or a toilet paper roll.

4. The information processing system according to claim 1 , further comprising an output unit that outputs the warning information to a terminal device of a monitor other than the user.

5. After receiving a notification from one of the terminal devices that has transmitted the warning information that it will respond to the warning information, the output means outputs subsequent warning information to that one terminal device. The information processing system according to claim 4 .

6. A corresponding monitor is previously determined for the user, The output means outputs the warning information to a terminal device of the monitor corresponding to the user. The information processing system according to claim 4 .

7. An information processing device that includes an imaging device and is installed on a toilet bowl such that the imaging device is positioned so that an imaging range of the toilet bowl includes an excrement excretion range, an acquisition means for acquiring excretion information indicating the content of the user's excretion based on the image data captured by the imaging device; a generating means for generating presentation information based on the excretion information; Furthermore, the acquiring means acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and the flushing liquid for the toilet bowl; When the acquisition means acquires information including the foreign object as the excretion information, the generation means generates, as at least a part of the presentation information, warning information including information indicating detection of the foreign object. Information processing device.

8. an acquisition step of acquiring excretion information indicating the content of the user's excretion based on image data captured by an imaging device installed so as to include the excretion range of the toilet bowl in the imaging range; a generation step of generating presentation information based on the excretion information; Equipped with The acquisition step acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and the flushing liquid for the toilet bowl; In the generating step, when information including the foreign object is acquired as the excretion information in the acquiring step, warning information including information indicating detection of the foreign object is generated as at least a part of the presentation information. Information processing methods.

9. On the computer, an acquisition step of acquiring excretion information indicating the content of the user's excretion based on image data captured by an imaging device installed so as to include the excretion range of the toilet bowl in the imaging range; a generation step of generating presentation information based on the excretion information; A program for executing The acquisition step acquires, as at least a part of the excretion information, information indicating whether the imaging data captured by the imaging device includes a foreign object other than feces and urine as a subject other than the toilet bowl and the flushing liquid for the toilet bowl; In the generating step, when information including the foreign object is acquired as the excretion information in the acquiring step, warning information including information indicating detection of the foreign object is generated as at least a part of the presentation information. program.

Images