Excrement determination method, excrement determination device, and excrement determination program

Abstract

This excrement determination device: acquires image data captured by a camera installed on a toilet bowl in a toilet so as to be capable of capturing a bowl part of the toilet bowl; acquires sensing data from a sensor that detects a user sitting on and leaving the toilet seat; decides whether the image data is valid or invalid on the basis of a change in the sensing data; determines that the user has defecated and / or urinated on the basis of only the image data decided to be valid; and outputs the determination result.

Description

Technical Field

[0006] , , , , ,

[0005]

[0001] The present disclosure relates to a technique for determining excrement based on image data.

Background Art

[0002] Patent Document 1 discloses a technique for detecting whether feces or urine has been discharged based on a change in the water level of the water seal formed at the bottom of the bowl portion, and causing the imaging means to image the feces or urine until the end of the feces or urine is detected when it is detected that the feces or urine has been discharged.

[0003] However, in the technique of Patent Document 1, when the seating state of the user sitting on the toilet changes, if the imaging means attempts to recognize the image of the excrement from the captured image data, there is a possibility that the excrement may be misrecognized, and further improvement is required.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

[0005] The present disclosure has been made to solve such problems, and an object thereof is to provide a technique for preventing the image of excrement from being misrecognized from image data when the seating state of the user sitting on the toilet changes.

[0006] A method for determining excrement in one aspect of the present disclosure is a method for determining excrement in an excrement determination device for determining excrement, wherein the processor of the excrement determination device acquires image data captured by a camera installed on the toilet so as to be able to photograph the bowl portion of the toilet bowl in the toilet, acquires sensing data from a sensor that detects when a user sits on and leaves the toilet bowl, decides whether to enable or disable the image data based on the changes in the sensing data, determines that at least one of defecation and urination has been performed by the user based only on the image data that has been determined to be enabled, and outputs the result of the determination.

[0007] According to this disclosure, when the seating position of a user sitting on a toilet changes, it is possible to prevent misrecognition of images of excrement from image data. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram shows the configuration of the excrement detection system in Embodiment 1. [Figure 2] This diagram illustrates the arrangement of the sensor unit and the excrement detection device in Embodiment 1. [Figure 3] This is a sequence diagram showing an overview of the processing of the excrement determination device in Embodiment 1. [Figure 4] This flowchart shows an example of the processing of the excrement detection device in Embodiment 1. [Figure 5] This flowchart shows the details of the invalidity determination process. [Figure 6] This is a sequence diagram illustrating the invalidity determination process. [Figure 7] This is a flowchart showing an example of excretion detection processing. [Figure 8] This is a block diagram showing an example of the configuration of the excrement determination system in Embodiment 2. [Figure 9] This flowchart shows an example of the invalidity determination process in Embodiment 2. [Figure 10]This is an explanatory diagram of the invalidity determination process in Embodiment 2. [Figure 11] This is a block diagram showing an example of the configuration of the excrement determination system in Embodiment 3. [Figure 12] This flowchart shows an example of the calibration process. [Figure 13] This is an explanatory diagram of the calibration process. [Modes for carrying out the invention]

[0009] (Knowledge forming the basis of this disclosure) In nursing care facilities, information about the frequency and timing of bowel movements is crucial for understanding the health risks of those being cared for. However, assigning caregivers the task of recording this information places a significant burden on them. Furthermore, having caregivers record this information while they are near the person being cared for places a considerable psychological burden on that person. Therefore, there is a need for a system that recognizes excrement from image data captured by a camera installed in the toilet, generates bowel information based on the recognition results, and automatically records the generated information.

[0010] However, during defecation, changes in seating position may occur, such as the user briefly lifting their buttocks off the toilet seat by readjusting their posture, or spreading their legs to wipe away waste while seated. When seating position changes, the amount of ambient light entering the toilet bowl increases rapidly, causing a rapid increase in the brightness of the image data captured by the camera, making it difficult to accurately recognize the waste from the image data. At this time, the camera's automatic exposure function activates, but it takes a certain amount of time for the camera's exposure to adjust to the appropriate exposure for the ambient light, making it difficult to correctly recognize the waste from the image data captured during that time.

[0011] Particularly, for a care recipient who needs assistance from a caregiver to sit on the toilet, they often sit down again several times before the sitting motion is completed, resulting in frequent changes in the sitting state. Also, for such care recipients, it is not easy to wipe their buttocks with paper, so there are also frequent changes in the sitting state in this case. Therefore, for such care recipients, it becomes difficult to correctly recognize excrement from the image data.

[0012] This disclosure has been made to solve such problems.

[0013] The excrement determination method in one aspect of this disclosure is an excrement determination method in an excrement determination device for determining excrement. The processor of the excrement determination device acquires image data captured by a camera installed on the toilet so that the bowl part of the toilet in the toilet can be photographed, acquires sensing data of a sensor that detects the user's sitting on and getting off the toilet, determines whether to make the image data valid or invalid based on changes in the sensing data, determines that at least one of defecation and urination has been performed by the user based only on the image data determined to be valid, and outputs the result of the determination.

[0014] According to this configuration, the validity and invalidity of the image data are determined based on changes in the sensing data of the sensor that detects the user's sitting on and getting off the toilet. Therefore, even if the external light entering the bowl part changes rapidly with the change in the sitting state, the image data captured in such a changed case can be determined as invalid image data. As a result, the excrement detection process is not applied to the image data when the external light entering the bowl part changes rapidly. As a result, misrecognition of excrement can be prevented when the sitting state of the user sitting on the toilet changes.

[0015] In the above excrement determination method, in the determination, after the sensing data indicates the sitting, if the change in the sensing data exceeds a predetermined range, the image data may be made invalid.

[0016] According to this configuration, when a user sitting on the toilet reseats, the image data can be invalidated.

[0017] In the above excrement determination method, in the determination, when the period during which the sensing data indicates the seat-off continues for a first period, the seat-off of the user from the toilet may be determined.

[0018] According to this configuration, when the period during which the sensing data indicates the seat-off continues for a first period, the seat-off is determined, so the seat-off of the user from the toilet can be accurately determined.

[0019] In the above excrement determination method, in the determination, when the period during which the change in the sensing data is within the predetermined range continues for a second period after the sensing data indicates the seating, at least the image data captured during the second period may be invalidated.

[0020] According to this configuration, after the sensing data indicates the seating, the image data captured until the second period during which the change in the sensing data is within the predetermined range elapses is invalidated. Therefore, even if the external light entering the bowl part rapidly decreases due to the user's seating on the toilet, it is possible to wait for the exposure of the camera to become an appropriate exposure according to the external light by the automatic exposure function and then apply the excretion detection process to the image data, preventing misrecognition of excrement.

[0021] In the above excrement determination method, in the determination, when the period during which the change in the sensing data is within the predetermined range continues for a second period after the sensing data indicates the seating, the seating may be determined.

[0022] According to this configuration, the seating can be determined after waiting for the exposure of the camera to become an appropriate exposure according to the external light.

[0023] In the above excrement determination method, in the determination, when the change in the sensing data goes out of the predetermined range after the seating is determined, the image data may be invalidated.

[0024] With this configuration, if the seating status changes after seating has been confirmed, the image data can be invalidated.

[0025] In the above method for determining excrement, the sensing data may be the distance value from a distance measuring sensor or the illuminance value from an illuminance sensor.

[0026] With this configuration, since the distance measurement value from the distance sensor or the illuminance value from the illuminance sensor is used as sensing data, the user's seating and unseating can be accurately detected.

[0027] In the above method for determining the presence of excrement, the determination may be made using valid image data from a predetermined period prior to the most recent image data to determine whether at least one of the defecation and urination has occurred.

[0028] With this configuration, it is determined that at least one of defecation and urination has occurred using valid image data from a predetermined period prior to the latest image data, thus reliably preventing the application of excretion detection processing to image data determined to be invalid.

[0029] In the above-described method for determining excrement, the determination is made by comparing image data captured by the camera with reference toilet bowl color data to determine that at least one of the defecation and urination has occurred, and the reference toilet bowl color data may be calculated based on the color data of a region within the bowl portion that is spaced a predetermined distance from the rim of the toilet bowl toward the toilet bowl's reservoir.

[0030] With this configuration, reference toilet bowl color data is generated based on image data of an area within the bowl that is a predetermined distance away from the rim of the bowl towards the toilet bowl's reservoir. This makes it possible to generate reference toilet bowl color data using color data from areas of the bowl other than the rim where it is difficult to clean accumulated dirt, and thus enable accurate detection of excrement from the image data.

[0031] A different aspect of this disclosure provides a program for determining the type of excrement that causes a computer to execute the above-described method for determining the type of excrement.

[0032] This configuration makes it possible to provide a waste determination program that can achieve the same effects as the waste determination method described above.

[0033] An excrement determination device in another aspect of the present disclosure is an excrement determination device for determining excrement, comprising: a first acquisition unit that acquires image data captured by a camera installed on the toilet so as to be able to photograph the bowl portion of the toilet bowl in the toilet; a second acquisition unit that acquires sensing data from a sensor that detects when a user sits on and leaves the toilet bowl; a determination unit that determines whether to enable or disable the image data based on changes in the sensing data; a determination unit that determines that at least one of defecation and urination has been performed by the user based only on the image data determined to be enabled; and an output unit that outputs the result of the determination.

[0034] This configuration makes it possible to provide a waste determination device that can achieve the same effects as the waste determination method described above.

[0035] A method for determining excrement in another aspect of the present disclosure is a method for determining excrement in an excrement determination device for determining excrement, wherein the processor of the excrement determination device acquires image data captured by a camera installed in the toilet so as to be able to photograph the bowl portion of the toilet bowl in the toilet, determines whether to enable or disable the image data based on changes in the image data, determines that at least one of defecation and urination has occurred based only on the image data determined to be enabled, and outputs the result of the determination.

[0036] When the user's seating position on the toilet changes, such as when they readjust their position or spread their legs to wipe away waste, the amount of ambient light entering the bowl changes rapidly, and this change in light intensity is reflected as a change in image data. With this configuration, it is determined whether to enable or disable the image data based on the change in image data. Therefore, even if the ambient light entering the bowl changes rapidly due to a change in seating position, the image data captured during that changed period can be determined as invalid image data. As a result, the excretion detection process is not applied to image data when the ambient light entering the bowl changes rapidly. Consequently, misrecognition of excrement can be prevented when the user's seating position on the toilet changes.

[0037] In the above method for determining excrement, if the determination involves detecting a predetermined object from the image data and a predetermined condition is met indicating that the number of pixels of the detected object has changed rapidly, the image data may be invalidated.

[0038] When the amount of ambient light entering the bowl changes rapidly due to a change in seating position, this change is reflected as a change in the number of pixels of a predetermined object included in the image data. With this configuration, if a predetermined condition is met indicating that the number of pixels of a predetermined object included in the image data has changed rapidly, the image data is determined to be invalid. Therefore, changes in seating position can be accurately detected from the image data.

[0039] In the above method for determining excrement, the predetermined conditions may be that the number of pixels of the object increases at a predetermined rate of increase and decreases at a predetermined rate of decrease.

[0040] This configuration allows for the distinction between rapid changes in pixel count due to diarrhea, urination, and bleeding, and changes in the pixel count of a given object due to changes in seating position.

[0041] In the above excrement determination method, the predetermined condition may be that the number of pixels at the t-th (t is a positive integer) sampling point is greater than a value obtained by multiplying the number of pixels at the (t - 1)-th sampling point by P1, and the number of pixels at the k-th (≤ t - 1) sampling point, which is at least one sampling point within a certain period in the past from the t-th sampling point, is smaller than a value obtained by multiplying the number of pixels at the (k - 1)-th sampling point by P2 (< P1).

[0042] According to this configuration, a rapid change in the number of pixels of a predetermined object associated with a change in the sitting state can be accurately detected.

[0043] In the above excrement determination method, the predetermined object may be at least one of urination, defecation, and blood.

[0044] When the external light entering the bowl part changes rapidly due to a change in the sitting state, the change appears as a change in the size of the images showing urination, defecation, and blood, which is detected from the image data. Therefore, according to this configuration, a change in the sitting state can be accurately detected from the change in the number of pixels showing urination, defecation, and blood.

[0045] In the above excrement determination method, in the determination, it may be determined that at least one of defecation and urination has occurred by using valid image data from a predetermined period before the latest image data.

[0046] According to this configuration, since it is determined that at least one of defecation and urination has occurred by using valid image data from a predetermined period before the latest image data, it is possible to surely prevent the application of excrement detection processing to image data determined to be invalid.

[0047] In the above-described method for determining excrement, the determination is made by comparing image data captured by the camera with reference toilet bowl color data to determine that at least one of the defecation and urination has occurred, and the reference toilet bowl color data may be calculated based on the color data of an area within the bowl portion that is separated from the rim of the bowl portion by a predetermined distance toward the toilet bowl's reservoir portion.

[0048] With this configuration, reference toilet bowl color data is generated based on image data of an area within the bowl that is a predetermined distance away from the rim of the bowl towards the toilet bowl's reservoir. This makes it possible to generate reference toilet bowl color data using color data from areas of the bowl other than the rim where it is difficult to clean accumulated dirt, and thus enable accurate detection of excrement from the image data.

[0049] A waste determination program in another aspect of this disclosure causes a computer to execute the waste determination method described above.

[0050] This configuration makes it possible to provide a waste determination program that achieves the same effects as the waste determination method described above.

[0051] An excrement determination device in another aspect of the present disclosure is an excrement determination device for determining excrement, comprising: an acquisition unit that acquires image data captured by a camera installed on a toilet so as to be able to photograph the bowl portion of the toilet bowl in the toilet; a determination unit that determines whether to enable or disable the image data based on changes in the image data; a determination unit that determines that at least one of defecation and urination has occurred based on the image data determined to be enabled; and an output unit that outputs the result of the determination.

[0052] This configuration provides a waste determination device that can achieve the same effects as the waste determination method described above.

[0053] This disclosure can also be implemented as an excrement determination system operated by such an excrement determination program. Furthermore, it goes without saying that such a computer program can be distributed via a computer-readable non-temporary recording medium such as a CD-ROM or via a communication network such as the Internet.

[0054] The embodiments described below are all specific examples of this disclosure. The numerical values, shapes, components, steps, and order of steps shown in the following embodiments are examples only and are not intended to limit this disclosure. Furthermore, among the components in the following embodiments, those not described in the independent claim representing the highest-level concept will be described as optional components. In addition, the contents of each embodiment can be combined.

[0055] (Embodiment 1) Figure 1 is a diagram showing the configuration of the excrement detection system in Embodiment 1 of the present disclosure. Figure 2 is a diagram illustrating the arrangement of the sensor unit 2 and the excrement detection device 1 in Embodiment 1 of the present disclosure.

[0056] The excrement detection system shown in Figure 1 includes an excrement detection device 1, a sensor unit 2, and a server 3. The excrement detection device 1 is a device that determines whether or not a user has excreted based on image data captured by a camera 24. The excrement detection device 1 is installed, for example, on the side of a water storage tank 105, as shown in Figure 2. However, this is just an example, and the excrement detection device 1 may be installed on the wall of the toilet, or built into the sensor unit 2, and its installation location is not particularly limited. The excrement detection device 1 is connected to the server 3 via a network. The network is, for example, a wide-area communication network such as the Internet. The server 3 manages the user's excretion information generated by the excrement detection device 1.

[0057] As shown in Figure 2, the sensor unit 2 is attached, for example, to the rim 101 of the toilet bowl 100. The sensor unit 2 is connected to the excrement detection device 1 so as to be able to communicate with each other via a predetermined communication path. The communication path may be a wireless communication path such as Bluetooth® or Wi-Fi, or it may be a wired LAN.

[0058] As shown in Figure 2, the toilet bowl 100 includes a rim 101 and a bowl portion 102. The rim 101 is located at the upper end of the toilet bowl 100 and defines the opening of the toilet bowl 100. The bowl portion 102 is located below the rim 101 and receives feces and urine.

[0059] A water reservoir 104 is provided at the bottom of the bowl 102. A drain (not shown) is provided in the reservoir 104. Feces and urine excreted in the bowl 102 are drained through the drain into the sewer pipe. In other words, the toilet 100 is a flush toilet. A toilet seat 103 is provided on top of the toilet 100 for the user to sit on. The toilet seat 103 rotates up and down. The user sits with the toilet seat 103 lowered on the rim 101. A water tank 105 is provided at the rear of the toilet 100 to store flushing water for flushing away feces and urine.

[0060] Refer back to Figure 1. Sensor unit 2 includes a seating sensor 21, an illuminance sensor 22, a lighting device 23, and a camera 24. The seating sensor 21 and the illuminance sensor 22 are examples of sensors that detect when a user sits on and leaves the toilet bowl 100.

[0061] The seating sensor 21 is positioned on the toilet 100 so as to be able to measure the distance to the buttocks of a user seated on the toilet 100. The seating sensor 21 is composed of, for example, a distance measuring sensor and measures a distance value which is the distance to the buttocks of a user seated on the toilet 100. An example of a distance measuring sensor is an infrared distance measuring sensor. The seating sensor 21 measures the distance value at a predetermined sampling rate and inputs the measured distance value to the excrement detection device 1 at a predetermined sampling rate. The seating sensor 21 is an example of a sensor that detects the seating state of a user. The distance value is an example of sensing data that indicates the user's seating and standing states.

[0062] The illuminance sensor 22 is positioned in the toilet bowl 100 to measure the illuminance inside the bowl 102. The illuminance sensor 22 measures the illuminance inside the bowl 102 at a predetermined sampling rate and inputs the measured illuminance value to the excrement detection device 1 at a predetermined sampling rate. The illuminance value is an example of sensing data indicating when a user is seated or standing.

[0063] The lighting device 23 is positioned on the toilet bowl 100 to illuminate the inside of the bowl portion 102. The lighting device 23 is, for example, a white LED and illuminates the inside of the bowl portion 102 under the control of the excrement detection device 1.

[0064] Camera 24 is installed in the toilet bowl 100 so that the bowl portion 102 can be photographed. Camera 24 is, for example, a high-sensitivity, wide-angle camera capable of capturing color images having R (red), G (green), and B (blue) components. Camera 24 images the inside of the bowl portion 102 at a predetermined frame rate and inputs the obtained image data to the excrement detection device 1 at a predetermined sampling rate.

[0065] The camera 24 includes an automatic exposure unit 241. The automatic exposure unit 241 performs an automatic exposure function that controls the exposure of the camera 24 to achieve appropriate exposure according to the illuminance inside the bowl 102. Here, the automatic exposure unit 241 may control the exposure of the camera 24 based on the illuminance value detected by the illuminance sensor 22.

[0066] The excrement detection device 1 includes a processor 11, a memory 12, a communication unit 13, and an entry / exit sensor 14.

[0067] The processor 11 is composed of, for example, a central processing unit (CPU) or an ASIC (application-specific integrated circuit). The processor 11 includes a first acquisition unit 111, a second acquisition unit 112, a determination unit 113, a judgment unit 114, and an output unit 115.

[0068] The first acquisition unit 111 acquires image data captured by the camera 24 at a predetermined sampling rate.

[0069] The second acquisition unit 112 acquires the distance measurement value measured by the seat sensor 21 at a predetermined sampling rate. The second acquisition unit 112 also acquires the illuminance value measured by the illuminance sensor 22 at a predetermined sampling rate.

[0070] The decision unit 113 determines whether to enable or disable the image data acquired by the first acquisition unit 111 based on changes in the sensing data of the seat sensor 21 or the illuminance sensor 22. Specifically, the decision unit 113 disables the image data if, after the sensing data of the seat sensor 21 or the illuminance sensor 22 indicates seating, the change in the sensing data exceeds a predetermined range. Here, the image data to be disabled may be image data from the present to a certain period in the past, or image data for a certain period before and after the present.

[0071] The determination unit 113 determines that the user has left the toilet bowl 100 if the sensing data from the seating sensor 21 or the illuminance sensor 22 indicates that the user has left the seat for a first period of time. The first period is a predetermined period of time, for example, from when the sensing data indicates that the user has left the seat until the user has stood up from the toilet bowl 100. The first period can be any appropriate value, such as 5 seconds, 10 seconds, or 20 seconds.

[0072] The determination unit 113 invalidates image data captured during at least the second period if, after the sensing data from the seating sensor 21 or the illuminance sensor 22 indicates that a seat has been taken, the change in the sensing data remains within a predetermined range for a second period. The second period is a predetermined time during which, for example, the amount of ambient light entering the bowl portion 102 decreases due to seating, and consequently, the automatic exposure unit 241 of the camera 24 is expected to operate, and the camera 24's exposure will adjust to the reduced ambient light.

[0073] Furthermore, the determination unit 113 confirms seating if, after the sensing data from the seating sensor 21 or the illuminance sensor 22 indicates seating, the change in the sensing data remains within a predetermined range for a second period.

[0074] The determination unit 113 invalidates the image data if the change in sensing data from the seat sensor 21 or the illuminance sensor 22 falls outside a predetermined range after the user's seating on the toilet bowl 100 has been confirmed. This prevents misrecognition of excrement by invalidating the image data if the user readjusts their position on the toilet bowl 100 after seating has been confirmed.

[0075] The determination unit 114 determines whether defecation and urination have occurred by the user, based only on image data determined to be valid by the decision unit 113. Specifically, the determination unit 114 sets a detection area D1 (see Figure 13) including the accumulation area 104 for valid image data, and determines whether defecation and urination have occurred by comparing the image data of the detection area D1 (hereinafter referred to as detection area data) with the standard toilet bowl color data. Specifically, the determination unit 114 removes pixel data having the color indicated by the standard toilet bowl color data (standard toilet bowl color) from the detection area data. Here, the determination unit 114 only needs to remove pixel data from the detection area data whose R, G, B values ​​are within a predetermined range relative to the R, G, B values ​​of the standard toilet bowl color.

[0076] The determination unit 114 then determines that urination has occurred if the detection area data (hereinafter referred to as the image data to be determined) from which the pixel data of the standard toilet bowl color has been removed satisfies the urination conditions. The determination unit 114 also determines that defecation has occurred if the image data to be determined satisfies the defecation conditions.

[0077] Furthermore, the determination unit 114 may determine whether or not the user is bleeding based on the image data that has been determined to be valid. In this case, the determination unit 114 only needs to determine that the user is bleeding if the image data to be determined satisfies the bleeding conditions.

[0078] Here, the standard toilet bowl color data is calculated based on image data of the standard region C2 (see Figure 13), which is the area within the bowl portion 102 located a predetermined distance away from the rim 101 of the toilet bowl 100 towards the reservoir portion 104. Specifically, the standard toilet bowl color data has the average values ​​of the R, G, and B values ​​of the standard region C2.

[0079] The output unit 115 generates excretion information including the determination result from the determination unit 114, and outputs the generated excretion information. Here, the output unit 115 may send the excretion information to the server 3 using the communication unit 13, or it may store the excretion information in the memory 12.

[0080] Memory 12 is composed of a storage device capable of storing various types of information, such as RAM (Random Access Memory), SSD (Solid State Drive), or flash memory. Memory 12 stores, for example, excretion information and standard toilet bowl color data. Memory 12 may also be a portable memory such as a USB (Universal Serial Bus) memory.

[0081] The communication unit 13 is a communication circuit that has the function of connecting the excrement detection device 1 to the server 3 via a network. The communication unit 13 also has the function of connecting the excrement detection device 1 to the sensor unit 2 via a communication path. The excretion information is information that associates, for example, information indicating that excretion has occurred (defecation, urination, and bleeding) and date and time information indicating the date and time of excretion. The excrement detection device 1 can, for example, generate excretion information on a daily basis and transmit the generated excretion information to the server 3.

[0082] The entry / exit sensor 14 is composed of, for example, a distance measuring sensor. The entry / exit sensor 14 detects when a user enters the toilet where the toilet bowl 100 is installed. Here, the distance measuring sensor that makes up the entry / exit sensor 14 has lower measurement accuracy but a wider detection range compared to the distance measuring sensor that makes up the seating sensor 21. The entry / exit sensor 14 may be composed of, for example, a motion sensor instead of a distance measuring sensor. The distance measuring sensor is, for example, an infrared distance measuring sensor. The motion sensor detects a user who is within a predetermined distance from the toilet bowl 100.

[0083] The above describes the configuration of the excrement determination system. Next, an overview of the processing of the excrement determination device 1 will be explained. Figure 3 is a sequence diagram showing an overview of the processing of the excrement determination device 1 in Embodiment 1 of this disclosure.

[0084] In Figure 3, the first row shows the sequence of the entry / exit sensor 14, which is composed of a motion sensor; the second row shows the sequence of the entry / exit sensor 14, which is composed of a distance measuring sensor; the third row shows the sequence of the seating sensor 21; the fourth row shows the sequence of the illuminance sensor 22; and the fifth row shows the sequence of the lighting device 23. In the example in Figure 3, the sequences of both the entry / exit sensor 14 composed of a motion sensor and the entry / exit sensor 14 composed of a distance measuring sensor are shown, but the excrement detection device 1 only needs to be equipped with at least one of the entry / exit sensors 14.

[0085] At timing t1, the user enters the toilet. Accordingly, the decision unit 113 determines that the user has entered the toilet based on the sensing data input from the entry / exit sensor 14 (human presence sensor) or the entry / exit sensor 14 (distance sensor). Here, the entry / exit sensor 14 (human presence sensor) sets the sensing data to high when it detects a user and sets the sensing data to low when it no longer detects a user. Therefore, the decision unit 113 determines that the user has entered the toilet when the sensing data input from the entry / exit sensor 14 (human presence sensor) is high. The decision unit 113 also determines that the user has entered the toilet when the distance value measured by the entry / exit sensor 14 (distance sensor) falls below the threshold A1. The threshold A1 can be any appropriate value, such as 50cm, 100cm, or 150cm.

[0086] Furthermore, at timing t1, the determination unit 113 starts accumulating the sensing data input from the entry / exit sensor 14, the seating sensor 21, and the illuminance sensor 22 into the memory 12.

[0087] Furthermore, at timing t1, upon detecting a user, the determination unit 113 sends an entry notification to the server 3 using the communication unit 13, indicating that the user has entered the toilet.

[0088] At timing t2, the user is seated on the toilet bowl 100. Accordingly, the distance measurement value input from the seating sensor 21 becomes less than or equal to the seating detection threshold A2, and the determination unit 113 determines that the user is seated on the toilet bowl 100. The seating detection threshold A2 is a predetermined value that indicates, for example, that the distance measurement value from the seating sensor 21 to the user's buttocks indicates that the user is seated on the toilet bowl 100. The seating detection threshold A2 is smaller than threshold A1, and appropriate values ​​such as 10cm, 15cm, or 20cm can be adopted.

[0089] Furthermore, at timing t2, the ambient light entering the bowl portion 102 is blocked by the user's buttocks due to seating, resulting in a decrease in the illuminance value input from the illuminance sensor 22.

[0090] Furthermore, at timing t2, the determination unit 113 turns on the lighting device 23 upon detection of seating. This causes the lighting device 23 to illuminate the inside of the bowl section 102, ensuring the necessary amount of light for extracting excrement from the image data.

[0091] Furthermore, at timing t2, the determination unit 113 activates the camera 24 and causes the camera 24 to photograph the inside of the bowl section 102. Thereafter, the first acquisition unit 111 acquires image data at a predetermined sampling rate.

[0092] The entry notification may also be sent at timing t2.

[0093] During the period B1 between timing t3 and timing t4, the user readjusts their position on the toilet 100. Consequently, at timing t3, the distance value measured by the seat sensor 21 exceeds the seat detection threshold A2, and at timing t4, the distance value measured by the seat sensor 21 falls below the seat detection threshold A2. Also, at timing t3, the determination unit 113 turns off the lighting device 23, and at timing t4, the determination unit 113 turns on the lighting device 23. Furthermore, the illuminance value measured by the illuminance sensor 22 also changes in conjunction with the distance value measured by the seat sensor 21.

[0094] At timing t5, the user has left the toilet bowl 100. Consequently, the distance measured by the seat sensor 21 exceeds the seat detection threshold A2. Also at timing t5, the determination unit 113 turns off the lighting device 23.

[0095] At timing t6, the distance measurement value of the entry / exit sensor 14 exceeds the threshold A1, so the determination unit 113 determines that the user has left the toilet. Accordingly, the output unit 115 sends an exit notification to the server 3 using the communication unit 13, indicating that the user has left the toilet. Furthermore, at timing t6, the output unit 115 sends excretion information generated based on the image data to the server 3 using the communication unit 13. Note that the exit notification and excretion information may also be sent at timing t7.

[0096] At timing t7, since the distance measurement value of the seat sensor 21 exceeded the seat detection threshold A2 for a period of B2 at timing t5, the determination unit 113 terminates the accumulation of sensing data in the memory 12 and also terminates the imaging of the inside of the bowl section 102 by the camera 24.

[0097] At timing t8, since the high state of the entry / exit sensor 14 (human presence sensor) has been active for a period of B4 since timing t7, the determination unit 113 puts the excrement detection device 1 into standby mode.

[0098] Next, the details of the processing of the excrement detection device 1 will be described. Figure 4 is a flowchart showing an example of the processing of the excrement detection device 1 in Embodiment 1 of this disclosure. In the following flowchart, the sensing data is assumed to be the distance measurement value detected by the seat sensor 21.

[0099] In step S1, the determination unit 113 determines whether or not the user has sat on the toilet bowl 100. Here, if the distance value acquired by the second acquisition unit 112 from the seating sensor 21 is less than or equal to the seating detection threshold A2 (YES in step S1), the determination unit 113 determines that the user has sat on the toilet and proceeds to step S2. On the other hand, if the distance value is greater than the seating detection threshold A2 (NO in step S1), the determination unit 113 waits in step S1 before proceeding.

[0100] In step S2, the determination unit 113 performs an invalidity determination process to determine whether the image data is valid or invalid. Details of the invalidity determination process will be described later with reference to Figure 5.

[0101] In step S3, the determination unit 114 determines whether or not urination has been confirmed. If urination has not been confirmed (NO in step S3), the process proceeds to step S4; if urination has been confirmed (YES in step S3), the process proceeds to step S7. Confirmation of urination means that it has been determined that the image data contains an image of urination.

[0102] In step S4, the determination unit 114 performs an excretion detection process that determines, based on the image data, that the user has performed at least one of urination and defecation. Details of the excretion detection process will be described later with reference to Figure 7.

[0103] In step S5, if the determination unit 114 determines that urination has occurred in the excretion detection process (YES in step S5), it confirms urination (step S6). On the other hand, if urination is not detected in the excretion detection process (NO in step S5), the process proceeds to step S7.

[0104] In step S7, the determination unit 114 determines whether or not defecation has been confirmed. If defecation has been confirmed (YES in step S7), the process proceeds to step S11; if defecation has not been confirmed (NO in step S7), the process proceeds to step S8. Confirmation of defecation means that it has been determined that the image data contains an image of defecation.

[0105] In step S8, the determination unit 114 performs excretion detection processing.

[0106] In step S9, if the determination unit 114 determines that defecation has occurred in the defecation detection process (YES in step S9), it confirms the defecation (step S10). On the other hand, if the determination unit 114 does not determine that defecation has occurred in the defecation detection process (NO in step S9), it proceeds to step S11.

[0107] In step S11, the decision unit 113 determines whether or not the user's departure from the seat has been confirmed. If the departure from the seat has been confirmed in step S42 (described later), the decision unit 113 determines YES in step S11 and proceeds to step S12. On the other hand, if the departure from the seat has not been confirmed (NO in step S11), the decision unit 113 returns to step S2.

[0108] In step S12, the output unit 115 transmits the exit notification and excretion information to the server 3 using the communication unit 13.

[0109] Next, the details of the invalidity determination process will be explained. Figure 5 is a flowchart showing the details of the invalidity determination process. In step S31, the determination unit 113 samples the distance measurement values ​​acquired by the second acquisition unit 112. Here, two distance measurement values ​​are sampled: the distance measurement value SD(0) at the latest sampling point (t) and the distance measurement value SD(-1) at the previous sampling point (t-1).

[0110] In step S32, the determination unit 113 determines whether the measured distance value SD(0) is greater than the measured distance value SD(-1) minus width N, and less than the measured distance value SD(-1) plus width N. That is, the determination unit 113 determines whether the change in the measured distance value SD is within a predetermined range. The width N can be any appropriate value such as 3 mm, 4 mm, 5 mm, 6 mm, or 10 mm. Twice the width N is one example of a predetermined range.

[0111] If the change in the measured distance value SD is within a predetermined range (YES in step S32), the process proceeds to step S33. If the change in the measured distance value SD exceeds the predetermined range (NO in step S32), the process proceeds to step S38.

[0112] In step S33, the determination unit 113 determines whether the period during which the change in the distance measurement value SD is within a predetermined range has continued for a second period. If this period has continued for a second period (YES in step S33), the determination unit 113 confirms that the user is seated on the toilet 100 (step S35) and proceeds to step S41. On the other hand, if the period during which the change in the distance measurement value SD is within a predetermined range has not continued for a second period (NO in step S33), the determination unit 113 counts up the timer that measures the second period (step S36).

[0113] In step S37, the determination unit 113 invalidates the image data and proceeds to step S41. Here, the determination unit 113 invalidates the image data by setting the pixel count data PD(t) = 0. The pixel count data PD(t) is the count value of the pixels that represent defecation, urination, and blood, respectively, in the image data of the sampling point (t). For example, if the image data of the sampling point (t) has X pixels that represent defecation, Y pixels that represent urination, and Z pixels that represent blood, then the pixel count data PD(t) = (X, Y, Z).

[0114] The determination unit 113 can invalidate the image data by setting the pixel count data PD(t) in the image data from the most recent sampling point up to 20 sampling points prior, i.e., the pixel count data PD(0), PD(-1), ..., PD(-20), to 0. Image data with pixel count data PD(0), PD(-1), ..., PD(-20) = 0 will not be detected as having the presence or absence of excretion in the excretion detection process described later. Therefore, by setting the pixel count data PD(0), PD(-1), ..., PD(-20) to 0, the image data from sampling point (0) to sampling point (-20) can be invalidated. Setting the pixel count data PD to 0 means setting all pixel count data PD for defecation, urination, and blood to 0.

[0115] In this example, image data from the most recent sampling point up to 20 sampling points prior was invalidated. However, this is just one example. Only the image data from the most recent sampling point may be invalidated, or image data from the most recent sampling point up to any sampling point other than 20 may be invalidated, or image data captured during a certain period before and after the most recent sampling point may be invalidated. The same applies to step S40, which will be described later.

[0116] In step S38, the determination unit 113 invalidates the seat confirmation because the change in the measured distance value SD exceeds a predetermined range.

[0117] In step S39, the determination unit 113 resets the timer that counts the second period.

[0118] In step S40, the determination unit 113 disables the image data from sampling point (0) to (-20) by setting the pixel count data PD(0)···PD(-20)=0.

[0119] In step S41, the determination unit 113 determines whether the period during which the measured distance value SD(0) is greater than the seating detection threshold A2 has continued for the first period. If this period has continued for the first period (YES in step S41), the determination unit 113 invalidates the confirmation of seating and confirms the departure from the seat, and proceeds to step S11 (Figure 4). On the other hand, if the period during which the measured distance value SD(0) is greater than the seating detection threshold A2 has not continued for the first period (NO in step S41), the process proceeds to step S3 (Figure 4).

[0120] Figure 6 is a sequence diagram illustrating the invalidity determination process. In Figure 6, the first waveform W1 indicates whether or not seating has been confirmed. In waveform W1, a high indicates confirmed seating, and a low indicates invalid seating.

[0121] At timing t1, the user sat on the toilet bowl 100, so the measured distance SD became less than or equal to the seating detection threshold A2. Also at timing t1, the change in the measured distance SD fell within a predetermined range, so the timing of the second period began.

[0122] At timing t2, the change in the measured distance value SD remained within a predetermined range for a second period, so seating is confirmed. As a result, the second period from timing t1 to timing t2 is an invalid interval. Image data captured during the invalid interval is invalidated. Note that at each sampling point in the invalid interval, image data from the most recent sampling point up to 20 sampling points prior may also be invalidated.

[0123] Between timings t3 and t4, the user readjusts their position on the toilet bowl 100. As a result, at timing t3, the change in the measured distance value SD exceeds a predetermined range, invalidating the confirmation of seating and initiating the invalidation period. This readjustment causes a rapid increase in ambient light entering the bowl portion 102, but since the image data is invalidated, the excretion detection process is not applied to the image data.

[0124] Between timings t3 and t4, the measured distance SD exceeds the seating detection threshold A2, but immediately falls below the seating detection threshold A2 due to the user sitting down. In other words, the period during which the measured distance SD exceeded the seating detection threshold A2 did not continue for the first period. Therefore, the invalid interval continues.

[0125] At timing t4, the change in the measured distance value SD fell within a predetermined range, so the timing of the second period began.

[0126] At timing t5, the period during which the change in the measured distance value SD remained within a predetermined range continued for the second period, thus ending the invalid section and confirming seating. This allows the image data to be activated only after the exposure of camera 24 has reached the appropriate exposure. Therefore, misidentification of excrement from the image data is prevented.

[0127] At timing t6, the user begins to leave the toilet bowl 100. As a result, the change in the measured distance value SD exceeds a predetermined range, so an invalidation period is started and the seating is invalidated.

[0128] At timing t7, the measured distance SD exceeded the seating detection threshold A2, so the timing of the first period began.

[0129] At timing t8, the period during which the measured distance SD exceeded the seating detection threshold A2 continued for the first period, thus confirming that the vehicle had left its seat.

[0130] Next, we will explain the excretion detection process. Figure 7 is a flowchart showing an example of the excretion detection process.

[0131] In step S110, the determination unit 114 obtains standard toilet bowl color data from the memory 12.

[0132] In step S120, the determination unit 114 acquires the image data for the processing timing from the image data acquired by the first acquisition unit 111. The image data for the processing timing is, for example, the image data from a predetermined sampling point (e.g., 20 sampling points) prior to the latest sampling point. However, this is just an example, and the image data for the processing timing may be the image data from the latest sampling point.

[0133] In step S130, the determination unit 114 determines whether the image data for the processing timing is valid or not. Here, the determination unit 114 determines that the image data for the processing timing is invalid if the pixel count data PD is 0, and that the image data for the processing timing is valid if the pixel count data PD is not 0. Specifically, if all the pixel count data PD for defecation, urination, and blood is 0, the image data for the processing timing is determined to be invalid. If the image data for the processing timing is valid (YES in step S130), the process proceeds to step S140, and if the image data for the processing timing is invalid (NO in step S130), the process proceeds to step S5 or step S9 (Figure 4).

[0134] In step S140, the determination unit 114 extracts image data of the detection area D1 (detection area data) from the image data at the processing timing.

[0135] In step S150, the determination unit 114 determines whether the detection area data contains pixel data of a different color from the standard toilet color. If the detection area data contains pixel data of a different color from the standard toilet color (YES in step S150), the process proceeds to step S160. If the detection area data does not contain pixel data of a different color from the standard toilet color (NO in step S150), the process proceeds to step S5 or S9.

[0136] In step S160, the determination unit 114 generates image data to be determined by removing pixel data from the detection area data that have R, G, B values ​​outside a predetermined range relative to the R, G, B values ​​of the reference toilet bowl color data.

[0137] In step S170, the determination unit 114 determines whether the image data to be determined satisfies the urination condition. Here, the urination condition is the condition that the image data to be determined contains pixel data within a predetermined R, G, B range that indicates urination. If the urination condition is met (YES in step S170), the process proceeds to step S180; if the urination condition is not met (NO in step S170), the process proceeds to step S190. Note that the urination condition may also be the condition that there are a predetermined number or more pixel data within a predetermined R, G, B range that indicates urination.

[0138] In step S180, the determination unit 114 determines that urination has occurred in the image data to be processed, and proceeds to step S5 or step S9 (Figure 4).

[0139] In step S190, the determination unit 114 determines whether the image data to be determined satisfies the defecation condition. Here, the defecation condition is the condition that the image data to be determined contains pixel data within a predetermined R, G, B range that indicates defecation. If the defecation condition is met (YES in step S190), the process proceeds to step S200; if the defecation condition is not met (NO in step S190), the process proceeds to step S210. Note that the defecation condition may also be the condition that there are a predetermined number or more pixel data within a predetermined R, G, B range that indicates defecation.

[0140] In step S200, the determination unit 114 determines that there is defecation in the image data to be processed, and proceeds to step S5 or step S9 (Figure 4).

[0141] In step S210, the determination unit 114 determines whether the image data to be determined satisfies the bleeding condition. Here, the bleeding condition is the condition that the image data to be determined contains pixel data within a predetermined R, G, B range that indicates blood. If the bleeding condition is met (YES in step S210), the process proceeds to step S220; if the bleeding condition is not met (NO in step S210), the process proceeds to step S230. Note that the bleeding condition may also be the condition that there are a predetermined number or more pixel data within a predetermined R, G, B range that indicates bleeding.

[0142] In step S220, the determination unit 114 determines that there is bleeding in the image data to be processed, and proceeds to step S5 or step S9 (Figure 4).

[0143] In step S230, the determination unit 114 determines that there is a foreign object in the image data to be determined. The foreign object is, for example, a diaper or toilet paper.

[0144] As described above, according to the excrement detection device 1 of Embodiment 1, the validity or invalidity of image data is determined based on changes in sensing data from a sensor that detects when a user sits on and leaves the toilet. Therefore, even if the ambient light entering the bowl portion 102 changes rapidly due to a change in the seating state, the image data captured during the period of change can be determined as invalid image data. As a result, the excrement detection process is not applied to image data when the ambient light entering the bowl portion 102 changes rapidly. Consequently, misrecognition of excrement can be prevented when the seating state of a user sitting on the toilet 100 changes.

[0145] (Embodiment 2) Embodiment 2 invalidates image data if the number of pixels of an object detected from the image data changes rapidly. Figure 8 is a block diagram showing an example of the configuration of the excrement detection system in Embodiment 2 of this disclosure. In Embodiment 2, the same reference numerals are used for components that are the same as in Embodiment 1, and their descriptions are omitted.

[0146] The excrement determination device 1A includes a processor 21A. The processor 21A includes an acquisition unit 211, a determination unit 212, a determination unit 213, and an output unit 214. The acquisition unit 211, the determination unit 213, and the output unit 214 are the same as the first acquisition unit 111, the determination unit 113, the determination unit 114, and the output unit 115 in Figure 1.

[0147] The determination unit 212 detects a predetermined object from the image data and invalidates the image data if it meets a predetermined condition (hereinafter referred to as the invalidation condition) indicating that the number of pixels of the detected object has changed rapidly. The invalidation condition will be described later. The predetermined object is at least one of urination, defecation, and blood.

[0148] Next, the processing of the excrement detection device 1A in Embodiment 2 will be described. The main routine of the excrement detection device 1A is the same as in Figure 4. Also, the excrement detection process in the excrement detection device 1A is the same as in Figure 7. The invalidity determination process of the excrement detection device 1A differs from that of the excrement detection device 1, so the invalidity determination process will be described below.

[0149] Figure 9 is a flowchart showing an example of the invalidity determination process in Embodiment 2. In step S51, the determination unit 212 shifts the pixel count data PD. Specifically, the determination unit 212 sets the pixel count data PD(1) to PD(20) by setting the pixel count data PD(0) to PD(1), setting the pixel count data PD(1) to PD(2), ..., setting the pixel count data PD(19) to PD(20).

[0150] In step S52, the determination unit 212 acquires the latest image data.

[0151] In step S53, the determination unit 212 detects the number of pixels for urination, defecation, and blood from the latest image data. Here, the determination unit 212 extracts a detection area D1 from the latest image data and detects the number of pixels for urination by counting the pixel data within a predetermined R, G, B range that indicates urination in the extracted detection area D1. The determination unit 212 also detects the number of pixels for defecation by counting the pixel data within a predetermined R, G, B range that indicates defecation in the detection area D1 of the latest image data. Furthermore, the determination unit 212 detects the number of pixels for blood by counting the pixel data within a predetermined R, G, B range that indicates blood in the detection area D1 of the latest image data.

[0152] In step S54, the determination unit 212 sets the number of pixels for urination, defecation, and blood detected from the latest image data into the pixel count data PD(0).

[0153] In step S55, the determination unit 212 determines whether the pixel count data PD satisfies the invalid condition. Here, the invalid condition is that |PD(0)|>|PD(-1)|×P1, and at least one pixel count data PD(k) within the (Q×T) period satisfies |PD(k)|<|PD(k-1)|×P2.

[0154] k is an integer less than or equal to -1. P1 can be any appropriate value such as 5, 6, or 7. P2 is a value smaller than P1, and can be any appropriate value such as 2, 3, or 4. Q is any appropriate value such as 3, 4, or 5. T is the sampling period. The determination unit 212 may determine YES in step S55 if at least one of the pixel count data PD from urination, defecation, and blood satisfies the invalid condition. Alternatively, the determination unit 212 may use the sum of urination, defecation, and blood as the pixel count data PD.

[0155] If the pixel count data PD satisfies the invalid condition (YES in step S55), the process proceeds to step S56. If the pixel count data PD does not satisfy the invalid condition (NO in step S55), the process proceeds to step S3 (Figure 4).

[0156] In step S56, the determination unit 212 sets PD(0), PD(-1), ..., PD(Q)=0. This invalidates the image data at sampling points (t), (t-1), ..., (tQ). For example, if Q=3, the four image data corresponding to the pixel count data PD(0), PD(-1), PD(-2), PD(-3) are invalidated. Once the processing in step S56 is complete, the process proceeds to step S3 (Figure 4).

[0157] Figure 10 is an explanatory diagram of the invalidity determination process in Embodiment 2. In this example, |PD(0)|>|PD(-1)|×P1. Furthermore, |PD(-2)|<|PD(-3)|×P2. Therefore, the pixel count data PD satisfies the invalidity condition. Consequently, the period from sampling point (0) to sampling point (t-3) is set as the invalidity interval.

[0158] When the seating position changes, such as when readjusting one's position on the toilet or spreading the legs to wipe away waste, the amount of ambient light entering the bowl changes rapidly, and this change in light intensity is reflected as a change in pixel count data (PD).

[0159] Therefore, the determination unit 212 determines that if it meets predetermined conditions indicating a rapid change in the pixel count data PD, the image data from the period of the rapid change is invalid. As a result, the excretion detection process is not applied to the image data from the period when the ambient light entering the bowl changed rapidly. Consequently, misrecognition of excrement can be prevented when the seating position of the user sitting on the toilet 100 changes.

[0160] The invalidation conditions are PD(0) > PD(-1) × P1, and at least one PD(k) within the (Q × T) period is PD(k) <PD(k-1)×P2であってもよい。

[0161] Furthermore, the invalidation condition may also be that, during the period Q×T, there is an interval in which the pixel count data PD increases at a slope greater than or equal to a predetermined rate of increase, and an interval in which the pixel count data PD decreases at a slope equal to a predetermined rate of decrease.

[0162] (Embodiment 3) Embodiment 3 performs a calibration process for the standard toilet bowl color. Figure 11 is a block diagram showing an example of the configuration of the excrement determination system in Embodiment 3. In Embodiment 3, the same reference numerals are used for components that are the same as those in Embodiments 1 and 2, and their descriptions are omitted.

[0163] The processor 31 of the excrement determination device 1B includes a first acquisition unit 311, a second acquisition unit 312, a determination unit 313, a determination unit 314, an output unit 315, and a calibration execution unit 316. The first acquisition unit 311 to the output unit 315 are the same as the first acquisition unit 111 to the output unit 115 in Figure 1.

[0164] The calibration execution unit 316 performs a calibration process to determine the standard toilet bowl color.

[0165] Figure 12 is a flowchart showing an example of the calibration process.

[0166] In step S71, the calibration execution unit 316 acquires image data captured by the camera 24, applies processing such as pattern matching to the acquired image data, and detects markers. Figure 13 is an explanatory diagram of the calibration process. Marker M1 is located at a predetermined position on the rim 101 of the toilet bowl 100. Marker M1 is a marker used when setting the detection area D1 and the reference area C2 in the image data.

[0167] In step S72, the calibration execution unit 316 determines whether or not marker M1 was detected. If marker M1 was detected (YES in step S72), the process proceeds to step S73; if marker M1 was not detected (NO in step S72), the process proceeds to step S76.

[0168] In step S73, the calibration execution unit 316 sets the detection area D1 and the reference area C2 in the image data. Here, setting information is predetermined that specifies at which coordinates in the image data the detection area D1 and the reference area C2 should be set, with respect to the marker M1. Therefore, the calibration execution unit 316 only needs to set the detection area D1 and the reference area C2 in the image data according to the setting information from the marker M1. The detection area D1 is a rectangular area including the accumulation area 104. The reference area C2 is a rectangular area within the bowl portion 102 that is spaced a predetermined distance from the edge portion 101 toward the accumulation area 104 and does not include the accumulation area 104.

[0169] In step S74, the calibration execution unit 316 calculates toilet bowl reference color data from the reference area C2. The toilet bowl reference color data is the average value of the R, G, and B values ​​of each pixel data constituting the reference area C2.

[0170] In step S75, the calibration execution unit 316 stores the calibration results in the memory 12. The calibration results include the coordinates of the vertices of the set detection area D1, the coordinates of the vertices of the reference area C2, and the reference toilet bowl color data.

[0171] Referring to Figure 13, conventionally, the area within the bowl portion 102 immediately below the rim 101 was set as the reference area C1. The area immediately below the rim 101 is difficult to clean, and therefore dirt is difficult to remove. Consequently, if the reference toilet bowl color data is calculated from the reference area C1, it may not be possible to calculate reference toilet bowl color data that accurately represents the color of the bowl portion 102 due to the influence of dirt. Therefore, the calibration execution unit 316 calculates the reference color data from the reference area C2.

[0172] In step S76, the calibration execution unit 316 terminates the process without storing the calibration results in the memory 12.

[0173] Thus, according to the excrement determination device 1B of Embodiment 3, it is possible to calculate appropriate standard toilet bowl color data.

[0174] This disclosure may be modified as follows:

[0175] (1) In addition to the invalidity determination process shown in Embodiment 1, the excrement determination device 1 may also perform the invalidity determination process shown in Embodiment 2. In this case, if the result is NO in step S41 in Figure 5, the process should proceed to step S51 in Figure 9. The invalidity determination process according to Embodiment 1 is effective for detecting changes in the seating state due to, for example, readjusting one's position. On the other hand, the invalidity determination process according to Embodiment 2 is effective for detecting changes in the seating state due to a seated user spreading their legs. Therefore, by combining Embodiment 1 and Embodiment 2, it is possible to detect changes in the seating state due to readjusting one's position and changes in the seating state due to spreading the legs.

[0176] (2) In the flowchart of Figure 5, the validity of image data is determined using the distance measurement value of the seat sensor 21, but the validity of image data may also be determined using the illuminance value detected by the illuminance sensor 22. In this case, in step S32, SD(0) represents the illuminance value at sampling point (0), and SD(-1) represents the illuminance value at sampling point (t-1). In addition, the seat detection threshold A2 in step S41 is a predetermined illuminance value that indicates that the user has left the toilet bowl 100.

[0177] (3) The calibration process shown in Embodiment 3 may also be applied to Embodiment 2. [Industrial applicability]

[0178] The excrement detection device described in this disclosure is useful in technology for determining whether excretion has occurred from image data.

Claims

1. A method for determining excrement in an excrement determination device for determining excrement, The processor of the excrement determination device, Image data is acquired from a camera installed on the toilet, which is capable of photographing the bowl portion of the toilet bowl inside the toilet. The sensor that detects when a user sits on and leaves the toilet bowl acquires sensing data. Based on the changes in the sensing data, a decision is made to enable or disable the image data. Based solely on the image data determined to be valid, it is determined that at least one of defecation and urination has occurred by the user. Output the result of the above determination. Excretion determination method.

2. In the above determination, if the change in the sensing data exceeds a predetermined range after the sensing data indicates the seating, the image data is disabled. The method for determining the type of excrement according to claim 1.

3. In the aforementioned determination, if the sensing data indicates that the user has left the toilet for a period of time, the user's departure from the toilet is confirmed. The method for determining the type of excrement according to claim 2.

4. In the above determination, if, after the sensing data indicates the seating, the change in the sensing data remains within the predetermined range for a second period, the image data captured during at least the second period is invalidated. A method for determining the type of excrement according to claim 2 or 3.

5. In the above determination, if, after the sensing data indicates the seating, the change in the sensing data remains within the predetermined range for a second period, the seating is confirmed. A method for determining the type of excrement according to any one of claims 2 to 4.

6. In the above determination, if the change in the sensing data falls outside the predetermined range after the seating is confirmed, the image data is invalidated. The method for determining the type of excrement according to claim 5.

7. The sensing data is the distance measurement value from the distance measuring sensor or the illuminance value from the illuminance sensor. A method for determining the type of excrement according to any one of claims 1 to 6.

8. In the determination described above, valid image data from a predetermined period prior to the most recent image data is used to determine whether at least one of the defecation and urination events has occurred. A method for determining the type of excrement according to any one of claims 1 to 7.

9. In the determination, the image data captured by the camera is compared with the standard toilet bowl color data to determine that at least one of the defecation and urination has occurred. The aforementioned standard toilet bowl color data is calculated based on the color data of the area within the bowl portion, which is located at a predetermined distance from the rim of the toilet bowl toward the toilet bowl's reservoir. A method for determining the type of excrement according to any one of claims 1 to 8.

10. The method for determining the type of excrement according to any one of claims 1 to 9 is to be performed by a computer. Excrement identification program.

11. A waste determination device for determining the type of waste, A first acquisition unit acquires image data captured by a camera installed on the toilet, which allows the bowl portion of the toilet bowl inside the toilet to be photographed. A second acquisition unit acquires sensing data from a sensor that detects when a user sits on and leaves the toilet bowl, A decision unit that determines whether to enable or disable the image data based on the changes in the sensing data, A determination unit that determines, based solely on the image data determined to be valid, that at least one of defecation and urination has been performed by the user, The system includes an output unit that outputs the result of the determination, Excretion determination device.

12. A method for determining excrement in an excrement determination device for determining excrement, The processor of the excrement determination device, Image data is acquired from a camera installed on the toilet, which is capable of photographing the bowl portion of the toilet bowl inside the toilet. Based on the changes in the image data, a decision is made to enable or disable the image data. Based solely on the image data determined to be valid, it is determined that at least one of defecation and urination has occurred. The result of the above determination is output, and in the determination, if a predetermined condition is met indicating that a predetermined object has been detected from the image data and the number of pixels of the detected object has changed rapidly, the image data is invalidated. Excretion determination method.

13. The aforementioned predetermined condition is that the number of pixels of the object increases at a predetermined rate of increase and decreases at a predetermined rate of decrease. The method for determining the type of excrement according to claim 12.

14. The predetermined conditions are that the number of pixels at the t-th (where t is a positive integer) sampling point is greater than the number of pixels at the (t-1)-th sampling point multiplied by P1, and the number of pixels at the k-th (≤t-1) sampling point, which is at least one sampling point in a certain period prior to the t-th sampling point, is less than the number of pixels at the (k-1)-th sampling point multiplied by P2 (<P1). The method for determining the type of excrement according to claim 12 or 13.

15. The aforementioned predetermined object is at least one of urine, feces, and blood. A method for determining the type of excrement according to any one of claims 12 to 14.

16. In the determination described above, valid image data from a predetermined period prior to the most recent image data is used to determine whether at least one of the defecation and urination events has occurred. A method for determining the type of excrement according to any one of claims 12 to 15.

17. In the determination described above, the image data captured by the camera is compared with the standard toilet bowl color data to determine that at least one of the defecation and urination has occurred. The aforementioned standard toilet bowl color data is calculated based on the color data of a region within the bowl portion that is a predetermined distance away from the rim of the bowl portion toward the toilet bowl's reservoir portion. A method for determining the type of excrement according to any one of claims 12 to 16.

18. A waste determination program that causes a computer to execute the waste determination method described in any one of claims 12 to 17.

19. A waste determination device for determining the type of waste, An acquisition unit that acquires image data captured by a camera installed on the toilet so that the bowl portion of the toilet bowl inside the toilet can be photographed, A determination unit that determines whether to enable or disable the image data based on the changes in the image data, A determination unit that determines that at least one of defecation and urination has occurred based on the image data that has been determined to be valid, It includes an output unit that outputs the result of the determination, The determination unit detects a predetermined object from the image data, and if a predetermined condition is met indicating that the number of pixels of the detected object has changed rapidly, it invalidates the image data. Excretion determination device.

Images