Biomonitoring devices, methods, and systems for use in bathroom environments
The integration of sensors in toilets and mirrors for excretion analysis addresses the lack of electronic biomonitoring in bathrooms, enabling accurate and convenient health tracking and intervention monitoring.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- TOI LABS INC
- Filing Date
- 2026-03-03
- Publication Date
- 2026-06-02
Smart Images

Figure 2026090577000001_ABST
Abstract
Description
Technical Field
[0001] This application claims the benefit of U.S. Provisional Application No. 62 / 482,912, filed Apr. 7, 2017.
[0002] This application generally relates to biomonitoring. More specifically, this application discloses biomonitoring devices and methods for measuring medically important excretions and health-related characteristics and for assisting with health-related tasks.
Background Art
[0003] The examination of human excretions is recognized to provide insights into human health. Self-reporting can be done by diary, but is subject to interpretation and bias. The ability to objectively and consistently assay excretions on a regular basis can help track symptoms of dysfunction and determine the effectiveness of medications, diets, lifestyles, supplements, and other interventions.
[0004] The major components of a bathroom in the United States, including toilets and mirrors, have not changed fundamentally for over 100 years. In the United States, toilets rarely have electric, sensor, or network-connected functionality. In Japan, toilet seats are widely used as electric bidets for hygienic reasons. Most bathroom mirrors around the world do not have electric sensors or network-connected functionality, especially related to health or wellness.
[0005] Therefore, there is a need for an accurate, convenient, and unbiased electronic biomonitoring function for analyzing excretions and other health-related characteristics in a bathroom environment. The present invention addresses that need.
Prior Art Documents
Patent Documents
[0006]
Patent Document 1
Patent Document 2
[0007] [Non-Patent Document 1] Gruber et al. (2016). Gas monitoring during a glucose challenge by a combined PTR-QMS / GCxGC-TOFMS approach for the verification of potential volatile biomarkers. Journal of breath research. 10:036003 [Non-Patent Document 2] Janssen et al. (2000) Estimation of skeletal muscle mass by bioelectrical impedance analysis. Journal of Applied Physiology 89:465-471 [Non-Patent Document 3] Kushner (1992). Bioelectrical impedance analysis: a review of principles and applications. Journal of the American College of Nutrition 11:199-209 [Non-Patent Document 4] Kushner and Schoeller (1986). Estimation of total body water by bioelectrical impedance analysis. American Journal of Clinical Nutrition 44:417-424 [Non-Patent Document 5] Zheng et al. (2011) The footprints of gut microbial-mammalian co-metabolism. Journal of proteome research. 10:5512-22 [Overview of the Initiative] [Problems that the invention aims to solve]
[0008] The present invention relates to devices, systems, and methods for electronic biomonitoring of the characteristics of excrement in a bathroom environment. [Means for solving the problem]
[0009] Accordingly, in some embodiments, a biomonitoring device is provided that measures the parameters of substances discharged while a user is using a toilet. This device comprises a sensor that detects electromagnetic radiation or sample chemical substances in the toilet bowl.
[0010] An example of a biomonitoring device that functions as a bathroom mirror is also provided. The device identifies the user, detects the user's febrile illness, dispenses medication / supplements quantitatively, connects to electrical device accessories in the bathroom, and provides an interactive user interface.
[0011] Furthermore, a system is provided for measuring the parameters of substances excreted by users during toilet use. This system includes the biomonitoring device described above.
[0012] In other embodiments, a method for determining a user's physiological parameters is provided. This method involves discharging a substance into a toilet bowl in the presence of the biomonitoring device described above. [Brief explanation of the drawing]
[0013] [Figure 1] This is a perspective view of the system of the present invention. [Figure 2A] This is a top perspective view of the seat-integrated toilet device of the present invention. [Figure 2B] This is a bottom view of the device. [Figure 2C] This is an exploded view of the image sensor inside the device. [Figure 2D] This figure shows a portion of the device's interior from an upper oblique cross-sectional view. [Figure 2E] This is a magnified view of the load cell inside the device. [Figure 2F] This figure shows the spectral components within the device. [Figure 3A] This figure shows an air duct system in the seat-integrated toilet device of the present invention, and is a perspective view of the air duct system located at the bottom of the device. [Figure 3B] This is a magnified view of the air outlet path from the air duct system. [Figure 3C] This is a magnified view of the array of gas sensors within the air duct system. [Figure 4A] This is an exploded perspective view of an embodiment of the image sensor of the present invention. [Figure 4B] This is an enlarged exploded view of an image sensor embodiment. [Figure 5A] This is an exploded perspective view of another embodiment of the image sensor of the present invention. [Figure 5B] This is an enlarged exploded view of an image sensor embodiment. [Figure 6A] This figure shows an embodiment of fecal collection according to the present invention, and is a bottom perspective view of one embodiment. [Figure 6B] This is a cross-sectional view of that embodiment. [Figure 6C] This is a bottom perspective view of an alternative mounting method for a fecal collection example. [Figure 7] This is an exploded view of an embodiment of the foot scale of the present invention. [Figure 8] This is a perspective view of the wall console of the present invention. [Figure 9A] This figure shows an embodiment of the mirror of the present invention, and is a front perspective view of an embodiment of a wall-mounted mirror. [Figure 9B] This is an exploded perspective view of an example of a wall-mounted mirror. [Figure 9C] This is a perspective view of accessories related to an example of a wall-mounted mirror. [Figure 9D] This is a diagram of a touchscreen user interface. [Figure 10A] This is a perspective view of a portable embodiment of the device of the present invention. [Figure 10B] This is a diagram showing the components of the embodiment. [Figure 10C] This diagram shows a device with wings at a 90-degree angle. [Figure 10D] This diagram shows a device with wings at a 180-degree angle. [Figure 10E] This image shows the device being opened and released from sleep mode. [Figure 10F] This diagram shows typical steps involved in using the device. [Figure 10G] This diagram shows typical steps involved in using the device. [Figure 10H] This diagram shows typical steps involved in using the device. [Figure 10I] This diagram shows typical steps involved in using the device. [Figure 11A] This figure shows an embodiment of the device of the present invention that clips onto a toilet seat, and is a perspective view of the device clipped onto the seat. [Figure 11B] This is a cutout diagram of the device. [Figure 11C] This is a cross-sectional view of the device. [Figure 11D] This is an additional cross-sectional view of the device. [Figure 12A] This figure shows an embodiment of the device of the present invention, which fits between the bottom of the toilet seat and the rim of the toilet bowl, and is a perspective view of the device installed in a toilet. [Figure 12B] This is a cutout diagram of the device. [Figure 12C] This is a cross-sectional view of the device. [Figure 13] This figure shows an example of a general-purpose computing device that can be used to store, transmit, and process data from the device of the present invention. [Figure 14] This block diagram shows exemplary communication network architectures, devices, and components for operating the device of the present invention. [Figure 15A] A block diagram illustrating an exemplary image processing and classification method for processing data from the device of the present invention, the diagram showing an exemplary image preprocessing task. [Figure 15B] This figure shows one image classification method for classifying the consistency of stool. [Figure 15C] This figure shows one image classification method for detecting the color of excrement. [Figure 15D] This figure shows a set of labels for classifying stool and urine. [Figure 15E] This diagram shows a workflow for estimating the amount of human waste. [Figure 16] This block diagram shows an exemplary set of steps taken by the user, device, software, and / or user interface during the use of the device of the present invention. [Modes for carrying out the invention]
[0014] When used herein, the singular form is intended to include the plural form unless explicitly indicated otherwise by the context. Furthermore, the use of "or" is intended to include "and / or" unless explicitly indicated otherwise by the context.
[0015] The present invention relates to devices, systems, and methods for electronic biomonitoring of the characteristics of excrement in a bathroom environment.
[0016] Accordingly, in some embodiments, a biomonitoring device is provided that measures the parameters of substances discharged while a user is using a toilet. This device comprises one or more sensors that detect electromagnetic radiation or sample chemicals in the toilet bowl.
[0017] These embodiments are not strictly limited to any particular biomonitoring device, nor are they limited to the measurement of any particular parameter or any particular emission substance. In various embodiments, the substance is feces, urine, flatulence, or exhaust gas from feces or urine.
[0018] Figure 1 shows an exemplary system of the present invention, consisting of a toilet 200 with various sensors integrated into the toilet seat, a foot scale 300, a wall console 400, and a mirror 500, all located in a bathroom environment. These various components of the system will be discussed further below.
[0019] Figure 2A shows an exemplary toilet 200 from Figure 1. A conductive material 201 is placed on a device that functions as a bioelectric impedance analysis electrode. Bioelectric impedance is determined by applying a sinusoidal current into the body via an electrode indicated by reference no. 201. The sinusoidal current is generated by an internal pattern generator and a digital-to-analog converter. A voltage-to-current converter applies this sinusoidal current into the body between a pair of two terminals. The voltage generated between these two terminals by the body's impedance is measured by a differential amplifier, rectified, its amplitude extracted, and measured by an analog-to-digital converter (ADC). The measured voltage is directly related to the body impedance. Common calibration methods and established formulas that can be used to derive body composition are described in several examples in Kushner (1982), Kushner and Schoeller (1986), and Janssen et al. (2000).
[0020] The conductive material can be applied to the seat by any method known in the art or to be discovered in the future. In some embodiments, a pad-printable, B-stageable conductive two-part epoxy adhesive containing a carbon filler is applied to the fixing device by tampography and cured at 100°C for 1 hour. The sheet resistance of the epoxy adhesive is 140-200 ohms / sq / mil. The epoxy adhesive has elongation properties that provide flexibility, for example, when a user sits on the device, and is resistant to solvents such as common toilet cleaning chemicals and abrasives.
[0021] Figure 2A also shows a nozzle 202 for quantitatively dispensing liquid, which is operably connected to a container 203. The container 203 may be replaceable and is for containing liquid to be dispensed quantitatively into the toilet bowl, such as a deodorant, chemical reagent, or cleaning agent. A charging port 204 is operably connected to a battery for recharging.
[0022] Figure 2B shows an exemplary toilet in a bottom perspective view. A low-distortion lens 205 is provided, which may further include hydrophobic and antimicrobial coatings. Electromagnetic radiation can travel from inside the toilet bowl through the lens 205 to the image sensor. An additional or alternative lens 206 made of the same material as lens 205 may be available in a position that does not change when the seat is lifted. Behind lenses 205 and 206 are light sources that project electromagnetic radiation in the visible and / or invisible ranges of the electromagnetic spectrum. A load cell 207 is for capturing the user's weight. In some embodiments, the load cell 207 pivots to accommodate contact with non-flat surfaces and / or includes anti-slip material where it contacts the toilet bowl.
[0023] Figure 2C shows an exploded view of an image sensor, light source, and lens in an exemplary toilet. The image sensor is housed in a housing 208. A lens 209, which can be coated with hydrophobic and antimicrobial coatings, allows the passage of electromagnetic radiation of various frequencies and wavelengths. An electromagnetic radiation source 210 can emit electromagnetic radiation in the visible and invisible ranges of the electromagnetic spectrum into the toilet bowl. The visible and / or invisible light captured by the lens can be measured electronically by any means known in the art, for example, using a motion-mechanical sensor such as a charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) 211. The light passing through the lens can also be measured using a thermographic array consisting of a focal plane array that responds to longer wavelengths (mid-wavelength and long-wavelength infrared). Image illumination is performed by switching the electromagnetic radiation source 210 on. Image acquisition is performed by the sensor 211, which acquires an illuminated image of the inside of the toilet bowl at configurable time intervals.
[0024] Figure 2D shows a top perspective cross-sectional view of a portion of the interior of an exemplary toilet device. The load cell 212 captures force in multiple vectors. A load cell that captures force in a single vector, such as a thin-film load cell, can also be used. The capacitive sensor 213 detects the presence of the user while the user is seated in the device. The presence of the user initiates sensor measurement, which can be used to determine the length of time the user is seated.
[0025] Figure 2E is a magnified view of an exemplary load cell. An additional strain gauge 214 is added to the conventional single-sensor bending moment force gauge 215. The addition of the strain gauge 214 enables the capture of torque around the sensing beam. This bending moment can be provided by the beam 216 capturing the force across the non-flat rim of a toilet bowl. The device algorithmically combines the torque and bending inputs from the four load cells to calculate the user's weight.
[0026] Figure 2F shows the components related to spectroscopic detection of objects such as blood and urine. Reference numeral 217 is a laser diode or photodiode array. Reference numeral 218 is a laser diode, reference numeral 219 is a prism-shaped member whose position can be changed according to optical requirements, reference numeral 220 is the surface of water in a toilet bowl, reference numeral 211 is a CMOS sensor, reference numeral 221 is a light sensor or photodetector, and reference numeral 222 is a distance sensor, the distance sensor intended to reflect the surface of water in a toilet bowl. Depending on the object to be detected, laser diode 218 can emit light at a specific wavelength. The characteristic spectral signature of blood along the near-infrared range (760-1500 nm) provides higher selectivity than using only the visible range (400-780 nm). The presence and concentration of urine can be measured by using distance sensor 222 as a power meter and utilizing Snell's law of reflection due to changes in refractive index. The CMOS sensor 211 can be monochromatic when the infrared filter is removed. The optical sensor or photodetector 221 can detect a target object in the near-infrared spectrum using single-pixel imaging. The use of a laser diode provides a narrower wavelength bandwidth compared to light sources such as light-emitting diodes (LEDs), and is therefore more object-specific. Laser diodes are wavelength-specific, with a full width at half maximum of ±5 nm, and require a prism or lens to disperse the laser across the target area (i.e., the water table).
[0027] This device can be used with or without additional chemicals to manipulate chemicals within and on living cells in excrement. Such additional chemicals may be useful for detecting or quantifying the presence of blood. The presence of blood may be associated with conditions such as ulcers, colitis, colorectal cancer, Crohn's disease, urinary tract infections, and bladder cancer. Such chemicals may be a combination of reagents, buffers, oxidizing agents, or other chemicals, and may be in liquid form or deposited on a substrate, and may be quantitatively supplied to a toilet bowl before defecation or urination, providing a photoluminescent glow that optically indicates a change in color relative to the substrate or can be detected by sensors 211 or 221. An example of such a substrate and color-based blood detection system approved by the U.S. Food and Drug Administration for use in colorectal cancer screening is EZ Detect (Biomerica, Inc., Irvine, California, USA).
[0028] In various embodiments, gaseous chemical substances are detected by gas sensors. Figure 3A shows an exemplary air fan and duct that draws air from inside a toilet bowl through a gas sensor. The path through which air is drawn from inside the toilet bowl 223 and the path through which air exits from the toilet seat 224 are shown. A set of gas sensors 225 can be calibrated to detect volatile organic compounds. The mean free path of air traveling through the gas sensor 225 may be constrained by walls.
[0029] Figure 3B is a magnified view of the air path. Filter 226 purifies the air before entering the bathroom. The filter can be formed from any suitable material, such as charcoal.
[0030] Gaseous chemical substances can be detected by appropriately utilizing any gas sensor known in the art. In some embodiments, the gas sensor is a micro-hotplate metal oxide sensor.
[0031] Figure 3C is an enlarged view of an exemplary gas sensor. It shows a combination of three micro-hotplate metal oxide sensors 227 (where each blade may have a different spectrum), a transimpedance amplifier 228, and a control circuit board 229, equipped with temperature and humidity sensors and a microcontroller. Electrochemical gas sensors can also be used. Some metal oxides can behave as semiconductors at high temperatures. Metal oxide sensors are designed with a heater element and a sensor element (sintered metal oxide with or without a catalyst) separated by a very thin insulating film. Redox reactions occurring on the sensor surface result in changes in resistance, which can be measured. These redox reactions depend on the properties of the metal oxide / catalyst, the reacting gas, and the temperature. Depending on the type of sensor and temperature, a very wide range of materials undergo redox reactions. A gas sensor assembly consists of one or more gas sensors, which may be broadband sensors responding to a mixture of gases or narrowband sensors responding only to the concentration of a specific gas. The actual concentrations can then be calculated using a Gaussian mixture model. Since most sensors operate with small currents and are susceptible to temperature changes, the assembly incorporates a temperature sensor and a chemical sensing front-end consisting of a transimpedance amplifier and a cell bias generator. Furthermore, to keep the analog sensing path short, a microcontroller is incorporated into the assembly and uses an ADC to convert the readings from the sensor into a digital signal, which can then be further communicated and processed via a digital interface as shown.
[0032] In these examples, any gaseous chemical substance present in the toilet bowl can be detected. In some of these examples, the gaseous chemical substance is a volatile organic compound (VOC). The volatile organic compounds found in the intestines include short-chain and branched-chain fatty acids (Gruber et al., 2016). Carbohydrates in the intestines are fermented by various bacteria to produce ethane, propionic, butanoic, pentanoic, and hexanoic acids. Sulfur-containing substances in the diet produce hydrogen sulfide and methanethiol. The fermentation of tyrosine and tryptophan leads to the production of phenols and indoles (Zheng et al., 2011). The relative proportions of these various VOCs may reflect the composition of bacteria present in the intestines.
[0033] In some embodiments, the device can be attached to an existing toilet seat (i.e., the toilet seat does not need to be replaced). These embodiments are not limited to any particular design and include, for example, connectors for connecting a camera or mobile phone to the seat or rim, or other designs. Figures 4 and 5 provide exemplary embodiments.
[0034] Figures 4A and 4B are perspective and exploded views of another embodiment of an image sensor that can be integrated with an existing toilet seat (e.g., without requiring replacement of the toilet seat). The mounting point 230 is bolted in place with an existing bolt 231 and covered by the existing seat 232. Mounting points that do not require bolting can also be used. Wires 233 capable of transmitting power and communication are provided. Power can also be supplied by a battery, and communication may be wireless. A processing and communication circuit 234 is also provided, which may be separate from the image sensor or not. Also shown is a housing 235 for a CMOS sensor 211 and an electromagnetic radiation source 210 that provides light in various spectra into the toilet bowl. In some embodiments, multiple CMOS sensors may be used. Components related to spectral-based detection of objects may also be used.
[0035] Figures 5A and 5B are perspective and exploded views of another embodiment of an image sensor that can be linked to an existing toilet seat. A tray-shaped device 236 fits into place on the rim of the toilet bowl and is covered by the existing seat 232. Wires 233 capable of transmitting power and communication, and a processing and communication circuit 234 are also included together with the upper cover 237. Power can be supplied by a battery, and communication may be wireless. An electromagnetic radiation source 210 provides light in various spectra into the toilet bowl, and this light is captured by a CMOS sensor 211. The CMOS sensor is held by a device 238. Components related to object detection based on spectroscopy, such as those described above, can also be used. The device may be partially or completely sealed.
[0036] A flushable waste collection system is also provided. Figures 6A and 6B are a bottom view and a cross-sectional view of such an exemplary system with a toilet seat. The waste collector 239 is made of a water-soluble material such as polyvinyl alcohol. The hole 240 of the waste collector works in cooperation with a modified foot located on the toilet seat 241 to attach the waste collector to the toilet seat, where the hole overlaps and hooks onto the modified foot. Another figure of the foot 242 shows an exemplary position where the waste collector 239 can be fixed.
[0037] Alternative embodiments of the fastener 243 in the stool collection system are shown in Figure 6C. These fasteners can be used as replacements for the fasteners in the toilet seat foot section shown in Figures 6A and 6B.
[0038] In an additional embodiment, the system further comprises a foot scale designed to be placed on the floor, which performs one or all of the functions of calculating, measuring, assessing, and / or determining physiological data.
[0039] Figure 7 is an exploded view of an exemplary scale or footrest 300. The mat 301 is close to the ground and has a sloping edge that can prevent injury to the user when using the device and also includes a guide on which the user can place their feet. A thin-film pressure sensor 302 is placed on the guide area indicated by reference no. 301 and can capture weight transmitted via member 303. In other embodiments, reference no. 302 is a load cell. A conductive material 304 acts as a bioelectric impedance electrode and measures bioelectric impedance through the foot. The base 305 can be placed on the bathroom floor. The processing and communication circuit 306 includes a battery holder.
[0040] In further embodiments, the system includes an electronic console that performs one or all of the functions of measuring ambient light, determining the presence of a user, and identifying a user, and / or has a user interface for displaying physiological information. In various embodiments, the displayed physiological information is one or all of the following: current information, historical information, and / or current information taking historical information into account.
[0041] Figure 8 is a perspective view of an exemplary console system 400. An electronic display 401 provides the user with real-time information such as weight and body composition while the user is sitting on the toilet. These embodiments also include an ambient light detection sensor 402. A speaker 403 is also present and can provide audio feedback to the user, for example, indicating that the user has been successfully identified. A fingerprint sensor 404 is an example of an identification method for uniquely identifying a user. A passive infrared sensor 405 can be used to detect the presence of a user.
[0042] Any of the above devices may also include any other bathroom-related components. Such components may include, but are not limited to, electric or non-electric bidets; motion-activated night lights; ambient lighting of different colors; heated toilet seats; foot warmers; voice or gesture-activated toilet flushes; automatically opening and closing toilet covers; and networked speakers for playing music.
[0043] Also provided is a bathroom mirror device, which may be non-portable or portable by nature, and which performs one or all of the following functions: user identification by facial recognition; detection of the user's febrile illness; quantitative dispensing of oral medications and supplements; collection of data from portable electronic devices and accessories, which may include deep body thermometers, toothbrushes, shavers, respiratory sensors, otoscopes, ophthalmoscopes, stethoscopes, pulse oximeters, and blood pressure monitors; and provision of an interactive user interface.
[0044] Figure 9A shows a front view of an exemplary wall-mounted mirror 500 powered by a public power source and connected to a private network 20 (Figure 14). An ambient light sensor 501 detects the ambient light conditions. A passive infrared sensor 502 detects the presence of a user. LED lighting 503 illuminates the user's face and body. An array of laser diodes 504 combined with an image sensor 505 is used to identify the user in the bathroom environment based on facial recognition techniques. A thermal sensor 506 is used to detect the elevated body temperature of a user with a fever. A screen 507 functions as both a mirror and a touch display. A microphone and speaker 508 provide voice input that can capture the user's voice and voice output from an artificial intelligence agent, etc., that can interact with the user. There is a power output 509, such as a universal serial bus or AC socket. A pill pack cartridge 510 contains medication and / or supplements. The pills are used and dispensed in predetermined doses through a pill dispenser 511. A storage unit 512 and a charging dock 513 for accessories are provided.
[0045] Figure 9B shows an exploded perspective view of the components of the mirror 500. A touchscreen display 514 is positioned over a one-way mirror or a transmissive mirror 515. A charger 516 for accessories connected to the mirror 500 may be inductive or wireless by nature. The charging embodiments described herein are not limited to any particular mechanism or device used for charging.
[0046] Figure 9C shows a more detailed diagram of the tablet metering system and exemplary accessories. Specific medication or supplement pills are sealed in packs 517 and placed in cartridges 518. The tablets can be combined to facilitate the metering of the correct dosage. Toothpaste 519 and mouthwash 520 are stored in storage compartments 512. Exemplary electrical devices shown that connect to the system include a thermometer 521, a toothbrush 522, a respiratory sensor 523, and a blood pressure monitor 524.
[0047] Figure 9D shows an interactive user interface 525 in which the user can interact with current and / or historical information using a touchscreen, such information being collected from the toilet equipment 200, scale 300, console 400, mirror 500, electrical devices and accessories connected to the system, the user themselves, or any type of data source that can be connected to the system. The user can also interact with the system by voice. The interface can perform, but is not limited to, the following functions: to obtain information from the user; to provide the user with current / historical information; to alert the user; to quantitatively dispense medication / supplements to the correct user; to determine the user's compliance in taking medication / supplements; to facilitate quantitative dispensing of medication / supplements at recommended times; to change the dosage of medication / supplements; to share information about the user with others; and to facilitate remote consultation and the provision of telemedicine based on information collected by the system.
[0048] Figure 10A shows a typical portable device 600 consisting of a body 601 made from a polymer that is sealed against liquid ingress, smooth with minimal cracks for easy cleaning, and has antimicrobial properties. The movable wings 602 are made of a textured elastomer material to enable a secure grip.
[0049] Figure 10B shows the components of the portable device 600, with the wings 602 positioned downwards, ready for transport. The upper area consists of a capacitive touchscreen panel 603. The central area includes a fingerprint sensor 604 intended for the user to place their finger on for identification, a printed circuit board assembly 605, a module chip 606 containing logic and communication hardware and components, a three-axis accelerometer 607, a battery 608, an image sensor assembly 609, and a data storage unit 610. The bottom contains an electromagnetic radiation source 611 capable of emitting electromagnetic radiation in the visible and invisible ranges of the electromagnetic spectrum into the toilet bowl, a low-distortion lens 612 to which a hydrophobic and antimicrobial coating can be applied, and a CMOS sensor 613. The CMOS sensor 613 may also be a thermographic array consisting of a focal plane array that responds to longer wavelengths (mid-wavelength and long-wavelength infrared). Components for spectroscopic detection and analysis, for example, as described above, may also be included.
[0050] In some embodiments, for example, when the user has finished defecating and / or urinating and wants to put the device down to free their hands, the device switches off when the device's wings 602 are moved to this downward position. The speaker 614 enables sound playback, and component 615 provides haptic feedback. The microphone 616 enables the capture of the user's voice.
[0051] Figure 10C shows a device with the wings 602 in a 90-degree position, which can be placed on the user's lap, with the body of the device extending under the user's legs and facing the toilet bowl drain. Figure 10D shows a device with the wings 602 in a 180-degree position, which can be held in the user's hand.
[0052] Figures 10E-10I illustrate the steps involved in switching the device on and using it. Figure 10E shows the wing 602 moving upward from a downward position (which is also a sleep state intended to conserve battery power) to a 90-degree position (which wakes up the device and prompts the user to identify themselves via the fingerprint sensor 617). Figure 10F shows the device in use with the wing 602 in the 90-degree position, resting on a female user's lap. Figure 10G shows the device in use with the wing 602 in the 180-degree position, held in the hand of a male user. Figure 10H shows the camera viewfinder in the upper area of the device, which has guide elements 618 and 619 to help the user correctly position the device and manually initiate image capture 620. Sound from speaker 614 or haptic feedback from component 615 is used to notify the user after a single or series of images have been captured. Figure 10I shows a question 621 including an area 622 for answering, means 623 for capturing additional images if the user needs to relieve themselves again, and means 624 for moving to or back to a different screen. The questions or questionnaires displayed to the user can be customized regarding topics such as urgency, satisfaction, pain, and difficulty with defecation and / or urination related to the specific disease or symptom being tracked.
[0053] This device can be used with or without additional chemicals to manipulate chemicals within and on living cells in excrement. Such additional chemicals may be useful for detecting or quantifying the presence of blood. The presence of blood may be associated with conditions such as ulcers, colitis, colorectal cancer, Crohn's disease, urinary tract infections, and bladder cancer. Such chemicals may be a combination of reagents, buffers, oxidizing agents, or other chemicals, and may be in liquid form or deposited on a substrate, and may be quantitatively supplied to a toilet bowl before defecation or urination, providing a photoluminescent glow that optically indicates a change in color relative to the substrate or can be detected by sensor 613. An example of such a substrate and color-based blood detection system approved by the U.S. Food and Drug Administration for use in colorectal cancer screening is EZ Detect (Biomerica, Inc., Irvine, CA, USA).
[0054] Figure 11A shows an alternative embodiment of the portable device 700 installed on the toilet seat 232. Due to the conformality of the features shown in Figures 11B-D, the device can be suitably mounted at various positions on the circumference of the seat.
[0055] Figure 11B shows the components of the device in Figure 11A. These include a printed circuit board assembly 701, a module chip 702, an image sensor assembly 703 comprising a light source and a CMOS sensor in these embodiments, and storage 704. Inside the toilet bowl is an image sensor including an electromagnetic radiation source 705 that provides light in various spectra into the toilet bowl, a low-distortion lens 706 which may be formed from a hydrophobic and / or antimicrobial material that allows light in the visible, near-infrared, and ultraviolet spectra to pass through, and a housing 707. The sensor 708 may also be a thermographic array consisting of a focal plane array that responds to longer wavelengths (mid-wavelength and long-wavelength infrared). On the front side of the toilet bowl are a battery 709 and a spring mechanism 710 shown in the uncompressed position, which fits multiple seat widths to securely hold the device in place while still allowing easy and quick removal by the user.
[0056] Figures 11C and 11D show cross-sectional views identifying the mechanisms that allow the device shown in Figure 11A to adapt to various widths and thicknesses of toilet seats. The sliding plunger 711 is shown in its uncompressed and compressed positions and is supported by a spring 712, which applies pressure to the outside of the toilet seat 716 and provides a constant force against the surface 713 to hold the device in place. Mechanism 714 acts to resist upward forces in order to keep the device in place. Mechanism 715 is positioned on the toilet seat 716 to resist downward forces.
[0057] Figure 12A shows an alternative embodiment of the device 800 in use, installed below the toilet seat 716 and above the toilet bowl 801, where the optical head can be manually rotated to direct it towards the excrement in the toilet bowl.
[0058] Figure 12B shows the device 800 of Figure 12A, which consists of an optical head positioned above the toilet bowl and an angled body intended to fit over the rim of the toilet bowl under the closed toilet seat, and has a tapered design 802 to accommodate various height gaps between the top of the toilet bowl and the bottom of the toilet seat. The design 802 is molded or coated with a conformal elastomer material, which may also be antimicrobial, to provide a grip to aid in retention. Furthermore, a rotating mechanism 803 allows the optical head to be positioned for optimal alignment with the excrement in the toilet bowl. Inside are a printed circuit board assembly 804, a module chip 805, a battery 806, an image sensor assembly 807, and storage 808. Inside the toilet bowl is an image sensor comprising a light source 809 that provides light in various spectra into the toilet bowl, a low-distortion lens 810 which may be formed from a hydrophobic material that allows light in the visible, near-infrared, and ultraviolet spectra to pass through, a housing 811 for the image sensor assembly, and a CMOS sensor 812. The sensor 812 may also be a thermographic array consisting of a focal plane array that responds to longer wavelengths (mid-wavelength and long-wavelength infrared). When the device is used in a toilet that may not be clean, a washable sanitary bag 813 can be used to protect the device 800 from direct contact with the rim and seat of the toilet bowl.
[0059] Figure 12C shows the device 800 of Figure 12A, which utilizes the wedge configuration 814 of design 802 to fit snugly between the bottom of the toilet seat 815 and the top of the rim 816 of the toilet bowl. The optical head 817 is shown above the toilet bowl. The wedge shape is covered by a sanitary bag over the entire surface indicated by reference numeral 818 to provide a sufficient barrier to prevent the device from touching the toilet seat 815 or the rim 816 of the toilet bowl.
[0060] The embodiments described herein are not strictly limited to the use of any particular power source. Therefore, any of these embodiments may use public power, electric batteries, solar energy, and the like.
[0061] In most embodiments, the device and / or system of the present invention further comprises a data storage and / or transmission unit that stores and / or transmits data from a sensor to a computing unit via wireless, optical, or wired communication, the computing unit analyzing the data from the sensor.
[0062] Figure 13 shows an example of a general-purpose computing device 900 that can be used with the techniques described herein. In various embodiments, any or all of the components characterized therein, and the functions performed therein, can be incorporated into any of the devices described above.
[0063] The computing device 900 includes, among other components, a processor 901, memory 902, input / output devices 903 such as a display, a communication interface 904, and a transceiver 905. The computing device 900 may also be provided with storage devices, such as a microdrive or other devices, to provide additional storage. Components 900, 901, 902, 903, 904, and 905 are interconnected using various buses, and some of the components may be mounted on a common motherboard or in other appropriate ways.
[0064] The processor 901 can execute instructions within the computing device 900, including instructions stored in memory 902. The processor can be implemented as a chipset of chips including multiple separate analog and digital processors. The processor can coordinate other components of the computing device 900, such as controlling the user interface, applications run by the computing device 900, and wireless communication by the computing device 900.
[0065] The processor 901 can communicate with the user via a control interface 906 and a display interface 907 coupled to the display 903. The display 903 may be, for example, a thin-film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, or other suitable display technology. The display interface 907 may include suitable circuitry for driving the display 903 to present graphics and other information to the user. The control interface 906 can receive commands from the user, translate those commands, and submit them to the processor 901. Furthermore, an external interface 908 that communicates with the processor 901 may be provided to enable short-range communication between the computing device 900 and other devices. The external interface 908 may, for example, provide wired communication in some implementations and wireless communication in others, and may also use multiple interfaces.
[0066] Memory 902 stores information within the computing device 900. Memory 902 can be implemented as one or more computer-readable media, volatile memory units, or non-volatile memory units. An expansion memory 909 may also be provided and connected to the computing device 900 via an expansion interface 910, which may include, for example, a SIMM (Single In Line Memory Module) card interface. Such an expansion memory 909 can provide additional storage space for the computing device 900, or it can store applications or other information for the computing device 900. Specifically, the expansion memory 909 may contain instructions for performing or complementing the processes described above, and may also contain secure information. Therefore, for example, the expansion memory 909 may be provided as a security module for the computing device 900 and may be programmed with instructions that enable the secure use of the computing device 900. Furthermore, a secure application can be provided by the SIMM card, along with additional information, such as storing identification information on the SIMM card in a hack-proof manner.
[0067] The memory may include, for example, flash memory and / or NVRAM memory, as discussed below. In one implementation, the computer program product is tangibly embodied in an information carrier. The computer program product includes instructions that, when executed, perform one or more of the methods described above. The information carrier is a computer or a machine-readable medium, for example, memory 902, extended memory 909, memory on the processor 901, or propagated signals that can be received, for example, via a transceiver 905 or an external interface 908.
[0068] The computing device 900 can communicate wirelessly via a communication interface 904, which may include digital signal processing circuitry if necessary. The communication interface 904 may be a cellular modem in some cases. The communication interface 904 can enable communication under various modes or protocols, including, among others, GSM® voice calls, SMS, EMS, or MMS messaging, CDMA, TDMA, PDC, WCDMA®, CDMA2000, or GPRS. Such communication can be performed, for example, via a radio frequency transceiver 1268. Furthermore, short-range communication may be performed, such as using Bluetooth®, WiFi, or other such transceivers (not shown). Additionally, a GPS (Global Positioning System) receiver module 911 can provide the computing device 900 with additional navigation and location-related radio data, which may be used as appropriate by applications running on the computing device 900.
[0069] The computing device 900 can also communicate via voice using the audio codec 912, which can receive speech information from the user and convert that information into usable digital information. Similarly, the audio codec 912 can also generate audible sound for the user, for example, through the speaker on the computing device 900's handset. Such sound may include sounds from voice calls, recorded sounds (e.g., voice messages or music files), or sounds generated by applications running on the computing device 900.
[0070] Computing device 900 can be implemented in several different forms.
[0071] The implementations of the subject matter and operations described herein may be implemented in digital electronic circuits, or in computer software, firmware, or hardware, or one or more combinations thereof, including the structures disclosed herein and their structural equivalents. The implementations of the subject matter described herein may be implemented as one or more modules of computer programs, i.e., computer program instructions, encoded in a computer storage medium for execution by a data processing device or for controlling the operation of a data processing device. Alternatively or additionally, the program instructions may be encoded in artificially generated propagating signals, such as mechanically generated electrical, optical, or electromagnetic signals, which are generated to encode information so that it can be transmitted to a receiver device suitable for execution by a data processing device. The computer storage medium may be, or may be, a computer-readable storage device, a computer-readable storage board, a random or serial access memory array or device, or one or more combinations thereof. Furthermore, the computer storage medium may not be a propagating signal, but rather a source or destination of computer program instructions encoded in artificially generated propagating signals. Furthermore, computer storage media may consist of or be comprised of one or more separate physical components or media (for example, multiple CDs, disks, or other storage devices).
[0072] The operations described herein can be implemented as operations performed by a data processing device on data stored in one or more computer-readable storage devices or on data received from other sources.
[0073] The term "data processing device" encompasses all types of devices, machines, and equipment for processing data, including, for example, programmable processors, computers, systems on a chip, or a combination of the above. Such devices may include, for example, dedicated logic circuits such as FPGAs (field programmable gate arrays) or ASICs (application-specific integrated circuits). In addition to hardware, devices may also include code that creates an execution environment for a target computer program, such as processor firmware, protocol stacks, database management systems, operating systems, cross-platform runtime environments, virtual machines, or a combination of one or more of these. Devices and execution environments can realize a variety of different computing models and infrastructures, including web services, distributed computing, and grid computing infrastructure.
[0074] Computer programs (also called programs, software, software applications, scripts, or code) can be written in any form of programming language, including compiled or interpreted languages, and declarative or procedural languages, and can be deployed in any form, for example, as standalone programs, or as modules, components, subroutines, objects, or other units suitable for use in a computing environment. Computer programs may, but are not required, correspond to files in a file system. A program can be stored in part of a file that holds other programs or data (e.g., one or more scripts stored in a markup language resource), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., a file storing one or more modules, subprograms, or parts of code). Computer programs can be deployed to run on one computer, or on multiple computers located in one site or distributed across multiple sites and interconnected by a communication network.
[0075] The processes and logic flows described herein can be implemented by one or more programmable processors executing one or more computer programs, performing actions by processing input data and generating outputs. Alternatively, the processes and logic flows can be implemented by dedicated logic circuits, such as FPGAs (Field-Programmable Gate Arrays) or ASICs (Application-Specific Integrated Circuits), and the device can be implemented as such a circuit.
[0076] Processors suitable for running computer programs include, for example, general-purpose and dedicated microprocessors, as well as any one or more processors of any type of digital computer.
[0077] Generally, a processor receives instructions and data from read-only memory, random-access memory, or both. Essential elements of a computer are a processor for performing actions according to instructions, and one or more memory devices for storing instructions and data.
[0078] Furthermore, computers generally include one or more mass storage devices (e.g., magnetic, magneto-optical, or optical disks) for storing data, or are operablely coupled to receive data from or transfer data to mass storage devices, or both. However, computers are not required to have such devices. Moreover, computers can be embedded in other devices, some of which include, for example, mobile phones, personal digital assistants (PDAs), mobile audio or video players, game consoles, Global Positioning System (GPS) receivers, or portable storage devices (e.g., Universal Serial Bus (USB) flash drives). Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media, and memory devices, including, for example, semiconductor memory devices such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and memory can be supplemented by dedicated logic circuits, or incorporated into dedicated logic circuits.
[0079] To provide interaction with the user, the implementations of the subject matter described herein may include a computer having a display device such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor for displaying information to the user, and a keyboard and pointing device (e.g., mouse or trackball) that allows the user to provide input to the computer.
[0080] Interaction with the user can also be provided using other types of devices. For example, the feedback provided to the user may be any form of sensory feedback, such as visual feedback, auditory feedback, or haptic feedback. Input from the user can be received in any form, including acoustic, voice, or haptic input. Furthermore, a computer can interact with the user by sending resources to and receiving resources from devices used by the user, for example, by sending a web page to a web browser on the user's client device in response to a request received from that web browser.
[0081] Implementations of the subject matter described herein may include, for example, a backend component as a data server, or a middleware component such as an application server, or a frontend component such as a client computer having a graphical user interface or a web browser that allows a user to interact with the implementation of the subject matter described herein, or any combination of one or more such backend, middleware, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication, such as a communication network.
[0082] Examples of communication networks include local area networks ("LANs") and wide area networks ("WANs"), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad-hoc peer-to-peer networks).
[0083] A computing system can include clients and servers. Generally, clients and servers are remote to each other and typically interact via a communication network. The relationship between a client and a server arises from computer programs running on each computer and having a client-server relationship with each other. In some implementations, the server sends data (e.g., HTML pages) to a client device (e.g., intended to display data to a user interacting with the client device and to receive user input from the user). Data generated on the client device (e.g., the results of user interaction) can be received by the server from the client device.
[0084] One or more computer systems can be configured to perform a specific operation or action by having software, firmware, hardware, or a combination thereof installed on the system that causes the system to perform an action when it is running. One or more computer programs can be configured to perform a specific operation or action by including instructions that cause a data processing device to perform an action when it is executed by the device.
[0085] Figure 14 is a block diagram showing exemplary communication network architectures, devices, and components, including a representation of a communication circuit that may be incorporated into an exemplary biometric monitoring device according to at least some embodiments of the present invention. In particular, the communication circuit may implement or employ any form of communication (e.g., wireless, optical, or wired) and / or protocol (e.g., standard or proprietary) that is currently known or to be developed in the future, and all forms of communication and protocols are intended to fall within the scope of the present invention (e.g., Bluetooth, ANT, WLAN, Wi-Fi, power line networking, all kinds and forms of internet-based communication, and / or SMS). Large files can be distributed using a peer-to-peer distributed file sharing protocol, which improves the scalability of the throughput of the networked system as more nodes are added and adds security through fingerprinting for data integrity verification, inter-node consensus, and cryptographic shared secrets exchanged as essential aspects of the protocol. In some cases, an encrypted virtual private network is utilized to provide an additional level of security for all communications, particularly with respect to management, maintenance, and metric collection functions.
[0086] In non-portable image sensor embodiments, images are conditioned for classification before image classification is performed. The unit acquires several non-sampled images (baseline images) during the day for calibration. Once the presence of a user is detected, the unit can capture several images per second. Each image is then assessed for motion. To this end, corners are found within each image using a Harris & Stephens corner detector, for example. The detected corners for each image are then assessed for motion by comparing blocks of pixels around the corner of the current image to the next block sequentially using a motion detector such as Sum of Absolute Differences (SAD) processing. The number of flows exceeding a set displacement threshold is then counted. If the number of flows exceeds the set threshold, the image is considered suboptimal and is removed from further processing. The purpose of this step is to limit classification to images with stationary samples. The images are then analyzed for indicating features, depending on the purpose of the analysis.
[0087] To accommodate various toilets (including unique shapes, cleaning agents, water color, materials, and porcelain color) and lighting conditions, a baseline model of an empty toilet bowl can be obtained from baseline images. For this purpose, a training period of sample images is provided during which no excrement is present in the toilet bowl. These baseline images are taken with or without lighting to create a robust background model that generates a moving average baseline. The background can be excluded from detection by frame difference, a pixel-by-pixel Gaussian mixture model, or a pixel-by-pixel mean filter. In frame difference, the values of consecutive images without samples are subtracted from the pixel values of images containing samples. In the case of a Gaussian mixture model, a confidence band is created for each pixel value of the background. As part of preprocessing, pixels within the confidence interval of the modeled mixture are ignored. In the case of a mean filter, the arithmetic mean of each pixel value is calculated from the images without samples. This value is subtracted from the pixels in the images containing samples. All pixels with a threshold close to zero, including environment-specific glare spots and static artifacts, are ignored from classification. Furthermore, histogram flattening is performed to ensure invariance with respect to changes in lighting. This procedure improves image contrast and makes classification robust across different lighting conditions. Once defecation and / or urination detected by software-based image detection is complete, sample collection is terminated, and the images are processed locally or sent via access point 30 to networked computing resources in the cloud computing environment 50. The images are then analyzed locally or remotely by memory 51 and processor 52.
[0088] Figure 15A shows an image classification method for a portable device 600, performed after the user is identified, sits on the toilet, and then points the device towards the toilet bowl immediately before or during defecation and / or urination. As soon as sample imaging begins, the light source is switched on, and the application processor continuously samples the image sensor with respect to frames, measuring the pan, tilt, and rotation angles for each image captured from the image sensor 613. The electromagnetic radiation source 611 projects light in various spectra into the toilet bowl. The 3-axis accelerometer sampling the pan, tilt, and rotation angles of the unit may be a MEMS-based accelerometer (such as Invensense MPU-60x0) or a solid-state accelerometer. The image sensor is a color CCD or CMOS-based image sensor. Furthermore, the optical stack includes a non-wide-angle lens (FOV less than 90°). This combination of sensor and lens minimizes image distortion. The sensor has a minimum resolution of 500x500 pixels. Frames and angles are sampled at a rate exceeding 2 frames per second and stored locally on the device until sample collection is stopped.
[0089] Once defecation and / or urination are complete (which is detected by software-based image detection, sound detection, and / or possibly completion of a questionnaire as shown in Figure 10I, and / or completion of the unit's transport readiness), sample collection is released, and the images are processed locally or sent via access point 40 to networked computing resources in the cloud computing environment 50. The images are then analyzed locally or remotely by memory 51 and processor 52.
[0090] In the device 600 of the present invention (Figure 10), the first step of image processing is to correct the image to be flat relative to the sample surface. Therefore, using the sampled pan, tilt, and rotation angles, as well as unique camera parameters, the affine transformation of the image to a planar sample is calculated for each image. The image is then individually transformed to the viewpoint of the planar sample. Known glare reflection locations of the luminaire are blacked out. Next, each image is assessed for motion. Corners are found in each image using a Harris & Stephens corner detector, as well as a stationary unit. Next, the detected corners for each image are assessed for motion by comparing blocks of pixels around the corner of the current image with the next block sequentially using a motion detector such as SAD processing. Next, the number of flows exceeding a set displacement threshold is counted. If the number of flows exceeds the set threshold, the image is considered suboptimal and is removed from further processing. The purpose of this step is to limit the classification to images with stationary samples. Next, the image is analyzed for indicating features, depending on the purpose of the analysis.
[0091] Figure 15B shows an image classification method for determining stool consistency. In embodiments where images are captured in color, the first step is to convert the captured color images to grayscale images. The magnitude of the gradient of the images is then calculated using an operator such as the Sobel-Feldman operator. The magnitude of the gradient is classified into bins of a histogram with a constant step size. Each image is encoded as a feature, as a quantized histogram of the gradient. These features are then fed into a pre-trained classifier, such as a support vector machine (SVM), which classifies the features into labels according to the Bristol Stool Texture Scale, or other similar clinically accepted scales known in the art. The classifier that assigns labels is trained on a set of labeled images. Each image in the training set is assigned a distinct label, which is then assigned as ground truth. Training the SVM minimizes the classification error for these ground truth labels. This classification method determines stool consistency, ranging from hard and lumpy to incompletely formed and liquid, using standard clinical labels used in clinical research to assess bowel stiffness. However, instead of relying on patient self-reports, this method automates or semi-automates classification using objective images captured from identified individuals. An alternative method for determining stool consistency is to use a shallow neural network (NN). The first few layers of a neural network, naturally, evolve through training to have more accurate feature detection capabilities than hand-drawn features such as gradient histograms, so with more data, the NN becomes more accurate. The output of the NN is modeled as an independent matrix function for each desired class label. The modified linear units in the individual outputs may resemble a sigmoid function. The independent outputs are then led to "metaclass labels" such as healthy or unhealthy.
[0092] Figure 15C shows an image classification method for blood and urine color. In preprocessing, pixels matching the color distribution of stool or known toilet fixtures are blacked out. From the remaining pixels, a color histogram is calculated for the red channel for blood, and a combined red and green histogram is calculated for urine. The two histograms form features for blood and urine classification, respectively. Limiting thresholds are obtained for each color channel for blood and urine from expert-labeled data, and the histograms for the color channels are trimmed accordingly. Here, the total number of histogram values is normalized to the total number of pixels in the remaining image. From the same historical dataset, thresholds are obtained for the channel-normalized counts for true blood and urine samples, respectively. Classification is then performed based on these thresholds. Alternatively, an SVM is trained using the normalized histograms of historical data. The pre-trained SVM provides a model for classifying histograms into known class labels. Features for blood and urine are classified using a pre-trained classifier such as an SVM. The SVM is pre-trained using features from expert-labeled images for the desired class label. For computational efficiency, the SVM is trained to classify samples into categories. The images used to train the SVM are expert-labeled, and features are extracted from them as well as from samples for each type of analysis. Representative labels are shown in Figure 15D.
[0093] Figure 15E shows a workflow for estimating the volume of human urine and feces excretion. Transient changes in water level are used to estimate the volume of urine and feces excretion. Transient changes in water level are an important indicator of sample density or porosity. Density estimation provides another input to machine learning methods and, when combined with optical features, achieves higher classification accuracy compared to the Bristol Stool Texture Scale or related methods. Average constant excretion rates in milliliters per second can be specified for each demographic and sex type. To estimate the volume of excretion, the start and end times of urination are recorded using image sensors. When a user excretes, the water table inside the toilet indicates movement. Optical motion sensing from a pair of consecutive frames flags the person if they are still excreting. The sum of the inter-frame capture times of the motion-indicating pairs has a constant flow rate as a factor and models the volume of excretion. Related motion sensing techniques include background subtraction based on the sum of absolute differences, motion sensing based on mean background subtraction, and motion sensing based on a background subtraction mixture Gaussian model. Background model-independent techniques can also be used, such as thresholding of the sum of absolute differences of pairs of frames.
[0094] To further improve the system's accuracy, the estimation of excretion volume can be monitored by user detection using other means, such as a capacitive sensor capable of detecting when a user is sitting on the toilet seat, or an ultrasonic sensor capable of detecting a user standing in front of the toilet, for example, a man urinating while standing. This monitoring of the estimation process can eliminate sources of false movements and reset the estimated excretion volume over various users and urination periods.
[0095] By applying the presented image classification methods and systems, results can be obtained from tests that can be performed in a toilet environment involving color changes. These tests include urine strips, lateral flow tests, or immunochromatographic assays, or other currently available or future tests that can obtain quantitative or semi-quantitative results using precise measurement of color changes.
[0096] The information may be provided interactively on a personal mobile device 60, which may be a smartphone or a connected device worn on the body, such as a wristwatch. After the data is stored, it can also be analyzed by human review to provide recommendations or alerts, such as verifying flagged images and using information such as weight, body composition, stool consistency, stool frequency, urine color, excretion volume, urination frequency, and the presence of visible blood. In non-portable embodiments of the image sensor device, the control of illumination and imager parameters and geometry means that the system does not need to consider projection distortion, as in a mobile camera. Furthermore, fixed settings provide the opportunity to add polarizing filters and wavelength filters to the imager to restrict the captured light to a spectrum that more clearly shows the features necessary for classification. By using polarizing lenses, the effects of glare and unwanted reflections can be reduced, which provides a significant reduction in noise and improves the overall quality of classifiable features.
[0097] Other embodiments provide a method for determining a user's physiological parameters. This method involves discharging a substance into a toilet bowl in the presence of the biomonitoring device described above. Figure 16 shows a typical workflow according to these methods.
[0098] In light of the above, it will be evident that several objectives of the present invention are achieved and other advantages are attained.
[0099] Various modifications can be made to the above methods and compositions without departing from the scope of the present invention, and all matters included in the above description and shown in the accompanying drawings are intended to be interpreted as examples rather than limitations.
[0100] All references cited herein are incorporated herein by reference. The discussion of references herein is intended solely to summarize the authors' claims and does not constitute prior art. The applicant reserves the right to challenge the accuracy and appropriateness of the cited references.
Claims
1. A biomonitoring device for measuring the parameters of substances discharged into a toilet bowl, A sensor unit for detecting electromagnetic radiation or sample chemical substances present in the toilet bowl, A nozzle for supplying additional chemicals into the toilet bowl for detecting the presence of blood or quantifying blood, The sensor unit is positioned behind the seat portion of the toilet to monitor the substance inside the toilet bowl. The aforementioned additional chemicals are biomonitoring devices that react with chemicals inside and on living cells in excrement.
2. The biomonitoring device according to claim 1, wherein the additional chemical substance emits photoluminescence that can be detected by the sensor unit.
3. The presence of the aforementioned blood is related to the condition, The biomonitoring device according to claim 2, wherein the conditions include ulcers, colitis, colorectal cancer, Crohn's disease, urinary tract infections, and bladder cancer.
4. It is further equipped with a gas sensor that detects gaseous chemical substances, The biomonitoring device according to any one of claims 1 to 3, wherein the gaseous chemical substance includes a volatile organic compound.
5. The biomonitoring device according to claim 4, wherein the volatile organic compound comprises short-chain fatty acids and branched-chain fatty acids.
6. Further equipped with a data processing device, The aforementioned sensor unit includes an image sensor, The data processing device uses a predetermined operator to calculate the magnitude of the gradient of an image for determining the consistency of the stool, the magnitude of the gradient is classified into bins of a histogram with a constant step size, and the consistency of the stool is determined based on the histogram. The biomonitoring device according to any one of claims 1 to 5, wherein the capture of the aforementioned image is performed by the image sensor.
7. Further equipped with a data processing device, The aforementioned sensor unit includes an image sensor, The data processing device calculates a color histogram for the red channel in the case of blood, and a combined red and green histogram in the case of urine. The aforementioned color histogram and the aforementioned combined histogram each form characteristics relating to the classification of the blood and the urine, respectively. The data processing device classifies the blood and urine based on the color histogram and the combined histogram. The biomonitoring device according to any one of claims 1 to 6, wherein the capture of the aforementioned image is performed by the image sensor.
8. The biomonitoring device according to any one of claims 1 to 7, wherein the biomonitoring device takes a training period during which data is analyzed when there is no excrement in the toilet bowl, the training period includes acquiring a baseline sample image when there is no excrement in the toilet bowl, and acquiring a baseline model of the empty toilet bowl from the baseline sample image.
9. The biomonitoring device according to claim 8, wherein the baseline model is a robust background model that generates a moving average baseline.
10. A biomonitoring method for measuring the parameters of substances discharged into a toilet bowl, The steps include detecting electromagnetic radiation or a sample chemical substance present in the toilet bowl, A method comprising the step of supplying additional chemicals into the toilet bowl for the detection of the presence of blood or for the quantification of blood.
11. The method according to claim 10, wherein in the step of detecting the electromagnetic radiation or the sample chemical substance, an image sensor having a complementary metal oxide semiconductor detects the electromagnetic radiation or the sample chemical substance.