Flight status display system

Abstract

To provide a stool state display system that allows a caregiver to easily understand a stool state of a care recipient when an image captured by a camera is simply displayed on a display part such as a display.SOLUTION: The present disclosure relates to the stool state display system that causes a display part to display the state of a user's stool. The stool state display system causes the display part to display stool presence / absence estimation information included in intra-period imaging information that is additional information imaging information whose imaging date is included in a predetermined period from additional information including the stool presence / absence estimation information and received captured image information.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present disclosure relates to a stool status display system. [Background technology]

[0002] As disclosed in Patent Document 1, a device for managing bowel movements is known that is characterized by attaching a digital camera to the inside of the toilet seat of a flush toilet in a position where the state of bowel movements can be clearly seen, taking images of the state of the stool, and determining the state of the stool of a person who needs bowel movement management from the captured images of the stool. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Registered Utility Model No. 3210435 Summary of the Invention [Problem to be solved by the invention]

[0004] Simply displaying an image captured by a camera on a display unit such as a monitor makes it difficult for a caregiver to easily understand the state of the stool of the care recipient. [Means for solving the problem]

[0005] The present disclosure provides a stool status display system that displays the status of a user's stool on a display unit, The stool status display system includes: Toilet, Server, and A user-side information processing device having the display unit Equipped with where: the toilet comprises a toilet seat, an imaging element, and a toilet-side information processing device; the toilet-side information processing device includes a toilet-side data transmission unit and a toilet-side control unit; The server includes a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit; the user-side information processing device further comprises a user-side input unit, a user-side transmitting unit, a user-side receiving unit, a user-side storage unit, and a user-side control unit; In the flight status display system, (t) First imaging step: the toilet-side control unit controls the imaging element so that the imaging element captures an image of the inside of the toilet bowl; (t) a first transmission step, in which the toilet-side control unit controls the toilet-side data transmission unit to transmit the image captured by the imaging element as captured image information to the server; Here, the captured image information includes the captured image and the image capture time of the captured image, (s) a first receiving step, in which the server-side control unit controls the server-side receiving unit to receive the captured image information; (First step of process s) Based on a feces presence / absence recognition algorithm, the server-side control unit estimates the presence / absence of the user's feces from at least one captured image included in the received captured image information as feces presence / absence estimation information, (s) a first storage step, in which the server-side control unit controls the server-side storage unit to store the feces presence / absence estimation information and the additional information imaging information including the received captured image information in the server-side storage unit; (u) First input step: The user-side control unit acquires, via the user-side input unit, the date of the stool status that the viewer who views the user's stool status wants to display on the display unit; (u) a first transmission step, in which the user-side control unit controls the user-side transmission unit to transmit the date to the server; (s) a second receiving step, in which the server-side control unit controls the server-side receiving unit to receive the date transmitted from the user-side transmitting unit; (Processing step 3) Based on the date, the server-side control unit selects, from the additional information imaging information stored in the server-side storage unit, additional information imaging information whose imaging date falls within a predetermined period as within-period imaging information, (s) a first transmission step, in which the server-side control unit controls the server-side transmission unit to transmit the captured image information within the period to the user-side information processing device; (u) a first receiving step, wherein the user-side control unit controls the user-side receiving unit to receive imaging information within the period; (u) a first display step, in which the user-side control unit controls the display unit to display the feces presence / absence estimation information included in the period-interval image information received by the user-side receiving unit. is executed. [Effects of the Invention]

[0006] According to the stool status display system of the present disclosure, stool presence / absence estimation information is displayed on the display unit, so that a viewer (e.g., care worker) of the user's (e.g., care recipient's) stool can easily recognize whether the user has stool. [Brief explanation of the drawings]

[0007] [Figure 1] Diagram of excretory device in embodiment 1 [Figure 2] Block diagram of an excretion device and system according to the first embodiment [Figure 3] Block diagram of a system according to the first embodiment [Figure 4] User-side information processing device according to the first embodiment [Figure 5] User-side information processing device according to the first embodiment [Figure 6] User-side information processing device according to the first embodiment [Figure 7] User-side information processing device according to the first embodiment [Figure 8] User-side information processing device according to the first embodiment [Figure 9] User-side information processing device according to the first embodiment [Figure 10] User-side information processing device according to the first embodiment [Figure 11] Flowchart in the first embodiment [Figure 12A] Schematic diagram of captured image information according to the first embodiment. [Figure 12B] Schematic diagram of captured image information according to the first embodiment. [Figure 12C] Schematic diagram of captured image information according to the first embodiment. [Figure 13] Schematic diagram of additional information imaging information in the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] (Embodiment 1) FIG. 1 is a diagram of an excretion device according to the first embodiment.

[0009] FIG. 2 is a block diagram of the excretion device and system according to the first embodiment.

[0010] In Figure 1, the device for excretion has a toilet bowl 1 and a toilet seat 2, each of which is assigned a unique ID. The toilet seat also has a switch sensor (i.e., seat sensor 3) that detects when a user sits on the toilet seat, and a camera 4 that serves as an imaging device for capturing images of the inside of the toilet bowl.

[0011] The stool status display system according to the first embodiment is a stool status display system that displays the stool status of a user (for example, a care recipient) on a display unit.

[0012] This stool status display system comprises a toilet 1, a server 101, and a user-side information processing device 201.

[0013] The toilet 1 comprises a toilet seat 2, an imaging element, a switch sensor (i.e., a seating sensor 3), and a toilet-side information processing device (i.e., a control unit 5). The toilet-side information processing device comprises a toilet-side memory unit, a toilet-side data transmission unit, and a toilet-side control unit.

[0014] The server 101, like a commonly used server, comprises a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit.

[0015] Examples of the server 101 are a general server on the Internet, a server in a care facility, and a server in a home.

[0016] The user-side information processing device includes a display unit. The user-side information processing device further includes a user-side input unit, a user-side transmitting unit, a user-side receiving unit, a user-side memory unit, and a user-side control unit. Examples of the user-side information processing device include a personal computer, a tablet, and a smartphone that are equipped with a display.

[0017] The storage unit is a so-called memory, and the control unit is a so-called central processing unit.

[0018] When it is detected that a user has sat on the toilet seat 2, the camera 4 starts capturing images of the inside of the toilet bowl.

[0019] When the control unit 5 located inside the toilet seat receives a seating signal from the seat sensor 3, it activates the camera 4 and continues to capture images while the user is seated on the toilet seat. The image capture interval is at a specified interval, here every second, but it can be longer or shorter. The captured images are saved in the control unit 5, and the image name includes the time the image was captured. The first image saved after image capture begins is saved with an image name that includes text that makes it clear that it was saved as such. When it detects that the user has left the toilet seat 2, image capture stops and the captured images are uploaded from the control unit 5 to the server 101.

[0020] As described above, in the system according to embodiment 1, first, when the seating sensor 3 detects that a user has sat on the toilet seat 2, the toilet-side controller controls the imaging element so that the imaging element begins capturing an image of the inside of the toilet 1. Hereinafter, this imaging process will be referred to as the "first imaging process."

[0021] Next, the toilet-side controller controls the toilet-side storage unit to store a plurality of captured images 502 (see FIGS. 12A to 12C) captured by the imaging element at predetermined time intervals in the toilet-side storage unit as captured image information 501 (see FIGS. 12A to 12C). In other words, as time passes, captured images 502 from the imaging element are sequentially accumulated in the toilet-side storage unit, and captured image information 501 is formed in the toilet-side storage unit. As shown in FIGS. 12A to 12C, captured image information 501 includes a plurality of captured images 502 and the image capture time 503 of each of the plurality of captured images 502. Hereinafter, this processing step will be referred to as the "first processing step."

[0022] Furthermore, the toilet-side control unit controls the toilet-side data transmission unit so as to transmit to the server captured image information 501. Hereinafter, this transmission step will be referred to as the "first transmission step."

[0023] Finally, when the seating sensor 3 detects that the user has left the toilet seat 2, the toilet-side controller controls the image sensor to stop capturing images of the inside of the toilet. Hereinafter, this stopping step will be referred to as the "first stopping step."

[0024] FIG. 3 is a block diagram of the system according to the first embodiment.

[0025] In FIG. 3, the server 101 has a stool / urine presence detection algorithm 102, a stool shape recognition algorithm 103, a stool color recognition algorithm 104, a stool volume recognition algorithm 105, a stool drop count detection algorithm 106, a urine color recognition algorithm 107, a urine volume recognition algorithm 108, and a representative image selection algorithm.

[0026] The feces and urine presence detection algorithm 102, feces shape recognition algorithm 103, feces color recognition algorithm 104, and urine color recognition algorithm 107 first input a large number of images of excrement into the algorithm, extract features from the images, and generate a learning model that can respond to those features. Next, the recognition algorithm equipped with the learning model is implemented on a server.

[0027] The stool volume recognition algorithm 105 calculates the area of ​​the stool region from the image and determines whether it is large, small, or normal based on a threshold value.

[0028] The feces dropping count detection algorithm 106 calculates the number of times feces dropped in one excretion behavior from the image group. The image group represents the images from the start of imaging to the image just before the start of the next imaging, and the images for one excretion behavior can be determined by adding text to the first image saved after imaging starts. Since the image group also includes the image capture time, the images are analyzed in order of earliest image capture time, and the number of times the feces area changes is counted to output the number of feces droppings.

[0029] The urine volume recognition algorithm 108 first inputs a large number of images of urine flowing into the toilet, extracts features from the images, and generates a learning model that can respond to those features. Next, the recognition algorithm equipped with the learning model is implemented on the server. This calculates the time that urine is flowing and estimates the urine volume.

[0030] The representative image selection algorithm 109 selects an image immediately after the user has finished excreting, that is, an image taken immediately before urine or feces is detected after the detection of urine or feces. Note that an image taken a specific time before the user leaves the seat may be selected as the representative image, or an image taken immediately before the user takes a shower or flushes.

[0031] The uploaded image is judged by a feces / urine presence / absence detection algorithm 102 as to whether the image contains excrement, i.e., feces, urine, paper, or nothing.

[0032] The stool / urine presence detection algorithm 102, stool shape recognition algorithm 103, stool color recognition algorithm 104, and urine color recognition algorithm may be detected by means other than images, for example, an infrared sensor.

[0033] When the fecal urine presence detection determines that stool is present in the image, a stool shape recognition algorithm 103 determines which category of the seven Bristol scale index the stool belongs to, and a stool color recognition algorithm 104 determines whether the color of the stool is red, black, yellow, green, or gray. Note that colors other than red, black, yellow, green, and gray may also be determined.

[0034] Furthermore, the stool volume recognition algorithm 105 determines whether the stool volume is large, small, or normal, and the stool drop count detection algorithm 106 determines the number of times stool has fallen from a group of images taken from when the user sits down until the next time they leave the seat.

[0035] Furthermore, if it is determined that urine is present in the image, a urine color recognition algorithm 107 determines whether the color of the urine is yellow or red.

[0036] Furthermore, a urine volume recognition algorithm 108 determines the amount of urine from a group of images taken from when the user sits down until the user leaves the seat.

[0037] Furthermore, a representative image selection algorithm 109 selects a representative image from a group of images taken from when the user sits down until the user leaves the seat next.

[0038] A database 110 is provided for storing the above determination results.

[0039] As described above, in the system according to the first embodiment, first, the server-side control unit controls the server-side receiving unit to receive captured image information 501. Hereinafter, this receiving step will be referred to as a "first receiving step."

[0040] Next, based on the above algorithm, stool is estimated from at least one captured image 502 included in the captured image information 501. More specifically, the presence or absence, state, etc. of stool are estimated. Here, based on the stool presence / absence recognition algorithm, stool shape recognition algorithm, stool amount recognition algorithm, urination presence / absence recognition algorithm, and urination amount recognition algorithm, the server-side control unit estimates the presence or absence, shape, amount of stool, and amount of urination of the user as stool presence / absence estimated information, estimated stool shape, estimated stool amount, urination presence / absence estimated information, and estimated urination amount, respectively, from at least one captured image 502 included in the captured image information 501 received via the server-side receiving unit. Hereinafter, this estimation step will be referred to as the "first step of processing s."

[0041] Next, the server-side control unit selects as a representative image from the multiple captured images 502 contained in the received captured image information 501, at least one image taken between the end of the user's excretory behavior and the detection of toilet paper in the toilet bowl, based on a representative image selection algorithm that uses the image capture time 503. Hereinafter, this selection process will be referred to as the "second process of s processing."

[0042] The captured image information 501 shown in FIG. 12A includes four captured images 502 and image capture times 503. The bottom captured image 502 shows only part of the feces. This is because the user threw toilet paper into the toilet bowl, which covered part of the feces from the imaging sensor. Therefore, for the captured image information 501 shown in FIG. 12A, the third captured image 502 from the top is selected as the representative image. Note that in FIG. 12A, the top or second captured image 502 from the top may also be selected as the representative image. This is also true for FIGS. 12B and 12C.

[0043] The order of the first and second steps of the s process is not important. The first step of the s process may be performed first, followed by the second step of the s process. Alternatively, the second step of the s process may be performed first, followed by the first step of the s process.

[0044] In this way, the server-side control unit forms additional information imaging information 601 as shown in Fig. 13. As shown in Fig. 13, the additional information imaging information 601 includes (a) the received captured image information 501, (b) feces presence / absence estimation information, (c) the estimated feces shape, (d) the estimated feces amount, (e) urination presence / absence estimation information, (f) the estimated urination amount, and (g) the selected representative image.

[0045] Finally, the server-side control unit controls the server-side storage unit to store the additional information imaging information 601. This control step is referred to as a "first storage step."

[0046] FIG. 4 is a diagram of a user-side information processing device according to the first embodiment.

[0047] In FIG. 4, a user-side information processing device 201 is provided for checking the judgment results, and the user can check the judgment results by entering the device ID and the date for which they want to check the judgment results on the web or in an app.

[0048] When the user inputs the device ID and date, the user-side information processing device 201 retrieves the corresponding determination result from the database 110 and downloads it as text or CSV format data 202. The user-side information processing device 201 displays the device ID, or if it can be linked to the device ID, the location where the defecation device is installed, such as the room number, or the name of the user using the device (not shown). The user-side information processing device 201 reads the determination result from the data 202 and displays on a graph 203 in the user-side information processing device 201 the time the user sat on the toilet seat 2, when the defecation occurred, whether the defecation was feces or urine, and if it was feces, the shape of the defecation at that time, its classification on the seven-category Bristol scale, the color of the defecation, the amount of feces, and the number of times the defecation occurred. If it was urine, the color and amount of urine are displayed on the graph 203 in the user-side information processing device 201.

[0049] Graph 203 is composed of three graphs with the horizontal axis representing time from 0:00:00 to 23:59:59. The first graph displays the time spent sitting on the toilet seat from the image capture time noted in the image name as a square wave.

[0050] The other step is to read the image capture time marked on the image that is determined to be urine by the fecal urine detection and display a bar-shaped figure on the graph. In this case, the figure may be displayed in the same color as the urine color determination result, with its height changed depending on the urine volume, or the urine color and urine volume may be displayed as text within the figure as shown in Figure 5, or text may be displayed as an annotation near the figure as shown in Figure 6.

[0051] Furthermore, the second stage reads the image capture time marked on the image determined to be stool by the feces / urine presence detection and displays a bar-shaped figure on the graph. In this case, the figure may display the stool shape recognition result as text within the figure, or may display an iconized figure of the Bristol scale index imitating the shape of stool. The figure may also be displayed in the same color as the stool color determination result, with its height changed depending on the stool volume, or the stool color, volume, and number of stool drops may be displayed as text within the figure, or text may be displayed as an annotation near the figure.

[0052] Furthermore, as shown in Fig. 7, the user-side information processing device 201 of this embodiment can display the image that is the basis for the judgment result by clicking or touching a graphic that represents the judgment result displayed on the graph 203. The image may be displayed on the graph 203 from the beginning. The image displayed at this time may be displayed in a form that pops up as an image display area 204 in a window separate from the graph, or may be displayed in an image display area 204 provided in the same window as the graph, as shown in Fig. 8. At this time, the image selected by the representative image selection algorithm 109 is displayed.

[0053] As described above, in the system according to the first embodiment, first, the user-side control unit acquires, via the user-side input unit, the date of the stool condition that a viewer (e.g., a caregiver at a nursing home) who views the user's stool condition wants to display on the display unit (e.g., the stool condition of a care recipient at a nursing home). This control process is referred to as the "first u input process."

[0054] Next, the user-side control unit controls the user-side transmission unit to transmit this date to the server. This transmission is called the "first transmission step."

[0055] The server control unit controls the server receiving unit to receive the date sent from the user transmitting unit. This receiving step is called the "first receiving step."

[0056] Based on the date, the server-side control unit selects, as within-period imaging information, the additional information imaging information 601 whose imaging date falls within the predetermined period from the additional information imaging information 601 stored in the server-side storage unit. This selection step is called the "third step of processing s."

[0057] A specific example of the third step of the process is described below. Here, the predetermined period is set to "3 days." The viewer inputs "October 2, 2020" from the user-side input unit. That is, the user-side control unit acquires "October 2, 2020" as the date via the user-side input unit.

[0058] 12A to 12C, FIG. 12A and FIG. 12B are included in the two days before and after "October 2, 2020" (i.e., the three days from October 1 to 3, 2020). On the other hand, FIG. 12C is not included in the three days before and after that. Therefore, the server-side control unit selects the two pieces of additional information imaging information 601 shown in FIG. 12A and FIG. 12B as within-period imaging information. FIG. 12C is captured image information 501 captured on October 4, 2020, so in this specific example, it is not selected as within-period imaging information.

[0059] The server-side control unit controls the server-side transmitting unit so as to transmit the captured image information within this period to the user-side information processing device. This transmitting step is referred to as a "first transmitting step".

[0060] The user-side control unit controls the user-side receiving unit to receive the imaging information within the period. This receiving step is called the "first receiving step."

[0061] The user-side control unit controls the display unit to display on the display unit (b) estimated information on the presence or absence of stool, (c) estimated estimated shape of stool, (d) estimated estimated amount of stool, (e) estimated information on the presence or absence of urination, (f) estimated estimated amount of urination, and (g) the selected representative image, which are included in the captured image information received by the user-side receiving unit. This display step is referred to as the "first display step."

[0062] In this way, in the stool status display system according to embodiment 1, stool presence / absence estimation information is displayed on the display unit, so that a viewer (e.g., care worker) of the user's (e.g., care recipient's) stool can easily recognize whether the user has stool or not, and as a result, can easily understand the user's health condition.

[0063] Furthermore, while the recognition algorithm's judgment results are assumed to be highly accurate, the judgment results output by the algorithm are not necessarily 100% accurate. The user-side information processing device 201 of this embodiment can display the image on which the judgment result was based. If the judgment result by the recognition algorithm differs from the judgment result visually confirmed by the user, the judgment result displayed in the graph 203 on the user-side information processing device 201 can be corrected. The user-side information processing device 201 of this embodiment displays the image on which the judgment result was based, and as shown in FIG. 9 , it also has a judgment result display box 205 below or around the image in which judgment result text is entered, and a pull-down box 206 next to the box 205. Clicking or touching the pull-down box 206 displays a list of judgment results, and the user can click or touch the judgment result they want to confirm to correct the judgment result displayed in the box 205. At this time, the graphic representing the judgment result displayed on the graph is also redrawn in accordance with the correction.

[0064] Furthermore, if the recognition algorithm outputs an incorrect result, the recognition accuracy can be further improved by additionally learning the incorrect image, so the representative image is extremely valuable. Generally, to improve the accuracy of an image-based recognition algorithm, a large number of images with correct answer labels are required, but re-learning images that can already be judged is not very effective, so it is preferable to re-learn images that have been judged incorrectly by labeling them with the correct answer.

[0065] In this embodiment, the user-side information processing device 201 transmits image information in which the user has corrected the judgment result to the server 101, and adds the corrected judgment result in addition to the correction of the image to the database 110. When re-learning the recognition algorithm, by selecting images to be used for learning based on the correction information, it is possible to further efficiently improve recognition performance.

[0066] As described above, in the system according to embodiment 1, the user-side control unit acquires, via the user-side input unit, correction information for correcting at least one of (b) estimated stool presence / absence information, (c) estimated estimated stool shape, (d) estimated estimated stool volume, (e) estimated urination presence / absence information, and (f) estimated estimated urination volume, which are displayed on the display unit. Hereinafter, this input step will be referred to as the "first correction input step."

[0067] Next, the user-side control unit controls the user-side transmission unit to transmit the correction information to the server. Hereinafter, this transmission step will be referred to as the "first correction transmission step."

[0068] The server control unit controls the server receiving unit to receive the correction information transmitted from the user transmitting unit. Hereinafter, this receiving step will be referred to as "s correction receiving first step."

[0069] The server control unit controls the server storage unit so that the additional information imaging information stored in the server storage unit is corrected based on the correction information. Hereinafter, this correction step will be referred to as "s first correction processing step."

[0070] The user-side information processing device 201 of this embodiment also includes a message box 207 for notifying the user of a message, as shown in Fig. 10. From the information in the database 110, it is possible to infer a state of constipation from various pieces of information, such as the absence of a bowel movement for several days, or, even if a bowel movement has occurred, the stool has been hard, such as type 1 or 2 on the Bristol scale, the amount of stool has been small, and the number of times the stool has passed has been frequent and the stool has been small and round, and the user can be notified by displaying advice on administering a laxative in the message box 207.

[0071] Furthermore, the presence or absence of urination and the interval between urinations can be analyzed from the information in the database 110, and instructions for hydration and advice for improving frequent urination can be displayed in the message box 207.

[0072] Furthermore, the user-side information processing device 201 of this embodiment may display information obtained from the excretion device, such as room occupancy information, whether the shower or flush was used, and whether the toilet lid, toilet seat, or toilet bowl is open or closed.

[0073] (Embodiment 2) The following describes the second embodiment. The second embodiment is the same as the first embodiment except for the following points.

[0074] (1) The toilet-side information processing device includes a toilet-side data transmission unit and a toilet-side control unit; and (2) The captured image information 501 is generated by the server control unit provided in the server 101 and stored in the server storage unit.

[0075] That is, in the second embodiment, the t processing step 1 is not performed. In the t transmission step 1, the toilet-side control unit controls the toilet-side data transmission unit to transmit the captured image 502 captured by the image sensor together with the image capture time 503 to the server. Meanwhile, in the s reception step 1, the server-side control unit controls the server-side receiving unit to receive the captured image together with the image capture time. The server-side control unit then controls the server-side storage unit to store the received captured image in the server-side storage unit. This is called the s processing step 2 step 1. As time passes, the t transmission step 1, s reception step 1, and s processing step 2 step 1 are repeated, and multiple captured images 502 are stored in the server-side storage unit together with their respective image capture times 503.

[0076] It is also possible to configure the system so that Bristol scale classification and stool color determination are performed for each of a plurality of images taken by the camera 4 while the user is seated, and the data are stored as time-series data in the server 101, and the time-series data is displayed in graph form on the user-side information processing device 201. With this configuration, even if the Bristol scale classification or stool color changes during defecation, the changes can be confirmed, allowing for more detailed excretion management.

[0077] In the first embodiment, the image capture is started and ended when the user sits down or leaves the seat, but it may also be started and ended when someone enters the room or their physical condition is detected. Furthermore, the image capture may start when the user presses the start image capture button and end when the user presses the end image capture button. In this case, multiple captured images may be taken from the start to the end of the image capture.

[0078] Also, it is possible to have the user press the capture button once after defecation, instead of taking multiple pictures. That is, the image of the inside of the toilet bowl may be captured by the image sensor when the user presses the capture button. In the first embodiment, captured image information 501 is made up of multiple captured images 502, but as described above, captured image information 501 may also be made up of a single captured image 502. [Industrial Applicability]

[0079] The stool status display system according to the present disclosure is used in nursing facilities by viewers (e.g., caregivers) for health management of users (e.g., care recipients) who require care due to aging or other reasons. The stool status display system according to the present disclosure is also used in the homes of users or those viewing the display content (i.e., stool presence / absence estimation information) on the display unit (i.e., viewers). A program for causing a computer to execute the stool status display system according to the present disclosure is also included in the contents of the present disclosure. [Explanation of symbols]

[0080] 1 toilet 2 toilet seats 3 Seat sensor 4. Camera 5. Control Unit 101 Server 102 Feces and urine detection algorithm 103 Stool shape recognition algorithm 104 Stool color recognition algorithm 105 Stool volume recognition algorithm 106 Flight Drop Detection Algorithm 107 Urine color recognition algorithm 108 Urine Volume Recognition Algorithm 109 Representative Image Selection Algorithm 110 databases 201 User side information processing device 202 Data 203 graphs 204 Image display area 205 Judgment result display box 206 Drop-down box 207 Message Box 501 Captured image information 502 Captured images 503 Image capture time 601 Additional information Imaging information

Claims

1. A stool status display system that displays the stool status of a user on a display unit, The stool status display system comprises: Toilet bowl, Server, and A user-side information processing device having the display unit Equipped with Where: the toilet comprises a toilet seat, an imaging element, and a toilet-side information processing device; the toilet side information processing device includes a toilet side data transmission unit and a toilet side control unit; The server includes a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit; The user-side information processing device further includes a user-side input unit, a user-side transmitting unit, a user-side receiving unit, a user-side storage unit, and a user-side control unit; In the flight status display system, (t) First imaging step: the toilet side control unit controls the imaging element so that the imaging element captures an image of the inside of the toilet bowl; (t) a first transmission step, in which the toilet-side control unit controls the toilet-side data transmission unit to transmit an image captured by the imaging element as captured image information to the server; Here, the captured image information includes the captured image and a capture time of the captured image, (a first receiving step) The server-side control unit controls the server-side receiving unit to receive the captured image information, (First process of process s) Based on a feces presence / absence recognition algorithm, the server-side control unit estimates the presence / absence of the user's feces from at least one captured image included in the received captured image information as feces presence / absence estimation information, (s) a first storage step, in which the server-side control unit controls the server-side storage unit to store the stool presence / absence inference information and additional information imaging information including the received captured image information in the server-side storage unit; (First input step) The user-side control unit acquires, via the user-side input unit, a date of the stool status that a viewer viewing the user's stool status wants to display on the display unit, (u) a first transmission step, in which the user-side control unit controls the user-side transmission unit to transmit the date to the server; (s) a second receiving step, in which the server-side control unit controls the server-side receiving unit to receive the date transmitted from the user-side transmitting unit; (a third process step of the process s) The server-side control unit selects, based on the date, additional information imaging information whose imaging date falls within a predetermined period from the additional information imaging information stored in the server-side storage unit, as within-period imaging information; (s) a first transmission step, in which the server-side control unit controls the server-side transmission unit to transmit the period-interval imaging information to the user-side information processing device; (u) a first receiving step, in which the user-side control unit controls the user-side receiving unit to receive the imaging information within the period; (u) A first display step, in which the user-side control unit controls the display unit to display the feces presence / absence estimation information included in the period image information received by the user-side receiving unit on the display unit. is executed, Between the first processing step and the first storage step, the following steps are further included: (a second process step) a step in which the server-side control unit selects, as a representative image, at least one image taken during a period from when the user sits down until when the user leaves the seat, from among the captured images included in the received captured image information, based on a representative image selection algorithm using the captured image time; A flight status display system that executes the above.

2. A program for operating a stool status display system that displays a user's stool status on a display unit, The stool status display system comprises: Toilet bowl, Server, and A user-side information processing device having the display unit Equipped with Where: the toilet comprises a toilet seat, an imaging element, and a toilet-side information processing device; the toilet side information processing device includes a toilet side data transmission unit and a toilet side control unit; The server includes a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit; The user-side information processing device further includes a user-side input unit, a user-side transmitting unit, a user-side receiving unit, a user-side storage unit, and a user-side control unit; The program is (t) First imaging step: the toilet side control unit controls the imaging element so that the imaging element captures an image of the inside of the toilet bowl; (t) a first transmission step, in which the toilet-side control unit controls the toilet-side data transmission unit to transmit an image captured by the imaging element as captured image information to the server; Here, the captured image information includes the captured image and a capture time of the captured image, (a first receiving step) The server-side control unit controls the server-side receiving unit to receive the captured image information, (First process of process s) Based on a feces presence / absence recognition algorithm, the server-side control unit estimates the presence / absence of the user's feces from at least one captured image included in the received captured image information as feces presence / absence estimation information, (s) a first storage step, in which the server-side control unit controls the server-side storage unit to store the stool presence / absence inference information and additional information imaging information including the received captured image information in the server-side storage unit; (First input step) The user-side control unit acquires, via the user-side input unit, a date of the stool status that a viewer viewing the user's stool status wants to display on the display unit, (u) a first transmission step, in which the user-side control unit controls the user-side transmission unit to transmit the date to the server; (s) a second receiving step, in which the server-side control unit controls the server-side receiving unit to receive the date transmitted from the user-side transmitting unit; (a third process step of the process s) The server-side control unit selects, based on the date, additional information imaging information whose imaging date falls within a predetermined period from the additional information imaging information stored in the server-side storage unit, as within-period imaging information; (s) a first transmission step, in which the server-side control unit controls the server-side transmission unit to transmit the period-interval imaging information to the user-side information processing device; (u) a first receiving step, in which the user-side control unit controls the user-side receiving unit to receive the imaging information within the period; (u) A first display step, in which the user-side control unit controls the display unit to display the feces presence / absence estimation information included in the period image information received by the user-side receiving unit on the display unit. Run Between the first processing step and the first storage step, the following steps are further included: (a second process step) a step in which the server-side control unit selects, as a representative image, at least one image taken during a period from when the user sits down until when the user leaves the seat, from among the captured images included in the received captured image information, based on a representative image selection algorithm using the captured image time; Run the program.

3. (a second transmission step), the server-side control unit controls the server-side transmission unit to transmit the selected representative image to the user-side information processing device, (u) A second receiving step, in which the user-side control unit controls the user-side receiving unit to receive the representative image; (u) A second display step, in which the user-side control unit controls the display unit to display the representative image received by the user-side receiving unit on the display unit. is executed, displaying the representative image on the user-side information processing device; The flight status display system according to claim 1.

4. (a second transmission step), the server-side control unit controls the server-side transmission unit to transmit the selected representative image to the user-side information processing device, (u) A second receiving step, in which the user-side control unit controls the user-side receiving unit to receive the representative image; (u) A second display step, in which the user-side control unit controls the display unit to display the representative image received by the user-side receiving unit on the display unit. is executed, displaying the representative image on the user-side information processing device; The program according to claim 2.

Images