Image generation device and program

Abstract

To enable tracking of changes in sanitary conditions over time. [Solution] The system includes an image acquisition unit 153 that acquires a first image including the connection point where a peritoneal dialysis tube is connected to the patient's abdomen, and a second image taken after the first image, and an image generation unit 155 that identifies locations in the second image where the difference between the pixel value of a red pixel in the first image and the pixel value of a red pixel in the second image is greater than or equal to a threshold, and generates an image for redness evaluation that shows the identified locations in a predetermined manner.

Description

Technical Field

[0001] The present invention relates to an image generation device and a program for generating an image used for analyzing a captured image of a patient undergoing peritoneal dialysis.

Background Art

[0002] Patent Document 1 discloses a technique for evaluating the hygiene state of a connection part for peritoneal dialysis based on an image obtained by imaging the connection part when a patient undergoing peritoneal dialysis performs peritoneal dialysis.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When evaluating the hygiene state of the connection part, it may be desired to evaluate the change over time of the hygiene state.

[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to enable grasping of the change over time of the hygiene state.

Means for Solving the Problems

[0006] In a first aspect of the present invention, there is provided an image generation device including an image acquisition unit that acquires a first image including a connection part where a peritoneal dialysis tube is connected to a patient's abdomen and a second image captured after the first image, and an image generation unit that specifies a location where a difference between a pixel value of a red pixel included in the first image and a pixel value of a red pixel included in the second image in the second image is greater than or equal to a threshold value, and generates a erythema evaluation image indicating the specified location in a predetermined manner.

[0007] The image acquisition unit may acquire the second image, which was captured on or after the day following the first image.

[0008] The image generation unit may generate the redness evaluation image in which the identified area is shown in red.

[0009] A display image may be generated that shows a display area for displaying the number of locations included in the redness evaluation image, and the redness evaluation image side by side.

[0010] The image generation unit may generate the redness evaluation image in which a dotted line frame is drawn around the boundary between the region where the difference in pixel values ​​is less than the threshold and the portion whose size is less than a predetermined value, and a solid line frame is drawn around the boundary between the portion whose size is greater than or equal to the predetermined value and the region.

[0011] The image generation unit may generate a display image that arranges a display area showing the number of locations whose size is less than a predetermined value and the number of locations whose size is greater than or equal to the predetermined value, along with the redness evaluation image.

[0012] The image generation unit may generate a display image that juxtaposes a display area that associates the date and time each of the first and second images was captured with the number of locations in each image, and the redness evaluation image.

[0013] In a second aspect of the present invention, a program is provided to cause a computer to function as an image acquisition unit that acquires a first image including a connection portion in which a peritoneal dialysis tube is connected to the patient's abdomen, and a second image taken after the first image, and an image generation unit that identifies locations in the second image where the difference between the pixel value of a red pixel in the first image and the pixel value of a red pixel in the second image is greater than or equal to a threshold, and generates an image for redness evaluation that shows the identified location in a predetermined manner. [Effects of the Invention]

[0014] According to the present invention, the effect is that changes in sanitary conditions over time can be understood.

Brief Description of the Drawings

[0015] [Figure 1] It is a diagram for explaining the outline of the image generation device. [Figure 2] It is a diagram for explaining the configuration of the image generation device. [Figure 3] It is a diagram for explaining the process of specifying the diameter of the tube. [Figure 4] It is a diagram for explaining the process of specifying the size of the connection part. [Figure 5] It is a schematic diagram of the captured image before trimming. [Figure 6] It is a schematic diagram of the processed image after trimming. [Figure 7] It is a diagram for explaining the process of generating a processed image from which the tube is removed from a plurality of captured images. [Figure 8] It is an example of an image for erythema evaluation. [Figure 9] It is a schematic diagram of a screen on which a plurality of processed images are arranged and displayed. [Figure 10] It is a flowchart showing an example of the flow of the process executed by the image generation device.

Embodiments for Carrying Out the Invention

[0016] [Outline of Image Generation Device 1] FIG. 1 is a diagram for explaining the outline of the image generation device 1. The image generation device 1 is, for example, a smartphone equipped with an imaging unit. The image generation device 1 images a connection part 3 to which a peritoneal dialysis tube 2 is connected for a patient undergoing peritoneal dialysis, and generates a captured image for an evaluator such as a doctor or a nurse to evaluate the hygiene state of the connection part 3. The connection part 3 is a site in the patient's body where the tube 2 is inserted, and is an opening in a state where the tube 2 is not inserted. The image generation device 1 has a display 11, and the captured image is displayed on the display 11.

[0017] If the diameter of the tube 2 and the size of the connection part 3 in the captured image vary each time it is captured, the connection part 3 may be enlarged too much and the vicinity area of the connection part 3 cannot be confirmed, or the connection part 3 may be too small and the details of the connection part 3 cannot be confirmed, so that the evaluator cannot appropriately evaluate the hygiene state of the connection part. Therefore, the image generation device 1 generates a processed image so that the diameter of the tube 2 or the size of the connection part 3 in the captured image does not vary greatly each time it is captured, and the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range with respect to the size of the captured image, and displays it on the display 11. The processed image is, for example, an image for assisting so that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range with respect to the size of the captured image, or an image in which the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range with respect to the size of the captured image.

[0018] The predetermined range is determined in advance so as to be an appropriate range corresponding to the actual diameter of the tube 2. For example, the predetermined range is represented by the ratio of the diameter of the tube 2 or the size of the connection part 3 in the captured image to the size of a predetermined part of the captured image. Specifically, the predetermined range is a range defined as a ratio range of the diameter of the tube 2 at the connection part 3 on the captured image to the size of a predetermined part of the captured image. The size of the predetermined part is, for example, the length of the long side, short side or diagonal of the captured image, or the number of pixels of the captured image, but is not limited thereto.

[0019] The predetermined range is defined as a range that enables the connection part 3 to be confirmed in a sufficiently large state and also enables the state of the skin in the peripheral part of the connection part 3 to be confirmed. The specific value of the predetermined ratio range is, for example, the ratio of the length is 30% or more and 70% or less (the ratio of the area is about 10% or more and about 50% or less). These predetermined ranges may be numerical ranges determined and stored in advance, or may be numerical ranges set by the user of the image generation device 1.

[0020] Figure 1(a) shows a processed image when the diameter of tube 2 or the size of the connection part 3 displayed in the captured image is too large, and the diameter of tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image. When the diameter of tube 2 or the size of the connection part 3 in the captured image is not within a predetermined range relative to the size of the captured image, the image generation device 1 generates a processed image that includes information indicating that the diameter of tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image.

[0021] The display 11 in Figure 1(a) shows a dotted line frame 41 indicating the area including the connection part 3, as information indicating that the diameter of the tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image. The display 111 in Figure 1(a) also shows the message 111, "Camera is too close. Move it away from the abdomen." This allows the user imaging the connection part 3 on the patient's abdomen to understand that the diameter of the tube 2 or the size of the connection part 3 is too large, and to move the position of the image generation device 1 so that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image.

[0022] Figure 1(b) shows a processed image when the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image. The display 11 in Figure 1(b) shows a solid line frame 42 indicating the area including the connection part 3, as information indicating that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image. The display 11 in Figure 1(b) also shows the message 112, "Touch the shutter button to take a picture," and the shutter button 5.

[0023] The user of the image generation device 1 can capture an image of the area around the connection part 3 while the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image by touching the shutter button 5 displayed on the display 11 in Figure 1(b). As a result, the image generation device 1 can generate an image in which the diameter of the tube 2 and the connection part 3 are of an appropriate size.

[0024] [Configuration of Image Generation Device 1] Figure 2 is a diagram illustrating the configuration of the image generation device 1. The image generation device 1 comprises a display 11, a communication unit 12, an imaging unit 13, a storage unit 14, and a control unit 15.

[0025] The display 11 is, for example, a liquid crystal display. The display 11 includes an input unit, which is, for example, a touch panel. The user can operate the image generation device 1 by touching the display on the screen shown on the display 11.

[0026] The communication unit 12 is a wireless communication module for sending and receiving information via a wireless communication line. The communication unit 12 can send and receive information with other devices, for example, via the Internet.

[0027] The imaging unit 13 captures an image of the target and generates an image. For example, the imaging unit 13 generates an image of the abdomen of a patient undergoing peritoneal dialysis. Specifically, the imaging unit 13 generates an image that includes the connection part 3 where the peritoneal dialysis tube 2 is connected to the patient's abdomen. The imaging unit 13 may also have a zoom function to enlarge or reduce the image of the target. Hereinafter, the size of the image generated by the imaging unit 13 will be assumed to be 12 million pixels, with 400,000 pixels horizontally and 300,000 pixels vertically, but it is not limited to this.

[0028] The memory unit 14 is a storage medium including ROM (Read Only Memory), RAM (Random Access Memory), and a hard disk. The memory unit 14 stores the program that the control unit 15 executes.

[0029] The control unit 15 is a computing resource that includes a processor such as a CPU (Central Processing Unit). The control unit 15 executes a program stored in the storage unit 14 to realize the functions of an input reception unit 151, a range determination unit 152, an image acquisition unit 153, a shape identification unit 154, and an image generation unit 155.

[0030] The input receiving unit 151 accepts operations entered by the user. For example, the input receiving unit 151 accepts input of an imaging range that includes the connection part 3 to be included in the processed image. The imaging range that includes the connection part 3 is defined, for example, by the distance from the center position of the connection part 3. Specifically, when the input receiving unit 151 receives an operation to start inputting the imaging range on the touch panel provided on the display 11, it displays the imaging range input screen on the display unit and accepts the numerical value entered on the displayed input screen as the imaging range.

[0031] The range determination unit 152 determines the size of the diameter of the tube 2 or the size of the connection part 3 in the captured image relative to the size of the captured image. For example, the range determination unit 152 determines a predetermined range based on the input imaging range. To capture a wider area, the distance from the connection part 3 needs to be increased. As the distance from the connection part 3 increases, the diameter of the tube 2 and the size of the connection part 3 in the captured image decrease. Therefore, the range determination unit 152 decreases the upper and lower limits of the predetermined range as the input imaging range becomes wider.

[0032] The image acquisition unit 153 acquires the captured image generated by the imaging unit 13. For example, the image acquisition unit 153 controls the imaging unit 13 to cause it to generate an captured image, and then acquires the captured image generated by the imaging unit 13.

[0033] The shape identification unit 154 identifies the diameter of the tube 2 in the captured image. Specifically, the shape identification unit 154 identifies the diameter of the tube 2 at the connection part 3 in the captured image. Figure 3 is a diagram illustrating the process of identifying the diameter of the tube 2. First, the shape identification unit 154 identifies the area of ​​the tube 2 in the captured image, and from the identified area of ​​the tube 2, it identifies the center line 21, outer edge 22a, and outer edge 22b of the tube 2. Next, the shape identification unit 154 identifies the point 24a where a straight line 23 perpendicular to the center line 21 intersects the outer edge 22a, and the point 24b where the straight line 23 intersects the outer edge 22b. Then, the shape identification unit 154 identifies the distance between points 24a and 24b as the diameter of the tube 2.

[0034] The shape identification unit 154 may identify the size of the connection portion 3 instead of the diameter of the tube 2 in the captured image. Figure 4 is a diagram illustrating the process of identifying the size of the connection portion 3. When identifying the size of the connection portion 3, the shape identification unit 154 identifies the region of the connection portion 3 in the captured image. For example, the shape identification unit 154 identifies the region within a predetermined distance r from the end portion 31 in the longitudinal direction of the tube 2 as the connection portion 3. Specifically, the shape identification unit 154 identifies the end portion 31, which is the intersection point of the center line 21 of the region of the tube 2 and the end edge 25, as the center of the connection portion 3, and identifies a circle 32 with radius r centered on the end portion 31 as the connection portion 3. The shape identification unit 154 may also identify a square 43 inscribed in the circle 32, or a square circumscribed around the circle 32, as the connection portion 3.

[0035] The shape-identifying unit 154 identifies the size of the circle 32 or square 43 identified as the connection part 3 as the size of the connection part 3. Specifically, the shape-identifying unit 154 identifies the diameter 2r of the circle 32 or the side length 2r of the square 43 as the length of the connection part 3. Alternatively, the shape-identifying unit 154 may identify the number of pixels contained in the circle 32 or square 43 as the size of the connection part 3.

[0036] The shape-identifying unit 154 identifies the size of the connection part 3 as well as its position. For example, the shape-identifying unit 154 identifies the position of the end portion 31, which is the center of the connection part 3, as the position of the connection part 3. Alternatively, if the shape-identifying unit 154 identifies the connection part 3 as a square, it may identify the center of the square or one of the four corners of the square as the position of the connection part 3.

[0037] The shape identification unit 154 may use machine learning to identify the diameter of the tube 2 or the connection part 3. For example, the shape identification unit 154 may identify the diameter of the tube 2 by inputting the captured image into a machine learning model that identifies the diameter of the tube 2 contained in the captured image. Alternatively, the shape identification unit 154 may identify the size of the connection part 3 by inputting the captured image into a machine learning model that identifies the size of the connection part 3 contained in the captured image.

[0038] The image generation unit 155 generates a processed image based on the diameter of the tube 2 or the size of the connection part 3 identified by the shape identification unit 154, so that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image. The process by which the image generation unit 155 generates the processed image will be described below.

[0039] The image generation unit 155 determines whether the diameter of the tube 2 or the size of the connection portion 3 in the captured image is within a predetermined range relative to the size of the captured image. For example, the image generation unit 155 determines whether the diameter of the tube 2 or the size of the connection portion 3 in the captured image is within a predetermined range relative to the size of the captured image based on whether the ratio between the diameter of the tube 2 at the connection portion 3 in the captured image and the size of a predetermined part of the captured image is within a ratio range.

[0040] The image generation unit 155 determines that the diameter of tube 2 or the size of the connecting portion 3 is within a predetermined range relative to the size of the captured image if the ratio of the diameter of tube 2 to the length of a predetermined portion of the captured image is within the ratio range. The image generation unit 155 determines that the diameter of tube 2 or the size of the connecting portion 3 is not within a predetermined range relative to the size of the captured image if the ratio of the diameter of tube 2 to the length of a predetermined portion of the captured image is outside the ratio range.

[0041] The image generation unit 155 may determine whether the diameter of the tube 2 or the size of the connecting portion 3 is within a predetermined range relative to the size of the captured image, based on the ratio of the size of the connecting portion 3 to the size of a predetermined area in the captured image, instead of the ratio of the diameter of the tube 2 in the captured image to the length of a predetermined part of the captured image. For example, if the ratio of the diameter or radius of the circle 32 identified as the connecting portion 3, or the length of the side or diagonal of the square 43, to the length of a predetermined part of the captured image is within the ratio range, the image generation unit 155 determines that the diameter of the tube 2 or the size of the connecting portion 3 is within the predetermined range relative to the size of the captured image. If the ratio of the diameter or radius of the circle 32, or the length of the side or diagonal of the square 43, to the length of a predetermined part of the captured image is outside the ratio range, the image generation unit 155 determines that the diameter of the tube 2 or the size of the connecting portion 3 is not within the predetermined range relative to the size of the captured image.

[0042] The image generation unit 155 may determine whether the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image, based on the ratio of the number of pixels in the region identified as the connection part 3 to the total number of pixels in the captured image. The image generation unit 155 determines that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image if the number of pixels in the connection part 3 is within the ratio range relative to the total number of pixels in the captured image. The image generation unit 155 determines that the diameter of the tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image if the ratio of the number of pixels in the connection part 3 to the total number of pixels in the captured image is outside the ratio range.

[0043] If the image generation unit 155 determines that the diameter of the tube 2 or the size of the connection part 3 in the captured image is within a predetermined range relative to the size of the captured image, it generates a processed image that displays first information indicating that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image. For example, as first information, the image generation unit 155 generates a processed image that displays a solid line frame 42 (see Figure 1(b)) surrounding the connection part 3, indicating that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image.

[0044] Specifically, the image generation unit 155 generates a processed image displaying a solid line frame 42 when the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image, and the position of the connection part 3 is within a predetermined area including the center of the captured image. The predetermined area can be determined as appropriate, but it is an area within a predetermined distance from the center of the captured image. The predetermined distance can be increased, for example, as the size of the captured image increases. If the number of pixels on the long side of the captured image is 400,000 pixels, the predetermined distance is, for example, 20,000 pixels, but it is not limited to this.

[0045] The image generation unit 155 may generate a processed image that displays a message indicating that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image, in addition to the solid line frame 42. For example, the image generation unit 155 generates a processed image (see Figure 1(b)) that displays the message 112, "Touch the shutter button to take a picture." This allows the user of the image generation device 1 to capture the connection part 3 while the diameter of the tube 2 and the size of the connection part 3 are within a predetermined range relative to the size of the captured image, so that the image generation unit 155 can generate an image in which the diameter of the tube 2 and the size of the connection part 3 are of an appropriate size.

[0046] If the image generation unit 155 determines that the diameter of the tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image, it generates a processed image that displays second information indicating that the diameter of the tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image (see Figure 1(a)). As second information, the image generation unit 155 generates a processed image that displays a dotted line frame 41 (see Figure 1(a)) surrounding the connection part 3, indicating that the diameter of the tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image. Specifically, the image generation unit 155 generates a processed image that displays the dotted line frame 41 if at least one of the following is true: the diameter of the tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image, or the position of the connection part 3 is outside a specified area.

[0047] The image generation unit 155 changes the displayed second information based on whether the diameter of the tube 2 or the size of the connection part 3 is greater than the upper limit of the predetermined range or less than the lower limit of the predetermined range relative to the size of the captured image, if the diameter of the tube 2 or the size of the connection part 3 is not within a predetermined range relative to the size of the captured image. For example, if the diameter of the tube 2 or the size of the connection part 3 is greater than the upper limit of the predetermined range relative to the size of the captured image, the image generation unit 155 generates a processed image that displays the message "The camera is too close. Move it away from your abdomen" as the second information. Also, if the diameter of the tube 2 or the size of the connection part 3 is smaller than the lower limit of the predetermined range relative to the size of the captured image, the image generation unit 155 generates a processed image that displays the message "The camera is too far away. Move it closer to your abdomen" as the second information. This allows the user of the image generation device 1 to understand how to move the image generation device 1 to make the diameter of the tube 2 or the size of the connection part 3 appropriate.

[0048] The image generation unit 155 may change the color of the frame indicating the connection part 3 depending on whether the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image. For example, if the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image and the position of the connection part 3 is within a specified area, the image generation unit 155 generates a processed image that displays a green dotted line frame. If the diameter of the tube 2 or the size of the connection part 3 is outside the predetermined range relative to the size of the captured image, or if the position of the connection part 3 is outside the specified area, the image generation unit 155 displays a white dotted line frame.

[0049] In the above description, an example was given in which the image generation unit 155 generates a processed image so that the diameter of the tube 2 or the size of the connection part 3 falls within a predetermined range relative to the size of the captured image when the user of the image generation device 1 captures the connection part 3. However, the image generation unit 155 may also generate a processed image by trimming an already captured image so that the diameter of the tube 2 or the size of the connection part 3 falls within a predetermined range relative to the size of the captured image. The process by which the image generation unit 155 trims an captured image to generate a processed image in which the diameter of the tube 2 or the size of the connection part 3 falls within a predetermined range relative to the size of the captured image will be described below with reference to Figures 5 and 6.

[0050] Figure 5 is a schematic diagram of the captured image before trimming. In the captured image in Figure 5, the position of the connection part 3 is outside the defined area 44 of the captured image. The image generation unit 155 generates a processed image by trimming the captured image so that the position of the connection part 3 is included in the defined area 44 and the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image. Specifically, first, the image generation unit 155 determines the size of the processed image when the ratio of the diameter of the tube 2 or the size of the connection part 3 to the size of the processed image is within a predetermined ratio range. For example, if the length of the diameter of the tube 2 is 10,000 pixels and the predetermined ratio range is between 1 / 6 and 1 / 4, the image generation unit 155 determines the size of the processed image to be 50,000 pixels. Next, the image generation unit 155 trims a rectangular area 45 centered on the center of the connection part 3, where the number of pixels on the longest side is 50,000 pixels.

[0051] Figure 6 is a schematic diagram of the processed image after trimming. By trimming the captured image, the image generation unit 155 positions the connection part 3 within the specified area 46 in the processed image, and the size of the connection part 3 is within a predetermined range. This makes the area around the connection part 3 easier to see, making it easier to evaluate the sanitary condition of the connection part 3.

[0052] However, if the captured image includes tube 2, the evaluator cannot assess the sanitary condition of the part of the captured image that is obscured by tube 2. Therefore, the image generation unit 155 may generate a processed image from which tube 2 has been removed from multiple captured images.

[0053] Figure 7 illustrates the process of generating a processed image from which tube 2 has been removed from multiple captured images. First, the image acquisition unit 153 acquires multiple captured images in which tube 2 is in a different position. For example, after acquiring one captured image, the image acquisition unit 153 displays a message on the display 11 or outputs it to the speaker of the image generation device 1 saying, "Please lift the tube and take an image." In this way, the image acquisition unit 153 acquires multiple captured images in which tube 2 is in a different position by having the user of the image generation device 1 take multiple captured images in which tube 2 is in a different position.

[0054] Figure 7(a) is the first image among several captured images. Figure 7(b) is the second image, which is different from the first image. The position of the connector 3 in the second image is the same as the position of the connector 3 in the first image, while the position of the tube 2 in the second image is different from the position of the tube 2 in the first image.

[0055] The image generation unit 155 identifies the area of ​​tube 2 in each of the multiple captured images. Specifically, the image generation unit 155 identifies the area of ​​tube 2 in each captured image by inputting each captured image into a machine learning model that identifies the area of ​​tube 2 contained in the captured image. Then, the image generation unit 155 generates a processed image from which tube 2 has been removed by combining the images from each captured image that do not contain the area of ​​tube 2. Figure 7(c) is a processed image from which tube 2 has been removed. In this way, by removing tube 2 from the captured image, the part that is hidden by tube 2 and cannot be seen is eliminated, making it easier for the evaluator to assess the sanitary condition of the connection part 3.

[0056] When evaluating the sanitary condition of the connection part 3, it is sometimes necessary to evaluate how the sanitary condition changes over time. Therefore, the image generation unit 155 generates a redness evaluation image for evaluating the redness that occurs around the connection part 3 using multiple captured images taken at different times. In this case, the image acquisition unit 153 acquires two processed images in which the position of the connection part 3 is included in a specified area and the size of the connection part 3 is within a predetermined range relative to the size of the captured image. Specifically, the image acquisition unit 153 acquires a processed image from the first day and a processed image from the second day, which is after the first day.

[0057] The image generation unit 155 identifies areas where the difference in pixel values ​​of red pixels in two processed images exceeds a threshold. The image generation unit 155 then generates a redness evaluation image that shows the identified areas in a predetermined color. The predetermined color is, for example, red, but is not limited to this. Figure 8 is an example of a redness evaluation image. The shaded area 61 in Figure 8 is an area where the difference in pixel values ​​of red pixels exceeds a threshold. In this way, it becomes easier for the evaluator to understand where and how large the redness is.

[0058] The image generation unit 155 may change the display mode depending on the length or diameter of areas where the difference in pixel values ​​of red pixels is greater than or equal to a threshold. For example, the image generation unit 155 changes the display mode depending on whether the length of areas where the difference in pixel values ​​of red pixels is greater than or equal to a predetermined length is greater than or equal to a predetermined size. The predetermined length is, for example, a value corresponding to the guidelines for evaluating redness in peritoneal dialysis, and specifically, it is 5 mm. The image generation unit 155 displays a solid line frame 62 when the length of areas where the difference in pixel values ​​of red pixels is greater than or equal to a predetermined threshold is greater than or equal to a predetermined threshold. The image generation unit 155 also displays a dotted line frame 63 when the size of areas where the difference in pixel values ​​of red pixels is greater than or equal to a predetermined threshold is less than a predetermined threshold. This makes it easier for evaluators to identify redness that is larger than the predetermined size indicated in the guidelines.

[0059] The image generation unit 155 transmits the generated processed image to another device via the communication unit 12. The other device is, for example, a computer of an evaluator who evaluates the sanitary condition of the connection unit 3. In this way, the evaluator can remotely evaluate the sanitary condition of the connection unit 3 without having to visit the patient undergoing peritoneal dialysis or having the patient come to the hospital.

[0060] (Variation 1) The image acquisition unit 153 may acquire an image in which the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image by zooming the imaging unit 13 so that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image. Specifically, if the diameter of the tube 2 or the size of the connection part 3 is smaller than the lower limit of the predetermined range relative to the size of the captured image, the image acquisition unit 153 zooms the imaging unit 13 to enlarge the connection part 3. If the diameter of the tube 2 or the size of the connection part 3 is larger than the upper limit of the predetermined range relative to the size of the captured image, the image acquisition unit 153 zooms the imaging unit 13 to reduce the size of the connection part 3. As a result, the user of the image generation device 1 can acquire an image in which the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image simply by positioning the image generation device 1 so that the connection part 3 is captured.

[0061] (Modification 2) In the above description, the image generation device 1 cropped the captured image to generate a processed image, but this is not limited to this; another device different from the image generation device 1 may crop the captured image to generate the processed image. In this case, the image generation device 1 transmits the captured image to the image processing device via the communication unit 12. The image processing device has the same configuration as the control unit 15 of the image generation device 1. Specifically, the image processing device acquires the captured image from the image generation device 1 and crops the captured image so that the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image, thereby generating a processed image. As a result, the image generation device 1 only needs to capture the captured image, thus reducing the processing load of cropping the captured image and generating a processed image.

[0062] (Variation 3) The image generation unit 155 generates a processed image and may also output audio information indicating whether the connection part 3 is of an appropriate size. For example, if the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image, the image generation unit 155 will output an audio message "Please take an image" to the speaker of the image generation device 1. If the diameter of the tube 2 or the size of the connection part 3 is greater than the upper limit of the predetermined range relative to the size of the captured image, the image generation unit 155 will output an audio message "The camera is too close. Move it away from your abdomen" to the speaker. If the diameter of the tube 2 or the size of the connection part 3 is smaller than the lower limit of the predetermined range relative to the size of the captured image, the image generation unit 155 will output an audio message "The camera is too far away. Move it closer to your abdomen" to the speaker. This makes it easier for the patient to adjust the connection part 3 to an appropriate size without looking at the screen when taking an image of the connection part 3 themselves.

[0063] (Modification 4) The image generation unit 155 may generate a processed image such that, instead of the diameter of the tube 2 or the size of the connection part 3, the size of a reference object of known size falls within a predetermined range relative to the size of the captured image. The reference object only needs to have a known size; for example, a sticker of known size attached around the connection part 3. This also helps to reduce the variation in the captured image of the connection part 3.

[0064] (Variation 5) The range determination unit 152 may determine a predetermined range according to the actual diameter of the tube 2 input via the display 11. In this case, the storage unit 14 stores a data table that associates the actual diameter of the tube 2 with the range corresponding to that diameter. The input reception unit 151 displays an input screen on the display 11 for inputting the actual diameter of the tube 2, and accepts the numerical value entered on the displayed input screen as the actual diameter of the tube 2. The range determination unit 152 then determines a predetermined range in the data table stored in the storage unit 14 that is associated with the input actual diameter of the tube 2. The input reception unit 151 may accept input of both the actual diameter of the tube 2 and the range corresponding to the actual diameter of the tube 2. In this case, the range determination unit 152 determines the input range to a predetermined range and stores the input actual diameter of the tube 2 and the range corresponding to the diameter of the tube 2 in the storage unit 14.

[0065] (Experimental variation 6) The image generation unit 155 may display an image on the display 11 containing multiple processed images. Figure 9 is a schematic diagram of a display screen on the display 11 in which multiple processed images are arranged. The display screen shown in Figure 9 includes a thumbnail image area 71, a parallel display area 72, and a redness information area 73. The thumbnail image area 71 displays thumbnail images of multiple processed images. The parallel display area 72 displays two processed images selected by the user from the thumbnail images of multiple processed images displayed in the thumbnail image area 71. The redness information area 73 displays information about the redness contained in each image.

[0066] The image generation unit 155 arranges and displays processed images obtained by cropping each of multiple captured images taken on different dates and times. For example, the image generation unit 155 arranges processed images obtained by cropping each of multiple captured images taken within a predetermined period (e.g., one month) in order of capture date and time and displays them in the thumbnail image area 71. Images 711 to 714 are processed images obtained by cropping captured images taken on 2022 / 7 / 29, 2022 / 7 / 22, 2022 / 7 / 15, and 2022 / 7 / 8, respectively.

[0067] The image generation unit 155 displays some of the processed images larger than the others. For example, the image generation unit 155 enlarges two processed images selected by the user from the multiple thumbnail images displayed in the thumbnail image area 71 and displays them in the parallel display area 72. Preferably, the enlarged image 721 and the enlarged image 722 are the same size. This allows the evaluator to compare the state of the connection part 3 at different times, making it easier to evaluate the changes in infection of the connection part 3 over time. The image generation unit 155 may also display the frame of the selected image 711 in a different manner than the frame of the unselected image 713. For example, the image generation unit 155 displays the frame of the selected image 711 with a solid line and the frame of the unselected image 713 with a dashed line.

[0068] The image generation unit 155 may display the number of red areas in each of the multiple processed images in the redness information area 73. For example, the image generation unit 155 displays the number of red areas in association with the date of the processed image. Specifically, the image generation unit 155 displays the number of areas where the difference in pixel values ​​of red pixels is greater than or equal to a threshold, where the length is 5 mm or more (hereinafter referred to as "large redness"), and where the length is less than 5 mm (hereinafter referred to as "small redness"), in association with the date of the processed image.

[0069] In the table displayed in the redness information area 73 of Figure 9, the date of processing the image is associated with the number of rednesses. For example, on 2022 / 7 / 29, the number of large rednesses [1] and the number of small rednesses [2] are associated. This makes it easier for evaluators to understand the changes in the number of rednesses over time.

[0070] The image generation unit 155 may generate symptom evaluation images to evaluate not only redness but also other symptoms. Other symptoms include, for example, scabs, exudates, and granulation tissue. The image generation unit 155 identifies the presence or absence of each symptom by inputting the captured image or processed image into a machine learning model that identifies whether or not each symptom is present in the input image. The image generation unit 155 then generates symptom evaluation images that indicate whether or not each symptom is present in the input image. For example, the image generation unit 155 displays symptom evaluation images on the display 11 that indicate whether or not each of the two selected processed images is present. This makes it easier for the evaluator to understand the presence or absence of each symptom.

[0071] In Figure 9, the redness information area 73 displays the number of redness areas. In addition, the image generation unit 155 may display information about other symptoms, such as scabs, exudates, and granulation tissue. Furthermore, these other symptoms are not limited to those identified by inputting captured or processed images into the machine learning model; they may also be those input by the user so as to correspond to the processed images displayed in the parallel display area 72. The image generation unit 155 may also display an input area for the user to input symptoms corresponding to the displayed processed images.

[0072] [Processing performed by image generation device 1] Figure 10 is a flowchart showing an example of the processing flow performed by the image generation device 1. It is assumed that the range determination unit 152 has determined a predetermined range before the flowchart in Figure 10 is executed.

[0073] The image acquisition unit 153 acquires the captured image (step S1). Specifically, the image acquisition unit 153 acquires the captured image generated by the imaging unit 13 by controlling the imaging unit 13. The shape identification unit 154 identifies the size of the connection part 3 in the captured image (step S2). Specifically, the shape identification unit 154 identifies the length of the connection part 3 by inputting the captured image into a machine learning model that identifies the length of the connection part 3 contained in the captured image.

[0074] Next, the image generation unit 155 determines whether the size of the connection portion 3 is within a predetermined range relative to the size of the captured image (step S3). For example, the image generation unit 155 determines whether the size of the connection portion 3 is within a predetermined range relative to the size of the captured image by determining whether the ratio of the length of the connection portion 3 to the long side, short side, or diagonal of the captured image is within a predetermined ratio range.

[0075] If the size of the connection part 3 is within a predetermined range relative to the size of the captured image, the image generation unit 155 generates a processed image with a solid line frame 42 (see Figure 1(b)) superimposed to indicate that the size of the connection part 3 is within a predetermined range relative to the size of the captured image (step S4). The image generation unit 155 also notifies that the size of the connection part 3 is within a predetermined range relative to the size of the captured image (step S5). For example, the image generation unit 155 may superimpose a message such as "Touch the shutter button to take a picture" onto the processed image and display it on the display 11, or output it as sound.

[0076] When the user of the image generation device 1 touches the shutter button 5 (see Figure 1(b)), the image acquisition unit 153 stores captured image data in the storage unit 14, where the size of the connection part 3 is within a predetermined range relative to the size of the captured image (step S6).

[0077] If the size of the connection part 3 is not within a predetermined range relative to the size of the captured image, the image generation unit 155 generates a processed image with a dotted line frame 41 (see Figure 1(a)) superimposed to indicate that the size of the connection part 3 is not within a predetermined range relative to the size of the captured image (step S7). The image generation unit 155 also notifies that the size of the connection part 3 is not within a predetermined range relative to the size of the captured image (step S8). For example, the image generation unit 155 may superimpose a message such as "The camera is too close. Move it away from the abdomen" onto the processed image and display it on the display 11, or output it as audio. When the image acquisition unit 153 sees the dotted line frame 41 indicating that the size of the connection part 3 is not within a predetermined range relative to the size of the captured image, and the information indicating that the size of the connection part 3 is not within a predetermined range relative to the size of the captured image, it returns to step S1 and acquires the captured image again.

[0078] The image generation device 1 repeats steps S1 to S3, steps S7 and S8 until the size of the connection portion 3 is within a predetermined range relative to the size of the captured image. In this way, the image generation device 1 can acquire a captured image in which the size of the connection portion 3 is within a predetermined range relative to the size of the captured image.

[0079] [Effects of Image Generation Device 1] As described above, the image generation device 1 generates a processed image such that the diameter of the tube 2 or the size of the connection part 3, which is connected to the patient's abdomen, is within a predetermined range relative to the size of the captured image. As a result, the image generation device 1 can obtain an image in which the diameter of the tube 2 or the size of the connection part 3 is within a predetermined range relative to the size of the captured image, thus reducing the variation in the size of the connection part 3 in the captured image to within a predetermined range. This allows the evaluator to appropriately assess the hygienic condition of the patient's abdomen.

[0080] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of its gist. For example, all or part of the apparatus can be configured by functionally or physically distributing and integrating in any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combinations are combined with the effects of the original embodiments. [Explanation of Symbols]

[0081] 1. Image generation device 11 displays 12 Communications Department 13 Imaging Unit 14 Storage section 15 Control Unit 151 Input Reception Section 152 Range Determination Unit 153 Image acquisition unit 154 Shape identification part 155 Image generation unit 2 tubes 3 Connection part 5. Shutter button

Claims

1. An image acquisition unit that acquires a first image including the connection point where a peritoneal dialysis tube is connected to the patient's abdomen, and a second image taken after the first image, An image generation unit identifies locations in the second image where the difference between the pixel value of a red pixel in the first image and the pixel value of a red pixel in the second image is greater than or equal to a threshold, and generates a redness evaluation image showing the identified locations in a predetermined manner. An image generation device having the following features.

2. The image acquisition unit acquires the second image, which is captured on or after the day following the first image. The image generation apparatus according to claim 1.

3. The image generation unit generates the redness evaluation image in which the identified area is shown in red. The image generation apparatus according to claim 1.

4. A display area for displaying the number of locations included in the redness evaluation image and a display image that arranges the redness evaluation image side by side are generated. The image generation apparatus according to claim 1.

5. The image generation unit generates the redness evaluation image in which a dotted line frame is drawn around the boundary between the region where the difference in pixel values ​​is less than the threshold and the region where the size is less than a predetermined value, and a solid line frame is drawn around the boundary between the region where the size is greater than or equal to the predetermined value. The image generation apparatus according to claim 1.

6. The image generation unit generates a display image which is an arrangement of the display area that displays the number of locations whose size is less than a predetermined value and the number of locations whose size is greater than or equal to the predetermined value, and the redness evaluation image. The image generation apparatus according to claim 1.

7. The image generation unit generates a display image which arranges a display area that associates the date and year in which the first image and the second image were captured with the number of the aforementioned locations in each image, and the redness evaluation image. The image generation apparatus according to claim 1.

8. Computers, An image acquisition unit that acquires a first image including the connection point where a peritoneal dialysis tube is connected to the patient's abdomen, and a second image taken after the first image, and An image generation unit identifies locations in the second image where the difference between the pixel value of a red pixel in the first image and the pixel value of a red pixel in the second image is greater than or equal to a threshold, and generates a redness evaluation image showing the identified locations in a predetermined manner. A program designed to function as such.

Images