Masking ostomy condition classification, devices and related methods
The method enhances ostomy condition classification by transforming and analyzing image data with neural networks to improve accuracy and consistency, addressing the challenges of inconsistent data processing in existing methods.
Patent Information
- Application Number
- JP2021535119
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2018-12-20
- Filing Date
- 2019-12-19
- Publication Date
- 2026-01-14
- Estimated Expiration
- 2039-12-19
AI Technical Summary
Existing methods for classifying ostomy conditions face challenges in accurately and consistently processing and interpreting image data from different locations, leading to inconsistent and potentially poor quality classifications.
A method involving obtaining image data of stoma and ostomy appliance surfaces, transforming and determining ostomy representations using convolutional neural networks, and outputting ostomy parameters to enhance classification accuracy and consistency.
Improves the classification of ostomy conditions by compensating for poor quality data and ensuring consistent processing, allowing for more accurate and detailed categorization into multiple condition types.
Smart Images

Figure 0007798570000001 
Figure 0007798570000002 
Figure 0007798570000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to methods and apparatus for classification of ostomy conditions, and in particular for image-based classification of ostomy conditions. Summary of the Invention [Means for solving the problem]
[0002] The accompanying drawings are included to provide a further understanding of the embodiments, and are incorporated in and a part of this specification. The drawings illustrate embodiments and, together with the description, serve to explain the principles of the embodiments. Other embodiments and many of the intended advantages of the embodiments will be readily appreciated as they become better understood by reference to the following detailed description. Elements of the drawings are not necessarily to scale relative to each other. Like reference characters indicate corresponding like parts. [Brief explanation of the drawings]
[0003] [Figure 1] 1 illustrates an exemplary method according to the present disclosure. [Figure 2] 1 shows an ostomy appliance and accessories. [Figure 3] 10 is an image of an appliance from the appliance image data. [Figure 4] 10 is a diagram illustrating an appliance image based on converted appliance image data. [Figure 5] 10 is an image of an appliance from the appliance image data. [Figure 6] FIG. 2 is a block diagram of an exemplary accessory device. [Figure 7] FIG. 2 is a block diagram of an exemplary server device. [Figure 8] 1 illustrates an exemplary first ostomy representation. [Figure 9] 1 illustrates an exemplary appliance image representation. [Figure 10] 1 illustrates an exemplary second ostomy representation. [Figure 11] 1 shows an exemplary ostomy representation. DETAILED DESCRIPTION OF THE INVENTION
[0004] Various exemplary embodiments and details are described below with reference to the drawings, where relevant. It should be noted that the drawings may or may not be to scale, and that elements of similar structure or function are represented by like reference numerals throughout the drawings. It should also be noted that the drawings are intended merely to facilitate the description of the embodiments. The drawings are not intended to be an exhaustive description of the invention or to limit the scope of the invention. Furthermore, the described embodiments need not possess all of the illustrated aspects or advantages. An aspect or advantage described in connection with a particular embodiment is not necessarily limited to that embodiment and may be implemented in any other embodiment, even if not so shown or explicitly described.
[0005] Throughout this disclosure, the words "stoma" and "ostomy" are used to refer to a surgically created opening that bypasses a person's intestinal or urinary system. These words are used interchangeably and no differential meaning is intended. The same applies to any words or expressions derived therefrom, such as "stoma's," "ostomy," etc. Also, both solid and liquid waste products that exit a stoma may be referred to interchangeably as stoma "output," "one or more waste products," and "fluid." A subject who has undergone ostomy surgery may also be referred to as an "ostomist" or "ostomate"—or even a "patient" or "user." However, in some cases, "user" may also relate to or refer to a healthcare professional (HCP), such as a surgeon or ostomy care nurse. In such cases, it may be specified or implied that the "user" is not the "patient" themselves.
[0006] Throughout this disclosure, the term "stoma site" refers to the stoma and the area around the stoma (peristomal area). "Peristomal area" refers to the area around the stoma that is covered by the adhesive surface when the ostomy appliance is attached to the user's skin in its intended position during use.
[0007] In the following, whenever a proximal side or proximal surface of a layer, element, device, or portion of a device is referenced, it refers to the side or surface that faces the skin when a user is wearing the ostomy appliance. Similarly, whenever a distal side or distal surface of a layer, element, device, or portion of a device is referenced, it refers to the side or surface that faces away from the skin when a user is wearing the ostomy appliance. In other words, the proximal side or proximal surface is the side or surface that is closest to the user when the appliance is attached to the user, and the distal side refers to the opposite side or surface - the side or surface that is furthest from the user during use.
[0008] The axial direction is defined as the direction of the stoma when the user is wearing the appliance, and is therefore approximately perpendicular to the user's skin or abdominal surface.
[0009] The radial direction is defined as perpendicular to the axial direction. In some sentences, the words "inner" and "outer" may be used. These modifiers are generally understood with reference to the radial direction, and therefore, a reference to an "outer" element should mean that this element is further from the central portion of the ostomy appliance than the element referred to as "inner." Furthermore, "innermost" should be interpreted as the portion of the component that forms the center of the component and / or is adjacent to the center of the component. Similarly, "outermost" should be interpreted as the portion of the component that forms the outer edge or outer shape of the component and / or is adjacent to the outer edge or outer shape.
[0010] The use of the word "substantially" as a modifier to certain features or advantages in the present disclosure is intended merely to mean that any deviations are within the tolerance that would normally be expected by one of ordinary skill in the art.
[0011] The use of the word "generally" as a modifier to certain features or effects in this disclosure is intended merely to mean that - for structural features, most or a major portion of such features exhibit that characteristic, and - for functional features or effects, most of the results involving the characteristic produce that effect, but the exceptional results do not produce that effect.
[0012] The present disclosure relates to methods, devices, ostomy systems and devices thereof, particularly methods and devices for classifying ostomy conditions. The ostomy system includes one or more of an ostomy appliance and one or more accessory devices. The accessory device (also referred to as an external device) may be a mobile phone (e.g., a smartphone), a tablet computer, or other handheld device. The accessory device may be a personal electronic device, such as a wearable device, such as a watch or an electronic device worn on the wrist. The ostomy system may include a server device. The server device may be operated and / or controlled by the ostomy appliance manufacturer and / or a service center.
[0013] A method for classifying an ostomy condition is provided, the method including: obtaining, e.g., by an accessory device, image data, the image data optionally including stoma image data of a stoma site including a stoma and / or appliance image data of an adhesive surface of an ostomy appliance; determining one or more ostomy representations, optionally including a first ostomy representation and / or a first ostomy parameter, based on the image data, e.g., based on the stoma image data and / or the appliance image data and / or converted image data; and outputting the first ostomy representation and / or the first ostomy parameter. The method optionally includes converting the image data. Determining the one or more ostomy representations based on the image data optionally includes determining the first ostomy representation and / or the first ostomy parameter based on the image data and / or the converted image data.
[0014] It is an advantage of the present disclosure that compensating for poor quality image data, such as image data obtained from different locations, results in improved classification of ostomy conditions. Furthermore, ensuring consistent processing and / or interpretation of image data results in improved classification of ostomy conditions.
[0015] It is also a significant advantage of the present disclosure that a more accurate classification of ostomy conditions may be provided by determining ostomy parameters in a consistent manner. Additionally, the present disclosure may provide increased resolution in classifying ostomy conditions, for example, allowing for classification of ostomy conditions into a greater number of ostomy condition types.
[0016] One or more exemplary methods for classifying ostomy conditions include: obtaining image data, the image data including stoma image data of a stoma site including a stoma and / or appliance image data of an adhesive surface of an ostomy appliance; determining one or more image representations based on the image data; determining one or more ostomy representations including a first ostomy parameter based on the one or more image representations; and Outputting the first ostomy parameter and / or one or more ostomy representations. Includes:
[0017] One or more exemplary methods for classifying ostomy conditions include: obtaining image data, the image data including stoma image data of a stoma site including a stoma and / or appliance image data of an adhesive surface of an ostomy appliance; determining one or more ostomy representations including a first ostomy parameter based on the image data; and Outputting the first ostomy parameter and / or one or more ostomy representations. and the method includes transforming the image data, and determining one or more ostomy representations based on the image data includes determining a first ostomy parameter based on the transformed image data.
[0018] The method includes obtaining image data, such as stoma image data and / or appliance image data. In one or more exemplary methods, obtaining the image data may include capturing the image data with a camera and transmitting the image data to a server device. In one or more exemplary methods, obtaining the image data may include receiving the image data at the server device.
[0019] The method optionally includes transforming the image data. In one or more exemplary methods, transforming the image data includes transforming the image data by a server device or an attached device. Transforming the image data may include transmitting the transformed image data, or a portion thereof, to the server device. Transforming the image data may include receiving the transformed image data, or a portion thereof, at the server device.
[0020] The method may include, for example, determining, by the accessory device and / or the server device, one or more ostomy representations. Determining the one or more ostomy representations may include receiving, by the accessory device, the one or more ostomy representations from the server device.
[0021] In one or more exemplary methods, determining one or more ostomy representations including a first ostomy parameter based on the image data includes: determining one or more image representations based on the image data; and determining one or more ostomy representations including a first ostomy parameter based on the one or more image representations; Includes:
[0022] In one or more exemplary methods, determining one or more ostomy representations including a first ostomy parameter based on the image data includes: converting image data; determining one or more image representations based on the transformed image data; and determining one or more ostomy representations including a first ostomy parameter based on the one or more image representations; Includes:
[0023] The image representation may be a binary mask. As such, one or more of the image representations may be binary masks. In other words, determining the one or more ostomy representations may include determining one or more binary masks based on the image data or transformed image data. In one or more exemplary methods, determining the one or more image representations based on the image data is performed by an N-layer convolutional neural network, e.g., in the range of 10 to 50 layers.
[0024] The method may optionally include storing one or more graphical representations that include the stoma identifier and / or the user identifier.
[0025] In one or more exemplary methods and / or devices, the one or more image representations include a stoma background image representation based on, for example, the stoma image data and / or the converted stoma image data. The stoma background image representation shows one or more portions / pixels of the stoma image data that are considered or identified as the background of the stoma image data, i.e., the background (e.g., including portions of the user's skin that are not covered by the adhesive surface of the ostomy appliance). Determining one or more ostomy representations, such as the first ostomy representation and / or the third ostomy representation, may be based on the stoma background image representation. The stoma background image representation may have a resolution of 256x256 pixels or greater, for example, 512x512 pixels.
[0026] In one or more example methods and / or devices, the one or more image representations include, for example, an appliance background image representation based on the appliance image data and / or the transformed appliance image data. The appliance background image representation shows one or more portions / pixels of the appliance image data that are considered or identified as the background of the appliance image data, i.e., the background (e.g., one or more image portions / pixels outside the area of the adhesive surface of the ostomy appliance). Determining one or more ostomy representations, such as the second ostomy representation and / or the third ostomy representation, may be based on the appliance background image representation.
[0027] In one or more exemplary methods and / or devices, the one or more image representations include a stoma image representation based on, for example, stoma image data and / or converted stoma image data. The stoma image representation shows one or more portions / pixels of the ostomy image data that are considered or identified as a stoma, i.e., a stoma. Determining one or more ostomy representations, e.g., the first ostomy representation and / or the third ostomy representation, may be based on the stoma image representation. The stoma image representation may have a resolution of 256x256 pixels or greater, e.g., 512x512 pixels.
[0028] In one or more exemplary methods and / or devices, the one or more image representations include a normal skin image representation based, for example, on the stoma image data and / or the transformed stoma image data. The normal skin image representation shows one or more portions / pixels of the ostomy image data that are considered or identified as normal skin, i.e., not discolored, in the peristomal area. Determining one or more ostomy representations, e.g., the first ostomy representation and / or the third ostomy representation, may be based on the normal skin image representation. The normal skin image representation may have a resolution of 256x256 pixels or greater, e.g., 512x512 pixels.
[0029] In one or more exemplary methods and / or devices, the one or more image representations include one or more, e.g., two, three, four, or more, stoma discoloration representations. The stoma discoloration representations may show discoloration of the peristomal area, i.e., one or more portions / pixels of the ostomy image data that are considered or identified as peristomal areas and discolored. The stoma discoloration representations may have a resolution of 256x256 pixels or more, e.g., 512x512 pixels.
[0030] In one or more exemplary methods and / or devices, the one or more image representations include, for example, a first stoma discoloration representation based on the stoma image data and / or the transformed stoma image data. The first stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data that are deemed or identified as a first discoloration of the peristomal area, i.e., a peristomal area, and that have a first discoloration (e.g., a first degree of redness). The first stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data within the peristomal area that have a color parameter, for example, a red channel of an RGB image, within a first range or below a first threshold, for example, below 0.25. The first stoma discoloration representation may indicate one or more portions / pixels of the peristomal area that have little or no discoloration. Determining the one or more ostomy representations may be based on the first stoma discoloration representation.
[0031] In one or more exemplary methods and / or devices, the method includes determining a first stoma discoloration representation based on red channel data of the image data / stoma image data.
[0032] In one or more exemplary methods and / or devices, the one or more image representations include, for example, a second stoma discoloration representation based on the stoma image data and / or the transformed stoma image data. The second stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data that are deemed or identified as having a second discoloration of the peristomal area, i.e., a peristomal area, and that have a second discoloration (e.g., a second degree of redness). The second discoloration is different from the first discoloration. The second stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data within the peristomal area that have a color parameter, e.g., a red channel of an RGB image, within a second range, e.g., a range of 0.25 to 0.5. The second stoma discoloration representation may indicate one or more portions / pixels of the peristomal area that have small, medium, or large discoloration depending on the value of the second range. Determining the one or more ostomy representations may be based on the second stoma discoloration representation.
[0033] In one or more exemplary methods and / or devices, the method includes determining a second stoma discoloration representation based on red channel data of the image data / stoma image data.
[0034] In one or more exemplary methods and / or devices, the one or more image representations include, for example, a third stoma discoloration representation based on the stoma image data and / or the transformed stoma image data. The third stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data that are deemed or identified as having a third discoloration of the peristomal area, i.e., a peristomal area, and that have a third discoloration (e.g., a third degree of redness). The third stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data within the peristomal area that have a color parameter, for example, a red channel of an RGB image, within a third range, for example, a range of 0.5 to 0.75. The third stoma discoloration representation may indicate one or more portions / pixels of the peristomal area that have moderate or severe discoloration. Determining the one or more ostomy representations may be based on the third stoma discoloration representation.
[0035] In one or more exemplary methods and / or devices, the method includes determining a third stoma discoloration representation based on red channel data of the image data / stoma image data.
[0036] In one or more exemplary methods and / or devices, the one or more image representations include, for example, a fourth stoma discoloration representation based on the stoma image data and / or the transformed stoma image data. The fourth stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data that are deemed or identified as having a fourth discoloration of the peristomal area, i.e., a peristomal area, and that have a fourth discoloration (e.g., a fourth degree of redness). The fourth stoma discoloration representation may indicate one or more portions / pixels of the ostomy image data within the peristomal area that have a color parameter, for example, a red channel of an RGB image, within a fourth range, for example, within a range of 0.75 to 1 or above a fourth threshold. The fourth stoma discoloration representation may indicate one or more portions / pixels of the peristomal area that have a high discoloration. Determining the one or more ostomy representations may be based on the fourth stoma discoloration representation.
[0037] In one or more exemplary methods, the method includes determining a fourth stoma discoloration representation based on red channel data of the image data / stoma image data.
[0038] In one or more exemplary methods, determining one or more image representations based on the image data includes determining primary color parameters, including, for example, a first primary color parameter and / or a second primary color parameter, and determining one or more image representations and / or one or more ostomy parameters based on the primary color parameters. The primary color parameters may be based on red channel data of the ostomy image data.
[0039] In one or more exemplary methods, determining one or more image representations and / or transforming the image data optionally includes performing an image transformation on the image data, e.g., stoma image data. The image transformation may be based on one or more color channels, including a red channel R and optionally a blue channel and / or a green channel, of the image being transformed. The transformed image I_C may be I_C=Abs(R-Average(GB) where R is the red channel of the image, G is the green channel, and B is the blue channel. In other words, the red, blue, and green channels of an image may be transformed into a single composite channel, also denoted CC, for each pixel of the image. The transformed image I_C may be a linear combination of the red, blue, and green channels.
[0040] In one or more exemplary methods, determining the one or more second ostomy parameters may be based on the first primary color parameter and / or the second primary color parameter.
[0041] In one or more exemplary methods, the first base color parameter indicates a lower limit of discoloration (i.e., corresponds to 0% discoloration) and optionally corresponds to the minimum discoloration of pixels in the fourth stoma image representation (the first discoloration representation indicates discoloration in the peristomal area). The first base color parameter may correspond to an R or CC pixel value of 0 or the lowest R or CC pixel value in the (transformed) image. The first base color parameter may be based on the CC values of pixels in the stoma image data identified as normal skin, for example, pixels near and outside a first boundary line indicating the perimeter or edge of the stoma site. Thus, the color of skin not covered by adhesive may be used as a reference or baseline for no discoloration.
[0042] In one or more exemplary methods, the second base color parameter indicates an upper color change limit (i.e., corresponds to 100% pixel color change) and optionally corresponds to the maximum red channel pixel value or the maximum composite channel pixel value in the second stoma image representation (the stoma image representation showing the stoma). Thus, the color of the stoma (which is always red) can be used as a reference color, providing even more uniform results and adjusting for differences due to lighting conditions when the image data is obtained.
[0043] In one or more exemplary methods and / or devices, the one or more image representations include one or more, e.g., two, three, four, or more, appliance discoloration representations. The appliance discoloration representations may show one or more portions / pixels of the appliance image data that are considered or identified as discolored, i.e., adhesive surfaces, of the ostomy appliance. The appliance discoloration representations may have a resolution of 256x256 pixels or greater, e.g., 512x512 pixels.
[0044] The one or more image representations may include, for example, a first appliance discoloration representation based on the appliance image data and / or the converted appliance image data. The first appliance discoloration representation may indicate one or more portions / pixels of the appliance image data that are considered or identified as having a first discoloration on the adhesive surface of the ostomy appliance, i.e., the adhesive surface, and that have a first discoloration (e.g., a first degree of body waste or simply body waste). The first appliance discoloration representation may indicate one or more portions / pixels of the appliance image data that have a color parameter, for example, a red channel and / or a green channel of an RGB image, within a first range or below a first threshold, e.g., below 0.25. The first appliance discoloration representation may indicate one or more portions / pixels of the adhesive surface that have little or moderate discoloration. Determining the one or more ostomy representations may be based on the first appliance discoloration representation.
[0045] The one or more image representations may include, for example, a second appliance discoloration representation based on the appliance image data and / or the converted appliance image data. The second appliance discoloration representation may indicate one or more portions / pixels of the appliance image data that are considered or identified as having a second discoloration on the adhesive surface of the ostomy appliance, i.e., the adhesive surface, and that have the second discoloration (e.g., a second degree of body waste). The second appliance discoloration representation may indicate one or more portions / pixels of the appliance image data that have color parameters, for example, the red channel and / or the green channel of an RGB image, within a second range or above a second threshold. The second appliance discoloration representation may indicate one or more portions / pixels of the adhesive surface that have moderate or severe discoloration. Determining the one or more ostomy representations may be based on the second appliance discoloration representation.
[0046] In one or more exemplary methods and / or devices, the one or more image representations include, for example, a stoma opening image representation based on the appliance image data and / or the transformed appliance image data. The stoma opening image representation shows one or more portions / pixels of the appliance image data that are considered or identified as a stoma opening, i.e., a stoma opening. Determining the one or more ostomy representations can be based on the stoma opening image representation. The stoma opening image representation can have a resolution of 256x256 pixels or greater, for example, 512x512 pixels.
[0047] The one or more image representations may include, for example, an appliance area representation based on the appliance image data and / or the transformed appliance image data. The appliance area representation may indicate one or more portions / pixels of the appliance image data that are free of appliance discoloration on the adhesive surface, i.e., free of body waste leakage, and are therefore considered or identified as being adhesive and not discolored by body waste. Determining the one or more ostomy representations may be based on the appliance area representation.
[0048] In one or more exemplary methods, determining the one or more ostomy representations includes determining the ostomy representation by combining multiple image representations. Determining the one or more ostomy representations may include overlaying one or more image representations, such as one or more stoma discoloration representations, on the stoma image data or the converted stoma image data. Determining the one or more ostomy representations may include overlaying one or more image representations, such as one or more appliance discoloration representations, on the appliance image data or the converted appliance image data.
[0049] Determining one or more ostomy representations, such as the first ostomy representation, may include determining a discoloration map based on the stoma image data or the converted stoma image data, and overlaying the discoloration map on the stoma image data or the converted stoma image data. In other words, the first ostomy representation may include a discoloration map.
[0050] Determining a discoloration map based on the stoma image data or the converted stoma image data may include assigning a first color value to pixels of the peristomal area that are discolored to a first degree within a first range. Determining a discoloration map based on the stoma image data or the converted stoma image data may include assigning a second color value to pixels of the peristomal area that are discolored to a second degree within a second range and / or assigning a third color value to pixels of the peristomal area that are discolored to a third degree within a third range. Four, five, six, seven, nine, ten, or more different color values may be assigned to four, five, six, seven, nine, ten, or more different ranges. Thus, the discoloration map may include first pixels having a first color value, second pixels having a second color value, and optionally, third pixels having a third color value.
[0051] In one or more exemplary methods, determining one or more ostomy representations includes determining a first ostomy representation and / or a second ostomy representation by combining a plurality of image representations.
[0052] The method includes outputting one or more ostomy representations, e.g., a first ostomy representation and / or a second ostomy representation and / or outputting a first ostomy parameter. Outputting the first ostomy representation and / or the first ostomy parameter may include displaying the first ostomy parameter or the first ostomy representation including the first ostomy parameter on a display of an accessory device. Outputting the first ostomy representation and / or the first ostomy parameter may include receiving the first ostomy representation and / or the first ostomy parameter at the accessory device. Outputting the first ostomy representation and / or the first ostomy parameter may include transmitting the first ostomy representation and / or the first ostomy parameter to, for example, the accessory device, by a server device. Outputting the one or more ostomy representations may include storing the ostomy representations in a memory of the accessory device and / or the server device.
[0053] Determining one or more ostomy representations based on the image data may include determining a first ostomy representation OR_1 based on the image data ID and / or transformed image data ID_T, e.g., stoma image data and / or appliance image data. The first ostomy representation OR_1, optionally also referred to as a stoma representation, may show discoloration of the user's stoma site. The first ostomy representation OR_1 may include or be superimposed on the stoma image data or the transformed stoma image data. The first ostomy representation may include a first ostomy parameter OP_1 and / or one or more second ostomy parameters P_2_1, P_2_2, .... The first ostomy representation may include stoma image data SID and / or transformed stoma image data SID_T.
[0054] The method includes determining one or more ostomy representations including a first ostomy parameter based on the one or more image representations.
[0055] The first ostomy parameter may be a discoloration index indicative of discoloration at the stoma site. The second ostomy parameter or second set of second ostomy parameters, also denoted OP_2, may be indicative of discoloration at the stoma site, such as indicating a percentage or degree of discoloration indicative of the severity of discoloration at the peristomal site. The second set of ostomy parameters optionally includes two or more second parameters, for example, three, four, five, six, seven, eight, nine, ten, or more second parameters. The second set of ostomy parameters optionally includes a second primary ostomy parameter, also denoted OP_2_1, and a second secondary ostomy parameter, also denoted OP_2_2. The second set of ostomy parameters optionally includes a second tertiary ostomy parameter, also denoted OP_2_3, and / or a second quaternary ostomy parameter, also denoted OP_2_4.
[0056] The first ostomy parameter may indicate the extent to which the peristomal area is discolored. For example, the first ostomy parameter OP_1 may be based on one or more stoma discoloration representations, and OP_1=N_TOT / N_PA where N_TOT is the total number of discolored pixels in the peristomal area, and N_PA is the total number of pixels in the peristomal area. can be given by
[0057] The first ostomy parameter may indicate an area of the peristomal site that is discoloured.
[0058] For example, the first ostomy parameter OP_1 may be based on one or more stoma discolouration representations; and OP_1=APP*N_TOT where N_TOT is the total number of discolored pixels in the peristomal area and APP is the area per pixel. It can be given as:
[0059] The area of the pixel APP is AAP=HPP*WPP where HPP is height per pixel and WPP is width per pixel. is given by
[0060] The height per pixel HPP may be based on one or more of the image representations, such as a stoma background image representation and / or an appliance background image representation.
[0061] The height per pixel HPP is HPP=AH / PH where AH is the height of the appliance (e.g., retrieved from a database), and PH is the pixel column height of the appliance, optionally determined as the number of pixels between two edges of the appliance, e.g., counted along the vertical axis in the appliance background image representation. It can be given as:
[0062] The width per pixel WPP is WPP=AW / PW where AW is the width of the appliance (e.g., retrieved from a database), and PW is the pixel-column width of the appliance, optionally determined as the number of pixels between two edges of the appliance, e.g., counted along the horizontal axis in the appliance background image representation. It can be given as:
[0063] The method optionally includes determining one or more second ostomy parameters based on the one or more image representations. The method optionally includes outputting one or more third, second parameters.
[0064] The second primary ostomy parameter may indicate how many discolored pixels in the peristomal area are discolored to a first degree, or may indicate an area of pixels in the peristomal area that are discolored to a first degree. For example, the second primary ostomy parameter OP_2_1 may be based on one or more stoma discoloration representations, and OP_2_1=N_DIS_1 / N_TOT where N_DIS_1 is the number of discolored pixels in the peristomal region that are discolored to a first degree, e.g., less than 0.25 or within a first range, where 0% discoloration corresponds to a first basic color parameter that indicates a lower limit of stoma discoloration, and 100% discoloration corresponds to a second basic color parameter that indicates a maximum red channel pixel value or a maximum composite channel pixel value in a second stoma image representation (a stoma image representation that indicates a stoma). where N_TOT is the total number of discolored pixels in the peristomal area. In other words, the red channel pixel intensity of each pixel in the peristomal area is evaluated and compared to a discoloration scale, where 0% corresponds to the minimum discoloration of the pixel in the fourth stoma image representation (the first discoloration representation indicative of discoloration of the peristomal area), and 100% corresponds to the maximum red channel pixel value in the second stoma image representation (the stoma image representation indicative of the stoma). In other words, each pixel in the fourth stoma image representation is evaluated to assign a degree of discoloration (selected from at least a first degree and a second degree) to each pixel among a plurality of discoloration degrees.
[0065] The one or more second primary ostomy parameters may indicate the area, extent, or number of discolored pixels within a first region of the peristomal site, for example, within one or more first radial distances from the edge of the stoma, for example, within 1 cm, 2 cm, and 3 cm. In other words, the first region may be considered an inner region of the peristomal site.
[0066] The one or more second secondary ostomy parameters may indicate the area, extent or number of discolored pixels within a second region of the peristomal site, for example, outside one or more first radial distances from the edge of the stoma, for example, outside 1 cm, 2 cm and 3 cm. In other words, the second region may be considered an outer region of the peristomal site.
[0067] The second secondary ostomy parameter may indicate how many discolored pixels in the peristomal area are discolored to a second degree, or may indicate an area of pixels in the peristomal area that are discolored to a second degree. For example, the second secondary ostomy parameter OP_2_2 may be based on one or more stoma discoloration representations, and OP_2_2=N_DIS_2 / N_TOT where N_DIS_2 is the number of discolored pixels in the peristomal area that are discolored to a second degree, for example, within a second range, such as 0.25 to 0.5, and N_TOT is the total number of discolored pixels in the peristomal area. can be given by
[0068] The second tertiary ostomy parameter may indicate how many discolored pixels in the peristomal area are discolored to a third degree, or may indicate an area of pixels in the peristomal area that are discolored to a third degree. For example, the second tertiary ostomy parameter OP_2_3 may be based on one or more stoma discoloration representations, and OP_2_3=N_DIS_3 / N_TOT where N_DIS_3 is the number of discolored pixels in the peristomal area that are discolored to a third degree, for example, within a third range, such as 0.5 to 0.75, and N_TOT is the total number of discolored pixels in the peristomal area. can be given by
[0069] The second quaternary ostomy parameter may indicate how many discolored pixels in the peristomal area are discolored to a fourth degree, or may indicate an area of pixels in the peristomal area that are discolored to a fourth degree. For example, the second quaternary ostomy parameter OP_2_4 may be based on one or more stoma discoloration representations, and OP_2_4=N_DIS_4 / N_TOT where N_DIS_4 is the number of discolored pixels in the peristomal area that are discolored to a fourth degree, for example, within a fourth range such as 0.75 to 1, or above a threshold, and N_TOT is the total number of discolored pixels in the peristomal area. can be given by
[0070] The first ostomy parameter can be a leakage parameter indicative of waste distribution on the adhesive surface of the ostomy appliance. The second ostomy parameter or second set of second ostomy parameters can be one or more leakage parameters indicative of waste distribution on the adhesive surface of the ostomy appliance.
[0071] The first ostomy parameter may indicate the extent to which the adhesive surface of the ostomy appliance is discolored. For example, the first ostomy parameter OP_1 may be based on one or more appliance discoloration representations, and OP_1=N_TOT / N_AA where N_TOT is the total number of discolored pixels in the adhesive area, and N_AA is the total number of pixels in the adhesive area. can be given by
[0072] The first ostomy parameter may indicate a discolored area on the adhesive surface of the ostomy appliance.
[0073] For example, the first ostomy parameter OP_1 may be based on one or more appliance discoloration representations; and OP_1=APP*N_TOT where N_TOT is the total number of discolored pixels in the adhesive surface of the ostomy appliance, and APP is the area per pixel. can be given by
[0074] The area of a pixel, APP, is AAP=HPP*WPP where HPP is the height of one pixel and WPP is the width of one pixel. It can be given as:
[0075] The one pixel height HPP may be based on one or more of the image representations, such as a stoma background image representation and / or an appliance background image representation.
[0076] The height of one pixel, HPP, is HPP=AH / PH where AH is the height of the appliance (e.g., retrieved from a database), and PH is the pixel column height of the appliance, optionally determined as the number of pixels between two edges of the appliance, e.g., counted along the vertical axis in the appliance background image representation. It can be given as:
[0077] The width per pixel WPP is WPP=AW / PW where AW is the width of the appliance (e.g., retrieved from a database), and PW is the pixel-column width of the appliance, optionally determined as the number of pixels between two edges of the appliance, e.g., counted along the horizontal axis in the appliance background image representation. It can be given as:
[0078] The method may include determining one or more boundary lines based on the one or more image representations. The method may include determining a first boundary line based on the one or more image representations, and the ostomy representation includes or is based on the first boundary line.
[0079] In one or more exemplary methods, the first boundary line may represent the perimeter or edge of the stoma site. The first boundary line may represent the perimeter or outer edge of the adhesive surface of the ostomy appliance.
[0080] The method may include determining a second boundary line based on the one or more image representations, and the ostomy representation includes or is based on the second boundary line.
[0081] In one or more exemplary methods, the second boundary line may represent the perimeter or edge of the stoma. The second boundary line may represent the perimeter or inner edge of the adhesive surface of the ostomy appliance.
[0082] The method may include determining a third boundary line based on the one or more image representations, and the ostomy representation includes or is based on the third boundary line.
[0083] In one or more exemplary methods, the third boundary line may indicate the boundary between the normal (non-discolored) skin area of the peristomal area and the discolored area of the peristomal area. The third boundary line may indicate the perimeter or inner edge of the adhesive surface of the ostomy appliance.
[0084] The method may include, for example, determining a fourth boundary line based on the one or more image representations. One or more ostomy representations and / or one or more ostomy parameters, e.g., the first and / or second ostomy parameters, may be based on the fourth boundary line. In one or more exemplary methods, the fourth boundary line may indicate a perimeter of a leak of waste material on the adhesive surface of the ostomy appliance.
[0085] The first ostomy representation may include one or more boundary lines, such as a first boundary line and / or a second boundary line. The first ostomy representation may include a first ostomy parameter and / or one or more second ostomy parameters. The first ostomy representation may include a fourth boundary line.
[0086] Determining one or more ostomy representations based on the image data may include determining a second ostomy representation based on the image data and / or transformed image data, such as stoma image data and / or appliance image data. The second ostomy representation, also referred to as an appliance representation, may show the distribution of waste on the adhesive surface of the ostomy appliance. The second ostomy representation may include or be superimposed on the appliance image data or the transformed appliance image data. The second ostomy representation may include one or more boundary lines, such as a first boundary line and / or a second boundary line. The second ostomy representation may include a third boundary line and / or a fourth boundary line.
[0087] As such, determining one or more ostomy representations based on the image data may include, for example, determining boundaries of the first ostomy representation and / or the second ostomy representation.
[0088] Determining one or more ostomy representations based on the image data may include determining a second ostomy parameter or a set of second ostomy parameters based on the image data and / or the converted image data, for example based on stoma image data and / or appliance image data.
[0089] The method optionally includes determining one or more third ostomy parameters based on the one or more image representations. The method optionally includes outputting the one or more third ostomy parameters.
[0090] The third primary ostomy parameter may indicate the shortest distance of waste leakage to the edge of the ostomy appliance. The third ostomy parameter may be based on a first boundary line indicating the perimeter or outer edge of the adhesive surface of the ostomy appliance and a fourth boundary line indicating the perimeter of waste leakage on the adhesive surface of the ostomy appliance. The third ostomy parameter may be determined as the shortest (radial) distance between the first boundary line and the fourth boundary line. An angle may be associated with the third ostomy parameter, for example, the third ostomy parameter may indicate a measured or determined direction. The angle may be used to determine one or more conversion parameters for converting between pixel length and absolute length.
[0091] In one or more exemplary methods, converting the image data includes determining position parameters representing the position of the camera image plane relative to the stoma site and / or adhesive surface, and the converted image data is based on the position parameters.
[0092] In one or more exemplary methods, the position parameters include angular parameters representing the angle between the optical axis of the camera from which the image data is obtained and a normal to the axial direction / adhesive surface of the stoma site. The transformed image data may be based on the angular parameters. In other words, transforming the image data may include determining angular parameters representing the angle between the optical axis of the camera from which the image data is obtained and a normal to the axial direction / adhesive surface of the stoma site. This may compensate for image data that is not taken with an optical axis perpendicular to the adhesive surface of the ostomy appliance or perpendicular to the ostomy patient's skin surface. Determining the angular parameters may include aligning the image data with the stoma site model image and / or the appliance model image, and determining the angular parameters based on an image transformation that satisfactorily matches the image data to the stoma site model image and / or the appliance model.
[0093] In one or more exemplary methods, the position parameters include a distance parameter representing the distance between a camera that is the source of the image data and the stoma site / adhesive surface. The transformed image data may be based on the distance parameter. In other words, transforming the image data may include determining a distance parameter representing the distance between a camera that is the source of the image data and the stoma site / adhesive surface. The distance parameter allows for (more accurately) determining the size of the stoma site / adhesive surface. Determining the distance parameter may include aligning the image data with a stoma site model image and / or an appliance model image, and determining the distance parameter based on an image transformation that satisfactorily matches the image data to the stoma site model image and / or the appliance model.
[0094] In one or more exemplary methods, the position parameters include rotation parameters representing a rotation angle between an image axis of the image data and a reference axis of the stoma site / adhesive surface. The transformed image data may be based on the rotation parameters. The reference axis may be a vertical reference axis or a horizontal axis. In other words, transforming the image data may include determining a rotation parameter representing a rotation angle between the image axis of the image data and a reference axis of the stoma site / adhesive surface. The rotation parameter may allow the rotated image data to be compensated, for example, to (more accurately) determine the directional ostomy condition. Determining the rotation parameters may include aligning the image data with the stoma site model image and / or the appliance model image, and determining the rotation parameter based on an image transformation that satisfactorily matches the image data to the stoma site model image and / or the appliance model.
[0095] In one or more exemplary methods, transforming the image data includes performing a geometric transformation on the image data, which may be based on one or more of a position parameter, an angle parameter, a distance parameter, and a rotation parameter.
[0096] In one or more exemplary methods, converting the image data includes matching the image data to the stoma site model image and / or the appliance model image. For example, converting the image data can include matching the stoma image data to the stoma site model and / or matching the appliance image data to the appliance model image.
[0097] In one or more exemplary methods, transforming the image data includes identifying a first stoma reference indicator on the stoma site. The transformed image data may be based on the first stoma reference indicator. The first stoma reference indicator may be the perimeter of the stoma or another parameter related to the stoma, such as the center of the stoma. Transforming the image data may include identifying a second stoma reference indicator and / or a third stoma reference indicator on the stoma site. The transformed image data may be based on, for example, a second stoma reference indicator and / or a third stoma reference indicator on and / or outside the stoma site. The second stoma reference indicator may be a scar or other body mark, such as a birthmark, navel, etc. The third stoma reference indicator may be a scar or other body mark, such as a birthmark, navel, etc. The stoma reference indicator may indicate the position and / or orientation of the stoma reference indicator.
[0098] In one or more exemplary methods, converting the image data includes identifying a first appliance reference indicator on an adhesive surface of the ostomy appliance. The converted image data may be based on the first appliance reference indicator. The first appliance reference indicator may be the periphery (or a portion thereof) of the ostomy appliance, the center of the stoma opening of the ostomy appliance, or the periphery of the stoma opening of the ostomy appliance. The appliance reference indicator may indicate the position and / or orientation of the appliance reference indicator.
[0099] In one or more exemplary methods, converting the image data includes identifying a second appliance reference indicator on an adhesive surface of the ostomy appliance. The second appliance reference indicator can be different from the first appliance reference indicator and can optionally be a periphery (or a portion thereof) of the ostomy appliance, a center of the stoma opening of the ostomy appliance, or a periphery or edge of the stoma opening of the ostomy appliance. The converted image data can be based on the second appliance reference indicator.
[0100] In one or more exemplary methods, converting the image data includes scaling, e.g., reducing the image data to a predetermined pixel size, e.g., N×M pixels, where N can be in the range of 100 to 2,500, e.g., 100 to 1,000, e.g., 256 or 512, and M can be in the range of 100 to 2,500, e.g., 100 to 1,000, e.g., 256 or 512. M can be different from N.
[0101] In one or more exemplary methods, transforming the image data includes centering the image data around a center or central region of the image data. In one or more exemplary methods, transforming the image data includes identifying and selecting a stoma region of the image data (stoma region data) and / or an appliance region of the image data (appliance region data), and optionally transforming the stoma region and / or appliance region to provide transformed stoma image data and / or transformed appliance image data, respectively. Selecting the stoma region and / or appliance region may include cropping the stoma region and / or appliance region from the respective stoma image data and / or appliance image data. The stoma region includes the stoma site, i.e., the stoma and peristomal site.
[0102] In one or more exemplary methods, transforming the image data includes identifying and selecting a stoma area, centering the stoma area, optionally rotating the stoma area (e.g., using a geometric transformation based on the rotation parameters), and down-scaling the rotated stoma area to provide transformed stoma image data.
[0103] In one or more exemplary methods, transforming the image data includes identifying and selecting an appliance region, centering the appliance region, optionally rotating the appliance region (e.g., using a geometric transformation based on the rotation parameters), and shrinking the rotated appliance region to provide transformed appliance image data.
[0104] In one or more exemplary methods, scaling the image data includes determining a scaling parameter. The transformed image data may be based on the scaling parameter. In one or more exemplary methods, determining the one or more ostomy representations may include scaling the representations, e.g., the first representation and / or the second representation, or portions thereof, based on the scaling parameter.
[0105] In one or more exemplary methods, transforming the image data includes performing an image transform on the image data, such as stoma image data. The image transform may be based on one or more color channels, including a red channel R and optionally a blue channel and / or a green channel, of the image being transformed. The transformed image I_C may be I_C=Abs(R-Average(GB) where R is the red channel, G is the green channel, and B is the blue channel in the image. In other words, the red, blue and green channels of an image can be converted into a single composite channel, also denoted CC, for each pixel of the image.
[0106] In one or more exemplary methods, obtaining the image data includes: detecting, by the attached device, a user input indicating a request for image capture; Determining the location of the accessory device relative to the adhesive surface of the ostomy appliance or the stoma site; determining whether the position of the attachment device relative to the adhesive surface of the ostomy appliance or the stoma site meets image capture criteria; and Following a determination that the position of the accessory device relative to the substrate of the ostomy appliance or the stoma site meets the image capture criteria, capturing image data of the ostomy appliance or stoma site; and Storing and / or transmitting image data Includes:
[0107] In one or more exemplary methods, obtaining the image data includes: providing feedback to a user pursuant to a determination that a position of the accessory device relative to the adhesive surface of the ostomy appliance or the stoma site does not meet image capture criteria, the feedback indicating the incorrect position of the accessory device. Includes:
[0108] Providing feedback to the user may include displaying a user interface element on a display of the accessory device. Providing feedback to the user may include determining a property of the user interface element based on a position of the accessory device relative to an adhesive surface of the ostomy appliance.
[0109] In one or more exemplary methods, after providing feedback to the user, the method includes: Determining the location of the accessory device relative to the adhesive surface of the ostomy appliance; determining whether the position of the accessory device relative to the adhesive surface of the ostomy appliance meets image capture criteria; and Following a determination that the position of the accessory device relative to the adhesive surface of the ostomy appliance meets the image capture criteria, Capturing image data of the ostomy appliance; and Storing and / or transmitting image data Includes:
[0110] In one or more exemplary methods, determining the position of the accessory device relative to the adhesive surface of the ostomy appliance includes determining the angle between the optical axis of the camera and the proximal surface of the substrate.
[0111] In one or more exemplary methods, determining the position of the accessory device relative to the stoma site includes determining an angle between an optical axis of the camera and a reference plane of the stoma site, the reference plane being perpendicular to the axial direction.
[0112] In one or more exemplary methods, determining the position of the accessory device relative to the adhesive surface of the ostomy appliance includes determining the distance between the accessory device and the adhesive surface.
[0113] In one or more exemplary methods, the method includes obtaining an ostomy appliance configuration, for example, including an ostomy appliance identifier, and determining the location of the accessory device relative to the adhesive surface of the ostomy appliance is based on the ostomy appliance configuration.
[0114] 1 shows a flowchart of an exemplary method for classifying an ostomy condition. Method 100 includes acquiring image data (S102A) using, for example, an accessory device. The image data ID includes stoma image data (SID) of a stoma site including a stoma and / or appliance image data (AID) of an adhesive surface of an ostomy appliance. Accordingly, method 100 optionally includes acquiring stoma image data (S102A) and / or acquiring appliance image data (S102B). Method 100 also includes determining S104 a first ostomy representation including first ostomy parameters based on one or more ostomy representations, e.g., the image data, e.g., the SID and / or the AID, and optionally outputting S106 the first ostomy parameters. Method 100 optionally includes converting the image data S108, and determining one or more ostomy representations based on the image data S104 includes determining a first ostomy parameter S104A based on the converted image data (the converted appliance image data AID_T and / or the converted stoma image data SID_T).
[0115] Determining one or more ostomy representations S104 optionally includes determining one or more image representations based on the image data or the converted image data S104B, and determining one or more ostomy representations including first ostomy parameters based on the one or more image representations S104C.
[0116] Determining one or more image representations based on the image data or the converted image data S104B optionally includes determining one or more stoma image representations showing the stoma site S104BA, and optionally determining one or more appliance image representations showing the adhesive surface of the ostomy appliance S104BB.
[0117] In one or more exemplary methods, the one or more stoma image representations include at least four stoma image representations, including a first stoma image representation SIR_1, a second stoma image representation SIR_2, a third stoma image representation SIR_3, and a fourth stoma image representation SIR_4.
[0118] The first stoma image representation may be a stoma background image representation showing one or more portions / pixels of the stoma image data that are considered or identified as the background of the stoma image data, i.e., outside the area covered by the adhesive surface (e.g., including portions of the user's skin that are not covered by the adhesive surface of the ostomy appliance).
[0119] The second stoma image representation may be a stoma image representation that shows the stoma, i.e., one or more portions / pixels of the ostomy image data that are considered or identified as a stoma.
[0120] The third stoma image representation may be a normal skin image representation showing normal skin in the peristomal area, i.e., one or more portions / pixels of the ostomy image data that are deemed or identified as not having discoloration.
[0121] The fourth stoma image representation may be one or more portions / pixels of the ostomy image data that are considered or identified as being discolored, i.e., the first discoloration representation showing discoloration of the peristomal area, i.e., the peristomal area, and that are considered or identified as being discolored.
[0122] In one or more exemplary methods, the one or more appliance image representations include at least three or at least four appliance image representations including a first appliance image representation AIR_1, optionally a second appliance image representation AIR_2, a third appliance image representation AIR_3, and a fourth appliance image representation AIR_4.
[0123] The first appliance image representation may be an appliance background image representation that shows one or more portions / pixels of the appliance image data / converted appliance image data that are considered or identified as the background of the appliance image data, i.e., one or more image portions / one or more pixels outside the area of the adhesive surface of the ostomy appliance.
[0124] The second appliance image representation may be a stoma opening image representation that shows the stoma opening, i.e., one or more portions / pixels of the appliance image data / transformed appliance image data that are considered or identified as the stoma opening.
[0125] The third appliance image representation may be an appliance area representation showing no appliance discoloration on the adhesive surface, i.e., one or more portions / pixels of the appliance image data / converted appliance image data that are deemed or identified as having no leakage of exudates and therefore being an adhesive surface and not discolored by exudates.
[0126] The fourth appliance image representation may be the first appliance discoloration representation, i.e., the adhesive surface, showing discoloration of the adhesive surface of the ostomy appliance, and may be one or more portions / pixels of the appliance image data that are deemed or identified as having discoloration (leaking waste).
[0127] Determining one or more ostomy representations including the first ostomy parameter based on the one or more image representations S104C optionally includes determining a first ostomy representation OR_1 including the first ostomy parameter OP_1 based on the one or more stoma image representations S104CA.
[0128] In one or more exemplary methods, the first ostomy representation OR_1 may be based on the first stoma image representation SIR_1, the second stoma image representation SIR_2, the third stoma image representation SIR_3, and the fourth stoma image representation SIR_4. The first ostomy representation OR_1 may include or be based on ostomy image data / transformed ostomy image data.
[0129] Determining the first ostomy representation S104CA optionally includes determining a second ostomy parameter OP_2 or a set of second ostomy parameters. In other words, the first ostomy representation OR_1 may include OP_1 and one or more second ostomy parameters.
[0130] Determining one or more ostomy representations including the first ostomy parameters based on the one or more image representations S104C optionally includes determining a second ostomy representation OR_2 based on the one or more appliance image representations S104CB.
[0131] In one or more exemplary methods, the second ostomy representation OR_2 may be based on the first appliance image representation, optionally the second appliance image representation, the third appliance image representation, and the fourth appliance image representation.
[0132] Outputting the first ostomy parameter S106 may include storing the first ostomy parameter or the first ostomy representation including the first ostomy parameter in a memory S106A and / or transmitting the first ostomy parameter or the first ostomy representation including the first ostomy parameter to an accessory device and / or a server device S106B. Outputting the first ostomy parameter S106 may include displaying the first ostomy parameter or the first ostomy representation including the first ostomy parameter on a display of the accessory device S106C. This allows a user and / or professional caregiver to review the ostomy condition and make decisions substantially in real time. For example, when changing an ostomy appliance, a user may be able or prompted to take steps to reduce the impact of the ostomy condition, e.g., during the change procedure, substantially in real time.
[0133] The method 100 includes outputting 110 one or more ostomy representations, including, for example, a first ostomy representation OR_1 and / or a second ostomy representation OR_2. Outputting 110 the one or more ostomy representations may include outputting 112 the second ostomy representation. Outputting the second ostomy representation S112 may include storing the second ostomy representation in a memory S112A and / or transmitting the second ostomy representation to an accessory device and / or a server device S112B. Outputting the second ostomy representation S112 may include displaying the second ostomy representation on a display of the accessory device S112C. This allows a user and / or professional caregiver to review and make decisions about an ostomy condition substantially in real time. For example, when changing an ostomy appliance, a user may be able or prompted to take steps to reduce the impact of the ostomy condition, e.g., during the change procedure, substantially in real time.
[0134] Transforming S108 the image data includes determining S108A position parameters that represent a position of the camera image plane relative to the stoma site and / or adhesive surface, and the transformed image data is based on the position parameters.
[0135] The position parameters optionally include angular parameters representing the angle between the optical axis of the camera that is the source of the image data and a normal to the axial / adhesive direction of the stoma site, and the transformed image data is based on the angular parameters. Thus, determining the position parameters S108A may include determining angular parameters 108B representing the angle between the optical axis of the camera that is the source of the image data and a normal to the axial / adhesive direction of the stoma site, and the transformed image data is based on the angular parameters.
[0136] The position parameters optionally include distance parameters representing a distance between a camera that is a source of the image data and the stoma site / adhesive surface, and the transformed image data is based on the distance parameters. Thus, determining the position parameters S108A may include determining a distance parameter 108C representing a distance between a camera that is a source of the image data and the stoma site / adhesive surface, and the transformed image data is based on the distance parameters.
[0137] The position parameters optionally include a rotation parameter representing a rotation angle between an image axis of the image data and a reference axis of the stoma site / adhesive surface. Thus, determining the position parameters S108A may include determining a rotation parameter 108D representing a rotation angle between the image axis of the image data and a reference axis of the stoma site / adhesive surface, and the transformed image data is based on the rotation parameter.
[0138] In method 100, transforming the image data S108 optionally includes identifying one or more reference indicia in the image data, such as a first stoma reference indicia and / or a second stoma reference indicia in the stoma image data and / or a first appliance reference indicia and / or a second appliance reference indicia in the appliance image data S108E. The transformed image data is optionally based on the one or more reference indicia.
[0139] In method 100, converting S108 the image data optionally includes scaling S108F the image data to a predetermined pixel size, for example, a pixel size of 256 x 256 pixels. Scaling the image data includes determining scaling parameters, and the converted image data is based on the scaling parameters.
[0140] In method 100, transforming the image data S108 optionally includes centering the image data around a center or central region of the image data S108G, e.g., based on a reference indicia (position and / or orientation) of the respective stoma image data and / or appliance image data. For example, transforming the stoma image data may include centering the stoma image data around a center, periphery, or central region of the stoma (e.g., identified as a first or second stoma reference identifier in S108E). In one or more exemplary methods, transforming the appliance image data may include centering the appliance image data around a center, periphery, or central region of the stoma opening of the ostomy appliance / substrate and / or around a periphery of the adhesive surface / substrate of the ostomy appliance (e.g., identified as a first or second appliance reference identifier in S108E).
[0141] 2 shows an accessory device 200 and an ostomy appliance 202. The accessory device 200 is implemented as a smartphone and includes a display 204 that displays an appliance image 206 representing appliance image data acquired by a camera of the accessory device 200. The accessory device 200 transmits the appliance image data AID and / or the converted appliance image data AID_T to a server device 208 over a network 210. The server device 210 determines one or more ostomy representations, including one or more of a first ostomy representation OR_1, a second ostomy representation OR_2, and a third ostomy representation OR_3, and transmits the one or more ostomy representations to the accessory device 200, thereby outputting the one or more ostomy representations. The accessory device 200 determines one or more ostomy representations by receiving one or more ostomy representations from the server device 208 using the accessory device 200, and outputs one or more ostomy representations by displaying the first ostomy parameter or the first ostomy representation including the first ostomy parameter on the display 204 (not shown in FIG. 2 ). The ostomy appliance 202 includes a substrate 212 with an adhesive surface 214 and a stoma opening 216. An ostomy pouch 218 is attached to the substrate 212 to collect waste material. During use, waste material 220 may leak between the adhesive surface and the user's skin surface. Such waste material leakage can irritate and damage the skin due to the highly aggressive behavior of the waste material. The present disclosure provides fast, uniform, and reliable analysis and communication of such leakage or ostomy conditions based on appliance image data.
[0142] 3 shows appliance image 250 (of ostomy appliance 202) representing exemplary appliance image data captured by the camera of accessory device 200. As shown in the figure, the user taking appliance image 250 rotated the camera slightly counterclockwise and did not center the stoma opening of the ostomy appliance.
[0143] Figure 4 shows an appliance image 270 representing exemplary transformed appliance image data based on the appliance image data of Figure 3 or Figure 5. The appliance image data of appliance image 250 has been centered, rotated, and reduced to 256 x 256 pixels, for example, using a geometric transformation, to provide the transformed appliance data of appliance image 270.
[0144] 5 shows appliance image 280 (of ostomy appliance 202) representing exemplary appliance image data captured by the camera of accessory device 200. As shown in the figure, the user taking appliance image 280 tilted the camera slightly, so that the camera's optical axis and the normal to the adhesive surface are slightly angled / not parallel. In this case, the appliance image data of appliance image 280 is transformed by performing a geometric transformation based on the angle parameters and reduced to 256 x 256 pixels to provide the transformed appliance data of image 270.
[0145] 6 is a block diagram illustrating an exemplary accessory device 200 according to the present disclosure. The present disclosure relates to an accessory device 200 for an ostomy system. The accessory device includes a display 204, a memory module 301, a processor module 302, and a wireless interface 303. The accessory device 200 is configured to perform any of the methods disclosed herein, such as any of the methods shown in FIG. The processor module 302 may be configured to perform any or at least some of steps S102, S102A, S102B, S104, S104A, S104B, S104BA, S104BB, S104C, S104CA, S104CB, S104CC, S106, S106A, S106B, S106C, S108, S108A, S108B, S108C, S108D, S108E, S108F, S108G, S110, S112, S112A, S112B, S112C (see FIG. 1 and related discussion).
[0146] The operations of accessory device 200 may be implemented in the form of executable logic routines (e.g., code sequences, software programs, etc.) stored in a non-transitory computer-readable medium (e.g., memory module 301) and executed by processor module 302. Furthermore, the operations of accessory device 200 may be viewed as methods that accessory device 200 is configured to perform. Also, while the described functions and operations may be implemented in software, such functions may also be performed in dedicated hardware or firmware or some combination of hardware, firmware, and / or software.
[0147] The memory module 301 may be one or more of a buffer, flash memory, a hard drive, removable media, volatile memory, non-volatile memory, random access memory (RAM), or other suitable device. In a typical configuration, the memory module 301 may include non-volatile memory for long-term data storage and volatile memory that serves as system memory for the processor module 302. The memory module 301 may exchange data with the processor module 302 through a data bus. There may also be control lines and an address bus between the memory module 301 and the processor module 302 (not shown in FIG. 6). The memory module 301 is considered a non-transitory computer-readable medium.
[0148] 7 is a block diagram illustrating an exemplary server device 208 according to the present disclosure. The present disclosure relates to a server device 208 of an ostomy system. The server device includes a memory module 401, a processor module 402, and an interface 403. The server device 208 is configured to perform any of the methods disclosed herein, such as any of the methods shown in FIG. The processor module 402 may be configured to perform any or at least some of steps S102, S102A, S102B, S104, S104A, S104B, S104BA, S104BB, S104C, S104CA, S104CB, S104CC, S106, S106A, S106B, S106C, S108, S108A, S108B, S108C, S108D, S108E, S108F, S108G, S110, S112, S112A, S112B, S112C (see FIG. 1 and related discussion).
[0149] The operations of server device 208 may be implemented in the form of executable logic routines (e.g., code sequences, software programs, etc.) stored in a non-transitory computer-readable medium (e.g., memory module 401) and executed by processor module 402. Furthermore, the operations of server device 208 may be viewed as methods that server device 208 is configured to perform. Also, while the described functions and operations may be implemented in software, such functions may be performed in dedicated hardware or firmware or some combination of hardware, firmware, and / or software.
[0150] The memory module 401 can be one or more of a buffer, flash memory, hard drive, removable media, volatile memory, non-volatile memory, random access memory (RAM), or other suitable devices. In a typical arrangement, the memory module 401 can include non-volatile memory for long-term data storage and volatile memory that functions as system memory for the processor module 402. The memory module 401 can exchange data with the processor module 402 through a data bus. There can also be control lines and an address bus between the memory module 401 and the processor module 402 (not shown in FIG. 7). The memory module 401 is regarded as a non-transitory computer-readable medium.
[0151] FIG. 8 shows an exemplary first stoma representation OR_1. The first stoma representation OR_1 includes a first stoma parameter OP_1 that indicates discoloration of the stoma site (OP_1 = 86.21% in the illustrated example). The first stoma representation OR_1 includes second stoma parameters OP_2_1, OP_2_2, OP_2_3, and OP_2_4 that indicate percentages showing the severity of the discoloration. The second primary stoma parameter OP_2_1 (OP_2_1 = 0.64%) indicates the number of pixels discolored with a first degree of discoloration (DSP < 25%) among the number of discolored pixels. The second secondary stoma parameter OP_2_2 (OP_2_2 = 29.76%) indicates the number of pixels discolored with a second degree of discoloration (25% < DSP < 50%) among the number of discolored pixels. The second tertiary stoma parameter OP_2_3 (OP_2_1 = 61.58%) indicates the number of pixels discolored with a third degree of discoloration (50% < DSP < 75%) among the number of discolored pixels. The second quaternary stoma parameter OP_2_4 (OP_2_4 = 8.01%) indicates the number of pixels discolored with a fourth degree of discoloration (75% < DSP < 100%) among the number of discolored pixels. The set of second stoma parameters is determined based on the fourth stoma image representation.
[0152] The first ostomy representation OR_1 includes a first boundary line BL_1 (red line) that indicates the perimeter or edge of the stoma site, for example, the boundary between the normal skin site 450 and the stoma image data background 454. The first boundary line is based on the first stoma image representation and / or the third stoma image representation.
[0153] The first ostomy representation OR_1 includes a second boundary line BL_2 (green line) that indicates the perimeter or edge of the stoma 456, the second boundary line being based on the second stoma image representation and / or the fourth stoma image representation.
[0154] The first ostomy representation OR_1 includes a third boundary line BL_3 (blue line) that indicates the boundary between the normal skin area 450 (non-discolored) of the peristomal area and the discolored area of the peristomal area 452. The third boundary line BL_3 is based on the third stoma image representation and / or the fourth stoma image representation.
[0155] The first ostomy representation OR_1 includes or is superimposed on the stoma image data SID on which the first ostomy representation OP_1 is based.
[0156] 9 shows an exemplary appliance image representation with the underlying appliance image data AID. The first appliance image representation AIR_1, 256x256 pixels, is an appliance background image representation (binary mask) that indicates the background 458 of the appliance image data, i.e., one or more portions / pixels of the appliance image data / converted appliance image data that are considered or identified as background (e.g., one or more image portions / pixels outside the adhesive surface area of the ostomy appliance). Yellow represents a binary value of 1 in the binary mask (i.e., the pixel is part of the background), and purple represents a binary value of 0 (i.e., the pixel is not part of the background).
[0157] The second appliance image representation AIR_2, of 256x256 pixels, is a stoma opening image representation showing one or more portions / pixels of the appliance image data / converted appliance image data that are considered or identified as a stoma opening 460. Yellow represents a binary value of 1 in the binary mask (i.e., the pixel is part of a stoma opening) and purple represents a binary value of 0 (i.e., the pixel is not part of a stoma opening).
[0158] The third appliance image representation AIR_3, which is 256x256 pixels, is an appliance area representation that shows one or more portions / pixels of the appliance image data / transformed appliance image data that are considered or identified as having no appliance discoloration on the adhesive surface of the ostomy appliance (clean adhesive surface 462), i.e., no body waste leakage and are therefore an adhesive surface and not discolored by body waste. Yellow represents a binary value of 1 in the binary mask (i.e., the pixel is not discolored), and purple represents a binary value of 0 (i.e., the pixel is not part of the undiscolored adhesive surface).
[0159] The fourth appliance image representation AIR_4, which is 256x256 pixels, is a first appliance discoloration representation showing one or more portions / pixels of the appliance image data that are considered or identified as being discolored (leaking body waste) on the adhesive surface of the ostomy appliance (discolored adhesive surface 464), i.e., adhesive surfaces, with yellow representing a binary value of 1 in the binary mask (i.e., the pixel is discolored) and purple representing a binary value of 0 (i.e., the pixel is not part of the discolored adhesive surface).
[0160] Figure 10 shows an exemplary second ostomy representation OR_2 based on the four appliance image representations similarly described in connection with Figure 9. The second ostomy representation OR_2 includes a first boundary line BL_1 (red line) that indicates the perimeter or edge of the adhesive surface of the ostomy appliance. The first boundary line BL_1 is based on the first appliance image representation and / or the third appliance image representation.
[0161] The second ostomy representation OR_2 includes a second boundary line BL_2 (green line) indicating the perimeter or edge of the stoma opening of the adhesive surface, the second boundary line being based on the second appliance image representation and / or the fourth appliance image representation.
[0162] The second ostomy representation OR_2 includes a third boundary line BL_3 (blue line) that indicates the boundary between the discolored (leaking) and non-discolored (clean) portions of the adhesive surface. The third boundary line BL_3 is based on the third stoma image representation and / or the fourth stoma image representation.
[0163] The second ostomy representation OR_2 includes or is overlaid on the appliance image data AID on which the second ostomy representation OP_2 is based.
[0164] 11 shows exemplary ostomy representations OR_1, OR_2, and OR_3 corresponding to stoma image data SID and appliance image data AID. The third ostomy representation OR_3 is based on one or more of the multiple stoma image representations and one or more appliance image representations. In the third ostomy representation, the blue portion indicates the fourth appliance image representation, and the light gray portion indicates discolored areas of the peristomal area, i.e., the third stoma image representation.
[0165] Also disclosed are methods according to any of the following items:
[0166] Item 1. A method for classifying ostomy conditions, comprising: obtaining image data, the image data including stoma image data of a stoma site including a stoma and / or appliance image data of an adhesive surface of an ostomy appliance; determining one or more ostomy representations including a first ostomy parameter based on the image data; and Outputting a first ostomy parameter and transforming the image data, wherein determining one or more ostomy representations based on the image data includes determining a first ostomy parameter based on the transformed image data.
[0167] Item 2. The method of item 1, wherein transforming the image data includes determining position parameters representing the position of the camera image plane relative to the stoma site and / or adhesive surface, and the transformed image data is based on the position parameters.
[0168] Item 3. The method according to Item 2, wherein the position parameters include angle parameters representing the angle between the optical axis of the camera that is the source of the image data and the normal to the axial direction / adhesive surface of the stoma site, and the transformed image data is based on the angle parameters.
[0169] Item 4. The method according to item 2 or 3, wherein the position parameters include distance parameters representing the distance between the camera, which is the source of the image data, and the stoma site / adhesion surface, and the converted image data is based on the distance parameters.
[0170] Item 5. The method according to any one of Items 2 to 4, wherein the position parameters include rotation parameters that represent a rotation angle between an image axis of the image data and a reference axis of the stoma site / adhesion surface, and the transformed image data is based on the rotation parameters.
[0171] Item 6. The method according to any one of Items 1 to 5, wherein converting the image data includes aligning the image data with a stoma site model image and / or an appliance model image.
[0172] Item 7. The method of any one of items 1 to 6, wherein transforming the image data includes identifying a first stoma reference indicator on the stoma site, and the transformed image data is based on the first stoma reference indicator.
[0173] Item 8. The method of item 7, wherein the first stoma reference indicator is the circumference of the stoma.
[0174] Item 9. The method of any one of Items 1 to 8, wherein converting the image data includes identifying a first appliance reference indicator on an adhesive surface of the ostomy appliance, and the converted image data is based on the first appliance reference indicator.
[0175] Item 10. The method of Item 9, wherein the first appliance reference marker is the circumference of the ostomy appliance.
[0176] Item 11. The method of any one of Items 1 to 10, wherein converting the image data includes identifying a second appliance reference indicator on an adhesive surface of the ostomy appliance, the converted image data is based on the second appliance reference indicator, and the second appliance reference indicator is an edge of a stoma opening of the ostomy appliance.
[0177] Item 12. The method according to any one of Items 1 to 11, wherein converting the image data includes scaling the image data to a predetermined pixel size.
[0178] Item 13. The method of item 12, wherein scaling the image data includes determining a scaling parameter, and the transformed image data is based on the scaling parameter.
[0179] Item 14. The method according to any one of Items 1 to 13, wherein the first ostomy parameter is a discoloration index indicating discoloration at the stoma site.
[0180] Item 15. The method according to any one of Items 1 to 14, wherein the first ostomy parameter is a leakage parameter indicating the distribution of excrement on the adhesive surface.
[0181] The use of the terms "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," etc. does not imply any particular order, but is included to identify particular elements. Furthermore, the use of the terms "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," etc. does not indicate any order or importance; rather, the terms "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," etc. are used to distinguish one element from another. It should be noted that the words "first," "second," "third," and "fourth," "primary," "secondary," "tertiary," etc. are used here and elsewhere for labeling purposes only, and do not indicate any particular spatial or temporal order.
[0182] Additionally, the labeling of a first element does not imply the presence of a second element, and vice versa.
[0183] 1-7 may be understood to include some modules or operations shown with solid lines and some modules or operations shown with dashed lines. The modules or operations included with solid lines are modules or operations included in the broadest exemplary embodiment. The modules or operations included with dashed lines are exemplary embodiments that may be included in or are part of the solid line exemplary embodiment, or are additional modules or operations that may be performed in addition to the modules or operations of the solid line exemplary embodiment. It should be understood that these operations need not be performed in the order presented. Furthermore, it should be understood that not all of the operations need be performed. The exemplary operations may be performed in any order and in any combination.
[0184] It should be noted that the word "comprising" does not necessarily exclude the presence of other elements or steps than those listed.
[0185] It should be noted that the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.
[0186] It should be further noted that any reference signs do not limit the scope of the claims, and that the exemplary embodiments may be implemented at least in part by both hardware and software, and that several "means," "units," or "apparatus" may be represented by the same item of hardware.
[0187] Various example methods, apparatuses, and systems described herein are described in one aspect generally with reference to a process of method steps that may be performed by a computer program product that may be embodied in a computer-readable medium, including computer-executable instructions, such as program code, executed by a computer in a networked environment. Computer-readable media may include removable and non-removable storage devices, including, but not limited to, read-only memory (ROM), random access memory (RAM), compact discs (CDs), digital versatile discs (DVDs), and the like. Generally, program modules may include routines, programs, objects, components, data structures, and the like that perform specified tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for executing the functions described in such steps or processes.
[0188] While several features have been shown and described, they are not limitations of the claimed invention, and it will be understood that various changes and modifications may be apparent to those skilled in the art without departing from the spirit and scope of the claimed invention. Accordingly, the specification and drawings are to be regarded as illustrative rather than restrictive. The claimed invention is intended to cover all alternatives, modifications and equivalents. The present disclosure further includes the following aspects: <<Aspect 1>> 1. A method for classifying an ostomy condition, comprising: obtaining image data, the image data including stoma image data of a stoma site including a stoma and / or appliance image data of an adhesive surface of an ostomy appliance; determining one or more image representations based on the image data; determining one or more ostomy representations including a first ostomy parameter based on the one or more image representations; outputting the first ostomy parameter; A method comprising: <<Aspect 2>> The method of aspect 1, wherein the one or more image representations include a stoma background image representation and / or an appliance background image representation, and determining the one or more ostomy representations is based on the stoma background image representation and / or the appliance background image representation. Aspect 3 3. The method of claim 1 or 2, wherein the one or more image representations include a stoma image representation, and determining the one or more ostomy representations is based on the stoma image representation. Aspect 4 A method according to any one of aspects 1 to 3, wherein the one or more image representations include a first stoma discoloration representation, and determining the one or more ostomy representations is based on the first stoma discoloration representation. Aspect 5 The method of embodiment 4, comprising determining the first stoma discoloration representation based on red channel data of the image data. Aspect 6 A method according to any one of aspects 1 to 5, wherein the one or more image representations include a second stoma discoloration representation, and determining the one or more ostomy representations is based on the second stoma discoloration representation. Aspect 7 The method of embodiment 6, comprising determining the second stoma discoloration representation based on red channel data of the image data. Aspect 8 A method according to any one of aspects 1 to 7, wherein determining one or more image representations based on the image data includes determining basic color parameters and determining the one or more image representations and / or the one or more ostomy representations based on the basic color parameters. Aspect 9 A method according to any one of aspects 1 to 8, wherein the one or more image representations include a first appliance discoloration representation, and determining the one or more ostomy representations is based on the first appliance discoloration representation. Aspect 10 A method according to any one of aspects 1 to 9, wherein the one or more image representations include a second appliance discoloration representation, and determining the one or more ostomy representations is based on the second appliance discoloration representation. Aspect 11 11. The method of any one of aspects 1 to 10, wherein the one or more image representations include an appliance area representation, and determining the one or more ostomy representations is based on the appliance area representation. Aspect 12 12. The method of any one of aspects 1-11, wherein determining one or more ostomy representations comprises determining a first ostomy representation by combining a plurality of image representations. Aspect 13 13. The method according to any one of aspects 1 to 12, wherein the first ostomy parameter is a discoloration index indicating discoloration of the stoma site. Aspect 14 13. The method according to any one of aspects 1 to 12, wherein the first ostomy parameter is a leakage parameter indicative of the distribution of excrement on the adhesive surface. Aspect 15 Aspect 15. The method of any one of aspects 1 to 14, wherein the one or more image representations are binary masks. Aspect 16 16. The method of any one of aspects 1-15, comprising determining a first boundary line based on the one or more image representations, wherein the ostomy representation includes the first boundary line. Aspect 17 17. The method of any one of aspects 1-16, wherein determining the one or more image representations based on the image data is performed by an N-layer convolutional neural network, with the N-layer convolutional neural network having between 10 and 50 layers. [Explanation of symbols]
[0189] 100 Methods for Classifying Ostomy Conditions S102 Obtain image data S102A Obtain stoma image data S102B Acquire appliance image data S104 Determine one or more ostomy representations S104A Determine first ostomy parameters based on the converted image data S104B Determine one or more image representations S104BA Determine one or more stoma image representations S104BB Determine one or more appliance image representations S104C. Determine one or more ostomy representations including first ostomy parameters based on the one or more image representations. S104CA Determine first ostomy presentation S104CB Determine secondary ostomy presentation S104CC Determine the third ostomy representation S106 Output first ostomy expression / first ostomy parameters S106A: Storing a first ostomy parameter or a first ostomy representation including the first ostomy parameter S106B: Sending at the server device and / or receiving at the accessory device the first ostomy parameter or the first ostomy representation including the first ostomy parameter. S106C Displaying the first ostomy parameter or a first ostomy representation including the first ostomy parameter S108 Convert image data S108A Determine position parameters S108B Determine angle parameters S108C Determine distance parameters S108D Determine rotation parameters S108E Identifying one or more reference indices for image data S108F Enlarge or reduce image data to a predetermined pixel size S108G Centering image data S110 Output one or more ostomy expressions S112 Output second ostomy representation S112A Remember the second ostomy description S112B Sending a second ostomy representation at the server device and / or receiving at the accessory device. S112C Show second ostomy representation 200 Accessory Equipment 202 Ostomy appliance 204 Display 206 Orthotic Images 208 Server device 210 Network 212 Substrate 214 Adhesive surface 216 Stoma opening 218 Ostomy Bag 220 Excrement 250 Orthotic Images of Orthotic Image Data 270 Converted Orthotic Image Data 280 Orthotic Image Data 301 Memory Module 302 Processor Module 302A Image conversion unit 302B Ostomy Expression Determination Section 302C Image representation determination unit 303 Wireless Interface 401 Memory Module 402 Processor Module 402A Image conversion unit 402B Ostomy Expression Determination Section 402C Image representation determination unit 403 Interface 450 normal skin areas 452 Discolored skin areas 454 Background 456 Stoma AID equipment image data AID_T converted orthotic image data AIR_1 First orthotic image representation AIR_2 Second Orthotic Image Representation AIR_3 Third Orthotic Image Representation AIR_4 Fourth Orthotic Image Representation BL_1 First boundary line BL_2 Second boundary line BL_3 Third boundary line ID image data ID_T converted image data IR_1 First Image Representation IR_2 Second Image Representation IR_3 Third Image Representation IR_4 Fourth Image Representation OP_1 First ostomy parameter OP_2_1 Second primary ostomy parameters OP_2_2 Secondary ostomy parameters OP_2_3 Second tertiary ostomy parameters OP_2_4 Second quaternary ostomy parameter OR_1 First ostomy presentation OR_2 Second ostomy representation OR_3 Third ostomy expression SID stoma image data SID_T converted stoma image data SIR_1 First Stoma Image Representation SIR_2 Second Stoma Image Representation SIR_3 Third Stoma Image Representation SIR_4 Fourth Stoma Image Representation
Claims
1. 1. A method for classifying an ostomy condition, comprising: obtaining image data, the image data including stoma image data of a stoma site including a stoma and / or appliance image data of an adhesive surface of an ostomy appliance; transforming the image data, wherein the transforming comprises determining position parameters representing a position of a camera image plane relative to the stoma site and / or the adhesive surface, the transformed image data being based on the position parameters, the position parameters comprising an angular parameter representing an angle between an optical axis of a camera that is a source of the image data and a normal to an axial direction / adhesive surface of the stoma site; determining one or more image representations based on the transformed image data; determining one or more ostomy representations including a first ostomy parameter based on the one or more image representations; outputting the first ostomy parameter; A method comprising:
2. The method of claim 1, wherein the one or more image representations include a stoma background image representation and / or an appliance background image representation, and determining one or more ostomy representations is based on the stoma background image representation and / or the appliance background image representation.
3. The method of claim 1 or 2, wherein the one or more image representations include a stoma image representation, and determining one or more ostomy representations is based on the stoma image representation.
4. 4. The method of claim 1, wherein the one or more image representations include a first stoma discoloration representation, and determining the one or more ostomy representations is based on the first stoma discoloration representation.
5. 5. The method of claim 4, comprising determining the first stoma discoloration representation based on red channel data of the image data.
6. 6. The method of claim 1, wherein the one or more image representations include a second stoma discoloration representation, and determining the one or more ostomy representations is based on the second stoma discoloration representation.
7. 7. The method of claim 6, comprising determining the second stoma discoloration representation based on red channel data of the image data.
8. The method of any one of claims 1 to 7, wherein determining one or more image representations based on the image data comprises determining base color parameters and determining the one or more image representations and / or the one or more ostomy representations based on the base color parameters.
9. 9. The method of claim 1, wherein the one or more image representations include a first appliance discoloration representation, and determining one or more ostomy representations is based on the first appliance discoloration representation.
10. 10. The method of claim 1, wherein the one or more image representations include a second appliance discoloration representation, and determining the one or more ostomy representations is based on the second appliance discoloration representation.
11. The method of any one of claims 1 to 10, wherein the one or more image representations include appliance area representations, and determining one or more ostomy representations is based on the appliance area representations.
12. The method of any one of claims 1 to 11, wherein determining one or more ostomy representations comprises determining a first ostomy representation by combining a plurality of image representations.
13. The method according to any one of claims 1 to 12, wherein the first ostomy parameter is a discoloration index indicating discoloration of the stoma site.
14. The method according to any one of claims 1 to 12, wherein the first ostomy parameter is a leakage parameter indicative of the distribution of waste on the adhesive surface.
15. The method of any one of claims 1 to 14, wherein the one or more image representations are binary masks.
16. 16. The method of any one of claims 1 to 15, comprising determining a first boundary line based on the one or more image representations, wherein an ostomy representation includes the first boundary line.
17. 17. The method of any one of claims 1 to 16, wherein determining one or more image representations based on the image data is performed by an N-layer convolutional neural network in the range of 10 to 50 layers.
Citation Information
Patent Citations
Methods and systems for wound assessment and management
JP2017504370A
A method and device for capturing and digitally storing images of a wound, fistula or stoma site
US20170079576A1