Skin examination device for identifying abnormalities

Abstract

The present application relates to a skin inspection device for identifying abnormalities. The device comprises: a transparent panel providing an inspection area; an array of thermochromic liquid crystal structures disposed on the transparent panel, the thermochromic liquid crystal structures being capable of changing colour in response to a change in temperature; one or more image capture devices having a wide angle lens for capturing images of the thermochromic liquid crystal structures and a skin area of a subject located in the inspection area; at least some of the thermochromic liquid crystal structures having a twisted shape, while others of the thermochromic liquid crystal structures have a non-twisted shape; the thermochromic liquid crystal structures having a twisted shape and the thermochromic liquid crystal structures having a non-twisted shape defining a pattern such that: when viewed through the wide angle lens, both the thermochromic liquid crystal structures having a twisted shape and the thermochromic liquid crystal structures having a non-twisted shape appear non-twisted.

Description

Technical Field

[0001] This application relates to a skin examination device for identifying abnormalities. In particular, but not in a limiting sense, the skin examination device relates to thermal sensing of a human foot to predict ulcer formation. Background Technology

[0002] Diabetic foot ulcers (DFUs) are a common occurrence in people with diabetes at some point in their lives. It is recommended that people with diabetes examine their feet daily to check for any unusual lesions on the skin, which could be indicators of DFU development. However, limiting factors such as decreased vision, reduced mobility, sensory impairment due to peripheral neuropathy, and lack of education can prevent people with diabetes from adhering to the recommended daily foot checks. Early identification of DFUs can improve outcomes and reduce healthcare costs. The benefits are even greater if they are detected before they form. Current best practice is to conduct a visual examination of the feet and report regularly to a podiatrist.

[0003] Temperature monitoring is a known method for predicting DFU formation. A temperature difference of 2.2°C between similar points on both feet can indicate the presence of inflammation that may be a precursor to ulcers. Temperature point probes are known in the art, allowing patients to measure the temperature of the soles of both feet, thus comparing the temperature of one point to another. Such point probes can be used to measure the skin temperature at individual target points. If a point on one foot shows a temperature change compared to the same point on the other foot, and this temperature change remains constant or becomes larger (rising to 4 degrees Fahrenheit (2.2°C) or higher over two days or more), it indicates a potential problem and prompts the patient to consult a doctor. The difficulty with this method lies in the need to measure the same point on the patient's feet over several days. It is difficult for patients to identify the same point for accurate measurement. Furthermore, patients bear the burden of recording temperature readings for comparison, which can lead to human error. It is recommended that all diabetic patients perform a daily visual inspection of their feet. As mentioned above, this can be difficult due to poor vision and mobility. Current temperature monitoring devices do not facilitate the recommended daily visual inspection.

[0004] The applicant's published PCT patent application WO2017202534 utilizes thermochromic liquid crystal (TLC) with color-changing properties. A light source, lens, and image sensor are used to measure temperature and record the region of the TLC. The captured image is then analyzed to obtain the color of the TLC at the region of interest (ROI). The temperature can then be determined by calculating the color using a correction equation and the obtained color. The array of TLC sensors is designed such that optical paths exist between the sensors, allowing visualization of the target behind the sensors while recording images of the TLC sensors. This design is useful for anomaly detection that can present either thermal or visual signals. Figure 1 The pattern of the TLC 100 shown defines a uniform pattern, in which the TLCs have substantially the same shape and size. One drawback of the uniform pattern of TLCs is that if the image capturing device has a wide-angle lens, the captured image will be distorted, causing changes in the geometry of the TLCs in the image. For example, when viewed through a wide-angle lens, such as... Figure 2A The straight chessboard shown will be as follows Figure 2B The distortion is as shown, where the degree of distortion and the reduction in size of each square will increase with increasing distance from the center of the image.

[0005] There is a need for a skin examination device that can address at least some of the shortcomings of existing technologies. Summary of the Invention

[0006] These and other problems are addressed by providing a skin examination device for identifying abnormalities; the device includes:

[0007] A transparent panel with an inspection area;

[0008] An array of thermochromic liquid crystal (TLC) structures is disposed on a transparent panel, wherein the thermochromic liquid crystal structures can change color in response to temperature changes.

[0009] One or more image capturing devices, the image capturing devices having a wide-angle lens for capturing images of thermochromic liquid crystal structures located in an inspection area and a skin area of ​​a target; at least some of the thermochromic liquid crystal structures have a distorted shape, while the others have a non-distorted shape;

[0010] The thermochromic liquid crystal structure with a distorted shape and the thermochromic liquid crystal structure with a non-distorted shape define a pattern such that when viewed through the wide-angle lens, both the thermochromic liquid crystal structure with the distorted shape and the thermochromic liquid crystal structure with the non-distorted shape appear non-distorted.

[0011] In one embodiment, the amount of twist in the thermochromic liquid crystal structure with a twisted shape increases toward the periphery of the pattern.

[0012] In another embodiment, the shape and size of the thermochromic liquid crystal structure vary relative to the center of the pattern, such that the thermochromic liquid crystal structure toward the periphery of the pattern is larger than the thermochromic liquid crystal structure adjacent to the center of the pattern.

[0013] In another embodiment, the twist angle of the thermochromic liquid crystal structure with a twisted shape varies as follows: the thermochromic liquid crystal structure facing the periphery of the pattern has a larger twist angle than the thermochromic liquid crystal structure at the center of the adjacent pattern.

[0014] In an exemplary embodiment, the captured images of the thermochromic liquid crystal structures have a uniform size, regardless of their position within the pattern. Advantageously, the captured images of the thermochromic liquid crystal structures have a uniform shape, regardless of their position within the pattern. Preferably, the captured images of the thermochromic liquid crystal structures have a uniform angle, regardless of their position within the pattern. In an exemplary embodiment, the captured images of the thermochromic liquid crystal structures have a uniform size, regardless of their position within the pattern.

[0015] In one embodiment, the geometry of the thermochromic liquid crystal structure is adjusted to match the parameters of a specific wide-angle lens. Advantageously, these parameters include at least one of focal length and field of view.

[0016] In an exemplary embodiment, the geometry of the thermochromic liquid crystal structure is adjusted to match the parameters of a specific image sensor. Advantageously, the parameters of the image sensor include at least one of resolution and aspect ratio.

[0017] In another embodiment, the thermochromic liquid crystal structure extends radially from the center point of the pattern, and the degree of distortion of the thermochromic liquid crystal structure increases with distance from the center point. Advantageously, the distortion angle of the distorted thermochromic liquid crystal structure increases with distance from the center point. Preferably, the size of the distorted thermochromic liquid crystal structure increases with distance from the center point.

[0018] This application also relates to a method for identifying skin abnormalities; the method includes:

[0019] Provides a transparent panel with an inspection area;

[0020] An array of thermochromic liquid crystal structures is provided on the transparent panel, the thermochromic liquid crystal structures being able to change color in response to temperature changes;

[0021] One or more image capturing devices are provided, the image capturing devices having a wide-angle lens for capturing images of thermochromic liquid crystal structures located in an inspection area and a skin area of ​​a target; at least some of the thermochromic liquid crystal structures have a distorted shape, while the others have a non-distorted shape;

[0022] The thermochromic liquid crystal structure with a distorted shape and the thermochromic liquid crystal structure with a non-distorted shape define a pattern such that when viewed through the wide-angle lens, both the thermochromic liquid crystal structure with the distorted shape and the thermochromic liquid crystal structure with the non-distorted shape appear non-distorted.

[0023] Referring to the accompanying drawings below will provide a better understanding of these and other structures, which are provided to aid in the understanding of the teachings of this application. Attached Figure Description

[0024] The present invention will now be described with reference to the accompanying drawings, wherein:

[0025] Figure 1 A skin examination device of the prior art is shown.

[0026] Figure 2A and Figure 2B The distortion caused by the wide-angle lens is shown.

[0027] Figure 3 Details of an exemplary skin examination device are shown.

[0028] Figure 4A , Figure 4B and Figure 4C A skin examination device according to the present invention is shown.

[0029] Figure 5A , Figure 5B and Figure 5C A skin examination device according to the present invention is shown.

[0030] Figure 6 This is a flowchart detailing exemplary steps of a method for identifying skin abnormalities.

[0031] Figure 7AThis is a flowchart detailing an exemplary method for generating the physical geometry of a TLC sensor, which will appear as the desired geometry when viewed through a wide-angle lens.

[0032] Figure 7B This is a flowchart that details the exemplary calibration steps.

[0033] Figure 8 An exemplary component of the skin examination device according to the present invention is shown.

[0034] Figure 9 This is a flowchart detailing exemplary steps performed using the skin examination device according to the present invention.

[0035] Figure 10 This is a flowchart detailing exemplary steps performed using the skin examination device according to the present invention.

[0036] Figure 11 This is a flowchart detailing exemplary steps performed using the skin examination device according to the present invention. Detailed Implementation

[0037] This application will now be described with reference to some exemplary skin examination devices. It should be understood that the exemplary skin examination devices provided are for the purpose of aiding understanding the teachings and should not be construed as limiting in any way. Furthermore, elements or components described with reference to any one of the accompanying drawings may be interchanged with elements or components of other drawings or other equivalent elements without departing from the spirit of this application. It should be understood that, for the sake of simplicity and clarity of illustration, reference numerals may be repeated in multiple drawings where deemed appropriate to indicate corresponding or similar elements.

[0038] Refer to the attached diagram and first refer to... Figure 1 It discloses the prior art skin examination device 100 in the published PCT patent application WO2017202534.

[0039] The device 100 includes a transparent panel 102 that defines an examination area for cooperating with an area of ​​the body being examined. For example, the examination area may be a foot, hand, arm, leg, etc. In an exemplary arrangement, the examination area is the sole of the foot 109 as shown in FIG. 2. The transparent panel 102 provides a footrest for accommodating the foot 109 during the examination. An array of thermochromic liquid crystal (TLC) structures 105 is disposed on the transparent panel 102, the thermochromic liquid crystal structures being able to change color in response to a detected temperature change.

[0040] A transparent panel 102 is supported on a housing 106, which houses the components of the device 100. The housing 106 includes a base 111 and sidewalls 112 extending upward from the base, the sidewalls and base together defining a hollow interior region 113. One or more image capturing devices 107 are disposed within the hollow interior region 113 for capturing color images of the TLC structure and the skin area on the foot 109. One or more light sources in the form of LEDs 122 may also be located within the hollow interior region 113. Other types of light sources besides LEDs may also be used, such as cold cathode lamps, electroluminescent coating materials (e.g., strips, panels, wires), xenon or halogen bulbs. A central processing unit 115 is also disposed within the hollow interior region 113 and configured to control the operation of the device 100, as described in detail below.

[0041] Thermochromic properties are the characteristic of a substance changing color in response to temperature changes, which are well known in the art. TLC point 105 is designed to change color at precise temperatures and is used as a means of determining foot temperature. TLC point 105 changes color within a predetermined range, for example, from red to blue over a temperature range spanning 20°C; for example, red at 20°C and blue at 40°C. The temperature range required for applications involving diabetic foot ulcers is 15°C–38°C. TLC point 105 changes color in response to heat. Digital photographic images of TLC point 105 are captured by image capture device 107. CPU 115 is configured to analyze the images of TLC point 105. CPU 115 can be used to analyze color changes and convert color information into temperature values. Therefore, the color of TLC point 105 indicates the temperature at each point on the foot registered with the TLC point. If a point on one foot shows a temperature change compared to the same point on the other foot, and that temperature change remains constant or becomes larger (rising to 4 degrees Fahrenheit (2.2°C) for two days or longer), the CPU 115 can be configured to indicate a possible DFU problem and prompt the patient to consult a doctor.

[0042] Now for reference Figure 4AThis illustration shows a skin examination device 200 according to the present invention. The skin examination device 200 is substantially similar to the skin examination device 100, and similar elements are indicated by similar reference numerals. The main difference between the skin examination device 200 and the skin examination device 100 is that, in the device 200, the pattern of TLC structures 205 on the transparent panel is arranged to eliminate image distortion when the image capturing device has a wide-angle lens. The skin examination device 200 includes a transparent panel 105 having an examination area. An array of thermochromic liquid crystal (TLC) structures 205 is disposed on the transparent panel; the thermochromic liquid crystal structures change color in response to temperature changes. One or more image capturing devices 107 with wide-angle lenses are provided to capture images of the TLC structures 205 located in the examination area and the target skin area. The pattern of the TLC structures 205 is arranged such that at least some TLC structures have a warped shape 207, while other TLC structures have a non-warped shape 209A. The pattern defined by the TLC structure 207 with a distorted shape and the TLC structure 209 with a non-distorted shape is such that, when viewed through a wide-angle lens 211, both the TLC structure with the distorted shape and the TLC structure with the non-distorted shape appear non-distorted, as... Figure 4B The best example shown is... Figure 4C A perspective view of the device 200 is shown, wherein a device is provided on the transparent panel 102 as shown in the figure. Figure 4A The diagram shows the pattern of the TLC structure 205. Those skilled in the art will understand that, although... Figure 4A A single image capture device 107 is shown, but additional image capture devices may be provided as needed.

[0043] Figure 4A An exemplary array of rhomboid TLC structures 205 is shown, the rhomboid TLC structures being designed such that when transmitted through... Figure 4B When viewed through the wide-angle lens 211 shown, the TLC's size, shape, and angle produce a consistent square shape. Figure 4A In the pattern, size, shape, and / or angle vary based on position relative to the image center. Figure 4B The image shows observation through wide-angle lens 211. Figure 4A The image of the pattern, Figure 4B These TLC structures 205 are shown to have consistent size, shape, and angle, regardless of their position relative to the center of image 215. Figure 5A An exemplary array of elliptical TLC structures 205 is shown, the elliptical TLC structures being designed such that when transmitted through... Figure 5B When viewed through the wide-angle lens 211 shown, the size, shape, and angle of these TLCs produce a consistent circularity. Figure 5AIn the pattern, size, shape, and / or angle vary based on position relative to the image center. Figure 5B The middle image shows an observation through a wide-angle lens 211. Figure 5A The image of the pattern, Figure 5B These TLC structures 205 are shown to have consistent size, shape, and angle, regardless of their position relative to the center of image 215. Figure 5C A perspective view of the device 200 is shown, wherein a device is provided on the transparent panel 102 as shown in the figure. Figure 5A The diagram shows the pattern of the TLC structure 205. Those skilled in the art will understand that, although... Figure 5A A single image capture device 107 is shown, but additional image capture devices may be provided as needed.

[0044] Those skilled in the art will understand that the term "distorted shape" refers to an irregular geometry, while the term "non-distorted shape" refers to a regular geometry. The irregularity of the geometry of the TLC structure will have an angular component, which is determined by the position of the TLC structure relative to the image center, such that most of the distortion of the structure is radial.

[0045] In the exemplary arrangement, the amount of twist in the TLC structure with a twisted shape increases towards the periphery of the pattern. The size of the TLC structure's shape varies relative to the center of the pattern, such that the TLC structure towards the periphery of the pattern is larger than the TLC structure near the center of the pattern. The twist angle of the TLC structure with a twisted shape varies, such that the TLC structure towards the periphery of the pattern has a larger twist angle than the TLC structure near the center of the pattern. The captured images of the TLC structures have a uniform size regardless of their position in the pattern. The captured images of the TLC structures have a uniform shape regardless of their position in the pattern. The captured images of the TLC structures have a uniform angle regardless of their position in the pattern. The captured images of the TLC structures have a uniform size regardless of their position in the pattern.

[0046] The geometry of the TLC structure 205 can be adjusted to match the parameters of a specific wide-angle lens 211, such as focal length and field of view. The geometry of the TLC structure 205 can also be adjusted to match the parameters of a specific image sensor (image capturing device 122), such as resolution and aspect ratio. In one example, the TLC structure 205 extends radially from the center point 213 of the pattern, and the further the TLC structure 205 is from the center point 213, the greater the degree of distortion of the TLC structure. The distortion angle of the distorted TLC structure 205 increases with distance from the center point 213. The further the TLC structure 205 is from the center point 213, the larger its size. Those skilled in the art will understand that the “distorted shape” is a transformation of the “reference shape” located at the center point 213 of the pattern. For example, Figure 4A The "reference shape" in the example is a square, which is transformed (distorted) into a rhombus at a point extending radially from its center point. In another example, Figure 5A The "reference shape" in the diagram is a circle that has been transformed (distorted) into an ellipse. The "reference shape" can be bent or twisted, and its dimensions can be changed to produce a "distorted shape." In other words, a "distorted shape" can be a distorted version of the "reference shape."

[0047] Using a wide-angle lens offers several advantages. It allows for minimizing the height of the device (200mm) to make it as easy to use as possible, while ensuring a sufficiently wide field of view to image the entire foot and temperature sensor array. This can be achieved by using a wide-angle lens. Furthermore, a wide-angle lens achieves a wider field of view by compressing the areas at the edges, ensuring that light from these areas falls onto the image sensor, unlike a low-field lens. The degree of optical compression applied by the lens increases with distance from the center of the lens.

[0048] One of the drawbacks of wide-angle lenses is that they cause image distortion and alter the geometry of objects within the image. For example, when viewing through a wide-angle lens, such as... Figure 2A The straight chessboard shown will be as follows Figure 2B The distortion is as shown, where the degree of distortion and the reduction in size of each square will increase with increasing distance from the center of the image.

[0049] Image sensors are used to create digital images by recording the level of light transmitted to the sensor, typically visible light within the portion of the electromagnetic spectrum perceptible to the human eye, with wavelengths ranging from 400 to 700 nanometers (nm). Some image sensors can also record wavelengths above and below the visible light spectrum. Image sensors come in various sizes, such as... 1 / 4 inches,1 / 3 inches and 1 / 2 inches. Image sensors come in a range of different resolutions, typically measured in megapixels (MP), such as 1MP, 5MP, 108MP, etc. Resolution is calculated by multiplying the sensor's width and height (in pixels). Therefore, a 2592×1944 image sensor has a total of 5,038,848 pixels and is referred to as a 5-megapixel image sensor.

[0050] When an image sensor records light, the scene being imaged must be bright enough to allow light to reach the sensor for recording. Various light sources can be used, including sunlight, incandescent bulbs, and light-emitting diodes (LEDs). A lens is used to focus the light onto the image sensor. Fisheye lenses are ultra-wide-angle lenses that achieve a wider field of view by compressing areas at the edges of the field of view, ensuring that light from these areas falls onto the image sensor, unlike low-field-of-view lenses. Wide-angle lenses typically have a field of view (FOV) ranging from 60° to 180°, and in some cases, over 200°. The focal length of a wide-angle lens can vary considerably, for example, from less than 4 mm to over 30 mm. Furthermore, some lenses have adjustable apertures, which can be varied and are typically specified as f-numbers, the ratio of focal length to the effective aperture diameter, typically ranging from f / 2.8 to f / 22. The degree of optical compression applied by the lens increases with distance from the center of the lens. One disadvantage of wide-angle lenses is that they cause image distortion and distortion of objects within the image. Distortion is related to the various lens parameters mentioned, as well as the position of the object relative to the optical center of the image. The degree of distortion usually increases with the distance from the center.

[0051] Those skilled in the art will understand the impact of a wide-angle fisheye lens on the region of interest (ROI) observed in a thermochromic liquid crystal display (TLC). To measure temperature, color information is obtained from the region where the TLC appears in the image. The location of the ROI can be defined in pixel coordinates within the captured image. The center pixel coordinates of the ROI are defined, defining the geometry of the boundary region centered on that pixel. For example, a square boundary can be defined by the height and width of the square (in pixels), such as 1×1, 3×3, 5×5, etc. The larger the number of pixels at the boundary of the region, the more robust the color signal. For example, a 5×5 square ROI contains 25 pixels, while a 1×1 square contains only 1 pixel. Therefore, it is advantageous for the TLC region in the captured image to have a size that ensures a minimum ROI is suitable for the TLC.

[0052] Figure 2 illustrates how an object is compressed when viewed through a wide-angle lens, and how this compression increases with distance from the center. This means that multiple TLC sensors with identical physical dimensions will appear sized differently in the captured image. Therefore, it would be advantageous to provide a method that ensures all TLC sensors have the same size in the image. Due to the nature of wide-angle lenses (the degree of compression varies with distance from the image center), this means that the physical size of the TLC sensors required to meet the minimum ROI will vary depending on the location. However, it is also advantageous to minimize the size of the TLC sensors to maximize the visibility of the foot behind. Therefore, a sensor array can be designed that both meets the minimum TLC size threshold and minimizes the size of the TLC sensors.

[0053] Two exemplary array designs are given, which are based on two of the most common shapes used to define regions in image processing: such as Figure 4A The square shown and as Figure 5A The shape shown is circular. However, this design approach can be applied to any other suitable shape, and therefore it should be understood that this application is not limited to the exemplary shape described. The physical shape of the sensor will be designed / adjusted to suit specific lens specifications (e.g., focal length, angle of view).

[0054] Using a wide-angle lens minimizes the device's height, improving usability. Using a TLC sensor allows for transparent optical paths between sensors, enabling simultaneous visual inspection. Therefore, minimizing the TLC sensor size maximizes foot visibility. Furthermore, this reduces the amount of TLC material used, thus lowering costs. Noise in TLC sensor measurements increases as the size of the TLC ROI in the image decreases. Therefore, ensuring all TLC ROIs exceed a certain threshold size is advantageous, as this prevents sensor noise from rising to unacceptable levels. Maintaining consistent TLC ROI size across captured images is beneficial, ensuring uniform noise levels across all sensors. Consistent ROI geometry in captured images facilitates ROI-based measurements using image processing software. No modification to software sampling parameters is needed for different regions because all ROIs have the same geometry. This reduces software and manufacturing process complexity.

[0055] refer to Figure 6 , Figure 6Flowchart 300 is shown, detailing exemplary steps for identifying skin abnormalities. Step 302: A transparent panel having an examination area is provided. Step 304: An array of thermochromic liquid crystal (TLC) structures is disposed on the transparent panel, the TLC structures changing color in response to temperature changes. Step 306: One or more image capturing devices are provided, each having a wide-angle lens for capturing images of the TLC structures located in the examination area and the target skin area; at least some of the TLC structures have distorted shapes, while others have undistorted shapes. Step 308: The TLC structures with distorted shapes and the TLC structures with undistorted shapes define a pattern such that, when viewed through the wide-angle lens, both the TLC structures with distorted shapes and the TLC structures with undistorted shapes appear undistorted.

[0056] refer to Figure 7A , Figure 7A This is a flow 400 detailing an exemplary method for generating the physical geometry of a TLC sensor, which will appear as the desired geometry when viewed through a wide-angle lens. Step 402: Perform wide-angle lens correction processing to generate a correction algorithm capable of de-distorting the image captured by the wide-angle lens. Step 404: Capture a reference image (the distorted image) through the lens. Step 406: Apply the desired geometry of the region of interest (ROI) to the captured distorted image. Step 408: De-distort the image using the developed correction algorithm. Step 410: Modify the geometry of the ROI using the correction algorithm to give it a geometry that will produce the desired geometry when viewed through a wide-angle lens.

[0057] Those skilled in the art will understand that wide-angle lens correction is a means of generating a mapping function that converts a distorted image captured by a wide-angle lens into an undistorted, straight-line image. The method described by Scaramuzza et al. (AToolbox for Easily Calibrating Omnidirectional Cameras 2006) is well known. Step 402 is performed as follows: Figure 7B The exemplary steps shown are as follows. They include step 412, capturing multiple images presented in a checkerboard pattern, followed by step 414, running software to analyze the images and generate a correction equation / model. The equation / model is saved in step 416 and can be applied in the dedistortion step 408. The correction takes into account lens parameters such as focal length and field of view. Step 418 involves reading the distorted image. Step 420 involves applying the correction equation / model to the distorted image. Step 422 involves saving the corrected image.

[0058] Therefore, it can be understood that by using the method described in this application, the physical shape of the object required to achieve the desired observation shape can be determined, and it will be applicable to any combination of image sensor, lens, light source and desired TLC structure shape.

[0059] It should be understood that device 200 includes one or more software modules programmed to perform predetermined functions. Device 200 includes hardware and software components for performing the methods according to this application. Device 200 includes a user interface 150, a CPU 115 communicating with memory 160, and a communication interface 165. CPU 115 is used to execute software instructions, which can be loaded and stored in memory 160. Depending on the specific application, CPU 115 may include multiple processors, multiprocessor cores, or some other type of processor. CPU 115 has access to memory 160, thereby enabling CPU 115 to receive and execute instructions stored on memory 160. For example, memory 160 may be random access memory (RAM) or any other suitable volatile or non-volatile computer-readable storage medium. Furthermore, memory 160 may be fixed or removable and may contain one or more components or devices, such as hard disk drives, flash memory, rewritable optical discs, rewritable magnetic tapes, or some combination of the above devices.

[0060] One or more software modules 170 may be encoded in memory 160. Software module 170 may include one or more software programs or applications having computer program code or a set of instructions configured to be executed by processor 115. The computer program code or instructions for performing the operations of the systems and methods disclosed in this application may be written in any combination of one or more programming languages. According to embodiments of this application, during the execution of software module 170, CPU 115 configures device 200 to perform various operations related to identifying the formation of skin abnormalities. CPU 115 may be configured to process images captured by image capture device 107 to determine target temperatures at multiple discrete locations. CPU 115 may be used to process the images and convert the colors of the identified TLC structures into corresponding temperature values. CPU 115 may be programmed to convert the colors of the identified TLC structures into corresponding temperature values ​​based on a color temperature conversion table and point hue / saturation / luminance. Those skilled in the art will understand that other color spaces such as Hue / Saturation / Luminance (HSV) or Red, Green, Blue (RGB) may be used. Additionally, CPU 115 can be configured to generate a temperature map based on temperature values. In one exemplary arrangement, CPU 115 can overlay the temperature map onto a captured image of the target. In another arrangement, CPU 115 is configured to perform image analysis on the temperature map and the captured image. The CPU can be programmed to compare temperatures at similar points in the captured image. CPU 115 can generate a cue indicating the presence of ulcers and / or other skin abnormalities based on the image analysis of the captured image. CPU 115 can generate a cue indicating the presence of ulcers and / or other skin abnormalities at a specific location in the captured image. For example, the cue can be presented as an output image. In another example, CPU 115 is configured to detect areas on the captured image, including detecting at least one of hyperindulgence, blisters, humidity, and discoloration.

[0061] Other information and / or data (e.g., database 185) related to the operation of this system and method may also be stored on memory 160. Database 185 may contain and / or maintain various data items and elements used in various operations. It should be noted that although database 185 is described as being configured locally to device 100, in some implementations, database 185 and / or various other data elements stored therein may also be remotely located. These elements may reside on a remote device or server not shown and be connected to device 100 via a network in a manner known to those skilled in the art so as to be loaded into a processor and executed.

[0062] Furthermore, as is known to those skilled in the art, the program code of software module 170 and one or more computer-readable storage devices (e.g., memory 160) forms a computer program product that can be made and / or distributed in accordance with this application.

[0063] Communication interface 165 may also be connected to CPU 115 and may be any interface that enables communication between device 100 and external devices, machines, and / or components. Communication interface 165 is configured to send and / or receive data. For example, communication interface 165 may include, but is not limited to, Bluetooth, WiFi; or cellular transceivers, wireless modules, satellite communication transmitters / receivers, optical ports, and / or any other interface for connecting device 110 to external devices.

[0064] User interface 150 may also be connected to CPU 115. The user interface may include one or more input devices, such as switches, buttons, keys, or touchscreens. User interface 150 is used to allow input data. The function of user interface 150 is to facilitate obtaining commands from the user, such as on / off commands or settings related to the operation of the methods described above.

[0065] Display 190 may also be connected to CPU 115. Display 190 may include a screen or any other display device that allows a user to view various options, parameters, and results. Display 190 may be a digital display such as an LED display. Device 110 may be powered via power supply 192. Alarm mechanism 195 is configured to generate an alarm. Alarm mechanism 195 may transmit the alarm to a remote entity via a telecommunications network.

[0066] Exemplary operation of device 200 is described with reference to flowcharts 500, 300A, 300B, and 300C. At block 502, a user steps onto transparent panel 102. Block 504: Strain gauge 169, coupled to CPU 115, senses a weight load on transparent panel 102. Block 506: Strain gauge 169 is configured to determine when the user is in a stable posture. Block 508: CPU 115 activates LED 122. Block 510: In this exemplary embodiment, two image capturing devices 107 are activated to capture images of the soles of an individual's feet 109 and a pattern of TLC points 105 that have changed color to indicate the temperature of corresponding points on the soles of the feet 109. Block 512: Temperature sensor 118 records the temperature of transparent panel 102. In this example, skin examination device 110 can also be used as a weighing scale to obtain an individual's weight (block 514). Step 516: Image data, weight data, reference temperature data, and timestamp are sent to CPU 115 for processing.

[0067] refer to Figure 10The data processing is described in flowchart 600. Block 602: CPU 115 receives image data, weight data, reference temperature data, and a timestamp. Block 604: Since two image capture devices are used to capture image data, the captured images are stitched together. Block 606: CPU 115 analyzes the captured images for color correction targets. Block 608: CPU 115 interprets the color correction targets and applies a color shift to the captured images. Furthermore, Block 610: The position of TLC point 105 is identified by CPU 115. Block 612: The color of TLC point 105 is converted into a temperature value by CPU 115. Block 614: CPU 115 applies the reference temperature and shift algorithm to the temperature value. Block 616: The modified temperature value is stored in the patient database. Image data, weight data, reference temperature, and timestamp are also stored in database 618. Box 620: If the temperature value indicates DFU formation, display an appropriate prompt on display 190 to warn the individual of the possible presence of an ulcer.

[0068] refer to Figure 11 The following flowchart 700 illustrates an exemplary data processing method. Block 702: CPU 115 receives image data, weight data, reference temperature data, and a timestamp. Block 704: CPU 115 processes the image data. This processing may include CPU 115 applying an algorithm that scans the captured image and identifies the location of temperature sensor 105. Block 706: The location of temperature sensor 105 in the captured image is linked to the temperature data recorded by sensor 105. Block 708: CPU 115 generates a temperature dataset based on the temperature values ​​recorded by sensor 105. The temperature dataset is stored in database 185. Block 710: CPU 115 applies a reference temperature and offset algorithm to the temperature dataset. Block 712: The modified temperature dataset is stored in a patient database. Block 714: Image data, weight data, reference temperature, and timestamp are also stored in the database. Block 716: If it is determined that the temperature values ​​in the temperature dataset indicate DFU formation, an appropriate prompt is displayed on display 190, warning the individual of a possible ulcer. It should be understood that this application is not limited to the exemplary steps provided or to the order of these steps, and the order of the steps may be modified as needed. For example, in the data processing method described above, weight data may be optional.

[0069] Box 318: The system can be configured to detect visual anomalies, thermal anomalies, or a combination of both. Visual anomalies can be detected first by identifying feet in an image. The feet are then examined for anomalous features. Thermal anomalies can be identified using only thermal data or by combining visual images with thermal data. The location of the feet can be determined using visual images. This is advantageous because sometimes the temperature of the feet is similar to the ambient temperature, making it difficult to determine the foot's location using thermal data alone. In such cases, performing a comparison between points on one foot and points on another foot can be difficult because it is hard to determine which points to compare.

[0070] By linking images of the feet to a temperature dataset, the temperature at any location on the foot can be determined. Abnormalities can be detected by comparing temperatures between similar points on both feet (contralateral comparison). Other methods for detecting abnormalities may include comparing average temperature, maximum temperature, minimum temperature, or any other statistically generated figure. Another approach is to compare the collected data with previously collected data. For some patients, there may be pre-existing temperature differences between contralateral sites; in such cases, comparing temperatures with previously recorded temperatures is advantageous. In another embodiment, comparisons of regional temperatures, such as forefoot temperature, heel temperature, big toe temperature, etc., can be performed.

[0071] Examining two different sensing modal datasets (thermal and visual) is advantageous because it increases the amount of information available to determine the presence of anomalies. Some anomalies may only appear in one of the datasets. This is advantageous because it provides four potential outcomes compared to only two for a single sensing modality.

[0072] result hot Visual 1 normal normal 2 normal abnormal 3 abnormal normal 4 abnormal abnormal

[0073] The system can be configured to modify alarms based on the type of anomaly detected. For example, an alert triggered by a contralateral temperature increase may differ from an alert triggered by the detection of an active ulcer in the absence of visual abnormalities.

[0074] Points in an image can be used to identify body parts such as toes, heels, and arches. The image can be digitized to generate a geometric map of the foot. Different regions of the image can be classified based on features. These classified regions can be used as reference points when comparing two feet. The geometric map can be used to identify body structures at a given coordinate. Therefore, the geometric map makes it possible to make accurate comparisons with the same regions on the other foot. This makes it easy to plot data from similar points on each foot.

[0075] Foot temperature is typically lower than body temperature. Normally, foot temperature can be similar to ambient temperature. In this case, it's impossible to determine which point on a thermometer corresponds to the foot. Therefore, it's difficult to make contralateral temperature comparisons.

[0076] Those skilled in the art will understand that various modifications can be made to the above embodiments without departing from the scope of the invention. In this way, it will be understood that the teachings are limited to the scope deemed necessary according to the appended claims. For ease of description, the TLC structure is referred to as a point in this application. However, many different shapes can be used, such as, but not limited to, circles, triangles, squares, ellipses, pentagons, stars, herringbone shapes, straight lines, curves, etc. It is conceivable that TLC structures with any desired configuration can be provided. In the exemplary arrangement, multiple image capturing devices are shown in the figures; however, it should be understood that a single image capturing device can also be used.

[0077] The advantage of using an array with a TLC dot structure is that it can acquire temperature data at a large number of discrete locations while maintaining the ability to capture a visual image of the target location. For example, the following shows the percentage of the image obscured by TLC dots of different diameters. In this example, the dots are spaced 1 cm apart, so every 100 mm... 2 It contains a point. The area of ​​the circle is given by the following formula:

[0078] π.r 2

[0079] r is the radius of the circle.

[0080] Diameter of the point Point area Panel transparency 2mm <![CDATA[3.14mm 2 ]]> 96.86％ 3mm <![CDATA[7.07mm 2 ]]> 92.93％ 4mm <![CDATA[12.57mm 2 ]]> 87.43％

[0081] In this way, due to the dispersed nature and size of the TLC points, they will not obstruct the image capturing device's observation of important parts of the surface area of ​​the sole of the foot.

[0082] Those skilled in the art will understand that various modifications can be made to the above embodiments without departing from the scope of the invention. In this way, it will be understood that the teachings are limited to the scope deemed necessary according to the appended claims. In an exemplary embodiment, the skin examination device 200 may be incorporated into a weighing scale having means for calculating an individual's weight.

[0083] Similarly, when used in the specification, the term "comprising / including" is used to specify the presence of the said structure, integer, step, or component, but does not exclude the presence or addition of one or more other structures, integers, steps, components, or groups thereof.

Claims

1. A skin examination device for identifying abnormalities, the skin examination device comprising: A transparent panel with an inspection area; An array of thermochromic liquid crystal structures, wherein the array of thermochromic liquid crystal structures is disposed on the transparent panel, and the thermochromic liquid crystal structures can change color in response to temperature changes; as well as One or more image capturing devices, the image capturing devices having a wide-angle lens for capturing images of an array of thermochromic liquid crystal structures located in the inspection area and the skin area of ​​the target; The array of thermochromic liquid crystal structures includes thermochromic liquid crystal structures with a twisted shape and thermochromic liquid crystal structures with a non-twisted shape. The pattern is defined by a thermochromic liquid crystal structure with a twisted shape and a thermochromic liquid crystal structure with an untwisted shape, wherein the amount of twist of the thermochromic liquid crystal structure with the twisted shape increases toward the periphery of the pattern, such that when viewed through the wide-angle lens, both the thermochromic liquid crystal structure with the twisted shape and the thermochromic liquid crystal structure with the untwisted shape appear untwisted.

2. The skin examination device according to claim 1, wherein, The shape and size of the thermochromic liquid crystal structure change relative to the center of the pattern, such that the thermochromic liquid crystal structure facing the periphery of the pattern is larger than the thermochromic liquid crystal structure adjacent to the center of the pattern.

3. The skin examination device according to claim 1, wherein, The twist angle of a thermochromic liquid crystal structure with a twisted shape varies as follows: the thermochromic liquid crystal structure facing the periphery of the pattern has a larger twist angle than the thermochromic liquid crystal structure at the center of the adjacent pattern.

4. The skin examination device according to claim 1, wherein, The captured images contain thermochromic liquid crystal structures of uniform size, regardless of their position within the pattern.

5. The skin examination device according to claim 1, wherein, The captured images show that the thermochromic liquid crystal structures have a uniform shape, regardless of their position within the pattern.

6. The skin examination device according to claim 1, wherein, The captured images show that the thermochromic liquid crystal structures have a uniform angle, regardless of their position within the pattern.

7. The skin examination device according to claim 1, wherein, The geometry of the thermochromic liquid crystal structure is adjusted to match one or more parameters of a specific wide-angle lens, wherein one or more parameters of the wide-angle lens include focal length or field of view.

8. The skin examination device according to claim 1, wherein, The geometry of the thermochromic liquid crystal structure is adjusted to match one or more parameters of a specific image sensor, wherein the one or more parameters of the specific image sensor include resolution or aspect ratio.

9. The skin examination device according to claim 1, wherein, The thermochromic liquid crystal structure extends radially from the center point of the pattern, and the further the thermochromic liquid crystal structure is from the center point, the higher the degree of distortion of the thermochromic liquid crystal structure.

10. The skin examination device according to claim 9, wherein, The twist angle of the distorted thermochromic liquid crystal structure increases as the thermochromic liquid crystal structure moves further away from the center point.

11. The skin examination device according to claim 9, wherein, The size of the distorted thermochromic liquid crystal structure increases as it moves further away from the center point.

12. A method for identifying skin abnormalities, the method comprising: Provides a transparent panel with an inspection area; An array of thermochromic liquid crystal structures is provided on the transparent panel, the thermochromic liquid crystal structures being able to change color in response to temperature changes; as well as One or more image capturing devices are provided, the image capturing devices having a wide-angle lens for capturing images of an array of thermochromic liquid crystal structures located in an inspection area and the skin area of ​​a target; The array of thermochromic liquid crystal structures includes thermochromic liquid crystal structures with a twisted shape and thermochromic liquid crystal structures with a non-twisted shape. The pattern is defined by a thermochromic liquid crystal structure with a twisted shape and a thermochromic liquid crystal structure with an untwisted shape, wherein the amount of twist of the thermochromic liquid crystal structure with the twisted shape increases toward the periphery of the pattern, such that when viewed through the wide-angle lens, both the thermochromic liquid crystal structure with the twisted shape and the thermochromic liquid crystal structure with the untwisted shape appear untwisted.

13. The method according to claim 12, wherein, The shape and size of the thermochromic liquid crystal structure change relative to the center of the pattern, such that the thermochromic liquid crystal structure facing the periphery of the pattern is larger than the thermochromic liquid crystal structure adjacent to the center of the pattern.

14. The method according to claim 12, wherein, The twist angle of a thermochromic liquid crystal structure with a twisted shape varies as follows: the thermochromic liquid crystal structure facing the periphery of the pattern has a larger twist angle than the thermochromic liquid crystal structure at the center of the adjacent pattern.

15. The method according to claim 12, wherein, The captured images contain thermochromic liquid crystal structures of uniform size, regardless of their position within the pattern.

16. The method according to claim 12, wherein, The captured images show that the thermochromic liquid crystal structures have a uniform shape, regardless of their position within the pattern.

17. The method according to claim 12, wherein, The captured images show that the thermochromic liquid crystal structures have a uniform angle, regardless of their position within the pattern.

18. The method according to claim 12, wherein, The geometry of the thermochromic liquid crystal structure is adjusted to match one or more parameters of a specific wide-angle lens, wherein the one or more parameters include focal length and field of view.

19. The method according to claim 12, wherein, The geometry of the thermochromic liquid crystal structure is adjusted to match one or more parameters of a specific image sensor, wherein the one or more parameters include resolution and aspect ratio.

20. The method according to claim 12, wherein, The thermochromic liquid crystal structure extends radially from the center point of the pattern, and the further the thermochromic liquid crystal structure is from the center point, the higher the degree of distortion of the thermochromic liquid crystal structure.

21. The method according to claim 20, wherein, The twist angle of the distorted thermochromic liquid crystal structure increases as the thermochromic liquid crystal structure moves further away from the center point.

22. The method according to claim 20, wherein, The size of the distorted thermochromic liquid crystal structure increases as it moves further away from the center point.

Images