Supporting body with chart and color drift detection system
The charted support system with integrated color charts addresses color shift issues in medical specimen imaging by detecting and correcting color inconsistencies, ensuring accurate image analysis.
Patent Information
- Application Number
- JP2023084836
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-23
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional methods for scanning large numbers of medical specimens face issues with sudden color shifts in images due to foreign substances, optical system changes, or operator errors, making it difficult to detect and correct color inconsistencies.
A charted support system with a color chart having specific color information and gamut information, integrated with a photographing device, allows for the detection of color shifts by comparing actual image colors against predefined standards.
The system effectively detects and alerts users to color shifts, ensuring accurate image analysis by maintaining consistent color representation across multiple scans.
Smart Images

Figure 2024168289000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a chart-bearing support and a color shift detection system. [Background technology]
[0002] In the field of pathology, medical specimens such as tissues and cells have been examined. In this case, the medical specimens are stained with a staining agent. The stained medical specimens are then observed to diagnose diseases.
[0003] The stained medical specimens may be digitally imaged. A large number of medical specimens may be scanned at once using a scanner or the like. However, while scanning a large number of medical specimens at once, a sudden color shift may occur in the scanned image. This may be due to the influence of foreign matter such as dust, a sudden change in the optical system of the scanner, or deterioration of the color chip. Alternatively, it may be due to a sudden change in the light receiving device such as a CCD camera that captures the medical specimen, or an operator's mistake. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2004 / 044639 Summary of the Invention [Problem to be solved by the invention]
[0005] The present disclosure provides a chart-attached support and a color shift detection system that can easily detect the occurrence of color shift in a read image. [Means for solving the problem]
[0006] The embodiments of the present disclosure relate to the following [1] to [6].
[0007] [1] A support with a chart for observing medical specimens, comprising a support and a color chart located in a position visible from at least one side of the support, the color chart including patches having colors within a certain color gamut, color information relating to the colors represented by the patches, and color gamut information relating to the color gamut.
[0008] [2] The support with a chart according to [1], wherein a plurality of color charts are present on the surface of the support, and the plurality of color charts are arranged repeatedly.
[0009] [3] The support with a chart according to [1] or [2], wherein the minimum diameter of the patch is 1 μm or more and 1000 μm or less.
[0010] [4] A support with a chart for observing a medical specimen, comprising a support, a movable part that is movable relatively to the support, and a color chart positioned on the movable part.
[0011] [5] A color shift detection system comprising: an imaging device that images a chart-attached support described in any one of [1] to [3]; and a processing device that processes an image sent from the imaging device, wherein the processing device detects color shift in the image based on the color information and the color gamut information.
[0012] [6] A color shift detection system comprising: an image capturing device that captures an image of a support with a chart described in any one of [1] to [3]; and an image processing server that processes an image sent from the image capturing device via a processing device, wherein the image processing server detects color shift in the image based on the color information and the color gamut information. Effect of the Invention
[0013] According to this embodiment, it is possible to easily detect the occurrence of color shift in a read image. [Brief description of the drawings]
[0014] [Figure 1] FIG. 1 is a plan view showing a chart-attached support according to a first embodiment. [Diagram 2] 2(A) and (B) are plan views showing a color chart according to a modified example of the first embodiment. [Diagram 3] 3(A) to 3(C) are plan views showing color charts according to modified examples of the first embodiment. [Figure 4] FIG. 4 is a plan view showing a chart-affixed support according to a modification of the first embodiment. [Diagram 5] 5(A) to 5(C) are plan views showing a chart-attached support according to a modification of the first embodiment. [Figure 6] 6(A) and (B) are plan views showing a chart-attached support according to a modification of the first embodiment. [Figure 7] FIG. 7 is a diagram showing a color shift detection system and a color shift detection method according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing a color shift detection system and a color shift detection method according to a modified example of the first embodiment. [Figure 9] FIG. 9 is a perspective view showing a chart-bearing support according to the second embodiment. [Figure 10] 10(A) and (B) are perspective views showing a chart-affixed support according to a modification of the second embodiment. [Figure 11] FIG. 11 is a perspective view showing a chart-affixed support according to a modification of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Each embodiment will be specifically described below with reference to the drawings. Each of the figures shown below is a schematic illustration. Therefore, the size and shape of each part are appropriately exaggerated to facilitate understanding. In addition, it is possible to carry out appropriate modifications within the scope of the technical idea. In each of the figures shown below, the same parts are given the same reference numerals, and some detailed explanations may be omitted. In addition, the numerical values such as dimensions of each member and the material names described in this specification are examples of embodiments, and are not limited to these, and can be appropriately selected and used. In this specification, terms that specify shapes and geometric conditions, such as parallel, orthogonal, and vertical, include substantially the same state in addition to their strict meanings.
[0016] (First embodiment) A first embodiment will be described with reference to the drawings. Figures 1 to 8 are diagrams showing the first embodiment.
[0017] (Structure of support with chart) The chart-attached support according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a schematic plan view showing an example of the chart-attached support according to this embodiment.
[0018] The chart-attached support 10 according to this embodiment is used when observing a medical specimen S. The chart-attached support 10 may be used when capturing a digital image of a medical specimen S such as cells using an imaging device such as a microscope or a slide glass scanner. In this case, the chart-attached support 10 may be integrated with the medical specimen S. The chart-attached support 10 integrated with the medical specimen S is read by the imaging device. In this case, the chart-attached support 10 may be read by a partial imaging method or a total imaging method. The partial imaging method refers to partially imaging one field of the medical specimen S by the imaging device. The total imaging method refers to imaging the entire or most part of the medical specimen S by connecting divided images or continuously reading them with a line scanner.
[0019] Regardless of whether a partial or full-body imaging method is used, the medical specimen S is often stained to determine its condition. The medical specimen S may be a stained tissue, cell, or other medical specimen. Examples of staining the medical specimen S include hematoxylin-eosin (HE) staining, Papanicolaou staining, Giemsa staining, PAS staining, Gram staining, Grocott staining, and Wright staining. Of these, hematoxylin-eosin (HE) staining is the most commonly used. Hematoxylin solution is blue-purple and stains cell nuclei and ribosomes blue-purple. Eosin solution is red and stains cytoplasm, intercellular connective tissue, fibers, red blood cells, and the like red or purple. As a result, the cell nuclei, cytoplasm, bone tissue, connective tissue of soft tissue, red blood cells, fibrous tissue, endocrine granules, and the like contained in the medical specimen S are stained.
[0020] As described above, the chart-attached support 10 according to this embodiment is used when observing a medical sample S. The chart-attached support 10 comprises a support 11 and a color chart 20. The color chart 20 is present at a position visible from at least one side of the support 11. The color chart 20 includes a patch 21, color information 22, and color gamut information 23. The patch 21 has a color within a certain color gamut. The color information 22 includes information about the color represented by the patch 21. The color gamut information 23 includes information about the color gamut of the patch 21.
[0021] The patch 21 of the color chart 20 may have a color close to the color of the stained medical specimen S. By making the color of the patch 21 close to the characteristic color of the stained medical specimen S, the color shift of the imaging device can be accurately detected using the chart-attached support 10. That is, in this embodiment, the color chart 20 does not necessarily have to have patches of various colors. It is preferable that the color chart 20 has patches 21 of a color suitable for HE staining, for example. Specifically, the patch 21 may have a color within the color gamut of HE staining or located on the border of the color gamut of HE staining. This makes it possible to find color shifts in the image of the medical specimen S in the color gamut specific to HE staining without making the area of the patch 21 too large. This makes it possible to ensure the area of the medical specimen S integrated with the chart-attached support 10.
[0022] It is preferable that the color chart 20 is provided for each medical specimen S to be scanned. In other words, it is preferable that the color chart 20 is provided for each of the multiple supports 11 to be scanned. By providing the minimum number of color charts 20 for each medical specimen S, abnormalities in the captured images can be detected one by one. Furthermore, even if the captured image cannot be re-captured, color correction information can be provided based on a small number of color charts 20.
[0023] The support 11 is capable of supporting the color chart 20. When the color chart 20 is read in a transmission manner, the support 11 may be a transparent substrate having optical transparency. When the color chart 20 is read in a reflection manner, the support 11 may be an opaque substrate having no optical transparency. The support 11 may be an inorganic substrate such as a glass substrate or a resin substrate. The resin substrate may be a plate-shaped one or a film or sheet.
[0024] The support 11 may be a glass slide used for observation with a pathological imaging device such as a microscope. The support 11, which is a glass slide, may be provided with a specimen support area SA for supporting the medical specimen S. The color chart 20, the medical specimen S, and the specimen support area SA may be covered with a cover glass (not shown). The color chart 20 may be located on the surface of the glass slide, or may be located inside the glass slide. By placing the color chart 20 on the glass slide, the positional relationship between the medical specimen S and the color chart 20 can be easily specified when preparing the medical specimen S. The color chart 20 may be located on the same surface as the surface of the glass slide on which the medical specimen S is placed. In this case, the distance between the medical specimen S and the color chart 20 in the optical axis direction of the pathological imaging device can be reduced. Therefore, it is easy to focus the medical specimen S and the color chart 20, especially when viewing the medical specimen S at a high magnification.
[0025] Alternatively, the support 10 with the chart may be provided separately from the slide glass that supports the medical specimen S. In this case, the support 11 may be a cover glass that covers the medical specimen S. In this case, since the support 10 with the chart is not covered by the cover glass, the influence of dirt or scratches on the cover glass on the color chart 20 is suppressed. In addition, the color of the color chart 20 can be suppressed from changing due to being covered by the cover glass. The color chart 20 may be located on the surface of the cover glass or inside the cover glass. By arranging the color chart 20 on the cover glass, the distance between the medical specimen S and the color chart 20 in the optical axis direction of the pathological imaging device can be reduced. Therefore, it is easy to focus the medical specimen S and the color chart 20, especially when viewing the medical specimen S at a high magnification.
[0026] As described above, the color chart 20 includes the patch 21, the color information 22, and the color gamut information 23. The color information 22 and the color gamut information 23 may be disposed adjacent to the patch 21.
[0027] The color chart 20 includes one or more patches 21. The color chart 20 may include a plurality of patches 21. The patches 21 have colors within a certain color gamut. It is desirable that each patch 21 is manufactured at a level where color differences cannot be detected. However, in reality, the patches 21 are often manufactured with a certain range of width within a predetermined color gamut. This is because there are restrictions on the color materials for manufacturing the patches 21, the size of the patches 21, the cost of the patches 21, and the like. The patches 21 according to this embodiment are manufactured in a state where they satisfy color information 22 and color gamut information 23 described later. For example, in the example shown in FIG. 1, the color chart 20 includes two patches 21. The two patches 21 have colors different from each other. When the color chart 20 includes a plurality of patches 21, even if some of the patches 21 cannot be seen due to dirt or the like, color shifts can be confirmed by using only the visible patches 21.
[0028] In the case of a transmissive color chart 20, the patch 21 may be generated by a conventional method such as a deposition method, a dyeing method, a printing method, an inkjet method, or a color filter method. The patch 21 may have a color composed of values of red, green, and blue when calculated based on a D65 light source in the color gamut of sRGB (an international standard established by the International Electrotechnical Commission (IEC)). In this case, the brightness / saturation / hue, etc. of the patch 21 are specified. The patch 21 may have an achromatic white or gray color. In this case, the brightness, etc. of the patch 21 are specified. The color gamut of the patch 21 may be within a range that is generally used, such as AdobeRGB or BT.2020. A microspectrometer is used as a method for measuring the color of the patch 21. This enables spectrum measurement of the patch 21 in a small area.
[0029] In the case of a reflective color chart 20, the patch 21 may be formed by overlaying the same transmissive color material as above on a base member. In this case, an achromatic white material may be used for the base member. The white material may be, for example, a commonly used white paint such as barium sulfate, alumina, magnesium oxide, sodium chloride, polytetrafluoroethylene, etc. In this case, it is desirable that the achromatic white material has a constant reflection spectrum from low wavelengths to long wavelengths in visible light. White glass may be used as the base member. The base member may be made by placing the above-mentioned transmissive patch 21 on acrylic resin, paper, etc.
[0030] When measuring the color of the patch 21, it is desirable to measure the white material of the base member having a size of 5 mm square or more on the support 11 in advance using a reflection type spectrometer. Since the patch 21 is minute in size, it is measured using a microspectrometer. The measurement value of the base member having a size of 5 mm square or more that has been measured in advance is used as a reference, and the reflectance ratio of the white material is calibrated using the microspectrometer, so that the measurement value of the patch 21 can be reproduced with high accuracy.
[0031] In Fig. 1, the planar shape of the patch 21 is a rectangle, but the planar shape of the patch 21 may be a circle or a polygon. If the image captured by the imaging device is the entire chart-attached support 10, the planar shape of the patch 21 may be a polygon that does not interfere with the imaging of the medical sample S. If the image captured by the imaging device is a portion of the chart-attached support 10, this image may be captured with a rectangular field of view. For this reason, the planar shape of the patch 21 may be a rectangle that is easy to place at the four corners of the field of view.
[0032] The minimum diameter of the patch 21 may be 1 μm or more, or may be 10 μm or more. The minimum diameter of the patch 21 may be 1000 μm or less, 200 μm or less, or 20 μm or less. Here, the minimum diameter of the patch 21 refers to the diameter of the largest circle that can be entirely contained within the patch 21 in a planar view. When the patch 21 is a square in a planar view, the minimum diameter of the patch 21 is the length of one side of the patch 21. When the patch 21 is a rectangle in a planar view, the minimum diameter of the patch 21 is the length of the short side of the patch 21. When the patch 21 is a circle in a planar view, the minimum diameter of the patch 21 is the diameter of the patch 21.
[0033] Since the minimum diameter of the patch 21 is 1 μm or more and 1000 μm or less, the color chart 20 can be easily photographed even when only a portion of the medical sample S centered on the medical sample S is scanned when photographing the medical sample S.
[0034] More specifically, by making the minimum diameter of the patch 21 1 μm or more, it is possible to suppress the difficulty in detecting color shift when the magnification is adjusted to, for example, cells and their aggregates, which are the medical specimen S. Assume that the patch 21 is photographed together with the medical specimen S through an imaging device such as a microscope. In this case, if the patch 21 is extremely smaller than the medical specimen S to be observed, it may not be possible to assign pixels or dots of sufficient size to the patch 21 portion of the image photographed through the imaging device. For example, even if the image of the medical specimen S has a width of several tens of dots, the image of the patch 21 may have a width of several dots. In this case, there is a risk that the RGB values of the image of the patch 21 alone will be mixed with the RGB values of its surrounding parts. For this reason, it is desirable that the patch 21 is as large as or larger than the observation target.
[0035] Generally, when observing cells for pathological diagnosis, etc., the cells are often stained and observed. Examples of observation objects include epithelial cells (generally 15 μm to 60 μm), endothelial cells (generally 10 μm to 50 μm), muscle cells (generally 50 μm to 100 μm), fat cells (generally 70 μm to 90 μm), white blood cells (generally 6 μm to 30 μm), red blood cells (generally 2 μm to 3 μm), tumor cells (generally 20 μm), and the like. Consider photographing these cells simultaneously with the patch 21. In this case, if the patch 21 is about the same size as the smallest cell, when photographing the small cell, it is possible to photograph only a part of the support 11 rather than scanning the entire support 11. In this case, considering that one small cell is captured within the field of view of the photograph, if the minimum diameter of the patch 21 is about the same as or about half the size of the cell, there is a high possibility that the patch 21 can be photographed simultaneously with the cell. For this reason, it is desirable that the minimum diameter of the patch 21 is 1 μm or more. Furthermore, in general, a support 11 such as a slide glass is used to observe slices of tissue, and white blood cells, red blood cells, etc. are rarely observed. For this reason, it is desirable that the minimum diameter of the patch 21 is 10 μm or more, which corresponds to the size of about one cell in the tissue slice.
[0036] Furthermore, by making the minimum diameter of the patch 21 1000 μm or less, the possibility of impeding imaging of the medical specimen S when reading the medical specimen S with an imaging device such as a microscope or slide scanner can be reduced.
[0037] Generally, when observing cells using an imaging device such as a microscope or a slide scanner, rather than observing only one cell using a high-magnification objective lens, a low-magnification objective lens may be used. This allows the shape of each cell to be confirmed and allows a certain cell tissue to be captured within the field of view. In this case, it is desirable to simultaneously see a certain tissue, which is a group of cells, and a group of patches 21, for example, two patches 21 (see Figure 1), in one field of view.
[0038] For example, let us assume that a 10x objective lens is used as a low-magnification objective lens when observing a medical specimen S. If the patch 21 is large enough not to obstruct the field of view for observing cells, the patch 21 is considered to be at most about half the size of the entire field of view. Also, most general eyepieces have a field number (FN) of about 22. For this reason, the range to be observed is as follows: Field of view = eyepiece field number / objective lens magnification =22 / 10 =2.2mm=2200μm Considering the case where the cells to be observed are photographed in more than half of the field of view and several patches are arranged in a part of the field of view, the minimum diameter of the patch 21 is at least 1000 μm or less, which is about half the field of view. The minimum diameter of the patch 21 is such that the medical specimen S occupies most of the field of view but the patch 21 can be confirmed, and may be 200 μm or less, which is about 1 / 10 of the field of view.
[0039] As described above, each cell has a size of several μm to about 100 μm. For example, when observing epithelial tissue, the cells are often observed at a magnification that allows several uneven parts such as columnar epithelium and squamous epithelium to be included in the field of view, along with cells of about several tens of μm each. The size of the uneven parts of columnar epithelium and squamous epithelium is about 200 μm. Therefore, the minimum diameter of the patch 21 may be 1000 μm or less, which is the same as that of multiple uneven parts. The minimum diameter of the patch 21 may be 200 μm or less, which is the same as that of one uneven part. It is more preferable that the minimum diameter of the patch 21 is 20 μm or less, which corresponds to about 1 / 10 of the uneven part in a field of view centered on the uneven part.
[0040] The color information 22 includes information on the color represented by the patch 21. The color information 22 is information on the color inherent to the patch 21. The color information 22 may be information indicating the reference of the color of the patch 21. The color information 22 may be a specific numerical value in a predetermined color space. The color space may be, for example, the Lab color system. The Lab color system may be, for example, the Hunter 1948 L,a,b color space color system or the (L*,a*,b*) color space color system of the CIE 1976 standard. The color information 22 may be described in a state that can be recognized by humans. The color information 22 may be a pattern formed by printing or the like as readable information such as various characters. Alternatively, the color information 22 may be a pattern formed by printing or the like as an identifier such as a code, a symbol, or a picture. The color information 22 does not need to describe all of the color information of the patch 21. For example, details of the color inherent to the patch 21 may be registered separately in a database or the like. In this case, the photographing device can automatically recognize the color information 22. For example, in the example shown in FIG. 1, the letters "P" and "LP" are written as the color information 22 corresponding to the two patches 21, respectively. The letter "P" means purple. The letters "LP" mean light purple. Detailed information on the colors indicated by "P" and "LP" may be registered separately in a database or the like. By using letters or symbols as the color information 22, the area in which the color information 22 is arranged can be reduced and it is easier for humans to understand.
[0041] The color gamut information 23 includes information about the color gamut of the patch 21. The color gamut information 23 indicates information about the allowable range of the color information 22, i.e., the color of the patch 21. In other words, the color gamut information 23 indicates the allowable variation range of the color information 22. The color gamut information 23 may be an independent range for each axis in a predetermined color space. Alternatively, the color gamut information 23 may be a specific area (for example, within a sphere in a three-dimensional space) expressed by a combination of multiple axes in a predetermined color space. The color space may be, for example, the Lab color system. The Lab color system may be, for example, the Hunter 1948 L, a, b color space color system or the (L*, a*, b*) color space color system of the CIE 1976 standard. The color gamut information 23 may be written in a state that can be recognized by humans. The color gamut information 23 may be a pattern formed by printing or the like as readable information such as various characters. Alternatively, the color gamut information 23 may be a pattern formed by printing or the like as an identifier such as a code, symbol, or picture. The color gamut information 23 does not need to include all of the information about the color gamut of the patch 21. For example, information about the allowable range of the color inherent to the patch 21 may be separately registered in a database or the like. In this case, the photographing device can automatically recognize the color gamut information 23. For example, in the example shown in FIG. 1, the numerical value "+1" is included as the color gamut information 23 corresponding to each of the two patches 21. "+1" means that the color difference ΔE is acceptable if it is within +1. By using numerical values such as color difference as the color gamut information 23, the area in which the color gamut information 23 is arranged can be reduced and it is easy for humans to understand.
[0042] The color gamut information 23 may be information indicating that the color difference ΔE is within a certain numerical range with respect to the reference value indicated in the color information 22, as described above. In this case, the color gamut information 23 may be information indicating that the color difference ΔE is within a certain positive value. Alternatively, the color gamut information 23 may be information indicating that, for example, the L value, the a value, or the b value of the Lab color system is within a certain numerical range with respect to the reference value indicated in the color information 22. In this case, the color gamut information 23 may be information indicating that the L value, the a value, or the b value is within a certain positive or negative value with respect to the reference value. For example, the color gamut information 23 may be a description of a range that is symmetrical in positive and negative, such as "±1", "±3", or "-1 to +1". Alternatively, the color gamut information 23 may be a description of a range that is asymmetrical in positive and negative, such as "-1 to +2". When the (L*, a*, b*) color space color system of the CIE 1976 standard is used as the Lab color system, the color gamut information 23 may be information indicating that the L* value, the a* value, or the b* value is within a certain numerical range with respect to the reference value indicated in the color information 22. Alternatively, the sign of the color gamut information 23 may be omitted in the case of a positive value. By omitting the sign, the area in which the color gamut information 23 is arranged can be reduced.
[0043] The color information 22 and color gamut information 23 of the color chart 20 may be located near the patch 21. The color information 22 and color gamut information 23 of the color chart 20 may be arranged along one side of the patch 21. Specifically, the color information 22 and color gamut information 23 of the color chart 20 may be located above the patch 21. By arranging the color information 22 and color gamut information 23 corresponding to the patch 21 near the patch 21, the correspondence between the patch 21 and the color information 22 and color gamut information 23 becomes clear. Note that being located "above," "below," "left," or "right" with respect to the patch 21 refers to "above," "below," "left," or "right" based on the direction in which the medical sample S is observed.
[0044] 1, the color chart 20 is placed near the medical sample S or the sample support area SA. The color chart 20 may be placed inside the sample support area SA or outside the sample support area SA. The color chart 20 may be present in the observation range when observing with a pathological imaging device such as a microscope. The color chart 20 is preferably placed in an area that does not overlap with the medical sample S.
[0045] 2(A)(B) and 3(A)-(C) show various modified examples of the color chart 20. FIG.
[0046] As shown in FIG. 2A, the color information 22 and the color gamut information 23 of the color chart 20 may be displayed as barcodes. In FIG. 2A, the color information 22 shows an example in which the L value, a value, and b value of the Lab color system are "33.65, 00.73, -0.832" and "83.56, 00.10, -0.024", respectively. In FIG. 2A, the color gamut information 23 shows an example in which the color difference ΔE is "within +1". In FIG. 2A, the color information 22 and the color gamut information 23 are displayed as barcodes according to the CODE39 standard defined in JIS X 0503. However, the color information 22 and the color gamut information 23 may be barcodes or two-dimensional codes according to other standards, or may use a unique code system. According to this modification, the color information 22 and the color gamut information 23 can be easily automatically recognized. Furthermore, by including a check digit or the like in the barcode, it is possible to prevent the color information 22 and the color gamut information 23 from becoming unrecognizable due to dirt or the like.
[0047] As shown in FIG. 2B, the color information 22 and color gamut information 23 of the color chart 20 may each be represented by a plurality of dots. In FIG. 2B, the color information 22 and color gamut information 23 are each represented by two types of dots, white and black. Specifically, the color information 22 and color gamut information 23 located on the left side of FIG. 2B are represented by four dots, "black, white, white, white". The dots "black, white, white, white" may mean, for example, that the L value, a value, and b value of the Lab color system are "33.65, 00.73, -0.832" and the color difference ΔE is "within +1". This information may be separately registered in a database or the like. Similarly, the color information 22 and color gamut information 23 located on the right side of FIG. 2B are represented by four dots, "white, black, white, white". The "white, black, white, white" dots may mean, for example, that the L, a, and b values of the Lab color system are "83.56, 00.10, -0.024" and that the color difference ΔE is "within +1". This information may be registered in a separate database or the like. In FIG. 2B, for example, a white dot may be defined as "0" and a black dot as "1". In this case, each dot may be converted to "0" or "1" using image recognition. According to this modified example, the color information 22 and color gamut information 23 can be expressed by arranging at least one dot (1 bit). Therefore, the area in which the color information 22 and color gamut information 23 are arranged can be narrowed. Furthermore, by using N white or black dots, 2 N It is possible to express three kinds of color information 22 and color gamut information 23. Furthermore, by using three or more colors, such as white, gray, and black, for each dot, it is possible to express more color information 22 and color gamut information 23 in a small area.
[0048] 3A, the color information 22 and the color gamut information 23 of the color chart 20 may be located at positions facing each other with the patch 21 in between. Specifically, the color information 22 of the color chart 20 is located above the patch 21, and the color gamut information 23 is located below the patch 21. In this case, since each patch 21 is sandwiched between the corresponding color information 22 and color gamut information 23, the correspondence between the patch 21 and the color information 22 and color gamut information 23 becomes clear. Note that the color information 22 may be located below the patch 21, and the color gamut information 23 may be located above the patch 21.
[0049] 3B, the color information 22 and the color gamut information 23 of the color chart 20 may be arranged side by side along one side of the patch 21. Specifically, the color information 22 and the color gamut information 23 may be located below the patch 21.
[0050] 3C, the color information 22 and the color gamut information 23 of the color chart 20 may each be arranged along one side of the patch 21. Specifically, the color information 22 and the color gamut information 23 may each be located on the right side of the patch 21. Alternatively, the color information 22 and the color gamut information 23 may each be located on the left side of the patch 21.
[0051] 4, 5(A)-(C), and 6(A) and (B) show various modified examples of the chart-bearing support 10 and the color chart 20. In FIG.
[0052] As shown in FIG. 4, the color chart 20 has a plurality of patches 21, and the plurality of patches 21 may be arranged at positions facing each other with respect to the medical sample S. For example, the plurality of patches 21 may be arranged along some of the four corners of the sample support area SA. In FIG. 4, the color information 22 of the color chart 20 is located above the patch 21, and the color gamut information 23 is located to the left or right of the patch 21. That is, the color information 22 and the color gamut information 23 of the color chart 20 are each arranged on the far side with respect to the medical sample S. In this case, the medical sample S is prevented from overlapping with the color chart 20, and it is possible to prevent the medical sample S and the color chart 20 from becoming difficult to recognize.
[0053] As shown in FIG. 5(A), the patch 21 of the color chart 20 may be disposed near the medical sample S, and the color information 22 and color gamut information 23 may be disposed away from the medical sample S. Specifically, the color information 22 and color gamut information 23 may be disposed away from the corresponding patch 21 by more than twice the minimum diameter of the patch 21. When there are multiple patches 21, it is preferable that the positional relationship between the multiple patches 21 and the positional relationship between the corresponding color information 22 and color gamut information 23 are the same. For example, in FIG. 5(A), the patch 21 on the left (right) side corresponds to the color information 22 and color gamut information 23 on the left (right). In addition, it is preferable that the size of the color information 22 and color gamut information 23 is larger than the size of the patch 21. Specifically, it is preferable that the width of one character included in the color information 22 and color gamut information 23 is larger than the minimum diameter of the patch 21. According to this modification, even if the size of the patch 21 is small, the color information 22 and the color gamut information 23 are large, so that the color information 22 and the color gamut information 23 are easily recognized by the naked eye. In addition, since the color information 22 and the color gamut information 23 are not arranged in the vicinity of the patch 21, the size of the patch 21 can be reduced.
[0054] 5(B), the patch 21 of the color chart 20 may be placed near the medical sample S, and the color information 22 and the color gamut information 23 may be placed away from the medical sample S. Furthermore, an additional patch 21L obtained by enlarging the patch 21 may be placed near the color information 22 and the color gamut information 23. Specifically, the additional patch 21L may be placed away from the corresponding patch 21 by more than twice the minimum diameter of the patch 21. In this case, the additional patch 21L, in addition to the color information 22 and the color gamut information 23, is easily recognized by the naked eye.
[0055] As shown in FIG. 5C, the patch 21, the color information 22, and the color gamut information 23 of the color chart 20 may be arranged near the medical sample S, and the additional patch 21L, the additional color information 22L, and the additional color gamut information 23L may be arranged away from the medical sample S. Specifically, the additional patch 21L, the additional color information 22L, and the additional color gamut information 23L may be arranged away from the corresponding patch 21 by more than twice the minimum diameter of the patch 21. In this case, the additional patch 21L, the additional color information 22L, and the additional color gamut information 23L are easily recognized by the naked eye. Even if the patch 21, the color information 22, or the color gamut information 23 becomes unrecognizable due to dirt or the like, the information can be recognized by the additional patch 21L, the additional color information 22L, or the additional color gamut information 23L.
[0056] As shown in FIG. 6(A), the chart-attached support 10 may have a plurality of color charts 20. The plurality of color charts 20 include patches 21 having the same color. The plurality of color charts 20 are arranged repeatedly. In FIG. 6, each color chart 20 includes two patches 21. Two color charts 20 are arranged at each of the four corners of the specimen support area SA. A color chart 20 larger than the color chart 20 in the specimen support area SA is arranged near the corner of the support 11. In this case, when photographing the medical specimen S, even if the entire surface of the support 11 is not scanned but a part centered on the medical specimen S is scanned, the color chart 20 can be easily photographed. That is, by arranging a plurality of patches 21 around the medical specimen S, the possibility of the patch 21 being photographed can be increased regardless of the photographing location. In addition, the patch 21 can also serve as a guide, making it easier to find the medical specimen S when photographing the medical specimen S. In addition, when there are a plurality of medical specimens S, it is easy to identify which medical specimen S is being observed. If the medical specimen S is small, moving the medical specimen S closer to the color chart 20 will make it easier to fit the patch 21 adjacent to the medical specimen S within the field of view and digital image.
[0057] As shown in FIG. 6(B), the chart-attached support 10 may have a plurality of color charts 20A, 20B, and 20C. The color charts 20A, 20B, and 20C each include two patches 21A, 21B, and 21C. The color combinations of the patches 21A, 21B, and 21C are the same as each other. The plurality of color charts 20A, 20B, and 20C are repeatedly arranged. In FIG. 6, the patches 21A, 21B, and 21C have different widths. The patch 21A is the narrowest, the patch 21B is the second narrowest, and the patch 21C is the widest. The widths of the patches 21A, 21B, and 21C may serve as a scale. For example, when the long side of the patch 21A is 0.4 mm, the long side of the patch 21B may be 0.8 mm, and the long side of the patch 21C may be 1.2 mm. According to this modification, when the medical sample S is observed, the length of a predetermined portion of the medical sample S can be easily measured based on the widths of the patches 21A, 21B, and 21C.
[0058] (Color shift detection system and processing performed in the color shift detection system) Next, a color shift detection system and a color shift detection method according to the present embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing a color shift detection system 50 and a color shift detection process performed by the color shift detection system 50 according to the present embodiment.
[0059] As shown in FIG. 7, the color shift detection system 50 includes an image capture device 51 and a processing device 52 that processes images sent from the image capture device 51. Examples of the image capture device 51 include a scanner such as a slide scanner, a camera, a microscope, a mobile device, and the like. The image capture device 51 may be a pathology image capture device used exclusively for capturing images of medical specimens. The image capture device 51 may be a general image capture device used for capturing images of objects other than medical specimens. The processing device 52 may be a computer configured separately from the image capture device 51, or may be a control computer that controls the image capture device 51 such as a scanner.
[0060] [Preparation (Generate color conversion information)] <1: Loading the reference chart> Before the actual color shift detection process is performed, a reference chart (not shown) is loaded into the photographing device 51 as a preliminary preparation. The reference chart includes patches colored in colors such as RGB and CMYK. It is assumed that the correct color information of the patches of the reference chart is known in advance in the Lab color system or the XYZ color system. Specifically, the correct color information of the patches is obtained in advance by actually measuring the patches of the reference chart using, for example, a colorimeter.
[0061] Next, the reference chart is read by the target photographing device 51 to create a calibration digital image file. The calibration digital image file contains the colors of the patches of the reference chart as RGB values. The RGB values are output from the photographing device 51 to the processing device 52.
[0062] <2: Conversion to color management space> Next, the processing device 52 converts the RGB values of the reference chart into a color management space. Here, the color management space refers to an intermediate space that handles correct color information independent of the device used when measuring colors with a calibrated colorimeter or the like. The color management space may also be called a profile space or a color conversion space. Here, an example is shown in which the Lab color system is used as the color management space. In general, the Lab color system is characterized by being a uniform color space, and since color differences can be expressed as distances as color differences, it is one of the coordinate systems that are effective when adjusting colors.
[0063] In this case, the processing device 52 first converts the RGB values of the reference chart described above into values of the XYZ color system according to, for example, the international standard ITU-R BT.709. Next, the processing device 52 converts the unit system of the XYZ color system values into the Lab color system according to, for example, (L*, a*, b*) of the CIE 1976 standard. When the Lab color system is used, the color difference can be expressed as a distance as a color difference as described above. Therefore, it is a color system suitable for detecting color shifts and correcting colors. On the other hand, the Lab color system changes values when the reference white light source is changed, but the XYZ color system does not change values. Therefore, it is preferable to convert the unit system into the Lab color system via the XYZ color system. In this embodiment, either the D65 light source or the D50 light source may be used as the reference white light source. Note that when the reference white light source is changed, a conversion process is performed to perform a calculation so that the Lab color system of the original reference white light source is obtained. In this way, the RGB values of the reference chart are mapped onto the color management space as Lab values. The processing device 52 may have such conversion processing for mapping onto the color management space stored in advance as a function, or may have the calculation results stored as a table, as described later.
[0064] The Lab values of the reference chart converted into the color management space are often different from the original Lab values. This is because there is a bias in the image capture device 51 such as a scanner. For example, the L value of the reference chart output by the image capture device 51 may deviate from the L value of the original reference chart. Taking this deviation into account, the color of the medical specimen S to be read in thereafter is corrected. For example, the reference color of the reference chart is black, and the Lab values of the reference color are L value=0, a value=0, and b value=0. Also, the Lab values of the reference chart read in by the image capture device 51 are, for example, L value=5, a value=0, and b value=0. In this case, there is no deviation in the a value and b value indicating the color tone, and correction is not necessary. On the other hand, the L value is 5, whereas the original value should be 0. Therefore, a correction process for correcting this is defined. As a result, when an image of an actual medical specimen S is read in, it is possible to perform color conversion that suppresses the bias of the image capture device 51 by taking into account the difference obtained from the reference chart. The L value generally ranges from 0 to 100.
[0065] When the conversion process for mapping onto the color management space is defined as a function in advance, for example, it may be as follows. For example, in the above-mentioned example, if the L value read by the photographing device 51 is 0 or more and 5 or less, the L value in the color management space may be set to 0 (a constant value). For example, if the L value read by the photographing device 51 is 5, the L value in the color management space becomes 0. Also, for example, if the L value read by the photographing device 51 is 100, the L value in the color management space becomes 100. If the L value read by the photographing device 51 is 5 or more and 100 or less, it may be linearly converted so that the L value in the color management space becomes 0 or more and 100 or less. In addition, in the above example, the Lab value of the reference chart is decomposed, and the L value, a value, and b value are treated independently, and only the L value is converted, but this is not limited to the above. The Lab value may be regarded as a three-dimensional vector, and a composite conversion process or the like may be performed. Such a color conversion process method is not particularly limited. In either case, as described below, when a large number of images (e.g., 1000 or more) of the medical sample S are read by the imaging device 51, the images are processed by the above-mentioned conversion processing method. This allows the Lab values of the images of the medical sample S captured by the imaging device 51 to be corrected, and the Lab values of the original images of the medical sample S to be calculated.
[0066] When the calculation result of the conversion process for mapping onto the color management space is specified in advance as a table, for example, it may be as follows. In general, RGB values are discrete values from 0 to 255 in 8-bit, and from 0 to 65535 in 16-bit. For this reason, all patterns may be calculated in advance. For example, when the RGB value is 8-bit, if the RGB value is (200, 200, 200), the Lab value is (80.6, 0, 0), and if the RGB value is (201, 200, 200), the Lab value is (80.7, 0.4, 0.1). The processing device 52 may hold such calculation results as a reference table. In this case, the calculation of the Lab value is completed by selecting the Lab value corresponding to the RGB value.
[0067] <3: Basic conversion process> Next, in this embodiment, a basic conversion processing method will be described when the medical specimen S is photographed by the photographing device 51 and the photographed image of the medical specimen S is converted. This processing method is used when a large number of medical specimens S (e.g., 1000 or more sheets) are read by the photographing device 51 such as a scanner, and the images are corrected.
[0068] First, the medical sample S is photographed by the photographing device 51 .
[0069] Next, the processing device 52 stores the image of the medical sample S read by the imaging device 51 as an RGB value in an image file or the like (hereinafter referred to as a first process).
[0070] Next, the RGB values are converted into units in the color management space, for example, Lab values (hereinafter, referred to as the second process). This conversion process may be performed using the unit system conversion process described above, for example.
[0071] Next, the converted Lab values are corrected into a predetermined color management space (hereinafter, referred to as a third process).
[0072] The Lab values in the color management space corrected in this way are values that are processed so as not to depend on the characteristics of the device. The corrected values are easier to use if they are saved as an RGB value file in a database or the like. For this reason, they may be saved as an image file based on RGB values with meta-information or the like added to indicate that they are RGB values that conform to the color management space (hereinafter referred to as the fourth process).
[0073] When a saved image file is to be viewed on a specific display, the saved image file may be converted into an image file with RGB values that match the display. In this case, the image file with RGB values that conform to the color management space may be temporarily converted back to Lab values that conform to the color management space. Next, by using a separately defined correction process, the image file is converted into Lab values for the display that match the characteristics of the display in the Lab unit system, which is a color uniform space. After that, the Lab values for the display may be converted into an RGB value file having RGB values for the display by passing through the XYZ color system, etc., and used. In this way, color conversion is generally performed based on Lab values that can be interpreted as distance for color differences. In some cases, passing through the XYZ color system makes it easier to convert to digital files other than RGB values.
[0074] [Color shift detection method according to the present embodiment] Next, a method for detecting color shift in the medical sample S using the chart-affixed support 10 according to this embodiment will be described with reference to FIG.
[0075] First, an image of the medical specimen S is read by the photographing device 51. A large number of images of the medical specimen S (for example, 1000 or more) may be read. The image of the medical specimen S read by the photographing device 51 is sent to the processing device 52. The image of the medical specimen S read by the photographing device 51 may be sent to the processing device 52 via any communication means such as a wired or wireless LAN or the Internet, or a storage medium such as a USB memory.
[0076] Next, the processing device 52 checks whether or not the color chart 20 according to this embodiment is present in the image of the medical sample S (step S11 in FIG. 7). Note that if any of the patches 21, color information 22, and color gamut information 23 of the color chart 20 is missing or damaged, it is also considered that the color chart 20 does not exist.
[0077] If the color chart 20 does not exist, the first to fourth processes described above are sequentially performed (steps S12, S13, S14, and S15 in FIG. 7). At this time, the patient ID information corresponding to the medical specimen S may be linked to the image of the medical specimen S, etc., so that it is possible to store the medical specimen S in such a manner that it is possible to know which patient's pathological specimen it is.
[0078] <First color shift detection process> When the color chart 20 according to the present embodiment is present in the image of the medical sample S, a first color shift detection step is performed (step S16 in FIG. 7).
[0079] During this process, the processing device 52 first inspects the image of the color chart 20 sent from the photographing device 51. Next, the processing device 52 converts the color of the patch 21, which is an RGB value, into Lab value. A general color conversion method may be used for the color conversion at this time. Next, the processing device 52 issues an alert if the color of the patch 21 before color correction greatly exceeds the range based on the color information 22 and the color gamut information 23.
[0080] Specifically, the processing device 52 extracts the image portion of the patch 21 from, for example, the captured image data based on the shape of the patch 21, the arrangement of the color information 22 and the color gamut information 23, and calculates the RGB value of the patch 21. At this time, the processing device 52 extracts the image portion of the patch 21 from, for example, the captured image data based on the shape of the patch 21, the arrangement of the color information 22 and the color gamut information 23, and the like. Here, when the image portion is made up of a plurality of pixels, the RGB value of each pixel takes a value of 0 to 255 if it is, for example, 8 bits, but due to the influence of color unevenness of the patch 21, noise of the photographing device 51, and the like, it may not necessarily be the same value for all pixels. Therefore, when the color unevenness of the patch 21 or the noise of the photographing device 51 does not affect the RGB value, the RGB value of any pixel in the image portion of the patch 21 may be used as the RGB value of the patch 21. Also, when there is some degree of color unevenness of the patch 21 or noise of the photographing device 51, the average value of each RGB color in the RGB values of all pixels of the image of the patch 21 may be used as the RGB value of the patch 21. In addition, the most frequent value of each color in the RGB values of all pixels in the image of the patch 21 may be used as the RGB value of the patch 21. Since noise may easily occur in the outer periphery of the patch 21, the average value or the most frequent value of each RGB color in the pixels in the center may be used as the RGB value of the patch 21 by excluding a certain number of pixels in the outer periphery of the patch 21 that is set in advance. In addition, as shown in FIG. 6(A) and FIG. 6(B), when a plurality of patches 21 having the same color are arranged, the average value or the most frequent value of each RGB color in the pixels included in the image of the patch 21 in any one patch 21 may be used as the RGB value of the patch 21, or the average value or the most frequent value of each RGB color may be calculated across the images of the plurality of patches 21 and used as the RGB value of the patch 21. Note that the average value is not limited to an integer, but the average value may be used as it is as the RGB value of the patch 21, or the average value may be rounded off to an integer. In addition, the processing device 52 extracts the color information 22 and the color gamut information 23 and reads the identifier or the barcode. As a result, the processing device 52 reads out the color information 22 and the color gamut information 23. Next, the processing device 52 calculates provisional Lab values from the RGB values calculated from the patch 21.The provisional Lab value is a Lab value assumed to be obtained by converting the RGB value calculated from the patch 21 into a Lab value through XYZ values and then directly converting it into the color management space. The processing device 52 determines whether the difference between this provisional Lab value and the Lab value described in the color information 22 is within a preset threshold value (for example, color difference ΔE=10).
[0081] The processing device 52 judges that the difference is normal if it is within the threshold value. On the other hand, the processing device 52 displays or transmits an alert if the difference is equal to or greater than the threshold value. The alert may be displayed on a display or may be transmitted to a pre-set email address or server. The alert may be, for example, "color difference error before color correction." In this case, in addition to the alert, information such as the time when the alert occurred, the image file name, the image data ID, and / or the patient ID may be displayed or transmitted. When the color chart 20 includes two patches 21, an alert may be displayed or transmitted if the difference between both of the two patches 21 is equal to or greater than the threshold value. Alternatively, an alert may be displayed or transmitted if the difference between one of the two patches 21 is equal to or greater than the threshold value. In addition, when one of the two patches 21 cannot be determined due to dirt or the like, the determination may be made based only on the other patch 21.
[0082] <Second color shift detection process> If the first color shift detection process is normal, a second color shift detection process is carried out (step S17 in FIG. 7).
[0083] The second color shift detection process is a process performed when a plurality of images of the medical sample S are continuously sent under the same conditions. In this case, for example, due to the operation of an automatic color matching function of the imaging device 51, the color of only one image of the read medical sample S may change significantly. In such a case, the processing device 52 issues an alert if the color of the patch 21 before color correction is significantly different from the color of the patch 21 read previously. In this case, the processing device 52 stores information on the previous color chart 20 and information on the color chart 20 a preset number of times before. The processing device 52 compares the currently read patch 21 with, for example, the previous patch 21, and determines whether the color difference ΔE is within a preset threshold value (for example, color difference ΔE=3).
[0084] Specifically, the processing device 52 extracts the image portion of the patch 21 from, for example, the captured image data based on the shape of the patch 21, the arrangement of the color information 22 and the color gamut information 23, and calculates the RGB value of the patch 21. The specific method of calculating the RGB value of the patch 21 is as described in the first color shift detection process. The processing device 52 also extracts the color information 22 and the color gamut information 23, and reads the color information 22 and the color gamut information 23 by reading an identifier or a barcode. Next, the processing device 52 calculates a provisional Lab value from the RGB value calculated from the patch 21. The provisional Lab value is a Lab value when it is assumed that the RGB value calculated from the patch 21 is converted to a Lab value through XYZ values and directly converted to a color management space. Next, the processing device 52 checks whether the color information 22 and color gamut information 23 of the color chart 20 captured one sheet before are the same as the color information 22 and color gamut information 23 of the current color chart 20. If they are not the same, the second color shift detection process is terminated. The second color shift detection process is also terminated if the color chart 20 is not present in the previously captured image. Alternatively, the second color shift detection process is also terminated if the previously captured image is not present. The processing device 52 determines whether the difference between this provisional Lab value and the provisional Lab value calculated from the patch 21 of the previously captured image is within a preset threshold value (for example, color difference ΔE=3).
[0085] The processing device 52 judges that the difference is normal if it is within the threshold value. On the other hand, the processing device 52 displays or transmits an alert if the difference is equal to or greater than the threshold value. The alert may be displayed on a display or may be transmitted to a pre-set email address or server. The alert may be, for example, "continuous reading color difference error." In this case, in addition to the alert, information such as the time when the alert occurred, the image file name, the ID of the image data, and / or the patient ID may be displayed or transmitted. When the color chart 20 includes two patches 21, an alert may be displayed or transmitted if the difference between both of the two patches 21 is equal to or greater than the threshold value. Alternatively, an alert may be displayed or transmitted if the difference between one of the two patches 21 is equal to or greater than the threshold value. In addition, when one of the two patches 21 cannot be determined due to dirt or the like, a determination may be made based only on the other patch 21. The processing device 52 may compare the current patch 21 with an average value of a plurality of patches 21 captured before the current patch 21 and determine whether this average value is within a preset threshold value (for example, color difference ΔE=3).
[0086] <First to third processes> When the second color shift detection process is normal, or when the second color shift detection process is completed, the above-mentioned first to third processes are sequentially performed (steps S18, S19, and S20 in FIG. 7).
[0087] <Third color shift detection process> After the third process is performed, a third color shift detection step is performed (step S21 in FIG. 7).
[0088] The third color shift detection process detects color shifts in the color-corrected image of the medical sample S. In this state, the color of the color-corrected image of the medical sample S is correctly converted from RGB values to Lab values with a certain degree of accuracy. In the third color shift detection process, it is determined whether or not there is any inconsistency in the result of the color correction of the patch 21 in light of the color information 22 and the color gamut information 23.
[0089] Specifically, the processing device 52 extracts the image portion of the patch 21 from the color-corrected image data that has been color-corrected with a certain degree of accuracy, based on the shape of the patch 21 and the arrangement of the color information 22 and the color gamut information 23, and calculates the RGB values of the patch 21. A specific method for calculating the RGB values of the patch 21 is as described in the first color shift detection process. In addition, the processing device 52 extracts the color information 22 and the color gamut information 23, and reads out the color information 22 and the color gamut information 23 by reading an identifier or a barcode. Next, the processing device 52 determines whether the calculated RGB values of the patch 21 are within the ranges of the color information 22 and the color gamut information 23.
[0090] The processing device 52 judges that the calculated RGB values of the patch 21 are normal if they are within the ranges of the color information 22 and the color gamut information 23. On the other hand, the processing device 52 displays or transmits an alert if the calculated RGB values of the patch 21 are not within the ranges of the color information 22 and the color gamut information 23. The alert may be displayed on a display or may be transmitted to a pre-set email address or server. The alert may be, for example, "color difference error after color correction." In this case, in addition to the alert, information such as the time, the image file name, the image data ID, and / or the patient ID may be displayed or transmitted. When the color chart 20 includes two patches 21, an alert may be displayed or transmitted if the calculated RGB values of the patch 21 are outside the ranges of the color information 22 and the color gamut information 23 for both of the two patches 21. Alternatively, an alert may be displayed or transmitted if the calculated RGB values of the patch 21 are outside the ranges of the color information 22 and the color gamut information 23 for one of the two patches 21. Furthermore, when one of the two patches 21 cannot be judged due to contamination or the like, the judgment may be made based on only the other patch 21.
[0091] For example, assume that the Lab values of the color information 22 are "33.65, 0.73, -0.832" and the color gamut information 23 has a color difference ΔE within +1. Also assume that the Lab values of the patch 21 color-converted from the RGB values in the color management space are "33.55, 0.33, -0.832." In this case, the distance between the Lab values of the color information 22 "33.65, 0.73, -0.832" and the Lab values of the patch 21 "33.55, 0.33, -0.832" is the color difference ΔE, which is calculated by the following formula: Color difference ΔE=√{(33.65-33.55) 2 +(0.73-0.33) 2 +((-0.832)-(-0.832)) 2}=about 0.412 In this case, it is determined to be normal because the color difference ΔE is within 1. Note that CIE DE2000 (delta E00) may also be used as a method for calculating the color difference ΔE.
[0092] Generally, the Lab color system is a uniform color space, and color shift detection can be performed as described above by using the color difference ΔE, which is a spatial distance, as the color gamut information 23. On the other hand, the color gamut information 23 may be expressed as, for example, "L±1, a-1 to +2, b-3 to +3" as information indicating that the L value, a value, or b value of the Lab color system is within a certain numerical range with respect to the reference value indicated in the color information 22. A range can be set for each of the L value, a value, and b value depending on the reading characteristics of the device. The color gamut information 23 indicates the range in which the difference between the Lab value of the color information 22 and the Lab value of the patch 21 should lie. In this case, if the Lab value of the color information 22 is "33.65, 0.73, -0.832" and the Lab value of the patch 21 is "33.55, 0.33, -0.832", then Difference in L value: 33.65-33.55=0.1 Difference in a value: 0.73-0.33=0.4 Difference in b value: (-0.832)-(-0.832)=0 and the L value, a value and b value are all "L±1, a-1 to +2, b-3 to +3" Since it is within the range, it is determined to be normal.
[0093] <Fourth Processing> If the third color shift detection process is normal, the fourth process described above is performed (step S22 in FIG. 7).
[0094] It is to be noted that all of the first color shift detection process to the third color shift detection process may be performed, or any one or two of them may be performed.
[0095] [Modification of the color shift detection process] Next, a modified example of the method for detecting color shift of a medical sample S using the chart-attached support 10 will be described with reference to Fig. 8. Fig. 8 is a diagram showing a color shift detection system 50A according to this embodiment and a color shift detection process performed by the color shift detection system 50A according to this modified example. The modified example shown in Fig. 8 differs in that the color shift detection system 50A includes an image processing server 53, and other configurations are substantially the same as those shown in Fig. 7 above. In Fig. 8, the same parts as those shown in Fig. 7 are given the same reference numerals and detailed description will be omitted.
[0096] 8, a color shift detection system 50A according to this modified example includes an image capturing device 51, a processing device 52, and an image processing server 53. The image processing server 53 processes the image sent from the image capturing device 51 via the processing device 52.
[0097] 8, first, an image of the medical specimen S is read by the imaging device 51. A large number of images of the medical specimen S (for example, 1000 or more) may be read. The image of the medical specimen S read by the imaging device 51 is sent to the processing device 52. The image of the medical specimen S is sent from the processing device 52 to an image processing server 53. The image of the medical specimen S may be sent to the image processing server 53 via any communication means such as a wired or wireless LAN or the Internet, or a storage medium such as a USB memory.
[0098] The color shift detection method performed by the image processing server 53 is substantially the same as the color shift detection process performed by the processing device 52 of the color shift detection system 50 shown in Fig. 7. The following describes the differences from the color shift detection method shown in Fig. 7.
[0099] 8, when an alert is displayed or sent, the sender of the image may be displayed or sent in addition to the alert. This is because data may be sent from a plurality of processing devices 52 to the image processing server 53, and it is necessary to record which processing device 52 the image was sent from together with the image. This sender may be, for example, an ID representing a hospital, or an ID identifying an individual within the hospital.
[0100] Also, for example, an image of the medical sample S may be linked to an ID representing a specific hospital, and if a color shift occurs in the image, it may be displayed or transmitted as an alert. In the case of this modified example, the alert may be displayed on a computer screen or a mobile terminal screen located at a remote location, or may be issued by e-mail, telephone call, automated voice, or the like. In this case, at least two of the destination of the alert and the content related to the alert may be determined in advance. For example, when an alert is transmitted to a computer screen or a mobile terminal screen, an IP address and a warning display command to an app may be determined in advance. For example, when an alert is transmitted by e-mail, an e-mail address and the body of the warning e-mail may be determined in advance. For example, when an alert is transmitted by telephone, a telephone number and the content of the automated voice may be determined in advance.
[0101] When the image processing server 53 detects a color shift in an image of the medical sample S, it may identify a user ID associated with the image, identify warning destination information and warning content information associated with the user ID, and display a warning on the screen of a computer at a remote location, for example. A plurality of pieces of warning destination information may be associated with a user ID, and multiple warnings may be sent to the screen of a computer at a remote location, e-mails may be sent, or calls may be made, for one color shift.
[0102] In this modification, the image data of the medical specimen S is stored in the image processing server 53, and the user may refer to the data in the image processing server 53 as necessary. Alternatively, the storage destination of the image data of the medical specimen S may be the processing device 52 connected to the imaging device 51 at a remote location of the user. The image data of the medical specimen S may be stored in another computer in addition to the image processing server 53. Alternatively, the image data of the medical specimen S may not be stored in the image processing server 53, but may be stored only in another computer.
[0103] As described above, according to this embodiment, the color chart 20 of the chart-mounted support 10 includes patches 21 having colors within a certain color gamut, color information 22 relating to the colors represented by the patches 21, and color gamut information 23 relating to the color gamut. This makes it easy to detect color shifts occurring in an image read by the photographing device 51. Furthermore, when multiple chart-mounted supports 10 are read in succession, if some of the chart-mounted supports 10 have the color charts 20 described above, it is easy to detect the occurrence of color shifts. More preferably, if all of the chart-mounted supports 10 have the color charts 20 described above, it is possible to more reliably detect the occurrence of color shifts.
[0104] (Second embodiment) Next, a second embodiment will be described with reference to Figures 9 to 11. Figures 9 to 11 are diagrams showing the second embodiment. In Figures 9 to 11, the same parts as those in the first embodiment shown in Figures 1 to 8 are given the same reference numerals and detailed description thereof will be omitted.
[0105] The configuration of a chart-affixed support for medical specimen observation according to this embodiment will be described with reference to FIG.
[0106] As shown in Fig. 9, the chart-affixed support 10A according to this embodiment is used when observing a medical sample S. The chart-affixed support 10A includes a support 11, a movable part 15, and a color chart 20. The movable part 15 is movable relative to the support 11. The color chart 20 is located on the movable part 15. The color chart 20 is located at a position visible from at least one side of the movable part 15.
[0107] According to this embodiment, the color chart 20 and the medical sample S are not fixed, but can be moved independently. Therefore, the color chart 20 can be placed anywhere within the observation field of the imaging device. This prevents the medical sample S and the color chart 20 from overlapping each other, regardless of the size of the medical sample S, and allows efficient use of the imaging area.
[0108] The movable part 15 may be slidable on the support 11. The movable part 15 may be movable parallel to the main surface of the support 11. The movable part 15 may be movable along the longitudinal direction of the support 11. The movable part 15 may be a transparent substrate having optical transparency, or an opaque substrate having no optical transparency. As the movable part 15, an inorganic substrate such as a glass substrate or a resin substrate may be used. The resin substrate may be a plate, a film, or a sheet.
[0109] Guides 16 are provided along a pair of opposing sides of the support 11, respectively. The pair of guides 16 guide the movable part 15 to move along the sides of the support 11. The movable part 15 is disposed between the pair of guides 16. The guides 16 may be rails. The guides 16 may be configured integrally with the support 11. The guides 16 may be configured separately from the support 11 and attached to the support 11.
[0110] The color chart 20 includes at least one patch 21. In the example shown in FIG. 9, the color chart 20 includes two patches 21. The patch 21 has a color within a certain color gamut. The patch 21 may be configured in the same manner as in the first embodiment. The color chart 20 may further include color information and color gamut information in the same manner as in the first embodiment. In this case, the color information and color gamut information may be configured in the same manner as in the first embodiment. According to this embodiment, since the color chart 20 is located on the movable part 15, there is little risk that the medical sample S and the color chart 20 overlap and obstruct the observation of the medical sample S. Therefore, it is possible to place more patches 21, color information, and color gamut information on the movable part 15. Note that the color chart 20 does not need to include color information and color gamut information.
[0111] On the medical sample S, a cover glass (not shown) may be placed.
[0112] 10(A), 10(B) and 11 show modified examples of a chart-affixed support 10A according to this embodiment.
[0113] As shown in Fig. 10(A), a handle 17 may be provided on the side surface of the movable part 15 (the surface on the guide 16 side). The handle 17 assists the movable part 15 to move along the side of the support 11. In Fig. 10(A), a groove 16a is formed along the longitudinal direction of one of the guides 16. The handle 17 extends outward from the groove 16a. Although not shown, the handle may be provided on the surface of the movable part 15 (the surface opposite the support 11) instead of on the side surface of the movable part 15.
[0114] As shown in FIG. 10(B), a cover 18 may be provided to cover the movable part 15. An inorganic substrate such as a glass substrate or a resin substrate may be used as the cover 18. A handle 17 is provided on a side surface of the movable part 15 (a surface perpendicular to the longitudinal direction of the guide 16). The handle 17 extends parallel to the moving direction of the movable part 15. The handle 17 extends outward from the space between the cover 18 and the support 11.
[0115] 11 , the guides 16 may be provided on the movable part 15. The guides 16 are provided along a pair of opposing sides of the movable part 15. The pair of guides 16 guide the movement of the movable part 15 along the sides of the support body 11. The support body 11 is disposed between the pair of guides 16.
[0116] It is not necessary for the movable part 15 to be coupled to the support 11 or to be in contact with the support 11. The movable part 15 may be provided on the side of an imaging device such as a microscope.
[0117] In addition, an AR marker may be provided on the movable part 15. The AR marker serves as a signal (trigger) for synthesizing the color chart 20 as an extended content with the image. In this case, the position of the patch 21 can be automatically recognized by using the AR marker.
[0118] Furthermore, the color chart 20 on the movable part 15 may have a plurality of patches 21 of different sizes. In this case, a patch 21 of a predetermined size can be set from the plurality of patches 21 in accordance with the objective lens. This allows the patch 21 of an optimum size corresponding to various magnifications to be selected. A handle 17A may be provided on the side or top surface of the movable part 15 or the guide 16. By providing the handle 17A on the side or top surface of the movable part 15 or the guide 16, it becomes easier to hold the handle 17A when moving the movable part 15.
[0119] According to this embodiment, the chart-attached support 10A includes a movable part 15 that is movable relatively to the support 11. The color chart 20 is located on the movable part 15. By moving the color chart 20 together with the movable part 15, the color chart 20 can be placed near the medical specimen S. In addition, since the color chart 20 and the medical specimen S are separated from each other, the color chart 20 can be brought into the field of view after the observation position of the medical specimen S is determined.
[0120] It is also possible to combine the multiple components disclosed in each of the above embodiments and modifications as necessary, or to delete some of the components disclosed in each of the above embodiments and modifications. [Explanation of symbols]
[0121] 10 Chart Support 10A Chart Support 11 Support 15 Moving parts 20 Color Chart 21 Patch 22 Color Information 23 Color Gamut Information 50 Color shift detection system 51 Imaging Equipment 52 Processing equipment 53 Image Processing Server S Medical specimens
Claims
1. A chart-attached support for observing medical specimens, A support; A color chart is provided at a position visible from at least one surface of the support, The color chart is A patch having a color within a certain color gamut; color information regarding the color represented by the patch; and color gamut information relating to said color gamut.
2. A plurality of color charts are present on the surface of the support, The support with charts according to claim 1 , wherein the plurality of color charts are arranged in a repeated manner.
3. 2. The support with a chart according to claim 1, wherein the minimum diameter of the patch is 1 μm or more and 1000 μm or less.
4. A chart-attached support for observing medical specimens, A support; A movable part that is movable relative to the support body; A color chart positioned on the movable portion.
5. In a color shift detection system, An imaging device for imaging the chart-attached support according to any one of claims 1 to 3; A processing device for processing the image sent from the photographing device, The processing device detects color shift of the image based on the color information and the color gamut information.
6. In a color shift detection system, An imaging device for imaging the chart-attached support according to any one of claims 1 to 3; an image processing server that processes the image sent from the photographing device via the processing device; The image processing server detects color shift of the image based on the color information and the color gamut information.
Citation Information
Patent Citations
Slide glass, cover glass, and pathologic diagnosis system
WO2004044639A1
