Article type determination device and specimen processing system using the same

The article type discriminating device uses diffuse and specular reflection imaging to accurately identify stoppers in sample containers, addressing false detections and complexity issues in existing methods, ensuring reliable and efficient identification.

JP2024165624APending Publication Date: 2024-11-28HITACHI HIGH TECH CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023081975
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-18
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing methods for identifying stoppers and containers in clinical sample tests are prone to false detections due to materials like translucent resin and glossy metal surfaces, leading to measurement errors and high costs, and require complex processing.

Method used

An article type discriminating device using two light sources for diffuse and specular reflection imaging, capturing multiple images to create a difference image, which is then processed to accurately determine the type and presence of stoppers in sample containers.

Benefits of technology

The device provides accurate identification of stoppers in sample containers regardless of color or material, reducing false detections and processing time while maintaining cost-effectiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165624000001_ABST
    Figure 2024165624000001_ABST
Patent Text Reader

Abstract

To provide an article type determination device capable of more accurately determining the type and presence or absence of articles with different colors or materials such as stoppers of specimen containers and a specimen processing system using the same.SOLUTION: An article type determination device includes: a first irradiation mechanism which irradiates an article to be determined with light in order to capture a diffuse reflection image of the article to be determined; a second irradiation mechanism which irradiates the article to be determined with light in order to acquire a mirror reflection image of the article to be determined; an imaging mechanism which images the article to be determined; and a determination mechanism which changes a light amount of the second irradiation mechanism while the first irradiation mechanism irradiates the article to be determined with light, captures multiple images of the article to be determined and determines the type of the article to be determined on the basis of a difference image of the multiple images captured by the imaging mechanism. There is also provided a specimen processing system using the same.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an article type discrimination device that discriminates the type of an article based on a captured image of the article, and more particularly to an article type discrimination device that is suitable for discriminating the type of stopper of a specimen container in the medical field, and a specimen processing system using the same. [Background technology]

[0002] Technology that identifies an item by checking a captured image of the item against pre-stored information such as the color and shape of the item has already been introduced in industries that handle items, such as logistics.

[0003] As an example of such a technique, Patent Document 1 describes the use of a light projecting means and an imaging device for acquiring a distance image of an object to be inspected, that is, a workpiece, according to a light section method or a pattern projection method.

[0004] The light-section method uses a projector that projects a line-shaped laser beam onto the workpiece, while the pattern projection method uses a projector that projects a sine wave stripe pattern onto the workpiece.

[0005] In addition to the light-projecting means corresponding to the light-section method or the pattern projection method, it is also possible to separately provide a general illumination device for performing bright field illumination or dark field illumination, or to make the light-projecting means function as a general illumination device.

[0006] Both methods obtain three-dimensional shape information, so in the light-section method, a line-shaped laser beam is irradiated onto the surface of the target object multiple times or continuously, and the shape is obtained from the information of the light diffusely reflected by the surface and received by a sensor (image sensor).In addition, in the pattern projection method, a projector or other device is used to project multiple (e.g., three) sine wave stripe pattern images onto the workpiece surface, and the shape is obtained by calculating position information based on the phase difference, i.e., the disturbance of the stripe pattern caused by the unevenness of the surface. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2018-112568 A Summary of the Invention [Problem to be solved by the invention]

[0008] In recent years, techniques for identifying articles such as specimen containers and specimen container stoppers used in clinical specimen testing based on captured images have been introduced.

[0009] In clinical testing, blood, urine, and other samples collected for the purposes of diagnosing, treating, or checking up on illness are analyzed in hospital laboratories or testing centers using a variety of medical analyzers, either directly or after being transferred to a separate container or distributed among the required number of containers, depending on the test items to be performed.

[0010] Although the process is automated in terms of transferring samples to containers, distributing samples according to the number of types of analytical equipment being used, and transporting them to the analytical equipment (hereinafter referred to as the automated line), the appearance of clinical samples such as blood and urine (hereinafter referred to as samples) brought to hospital laboratories and large-scale testing centers varies greatly, so humans visually identify the container type and test items before feeding the samples into the automated line.

[0011] For example, when performing a complete blood count, a blood collection tube containing collected blood must be transported by an automated line to a blood cell counter that examines the cellular components in the blood.

[0012] Furthermore, in serological testing, if the specimen is a blood collection tube in which serum and blood clots have been separated by centrifugation, the specimen must be transported to the serological testing device after passing through an automatic dispenser that opens the cap of the blood collection tube and dispenses the serum into a separate container.

[0013] On the other hand, even for the same serological test, if the sample is a container containing only serum, the sample must be transported to the serological test device either in the container itself or after being distributed by an automatic dispenser into the required number of containers.

[0014] Although the method described in Patent Document 1 is an excellent general-purpose method for measuring workpieces of various shapes, it requires dedicated optical equipment and complex processing, which is costly and takes a long time.

[0015] Furthermore, specimen containers such as blood collection tubes may use translucent resin stoppers or shiny, i.e., highly specularly reflective metal stoppers, and transparent glass tubes are used for the containers, so methods that acquire laser light or image patterns often result in false detections.

[0016] For example, in the light section method, the laser light penetrates deeply into a translucent resin stopper, causing scattering within the resin, and halation occurs in a metallic stopper, which may result in measurement errors.

[0017] Furthermore, in the pattern projection method, the image pattern may not be projected onto the surface of a translucent resin plug or a shiny metallic plug.

[0018] In addition, when projecting the image pattern, it needs to be projected at an angle so that the three-dimensional shape can be grasped. However, transparent glass tubes are often used for sample containers, and when the light passes through the tube, a pattern with a phase difference caused by refraction appears on the floor, which can lead to false detections.

[0019] An object of the present invention is to provide an object type discrimination device that can more accurately discriminate the type and presence or absence of a stopper, even for objects of different colors or materials, such as a stopper for a sample container, and a sample processing system using the same. [Means for solving the problem]

[0020] In order to achieve the above object, the present invention is configured as follows.

[0021] An article type discrimination device comprising: a first irradiation mechanism that irradiates light onto the identified article to capture a diffuse reflection image of the identified article; a second irradiation mechanism that irradiates light onto the identified article to obtain a specular reflection image of the identified article; an imaging mechanism that images the identified article; and a discrimination mechanism that takes multiple images of the identified article by changing the amount of light from the second irradiation mechanism while the first irradiation mechanism is irradiating light onto the identified article, and discriminates the type of the identified article based on a differential image of the multiple images captured by the imaging mechanism.

[0022] The present invention is particularly suitable for identifying specimen containers and specimen container stoppers used in medical applications, but the objects to be identified are not limited to this.

[0023] For the definitions of the diffuse reflection image and the specular reflection image, please refer to the description in the Examples. The article type discrimination device of the present invention is particularly suitable for use as a plug type discrimination device incorporated in a specimen processing system.

[0024] "Changing the amount of light from the second irradiation mechanism" can be achieved most simply by turning off the light source or blocking the light from the light source so that light is not emitted from the second irradiation mechanism, but the effects of the present invention can also be achieved by appropriately reducing the light within a range where a difference image required for discrimination can be obtained. Effect of the Invention

[0025] According to the present invention, it is possible to provide an object type discrimination device that can more accurately discriminate the type and presence or absence of a stopper, even for objects of different colors or materials, such as a stopper for a sample container, and a sample processing system using the same. [Brief description of the drawings]

[0026] [Figure 1] FIG. 2 is a diagram for explaining an example of a device configuration of the plug type discrimination device in the first embodiment of the present invention. [Diagram 2] FIG. 1 is a block diagram illustrating an example of the configuration of a plug type determining device in a first embodiment of the present invention. [Diagram 3]FIG. 2 is a block diagram illustrating an example of the configuration of a plug top surface image acquisition unit of the plug type discrimination device in the first embodiment of the present invention. [Figure 4] FIG. 2 is a block diagram illustrating an example of the configuration of a plug type determining unit of the plug type determining device in the first embodiment of the present invention. [Figure 5a] FIG. 11 is a diagram illustrating an example of a device configuration of a plug type discrimination device in Example 2 of the present invention. [Figure 5b] 10 is a diagram illustrating an example of a rotating mirror device for specular reflection in a second embodiment of the present invention. FIG. [Figure 5c] FIG. 11 is a diagram illustrating an example of a dressing table with a rotating plate device in accordance with a second embodiment of the present invention. [Figure 6] FIG. 11 is a block diagram illustrating an example of the configuration of a plug type determining device in Example 2 of the present invention. [Figure 7] FIG. 2 is a diagram illustrating light reflection in the first embodiment of the present invention. [Figure 8a] FIG. 2 is a diagram illustrating diffuse reflection in the first embodiment of the present invention. [Figure 8b] FIG. 4 is a diagram illustrating the intensity of diffuse reflection in Example 1 of the present invention. [Figure 8c] 4 is a diagram illustrating the relationship between the intensity of diffuse reflection and the angle of the object surface in Example 1 of the present invention. FIG. [Figure 9a] FIG. 4 is a diagram illustrating the unevenness on the upper surface of the plug in the first embodiment of the present invention. [Figure 9b] FIG. 4 is a diagram for explaining the relationship between the unevenness on the top surface of the plug and specularly reflected light in the first embodiment of the present invention. [Figure 9c] FIG. 2 is a diagram for explaining the relationship between the unevenness on the top surface of the plug and an image of the mirror reflection in Example 1 of the present invention. [Figure 10a] FIG. 2 is a diagram for explaining a mask image formed by unevenness on the top surface of the plug in the first embodiment of the present invention. [Figure 10b] FIG. 2 is a diagram illustrating a mask image covering the entire top surface of the plug in the first embodiment of the present invention. [Figure 10c] FIG. 2 is a diagram illustrating an extracted contour image of the outer side of the upper surface of the plug in the first embodiment of the present invention. [Figure 11]4A to 4C are diagrams for explaining an example of an image creation method for extracting a plug top surface in the first embodiment of the present invention. [Figure 12a] FIG. 2 is a diagram for explaining an extracted image of the top surface of a plug in the first embodiment of the present invention. [Figure 12b] 1A to 1C are diagrams illustrating a method for expanding a cut-out image of the top surface of a plug in the first embodiment of the present invention. [Figure 12c] FIG. 2 is a diagram for explaining a contour extraction image of the top surface of the plug in the first embodiment of the present invention. [Figure 12d] FIG. 2 is a diagram for explaining an image of extracted contour features of the top surface of the plug in the first embodiment of the present invention. [Figure 12e] FIG. 2 is a diagram for explaining a contour extraction image at a transposed position on the top surface of the plug in the first embodiment of the present invention. [Figure 13] FIG. 2 is a diagram for explaining a feature extraction method using a contour feature extraction image of the plug top surface in the first embodiment of the present invention. [Figure 14] FIG. 11 is a diagram illustrating an example of a device configuration of a plug type discrimination device in Example 3 of the present invention. [Figure 15a] FIG. 11 is a block diagram illustrating an example of the configuration of a plug type determining device in Example 3 of the present invention. [Figure 15b] FIG. 11 is a block diagram illustrating an example of an additional configuration of the plug type determining device in Example 3 of the present invention. [Figure 16] FIG. 11 is a block diagram illustrating an example of the configuration of a plug side image acquisition unit of a plug type discrimination device in Example 3 of the present invention. [Figure 17] FIG. 11 is a block diagram illustrating an example of the configuration of a plug type determining unit of a plug type determining device in Example 3 of the present invention. [Figure 18a] FIG. 11 is a diagram for explaining an example of color distribution thresholds using the HSV color space of the plug side image acquisition unit in the third embodiment of the present invention. [Figure 18b] 13 is a diagram for explaining the relationship between the color distribution threshold of the plug side image acquisition unit and a binarized image in Example 3 of the present invention. FIG. [Figure 18c] FIG. 11 is a diagram illustrating an example of horizontal frequency distribution of the plug side image acquisition unit and dimensional measurement of a sample container in Example 3 of the present invention. [Figure 18d]FIG. 11 is a diagram illustrating an example of vertical frequency distribution of the plug side image acquisition unit and dimensional measurement of a sample container in Example 3 of the present invention. [Figure 19] 1 is a flowchart illustrating a plug type discrimination method in Example 1 of the present invention. [Figure 20] 4 is a flowchart illustrating an example of a method for acquiring a plug top surface image of the plug type discrimination device in the first embodiment of the present invention. [Figure 21] 4 is a flowchart illustrating an example of a plug type discrimination method of the plug type discrimination device in the first embodiment of the present invention. [Figure 22a] 10 is a flowchart illustrating a plug species discrimination method in Example 2 of the present invention. [Figure 22b] 10 is a flowchart illustrating a rotation control method based on timing in the plug type discrimination device according to the second embodiment of the present invention. [Diagram 23] 10 is a flowchart illustrating a plug species discrimination method in Example 3 of the present invention. [Figure 24] 11 is a flowchart illustrating an example of a method for acquiring an image of a side surface of a plug in the plug type discriminating device according to the third embodiment of the present invention. [Diagram 25] 10 is a flowchart illustrating an example of a plug type discrimination method of the plug type discrimination device in the third embodiment of the present invention. [Figure 26a] FIG. 11 is a diagram illustrating an example of a sample processing system according to a fourth embodiment of the present invention. [Figure 26b] FIG. 11 is a diagram illustrating an example of a sample processing system including error sample processing in Example 4 of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] An overview of the present invention will be described by taking as an example a sample processing system that uses an article discrimination device in which the article to be discriminated is a stopper of a sample container used in clinical testing.

[0028] The method according to the present invention has two light sources and an imaging device to extract an image of the upper surface of the plug (hereinafter referred to as the plug upper surface image) of a plugged tubular specimen container (hereinafter referred to as the specimen container) such as a blood collection tube and a background image.

[0029] Two types of light sources are used: a diffuse reflection light source that is installed on the imaging device side to illuminate the upper surface of the stopper in order to obtain feature quantities such as color distribution and contours from the color information of the stopper of the specimen container, and a specular reflection light source that is installed in a position where the specular reflection intensity is strong only on the upper surface of the stopper toward the imaging device, i.e., in the position or direction of the imaging device and the target, with the stopper at the center.

[0030] To cut out the plug top surface image and the background image, the light source for diffuse reflection is turned on, the light source for specular reflection is turned on, an image of the plug top surface including specular reflection is captured, and then the light source for specular reflection is turned off to obtain an image without specular reflection.

[0031] The specular reflection component is extracted using the difference image between the two images with and without specular reflection. Since specular reflection is basically strong on the top surface of the plug, the area with a large brightness difference in the difference image represents the top surface of the plug.

[0032] The image obtained by binarizing this difference image is used as a mask image of the plug, and by combining it with the image obtained from the diffuse reflection light source, an image of the plug's top surface can be extracted.

[0033] The shape of the top surface of the stopper of a specimen container may be flat or may have simple irregularities. In areas with irregularities, the light from the specular reflection light source is blocked, i.e., shadows are generated, so the three-dimensional features of the shape can be confirmed from the mask image.

[0034] In the method of the present invention, the plug species can be identified based on the features of these three-dimensional shapes and the features obtained from color information.

[0035] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Needless to say, these are merely examples, and the present invention is not necessarily limited to these embodiments.

[0036] In addition, in each drawing explaining the embodiment, the same members are given the same reference numerals and the repeated explanation is omitted. EXAMPLES

[0037] In this embodiment, an example of a plug type discrimination device is described, which uses two lighting devices, one for specular reflection and one for diffuse reflection, captures the characteristics of the undulations by specular reflection, extracts an image of the upper surface of the plug of a specimen container (hereinafter, the plug top surface) by diffuse reflection, and then discriminates the plug type based on color information of the image, such as the contour and color distribution.

[0038] FIG. 1 is a diagram for explaining an example of a device configuration of a plug type discrimination device in the first embodiment of the present invention.

[0039] The plug type discrimination device in this embodiment has two lighting devices: an imaging device 10, a diffuse reflection lighting device 20 for illuminating the specimen container W from the imaging device side, and a specular reflection lighting device 30 installed on the opposite side of the specimen container W from the imaging device in a position where it reflects specularly from the top surface of the plug of the specimen container W. The device also includes an image processing device 100, a display device 40, and a transport device 50 for placing the specimen container W in the imaging position.

[0040] FIG. 2 is a block diagram illustrating an example of the configuration of the plug type determining device in the first embodiment of the present invention.

[0041] The plug type discrimination device in the first embodiment of the present invention includes an image acquisition unit 101 that receives as input signals a notification signal 51 from a transport device 50 indicating that a specimen container has been placed at an imaging position and an imaging data signal 11 output from an imaging device 10 that images the specimen container, and outputs a dimming signal 103 to a dimming unit 104 and an image data signal 102 for one frame, an illumination device for diffuse reflection 20 whose on / off state is controlled by an illumination control signal for diffuse reflection 21 output from the dimming unit 104, and an illumination device for specular reflection 30 whose on / off state is controlled by an illumination control signal for specular reflection 31 output from the dimming unit 104.

[0042] The device further includes a plug top image acquisition unit 200 which receives the image data signal 102 as an input signal and outputs a plug top cut-out image data signal 105, and a plug type discrimination unit 300 which receives the plug top cut-out image data signal 105 as an input signal and outputs a plug type identification data signal 41 for displaying the result of the plug type discrimination on a display device 40.

[0043] The imaging device 10 may be a CCD or CMOS image sensor, and may be either a monochrome camera or a color camera. The imaging device 10 according to the present embodiment will be described as a color camera capable of identifying differences in species due to color.

[0044] The imaging data signal 11 output from the color camera may be an RGB signal, or a color signal such as YCbCr using color difference signals.

[0045] Furthermore, the image data signal 102 for one frame output by the image acquisition unit 101 may be an RGB signal like the input signal, or a YCbCr signal, or an l*a*b* signal, HSV signal, or HSL signal.

[0046] The display device 40 may be, for example, a display that displays images, or an output device such as a printer that displays on paper, and does not have to be included in the configuration of the device.

[0047] In addition, the transport device 50 is a device that transports the specimen container 52 before imaging to an imaging position where imaging can be performed by the imaging device 10, and transports the specimen container 53 from the imaging position after imaging. However, for example, the transport device may not have a transport function and may be equipped with a tray or the like for manually placing it at the imaging position and manually transporting it after imaging.

[0048] The lighting device in the present invention uses two types of light sources: a lighting device 20 for diffuse reflection and a lighting device 30 for specular reflection. The light source is preferably a lighting device with high directivity, but a planar lighting device may also be used. Here, for simplicity, the Phong reflection model is assumed as a model of the optical system, and diffuse reflection and specular reflection are explained.

[0049] 7 is a diagram illustrating the reflection of light in the first embodiment of the present invention, showing the Phong reflection model. The Phong reflection model is an empirical model, not an optical model based on a physical explanation, and will be described using only geometrical optical elements.

[0050] In the Phong reflection model, the reflection of light from a light source Ls onto an object is composed of a specular reflection area Rs, a diffuse reflection area Rd, and an area Ra reflected by ambient light. Specular reflection light is light that is reflected like a mirror on the object surface Ob, and depends on the direction to the viewpoint E, and the intensity of the reflected light is the dot product of the reflection vector R and the viewpoint vector V.

[0051] Diffuse reflected light is light that does not depend on the direction to the viewpoint E, and is determined by the normal vector N on the object surface Ob and the direction vector L to the light source Ls. Ambient light is the reflection of light scattered in the surroundings onto a shadow, and is reflected light that is expressed as the color of the shadow. The light intensity Ip of the Phong reflection model is shown in equation (1).

[0052]

number

[0053] Next, features of the illuminating device for diffuse reflection 20 according to the present invention will be described.

[0054] Fig. 8a is a diagram for explaining diffuse reflection in the first embodiment of the present invention, showing the characteristics of diffuse reflection in the Phong reflection model. As shown in Fig. 8a, the light reflected by the light ray l on the object surface Ob is diffusely reflected uniformly, regardless of the viewpoint.

[0055] Fig. 8b is a diagram for explaining the intensity of diffuse reflection in Example 1 of the present invention. As shown in Fig. 8a, the intensity of diffuse reflected light is uniformly diffused regardless of the viewpoint, and therefore depends on the amount of light rays l that strike a unit area U, i.e., the luminous flux.

[0056] Fig. 8c is a diagram for explaining the relationship between the intensity of diffuse reflection and the angle of the object surface in Example 1 of the present invention. Since the intensity of diffuse reflected light depends on the light flux, for example, when the object surface Ob is tilted, the reflected light intensity depends on the dot product of the normal vector N and the light ray l, as shown in Fig. 8c.

[0057] In this way, the diffuse reflected light is observed to have the same color regardless of the viewpoint, and is expressed as the color of the object surface Ob.

[0058] Next, features of the specular reflection lighting device 30 in the first embodiment of the present invention will be described.

[0059] 9a is a diagram for explaining the unevenness on the top surface of the plug in the embodiment 1 of the present invention. As shown in the figure, the unevenness on the top surface of the plug is often located at the center of the plug, such as the depression B and protrusion D in the figure.

[0060] The specular reflection occurring on the uneven plug surface indicated by the depressions B and protrusions D will now be described.

[0061] 9b is a diagram for explaining the relationship between the unevenness of the upper surface of the plug and the specular reflected light in Example 1 of the present invention. It shows that the light ray l is blocked by the depression B and the protrusion D on the upper surface of the plug, and a shadow is observed from the viewpoint E.

[0062] 9c is a diagram for explaining the relationship between the unevenness of the upper surface of the plug and an image capturing the specular reflection in Example 1 of the present invention, showing that the concave depressions and convex protrusions on the upper surface of the plug appear as shadows in the image observed from viewpoint E.

[0063] In FIG. 1, the imaging device 10 and the specular reflection illumination device 30 should be installed in opposite positions relative to the specimen container W so that an image similar to that in FIG. 9c can be captured. Furthermore, when only the diffuse reflection illumination device 20 is illuminated, the captured image will have shadows due to diffuse reflection caused by the inclination of the object surface, but the devices should be installed so that shadows such as those in FIG. 9c do not appear.

[0064] Next, in formula (1), the intensity Is of specularly reflected light, which is one of the components of the light intensity Ip, is expressed as the power of the dot product of the reflection vector R and the viewpoint vector V shown in Fig. 7. The power s represents glossiness in the Phong reflection model, and can be considered as an expression of the reflective light distribution characteristics for each angle α between the reflection vector R and the viewpoint vector V. Here, if the dot product of the reflection vector R and the viewpoint vector V is negative, that is, if the angle α is greater than π / 2, it is set to 0.

[0065]

number

[0066] In addition, the ambient light intensity Ia, which is one of the components of the light intensity Ip, is the intensity due to reflection and scattering from surrounding walls, etc., and is an element expressed as an offset value. However, in the present invention, the influence of ambient light can be ignored by suppressing wall reflection using light-shielding paint, etc.

[0067]

number

[0068] Here, if the intensity of the light reflected by the illuminating device for diffuse reflection 20 in the present invention is Ip0, since the illuminating device for diffuse reflection 20 is installed on the opposite side of the specimen container W, i.e., so that the angle α is wider than π / 2, the intensity of the specularly reflected light is 0 according to equation (2). Equation (1) can be expressed as equation (4) based on equations (2) and (3).

[0069]

number

[0070] In addition, if the intensity of reflected light obtained by adding the illuminating device for specular reflection 30 to the illuminating device for diffuse reflection 20 in the present invention is Ip1, it can be expressed by equation (5).

[0071]

number

[0072] From the above, the intensity of reflected light when the lighting device 20 for diffuse reflection is turned on and the lighting device 30 for specular reflection is turned off is expressed by equation (4), and the intensity of reflected light when the lighting device 30 for specular reflection is turned on is expressed by equation (5).

[0073] FIG. 3 is a block diagram illustrating an example of the configuration of the plug top surface image acquisition unit of the plug type discrimination device in the first embodiment of the present invention.

[0074] The plug top surface image acquisition unit 200 in the first embodiment of the present invention includes a grayscale image conversion unit 201 that receives one frame of image data signal 102 as an input signal and outputs a grayscale image data signal 202. The grayscale image data signal 202 and the grayscale image data signal 204 stored in the image storage unit 203 are input signals, and the differential image creation unit 205 outputs a differential image data signal 206 between one frame of image data signal 102 acquired when the specular reflection lighting device 30 is turned on and one frame of image data signal 102 acquired when the specular reflection lighting device 30 is turned off. The differential image data signal 206 is input as an input signal, and the mask image creation unit 207 binarizes the differential image data signal 206 using a threshold value Ts to output a mask image data signal 208. The plug top surface image cutout unit 209 receives the mask image data signal 208 and one frame of image data signal 102 acquired when the specular reflection lighting device 30 is turned off as input signals, and outputs a plug top cutout image data signal 105.

[0075] The grayscale image data signal 202 created in the grayscale image conversion unit 201 may be converted from one frame of image data signal 102, and may be, for example, a luminance (Y) signal such as YCbCr using color difference signals, a lightness (L) signal in an L*a*b* color space, a lightness (V) signal in an HSV color space, or a luminance (L) signal or saturation (S) signal in an HSL color space, or may be a weighted average of the color components of each color space, i.e., channels, as constituent elements.

[0076] A differential image creation unit 205, which is an example of the present invention, creates a differential image by taking the grayscale difference between one frame of image data signal 102 acquired when the illuminating device 20 for diffuse reflection is turned on and the illuminating device 30 for specular reflection is turned off, i.e., a diffuse reflection image, and one frame of image data signal 102 acquired when the illuminating device 30 for specular reflection is turned on, i.e., a specular reflection image.

[0077] Next, the diffuse reflection image is an image capturing the intensity of reflected light according to equation (4), and the specular reflection image is an image capturing the intensity of reflected light according to equation (5). Here, the difference between the intensity of diffuse reflection light and the intensity of specular reflection light is expressed by equation (6).

[0078]

number

[0079] In order to improve the accuracy of extracting the intensity Is1 of the specular reflection light, it is preferable to install the illuminating device for specular reflection 30 so as to suppress the intensity Id1 of the diffuse reflection light by the illuminating device for specular reflection 30 in equation (6). Here, the illuminating device for specular reflection 30 should be installed on the opposite side of the imaging device 10 with respect to the specimen container W as a reference so that the image shown in Fig. 9c of the unevenness of the stopper surface in Fig. 1 is captured, and at the same time, its position should be adjusted so that the dot product of the direction vector L and the normal vector N is small.

[0080] A mask image creation unit 207, which is an example of the present invention, creates a mask image by binarizing the differential image data signal 206 using a threshold value Ts. The threshold value Ts should satisfy the condition expressed by equation (7) so that the intensity of the specularly reflected light can be extracted in equation (6).

[0081]

number

[0082] Here, it may be assumed that the diffuse reflection illumination device 20 is fixed, and the normal vector N of the top surface of the stopper is perpendicular to the horizontal plane. In addition, since the standard height of the sample container can be assumed, the threshold value Ts may be determined, for example, under the condition that the right side of the formula (7) becomes the maximum value.

[0083] In addition, since the position of the stopper in the image varies depending on the height of the sample container, the threshold value Ts may be corrected depending on the height of the sample container. The height of the sample container can be calculated by, for example, measuring the elevation and depression angles of the imaging device, the distance to the imaging center, and the height at the imaging center in advance, obtaining a correlation between the pixel position in the image and the actual measured value, and then measuring the amount of deviation of the center of the top surface of the stopper from the imaging center.

[0084] Here, the correction of the threshold value Ts depending on the height of the specimen container may be performed, for example, by calculating a direction vector to the light source based on the height of the specimen container, calculating the inner product with the normal vector N, and correcting it as a ratio to a reference inner product. In addition, the reflected light has been explained above using the Phong reflection model, but in reality, for example, the diffuse reflection on the upper surface of the stopper of the specimen container is never completely uniform, so errors occur. Therefore, a table for the amount of deviation may be prepared.

[0085] FIG. 10a is a diagram for explaining a mask image formed by unevenness on the upper surface of the plug in Example 1 of the present invention.

[0086] For example, a binarized image can be created so that the area equal to or greater than the threshold Ts is set to “1” and the area less than the threshold Ts is set to “0.” As explained in Fig. 9c, for a plug with an uneven upper surface, a shadow area appears in the image.

[0087] FIG. 10b is a diagram illustrating a mask image covering the entire upper surface of the plug in the first embodiment of the present invention.

[0088] The mask image of the present invention is an example of a mask image created to complement shadow areas. A mask image can be created by extracting the outer contour of the mask image in Figure 10a and then filling the inside of the contour with "1".

[0089] Fig. 10c is a diagram for explaining a contour extraction image of the outer side of the upper surface of the plug in the first embodiment of the present invention. For example, by using the mask image of Fig. 10a, the first and last positions of the specular reflection area, i.e., the area with "1" found along the scanning line sl, may be taken as contour C. By filling in the inside of this contour C, the plug upper surface mask image of Fig. 10b can be created.

[0090] FIG. 11 is a diagram for explaining an example of an image creation method for extracting the top surface of a plug in the first embodiment of the present invention.

[0091] The plug top surface image extraction unit 209 turns on the diffuse reflection lighting device 20 and uses one frame of image data signal 102, i.e., the diffuse reflection image, acquired when the specular reflection lighting device 30 is turned off, and the mask image data signal 208 to create a plug top surface extraction image, for example, by applying the color of the diffuse reflection image as the plug top cut-out image data signal 105 when the mask image data signal 208 at the same pixel position is "1", and by applying a color not used in the diffuse reflection image as a color key when the mask image data signal 208 is "0".

[0092] If you cannot find a color to use as a color key, you can increase the number of layers by using a transparent channel, etc. For example, if the image data signal 102 for one frame is an RGB signal, an RGBA signal can be used as a signal with an additional transparent channel.

[0093] Here, the RGBA signal is an RGB signal to which an A signal is added as a transparent color channel. For example, when an RGBA signal having a 1-bit A signal is used, if the RGB image data signal is (r0, g0, b0), when the mask image data signal 208 is "1", the RGBA signal is (r0, g0, b0, 1), and when the mask image data signal 208 is "0", for example, only the A signal may be 0, that is, (r0, g0, b0, 0) or (0, 0, 0, 0).

[0094] As another method, for example, the RGB signal can be expanded as an 8-bit channel so that 240≧R≧16, 240≧G≧16, and 240≧B≧16, so that, for example, a black signal for which the mask image data signal 208 is “1” can be distinguished as (R,G,B)=(16,16,16), and a signal outside the mask area for which the mask image data signal 208 is “0” can be distinguished as (R,G,B)=(0,0,0).

[0095] Here, the mask image data signal 208 may be a mask image including relief information as shown in FIG. 10a, a mask image covering the entire top surface of the plug as shown in FIG. 10b, or may have multiple masks other than these at the same time.

[0096] When multiple masks are used, a channel with the same number of bits as the number of masks may be added. When two mask images, such as those shown in Fig. 10a and Fig. 10b, are used, a 2-bit channel may be added.

[0097] In the present embodiment, an example in which two mask images shown in FIG. 10a and FIG. 10b are used will be described below.

[0098] FIG. 4 is a block diagram illustrating an example of the configuration of the plug type determining unit of the plug type determining device in the first embodiment of the present invention.

[0099] The plug type discrimination unit 300 in the first embodiment of the present invention includes a contour information extraction unit 301 that receives the plug upper part cut-out image data signal 105 as an input signal and outputs a shape information signal 303, a color information extraction unit 302 that receives the plug upper part cut-out image data signal 105 as an input signal and outputs a color information signal 304, a plug type information search unit 305 that receives the shape information signal 303 and the color information signal 304 as input signals and outputs a plug type identification data signal 41, and a plug type data unit 307 that receives a search key 306 output from the plug type information search unit 305 and outputs plug type identification data 308.

[0100] Regarding the contour information extraction unit 301 of the plug type discrimination device in the embodiment of the present invention, a method for acquiring contour information will be described with reference to Figs. 12a, 12b, 12c, 12d and 13.

[0101] Fig. 12a is a diagram for explaining an image of the top surface of a plug in the first embodiment of the present invention. As an example of feature extraction of a pattern drawn on the top surface of a plug, a plug with a pattern on the edge of the top surface of the plug is used. The cut-out range in the figure can be specified by searching the masked plug region in the horizontal and vertical directions using the plug top cut-out image data signal 105.

[0102] For example, the height of the cut-out area is found by detecting the vertical position where the first and last pixels in the masked plug area are found by moving vertically using a horizontal scanning line, and measuring the distance between the two points. Similarly, the width of the cut-out area is found from the horizontal positions of the two points obtained by moving horizontally using the vertical scanning line.

[0103] FIG. 12b is a diagram for explaining a method for expanding the cut-out image of the top surface of the plug in the first embodiment of the present invention.

[0104] The extension method may involve assuming that the top surface of the plug is circular and extending the cut-out range to a square, or the extension ratio may be calculated based on the installation angle of the imaging device.

[0105] FIG. 12c is a diagram illustrating a contour extraction image of the top surface of the plug in the first embodiment of the present invention.

[0106] For the contour detection, a Sobel filter, a Laplacian filter, or the Canny method may be used. Using the contour extraction image, the scanning line sl is moved vertically from the diagonal line d1 to the diagonal line d2, and the contour image is reconstructed in a coordinate system in which the position of the detected contour pixels on the scanning line sl is the horizontal coordinate and the vertical position of the scanning line sl is the vertical coordinate.

[0107] FIG. 12d is a diagram illustrating an image of extracted contour features of the top surface of the plug in the first embodiment of the present invention.

[0108] In the image reconstructed by the method described in Fig. 12c, the circular, i.e. angular, contours become vertical lines, and the radial, i.e. radial, contours become horizontal lines. Also, in Fig. 12c, the length of the scan line sl changes between the diagonal line position and the horizontal line position passing through the center, so there are areas of missing data in the reconstructed image.

[0109] FIG. 13 is a diagram for explaining a feature extraction method using a contour feature extraction image of the plug top surface in the first embodiment of the present invention.

[0110] To extract the contour features, the contour feature extraction image is scanned horizontally and vertically, and contour pixels are counted at horizontal and vertical positions to create a frequency distribution map of the contour.

[0111] That is, for the vertical direction, a horizontal contour distribution map is created by counting contour pixels for the horizontal position, and for the horizontal direction, the left and right sides are scanned separately from the center position for the vertical position to create a vertical contour distribution map (left side) and a vertical contour distribution map (right side). When creating the distribution map, the accuracy decreases near the center, so the area is considered an invalid range and is not counted for contour pixels.

[0112] By detecting the peak of the horizontal contour distribution map, the number of circular contours that appear as rings on the top surface of the plug and the radius of the circles can be obtained, and by detecting the peaks of the vertical contour distribution map (left side) and the vertical contour distribution map (right side), the angle and number of radial contours can be obtained.

[0113] The detection of contours based on peaks can be performed by threshold judgment. For example, in each of the horizontal and vertical contour distribution maps, it is detected that the horizontal contour peak is equal to or greater than a threshold value Th, and it is detected that the vertical contour peak is equal to or greater than a threshold value Tv.

[0114] FIG. 12e is a diagram illustrating a contour extraction image at a transposed position on the top surface of the plug in accordance with the first embodiment of the present invention.

[0115] In the description of FIG. 12c, contour detection was performed while moving the scanning line in the vertical direction from diagonal line d1 to diagonal line d2. Similarly, by performing contour detection while moving the scanning line in the horizontal direction from diagonal line d2 to diagonal line d1, all-directional contour information can be obtained.

[0116] As described above, the extended image was created from the cut-out image of the top surface of the stopper in FIG. 12b, but it is not actually necessary. By taking into account the magnification factor in the calculations of FIGS. 12c, 12d, and 13, the contour information can be calculated.

[0117] Also, regarding the contour information extraction unit 301 of the stopper type discrimination device in the embodiment of the present invention, the method of obtaining the undulations due to the unevenness of the top surface of the stopper will be described with reference to FIGS. 9c, 10a, 10b, and 12a.

[0118] As shown in FIG. 9c, a concave depression can create a shadow on the upper half of the top surface of the stopper, and a convex protrusion can create a shadow on the lower half of the top surface of the stopper. Also, in the case of only a flat surface, no shadow appears.

[0119] Therefore, for the mask image shown in FIG. 10a, the masked range covered by the mask image shown in FIG. 10b is synthesized to obtain the masked range, and the number of pixels in the area where the mask value of the synthesized masked range is "0" is counted separately for the upper half and the lower half to obtain the undulation information.

[0120] For example, assuming that the number of pixels in the upper half is Nu, the number of pixels in the lower half is Nl, and the determination threshold for undulation is Tb, a flat stopper can be discriminated when Nu < Tb and Nl < Tb, a concave stopper when Nu ≥ Tb and Nl < Tb, a convex stopper when Nu < Tb and Nl ≥ Tb, and a stopper with unevenness or engraving such as a pattern or characters when Nu ≥ Tb and Nl ≥ Tb, into four types of undulation information.

[0121] The shape information signal 303 output by the contour information extraction unit 301 may be a signal composed of all of the above-described contour information and undulation information, or may be a signal composed of any one of them.

[0122] Next, the color information extraction unit 302 can obtain the color by examining the color distribution of the cut-out image of the top surface of the plug in FIG. 12a.

[0123] The color space for calculating the color distribution may be, for example, RGB, YCbCr with color difference channels, or l*a*b*, HSV, or HSL. For example, a plug consisting of two colors, red and green, can be identified by the appearance of two peaks around 0° and 120° in hue using the HSV color space.

[0124] The color information signal output from the color information extraction unit 302 may be configured with the channels of the color space used for discrimination, or may be configured with the channels when converted into a specific color space.

[0125] Next, the plug type information search unit 305 in the first embodiment of the present invention searches for plug type identification data 308 registered in advance in the plug type data unit 307 using a search key 306 created from the shape information signal 303 and the color information signal 304. For example, the product number of the specimen container may be registered in the plug type data unit 307, or classification information required for discriminating the plug type, such as the uncapping means and the type of specimen, may be registered.

[0126] The plug type discrimination unit 300 has been described above with reference to the configuration shown in FIG. 4. However, a discriminator may be used that is obtained by learning image data from the plug upper portion cut-out image data signal 105 using a model such as a CNN (Convolutional Neural Network) using two-dimensional convolution.

[0127] Alternatively, a matching method may be used in which a plug pattern is prepared in advance as a template image and a match with the extracted image data signal 105 is checked, that is, a template matching method or the like.

[0128] FIG. 19 is a flowchart illustrating a plug type discrimination method in the first embodiment of the present invention.

[0129] In the plug type discrimination method in the first embodiment of the present invention, the image acquisition unit 101 receives a notification signal 51 from the conveying device 50 notifying that the plug has been installed (step S1), sends a dimming signal 103 to the dimming unit 104 to turn on the diffuse reflection lighting device 20 and the specular reflection lighting device 30 (step S2), and captures a specular reflection image with the imaging device 10 (step S3).

[0130] After capturing the specular reflection image, a dimming signal 103 is sent to the dimming unit 104 to turn off the specular reflection lighting device 30 (step S4), and a diffuse reflection image is captured (step S5).

[0131] After capturing the diffuse reflection image, a dimming signal 103 is sent to the dimming unit 104 to turn off the diffuse reflection lighting device 20 (step S6).

[0132] Next, the plug top surface image acquisition unit 200 creates a plug top cut-out image data signal 105 from the captured specular reflection image and diffuse reflection image (step S200).

[0133] The plug type discrimination unit 300 acquires a plug type identification data signal 41 based on a shape information signal 303 and a color information signal 304 created from the plug upper portion cut-out image data signal 105 (step S300), and displays the acquired plug type identification data signal 41 on the display device 40 (step S7).

[0134] FIG. 20 is a flowchart illustrating an example of a method for acquiring an image of the top surface of a plug in the plug type discriminating device in the first embodiment of the present invention.

[0135] In the method of acquiring the plug top surface image in the embodiment 1 of the present invention, the specular reflection image input to the grayscale image conversion unit 201, i.e., the image data signal 102 of one frame when the specular reflection lighting device 30 is turned on, is converted to grayscale by the grayscale image conversion unit 201 (step S201), and the grayscale image data signal output from the grayscale image conversion unit 201 is stored in the image storage unit 203 (step S202).

[0136] Next, the diffuse reflection image input to the grayscale image conversion unit 201, i.e., the image data signal 102 of one frame when the specular reflection lighting device 30 is turned off, is converted to grayscale by the grayscale image conversion unit 201 (step S20), and a differential image data signal 206 is created from the grayscale image data signal 202 and the grayscale image data signal 204 stored in the differential image creation unit 205 (step S204), and a mask image creation unit 207 binarizes the differential image data signal 206 using a threshold value Ts to create a mask image data signal 208 (step S205).

[0137] Next, the plug top image cutting-out unit 209 uses the mask image data signal 208 to cut out the plug top image from the diffuse reflection image, i.e., one frame of the image data signal 102 when the specular reflection lighting device 30 is turned off, thereby creating a plug top cut-out image data signal 105 (step S206).

[0138] FIG. 21 is a flowchart illustrating an example of a plug type discrimination method of the plug type discrimination device in the first embodiment of the present invention.

[0139] In the plug species discrimination method in the first embodiment of the present invention, the contour information extraction unit 301 extracts contour and undulation information from the input plug upper portion cut-out image data signal 105 to create a shape information signal 303 (step S301), and the color information extraction unit 302 creates a color information signal 304 from the input plug upper portion cut-out image data signal 105 (step S302).

[0140] Next, a plug species information search unit 305 receives a search key 306 created from the shape information signal 303 and the color information signal 304, and searches for plug species identification data 308 registered in advance in a plug species data unit 307 (step S303).

[0141] Here, the image processing device 100 in this embodiment may be implemented by an LSI or an FPGA, or may be implemented by a program such as a CPU or a GPU.

[0142] As described above, according to this embodiment, by using two lighting devices, one for specular reflection and one for diffuse reflection, for the stoppers of specimen containers that have specular reflection, it is possible to extract an image of the top surface of the stopper regardless of its color or material, and by capturing the undulating characteristics due to specular reflection and the color and contour information due to diffuse reflection, it is possible to provide a stopper type discrimination device and method that can suitably discriminate the type of stopper. EXAMPLES

[0143] In the first embodiment, an example of a plug type discrimination device was described in which two lighting devices, one for specular reflection and one for diffuse reflection, were used to extract an image of the top surface of the plug by specular reflection, and then the plug type was discriminated based on color information of the image, such as contour and color distribution. In the second embodiment, a configuration using optical components instead of the lighting device for specular reflection in the first embodiment of the present invention will be described.

[0144] The plug type discriminating device in this embodiment includes a rotating mirror device 60 for specular reflection instead of the illumination device 30 for specular reflection in FIG.

[0145] FIG. 5a is a diagram for explaining an example of a device configuration of a plug type determining device in Example 2 of the present invention.

[0146] The plug type discrimination device in this embodiment has an imaging device 10, a diffuse reflection lighting device 20 for illuminating a specimen container W from the imaging device side, and a mirror reflection rotating mirror device 60 installed on the opposite side of the specimen container W from the imaging device in a position where the light from the diffuse reflection lighting device 20 is mirror-reflected on the top surface of the plug of the specimen container W, and is also equipped with an image processing device 100, a display device 40, and a transport device 50 for placing the specimen container W at the imaging position.

[0147] The rotating mirror device 60 for specular reflection uses an optical component as a substitute for a lighting device for specular reflection, and controls the turning on and off of the light by rotating, for example, a hexagonal prism with mirrors and light-blocking painted surfaces attached alternately on three sides at a time by 60° using a motor.

[0148] FIG. 5b is a diagram for explaining an example of a rotating mirror device for specular reflection in the second embodiment of the present invention.

[0149] In FIG. 5a, an example is shown in which a mirror and a light-blocking coating are applied to a polygonal surface as a substitute for a specular reflection lighting device, but it is also possible to use a single mirror plate with a light-blocking coating on the back side that is rotated 180°.

[0150] FIG. 5c is a diagram illustrating an example of a dressing table with a rotating plate device according to the second embodiment of the present invention.

[0151] In Figures 5a and 5b, an example is shown in which a rotating mirror is used as a substitute for a specular reflection lighting device, but it is also possible to rotate a light-shielding plate with cutouts and coated with light-shielding paint, as shown in Figure 5c.

[0152] FIG. 6 is a block diagram illustrating an example of the configuration of a plug type determining device according to the second embodiment of the present invention.

[0153] The plug type discrimination device in the second embodiment of the present invention includes an image acquisition unit 101 that receives as input signals a notification signal 51 indicating that a specimen container has been placed at an imaging position from a transport device 50 and an imaging data signal 11 output from an imaging device 10 that images the specimen container, and outputs a dimming signal 103 to a dimming unit 106 and a rotation control unit 107 and an image data signal 102 for one frame, an illumination device 20 for diffuse reflection that is controlled to be turned on and off by an illumination control signal 21 for diffuse reflection output from the dimming unit 106, and a rotating mirror device 60 for specular reflection that is controlled to be turned on and off at a rotation angle by a rotation control signal 61 output from the rotation control unit 107, and further includes a plug top image acquisition unit 200 that receives as an input signal the image data signal 102 and outputs a plug top cut-out image data signal 105, and a plug type discrimination unit 300 that receives as an input signal the plug top cut-out image data signal 105 and outputs a plug type identification data signal 41 for displaying the result of the plug type discrimination on a display device 40.

[0154] FIG. 22a is a flowchart illustrating a plug type discrimination method according to the second embodiment of the present invention.

[0155] In the plug type discrimination method in the second embodiment of the present invention, the image acquisition unit 101 receives a notification signal 51 from the conveying device 50 notifying that the plug has been installed (step S1), sends a dimming signal 103 to the dimming unit 106 to turn on the diffuse reflection lighting device 20 (step S2), and also rotates the mirror surface of the mirror of the mirror rotation device 60 for specular reflection by the rotation control unit 107 in response to the dimming signal 103 so that the light from the diffuse reflection lighting device 20 illuminates the top surface of the plug (step S101), and captures a specular reflection image (step S102).

[0156] Next, the mirror of the rotating mirror device 60 for specular reflection is rotated by the dimming signal 103 to an angle where the reflective surface is at the painting position so that the light from the lighting device 20 for diffuse reflection does not illuminate the top surface of the plug (step S101), and a diffuse reflection image is captured (step S102).

[0157] After capturing the diffuse reflection image, a dimming signal 103 is sent to the dimming unit 106 to turn off the diffuse reflection lighting device 20 (step S6), and the plug top image acquisition unit 200 creates a plug top cut-out image data signal 105 from the captured specular reflection image and diffuse reflection image (step S200).

[0158] The plug type discrimination unit 300 acquires a plug type identification data signal 41 based on a shape information signal 303 and a color information signal 304 created from the plug upper portion cut-out image data signal 105 (step S300), and displays the acquired plug type identification data signal 41 on the display device 40 (step S7).

[0159] FIG. 22b is a flowchart illustrating a rotation control method based on timing in the plug type determining device according to the second embodiment of the present invention.

[0160] In the method of controlling rotation based on timing of the plug type discrimination device in the second embodiment of the present invention, the image acquisition unit 101 receives a notification signal 51 from the conveying device 50 notifying that the plug type discrimination device has been installed (step S1), and sends a dimming signal 103 to the dimming unit 106 to turn on the diffuse reflection lighting device 20 (step S2).

[0161] When the dimming signal 103 instructs the light to be turned on, the rotation control unit 107 rotates the mirror of the rotating mirror device 60 for specular reflection (S111). When the light from the lighting device 20 for diffuse reflection is reflected by the mirror of the rotating mirror device 60 for specular reflection and reaches an angle at which it illuminates the top surface of the plug, the imaging device 10 captures a specular reflection image (S112).

[0162] The timing of imaging may be controlled by the elapsed time, or a sensor that measures the timing of imaging on the mirror surface and the light-shielding coated surface may be added to the rotating mirror device 60 for specular reflection so as to be linked to the shutter of the imaging device 10, or the dimming signal 103 of the image acquisition unit 101 may be made bidirectional to notify the timing of imaging. Also, compared to a lighting device for diffuse reflection, the installation and direction adjustment of the lighting device for specular reflection must be performed more precisely, but the angle of the specular reflected light can be easily adjusted by adjusting the timing of imaging.

[0163] Next, after capturing the specular reflection image, the imaging device 10 captures a diffuse reflection image at an angle where the light from the diffuse reflection lighting device 20 is not reflected by the mirror by the rotating mirror device 60 for specular reflection, i.e., at a timing where the light does not illuminate the top surface of the stopper due to the light-shielding painted surface (S113).

[0164] Next, after capturing the specular reflection image, a dimming signal 103 is sent to the dimming unit 106 to turn off the diffuse reflection lighting device 20 (step S6). When the dimming signal 103 instructs turning off the lighting device 20, the rotation control unit 107 stops the rotation of the mirror of the rotating mirror device 60 for specular reflection (S114).

[0165] Next, the plug top image acquisition unit 200 creates a plug top cutout image data signal 105 from the captured specular reflection image and diffuse reflection image (step S200). The plug type discrimination unit 300 acquires a plug type identification data signal 41 from a shape information signal 303 and a color information signal 304 created from the plug top cutout image data signal 105 (step S300), and displays the acquired plug type identification data signal 41 on the display device 40 (step S7).

[0166] Here, the plug type discrimination device in this embodiment has been described as an example in which a mirror is used as the optical component instead of a lighting device for specular reflection, but any device having similar functions using optical components such as a prism or half mirror may be used.

[0167] As described above, according to this embodiment, it is possible to provide a method that enables easy adjustment of the angle of the light source by using an optical member for illumination for specular reflection. EXAMPLES

[0168] In the first and second embodiments, an example of a plug type discrimination device was described in which two light sources, one for specular reflection and one for diffuse reflection, were used to capture undulating features by specular reflection, extract a plug image of the top surface of the plug by diffuse reflection, and then discriminate the plug type based on color information of the image, such as the contour and color distribution.

[0169] In the third embodiment, an example of a plug type discriminating device in which an imaging device for imaging a specimen container from the side and a backside illumination device are added to the first embodiment according to the present invention will be described.

[0170] FIG. 14 is a diagram for explaining an example of a device configuration of a plug type determining device in the third embodiment of the present invention.

[0171] The plug type discrimination device in this embodiment has two illumination devices: an imaging device 10, a diffuse reflection illumination device 20 for illuminating the specimen container W from the imaging device side, and a specular reflection illumination device 30 installed on the opposite side of the specimen container W from the imaging device in a position where the specimen container W is mirror-reflected by the top surface of the plug of the specimen container W. The device also includes an image processing device 100, a display device 40, a transport device 50 for placing the specimen container W at the imaging position, an imaging device 70 for imaging the specimen container W from the side, and a backside illumination device 80 for illuminating the specimen container W from the back.

[0172] The backlighting device 80 is preferably a rectangular panel light source with little luminance unevenness, since it illuminates the sample container W from behind to extract the silhouette of the sample container W. The imaging device 70 may be installed so that the entire sample container is captured in an image captured using the backlighting device 80, for example, so that an error sample can be identified.

[0173] FIG. 15a is a block diagram illustrating an example of the configuration of a plug type determining device according to a third embodiment of the present invention.

[0174] The plug type discrimination device in the third embodiment of the present invention receives as input signals a notification signal 51 from a transport device 50 indicating that a specimen container has been placed at an imaging position and an imaging data signal 11 output from an imaging device 10 that images the specimen container, receives as input signals a light adjustment signal 103 to a light adjustment unit 114, an image acquisition unit 101 that outputs an image data signal 102 for one frame, a light adjustment signal 103 output from the image acquisition unit 101, and an imaging data signal 71 output from an imaging device 70 that images the specimen container, and controls a light adjustment the image acquisition unit 101 outputs a dimming signal 103 to the dimming unit 114 and one frame of image data signal 112; a diffuse reflection lighting device 20 whose on / off state is controlled by a diffuse reflection lighting control signal 21 output from the dimming unit 114; a specular reflection lighting device 30 whose on / off state is controlled by a specular reflection lighting control signal 31 output from the dimming unit 114; and a backside lighting device 80 whose on / off state is controlled by a backside lighting control signal 81 output from the dimming unit 114.

[0175] The device further includes a plug top image acquisition unit 200 which receives the image data signal 102 as an input signal and outputs a plug top cut-out image data signal 105, a plug side image acquisition unit 250 which receives the image data signal 112 as an input signal and outputs a dimension information signal 115, and a plug type discrimination unit 350 which receives the plug top cut-out image data signal 105 and the dimension information signal 115 as input signals and outputs a plug type identification data signal 41 for displaying the result of the plug type discrimination on the display device 40.

[0176] FIG. 16 is a block diagram illustrating an example of the configuration of a plug side image acquisition unit of a plug type discrimination device in Example 3 of the present invention.

[0177] The plug side image acquisition unit 250 in the third embodiment of the present invention includes a color distribution determination unit 251 that receives the image data signal 112 as an input signal and outputs a binary image signal 252 that identifies pixels that pass through a color space determined by a threshold value Tc, a frequency distribution creation unit 253 that receives the binary image signal 252 and outputs a frequency distribution data signal 254, and a dimension detection unit 255 that receives the frequency distribution data signal 254 and outputs a dimension information signal 115.

[0178] Next, a method for generating the binary image signal 252 in the third embodiment of the present invention will be described with reference to Figs. 18a and 18b.

[0179] FIG. 18A is a diagram for explaining an example of color distribution thresholds using the HSV color space of the plug side image acquisition unit in the third embodiment of the present invention.

[0180] The color distribution threshold for creating a binarized image will be explained using the HSV color space. The HSV color space is expressed as a cylindrical coordinate or a cone-shaped coordinate with the axes of Hue, Saturation, and Value, as shown in the figure. Generally, the initial letters of these are taken and the hue, saturation, and value are expressed as H, S, and V, respectively. In this explanation, cylindrical coordinates will be used.

[0181] Hue H is expressed as an angle around the central axis of the cylinder, and for example, from 0° to 60°, the colors are expressed as red, yellow, green, cyan, blue, and magenta. Saturation S represents the shade of the color on the radial axis, and lightness V represents the lightness of the color on the central axis of the cylinder. In this explanation, the numerical values ​​of saturation S and lightness V are expressed as percentages.

[0182] The binary image signal 252 is created by extracting the light source color of the backlighting device 80 that illuminates the back of the specimen container from the plug side image. Here, the case where the light source color of the backlighting device 80 is white will be described using the HSV color space of cylindrical coordinates.

[0183] Colors near white are distributed near the upper center of the cylindrical coordinate system, as shown in the shaded area in the figure (called the partial color space in this explanation). For example, in the partial color space Ct, colors near white are in the light color range in terms of color shading, so if the upper threshold value of saturation is St, they can be expressed in the range [0,St].

[0184] Additionally, colors near white are in the light gamut in terms of color brightness, so if the lower threshold value of brightness is Vt, they can be expressed as [Vt, 100]. As all colors are included in the color family, they can be expressed as the entire range of hue, that is, [0, 360). Thus, the partial color space Ct where the three ranges of hue H, saturation S, and brightness V overlap is a color space close to white.

[0185] Furthermore, for colors other than white, if the upper limit of hue is H0, the lower limit is H1, the upper limit of saturation is S0, the lower limit is S1, and the upper limit of lightness is V0, the lower limit is V1, then the partial color space Ct can be defined as the overlapping range of [H0,H1], [S0,S1], and [V0,V1], i.e., the logical product of the range conditions.

[0186] 16 is the color distribution threshold value defined in the partial color space Ct in the case of the HSV color space, for example. At this time, the binarized image is created by inclusion determination of the threshold value Tc.

[0187] In the present invention, the color distribution defining the threshold value Tc has been described using the HSV color space, but this is not limited to the HSV color space, and any color space capable of defining a partial color space may be used, such as the HSL color space, the RGB color space, or a color space such as YCbCr using color difference signals, or even the l*a*b* color space.

[0188] Furthermore, for example, if the plug to be identified is made of a material that does not transmit light, i.e., is not a translucent material, and the material of the tube is also highly transparent, it is possible to make the determination in a one-dimensional color space without using a three-dimensional color space, for example, by using only a luminance signal Y such as YCbCr and determining that a luminance of Y0 or more is the light source as a threshold value Tc.

[0189] Also, in this description, the color distribution defined by the threshold value has been described as one range, that is, a partial color space, but it may be a range that combines a plurality of ranges.

[0190] FIG. 18b is a diagram for explaining the relationship between the color distribution threshold of the plug side image acquisition unit and a binarized image in the third embodiment of the present invention.

[0191] The binarized image is created by distinguishing between pixels that contain panel light sources and pixels that are not panel light sources in the plug side image.

[0192] In FIG. 16, the image data signal 112 of one frame of the plug side image captured by the imaging device 70 when the backlight device 80 is turned on is used as the color distribution determination unit 251 to generate a binary image signal 252 by setting, for example, pixels included in the partial color space Cw to “1” and pixels not included to “0” using a threshold value Tc.

[0193] Next, a dimension detection method by the dimension detection unit 255 using the binarized image signal 252 in the third embodiment of the present invention will be described with reference to Figs. 18c and 18d.

[0194] FIG. 18c is a diagram illustrating an example of the horizontal frequency distribution of the plug side image acquisition unit and the dimensional measurement of a sample container in Example 3 of the present invention.

[0195] The image based on the binary image signal 252 is configured, for example, with pixels that include a light source as "1" and pixels that do not include a light source as "0." Therefore, in the plug side image, the area where the panel light source of the backlight device can be confirmed is "1" and the semi-transparent or opaque area of ​​the specimen container is "0," so the specimen container W can be detected by detecting pixels that are "1" in the binary image using horizontal scanning lines and counting the number of pixels.

[0196] The frequency distribution creation unit 253 in the present invention moves the horizontal scanning line in the vertical direction and counts the number of pixels to create a distribution map of the number of pixels of the panel light source at the vertical coordinate position, i.e., a horizontal frequency distribution map of the illumination light. In the horizontal frequency distribution map of the illumination light, the number of pixels detected in the horizontal scanning line is a constant value and is also a maximum value, since the width of the panel light source is fixed.

[0197] Therefore, the horizontal scanning line is moved downward from the upper end of the panel light source, and the vertical coordinate position when the number of pixels becomes smaller than the threshold value TL, for example, is determined to be the upper end of the stopper of the specimen container W and recorded as the stopper upper end position. The horizontal scanning line is again moved downward, and when the number of detected pixels again becomes the maximum value of the pixel number of the panel light source or is equal to or greater than the threshold value TL, it is recorded as the stopper lower end position.

[0198] In this case, the distance between the upper end position of the stopper and the lower end position of the stopper is the length of the stopper. Also, the height of the tube bottom of the sample container is, for example, the position of the receiving tray of the transport device and is constant, so the distance between the upper end position of the stopper and the receiving tray position is the length of the sample container.

[0199] FIG. 18d is a diagram illustrating an example of the vertical frequency distribution of the plug side image acquisition unit and the dimensional measurement of a sample container in Example 3 of the present invention.

[0200] The frequency distribution creation unit 253 in the present invention moves the vertical scanning line in the horizontal direction and counts the number of pixels to obtain a distribution map of the number of pixels of the panel light source at the horizontal coordinate position, i.e., a vertical frequency distribution map of the illumination light. At this time, the range of the vertical scanning line is from the top end of the panel light source to the plug bottom position detected from the horizontal frequency distribution map.

[0201] Furthermore, in a vertical frequency distribution diagram of the illumination light, the distance from the top end position of the panel light source to the bottom end position of the plug is the maximum value of the vertical frequency distribution. Therefore, for example, a reference value may be set and the threshold value Tw may be changed according to the ratio to the maximum value. Alternatively, the threshold value Tw may be set as an offset value from the maximum value, that is, a fixed offset value T0 with respect to the maximum value Fmax that changes depending on the specimen container, thereby detecting the frequency drop as shown in equation (8).

[0202]

number

[0203] In the present invention, the vertical scanning line is moved from the left end to the right end of the panel light source, and the horizontal coordinate position when the number of pixels becomes less than the threshold value Tw, for example, is determined to be the left end of the stopper of the specimen container W and recorded as the stopper left end position. The horizontal scanning line is again moved to the right, and when the number of detected pixels again becomes the maximum number of pixels of the panel light source or equal to or greater than the threshold value Tw, it is recorded as the stopper right end position. At this time, the distance between the stopper left end position and the stopper right end position becomes the stopper width.

[0204] In Fig. 16, frequency distribution data signal 254 created in frequency distribution creation unit 253 is, for example, a distribution data signal of the horizontal frequency distribution diagram of illumination light shown in Fig. 18c, and a distribution data signal of the vertical frequency distribution diagram of illumination light shown in Fig. 18d. Also, dimension information signal 115 created in dimension detection unit 255 is, for example, dimension information detected from frequency distribution data signal 254 and composed of the length and width of the stopper and the length of the specimen container.

[0205] FIG. 17 is a block diagram for explaining an example of the configuration of the plug type determining unit of the plug type determining device in the third embodiment of the present invention.

[0206] The plug type discrimination unit 350 in the third embodiment of the present invention includes a contour information extraction unit 301 which receives the plug upper part cut-out image data signal 105 as an input signal and outputs a shape information signal 303, a color information extraction unit 302 which receives the plug upper part cut-out image data signal 105 as an input signal and outputs a color information signal 304, a plug type information search unit 351 which receives the shape information signal 303, the color information signal 304, and the dimension information signal 115 as input signals and outputs a plug type identification data signal 41, and a plug type data unit 307 which receives the search key 306 output from the plug type information search unit 351 and outputs plug type identification data 308.

[0207] Next, the plug type information search unit 351 in the third embodiment of the present invention searches for plug type identification data 308 registered in advance in the plug type data unit 307 using a search key 306 created from the shape information signal 303, the color information signal 304, and the dimension information signal 115. For example, the product number of the specimen container may be registered in the plug type data unit 307, or classification information required for discriminating the plug type, such as the uncapping means and the type of specimen, may be registered.

[0208] FIG. 23 is a flowchart illustrating a plug type discrimination method according to the third embodiment of the present invention.

[0209] In the plug type discrimination method in the third embodiment of the present invention, the image acquisition unit 101 receives a notification signal 51 from the conveying device 50 notifying that the plug has been installed (step S1), sends a dimming signal 103 to the dimming unit 114 to turn on the diffuse reflection lighting device 20 and the specular reflection lighting device 30 (step S2), and captures a specular reflection image with the imaging device 10 (step S3).

[0210] After capturing the specular reflection image, a dimming signal 103 is sent to the dimming unit 114 to turn off the specular reflection lighting device 30 (step S4), and a diffuse reflection image is captured (step S5).

[0211] After capturing the diffuse reflection image, the light control unit 114 transmits a light control signal 103 to turn off the diffuse reflection lighting device 20 (step S6). At the same time, the image acquisition unit 101, which has received a notification by the light control signal 103 that the diffuse reflection lighting device 20 has been turned off, transmits the light control signal 103 to the light control unit 114 to turn on the backlighting device 80 (step S11), and captures an image of the plug side surface with the imaging device 70 (step S12).

[0212] After capturing the plug side image, the image acquisition unit 101 sends a dimming signal 103 to the dimming unit 114 to turn off the backlighting device 80 (step S13).

[0213] Next, the plug top image acquisition unit 200 creates a plug top cutout image data signal 105 from the captured specular reflection image and diffuse reflection image (step S200). The plug side image acquisition unit 250 creates a dimension information signal 115 from the captured plug side image (step S250). The plug type discrimination unit 300 acquires a plug type identification data signal 41 from the shape information signal 303, color information signal 304, and dimension information signal 115 created from the plug top cutout image data signal 105 (step S350), and displays the acquired plug type identification data signal 41 on the display device 40 (step S7).

[0214] FIG. 24 is a flowchart illustrating an example of a method for acquiring an image of a side surface of a plug in the plug type discriminating device in the third embodiment of the present invention.

[0215] In the plug side image acquisition method in the third embodiment of the present invention, the plug side image input to the color distribution determination unit 251, i.e., the image data signal 112 of one frame when the backlight device 80 is turned on, is converted into a binary image signal 252 by the color distribution determination unit 251 (step S251), and a frequency distribution data signal 254 such as a horizontal frequency distribution diagram and a vertical frequency distribution diagram is created by the plug side image acquisition unit 250 from the binary image signal 252 output from the color distribution determination unit 251 (step S252).

[0216] Next, the dimension detection unit 255 creates the dimension information signal 115, such as the length and width of the stopper and the length of the sample container, from the frequency distribution data signal 254 (step S253).

[0217] FIG. 25 is a flowchart illustrating an example of a plug type discrimination method of the plug type discrimination device in the third embodiment of the present invention.

[0218] In the plug type discrimination method in the third embodiment of the present invention, the contour information extraction unit 301 extracts contour and undulation information from the input plug upper portion cut-out image data signal 105 to create a shape information signal 303 (step S301), the color information extraction unit 302 creates a color information signal 304 from the input plug upper portion cut-out image data signal 105 (step S302), and the dimension detection unit 255 acquires the created dimension information signal 115 (step S351).

[0219] Next, the plug type information search unit 351 inputs a search key 306 created from the shape information signal 303, the color information signal 304, and the dimension information signal 115, and searches for the plug type identification data 308 previously registered in the plug type data unit 307 (step S352).

[0220] FIG. 15b is a block diagram illustrating an example of an additional configuration of the plug type determining device in the third embodiment of the present invention.

[0221] The present invention is an apparatus for discriminating plug types described in FIG. 15a, in which an error sample section 116 is added as a sample container so that, for example, an error sample can be detected as a secondary effect from one frame of image data signal 112 captured using an imaging device 70 and a backlighting device 80.

[0222] The plug type discrimination device in the third embodiment of the present invention receives as input signals a notification signal 51 from a transport device 50 indicating that a specimen container has been placed at an imaging position and an imaging data signal 11 output from an imaging device 10 that images the specimen container, receives as input signals a light adjustment signal 103 to a light adjustment unit 114, an image acquisition unit 101 that outputs an image data signal 102 for one frame, a light adjustment signal 103 output from the image acquisition unit 101, and an imaging data signal 71 output from an imaging device 70 that images the specimen container, and controls a light adjustment the image acquisition unit 101 outputs a dimming signal 103 to the dimming unit 114 and one frame of image data signal 112; a diffuse reflection lighting device 20 whose on / off state is controlled by a diffuse reflection lighting control signal 21 output from the dimming unit 114; a specular reflection lighting device 30 whose on / off state is controlled by a specular reflection lighting control signal 31 output from the dimming unit 114; and a backside lighting device 80 whose on / off state is controlled by a backside lighting control signal 81 output from the dimming unit 114.

[0223] The device further includes a plug top surface image acquisition unit 200 which receives the image data signal 102 as an input signal and outputs a plug top cut-out image data signal 105, a plug side surface image acquisition unit 250 which receives the image data signal 112 as an input signal and outputs a dimension information signal 115, a plug type discrimination unit 350 which receives the plug top cut-out image data signal 105 and the dimension information signal 115 as input signals and outputs a plug type identification data signal 41 for displaying the result of the plug type discrimination on a display device 40, an error detection unit 116 which receives one frame of image data signal 112 as an input signal, replaces the plug type identification data signal 41 with an error identification signal E, and outputs an error signal 117 which converts it into an error-containing plug type identification data signal 42, and a display device 40 which displays the error-containing plug type identification data signal 42.

[0224] The error detection unit 116 according to the present invention notifies an error in advance so that foreign matter, etc., mixed in the supernatant of serum plasma, etc., does not clog the nozzle of the inspection device. For example, a method of detecting foreign matter may use a discriminator obtained by learning an image of a foreign matter using a model such as a CNN (Convolutional Neural Network) using two-dimensional convolution, or, for example, as shown in Fig. 18c, a decrease in intensity may be determined as a foreign matter based on the color distribution of the supernatant of serum plasma, etc., instead of the color distribution of the light source.

[0225] As described above, according to this embodiment, the accuracy of plug type determination can be improved by detecting dimensional information of the sample container using back lighting and an imaging device for side imaging, and by using an imaging device for side imaging, a technology can be provided that can simultaneously perform error sample detection, etc. as a secondary effect. EXAMPLES

[0226] Examples of the plug type discriminating device have been described in the first to third embodiments. In the fourth embodiment, a configuration of a specimen processing system using the plug type discriminating device in the first to third embodiments according to the present invention will be described.

[0227] FIG. 26a is a diagram illustrating an example of a sample processing system according to a fourth embodiment of the present invention.

[0228] The specimen processing system in this embodiment comprises a transport device 502 for setting a specimen container 501 in the specimen processing system, and a plug type discrimination device 1a which carries in the specimen container 52 before being photographed and transported by the transport device 502, takes an image for determining the type of stopper, and then carries out the photographed specimen container 53, and outputs a plug type identification data signal 41. The system also comprises a sorting device 503 which sorts specimen containers 504 containing specimens requiring preprocessing and specimen containers 505 containing specimens not requiring preprocessing based on the plug type identification data signal 41, a preprocessing device 506 which performs preprocessing on the specimen container 504 containing the specimen requiring preprocessing, and an analyzing device 508 which performs analysis on the specimen container 507 containing the preprocessed specimen.

[0229] The plug type discrimination device 1a may be, for example, a device having the configuration shown in Figures 1 and 2, or a device having the configuration shown in Figures 5a and 6, or a device having the equipment configuration shown in Figures 5b or 5c instead of the optical components of Figure 5a.

[0230] The sorting device 503 is a device that sorts samples into those to be sent to the pre-processing device 506 and those to be sent to the analytical device 508 based on the plug type identification data signal 41 output from the plug type discrimination device 1a. The sorting method can be, for example, by treating the plug type identification data signal 41 as a 1-bit signal, and sorting into sample container 504 containing a sample that requires pre-processing when it is "1", and into sample container 505 containing a sample that does not require pre-processing when it is "0".

[0231] The pretreatment device 506 may be, for example, a centrifuge device, a dispensing device, a capping device, or the like, or may be composed of these devices.

[0232] Furthermore, the analysis device 508 may be, for example, a biochemical analysis device, an immunoanalysis device, a blood cell counter, or the like, or may be configured with these devices.

[0233] FIG. 26b is a diagram illustrating an example of a sample processing system including error sample processing in Example 4 of the present invention.

[0234] The specimen processing system in this embodiment includes a transport device 502 for setting a specimen container 501 in the specimen processing system, and a plug type discrimination device 1b which transports the specimen container 52 before being photographed, transported by the transport device 502, takes an image for determining the type of stopper, and then transports the photographed specimen container 53, and outputs an error-containing plug type identification data signal 42. The specimen processing system is also equipped with a sorting device 511 which sorts specimen containers 513 containing error specimens and specimen containers 512 containing no error specimens based on the plug type identification data signal 42, a sorting device 503 which sorts specimen containers 504 containing specimens requiring preprocessing and specimen containers 505 containing specimens not requiring preprocessing, a preprocessing device 506 which performs preprocessing on the specimen container 504 containing the specimen requiring preprocessing, and an error discharge device 517 which discharges the specimen container 513 containing the error specimen, and an analyzing device 508 which performs analysis on the specimen container 507 containing the preprocessed specimen.

[0235] The sorting devices 511 and 503 are devices that identify the specimen discharged by the error discharge device 517 based on the plug type identification data signal 42 output from the plug type discrimination device 1b, and sort the specimen into one to be sent to the pretreatment device 506 and one to be sent to the analysis device 508.

[0236] A sorting method, for example, is to make the plug type identification data signal 42 a two-bit signal, and when the lowest bit is "1", it is sorted as a specimen container 513 containing an error sample, and when it is "0", it is sorted as a specimen container 512 without an error sample. Also, when the highest bit is "1", it is sorted as a specimen container 504 containing a sample that requires preprocessing, and when it is "0", it is sorted as a specimen container 505 containing a sample that does not require preprocessing.

[0237] 26a and 26b show an example of one pretreatment device and one analysis device, but it may be configured with multiple devices. When multiple pretreatment devices or analysis devices are used, multiple sorting devices or a sorting device capable of sorting to multiple sorting destinations are required. As a sorting method, for example, a plug type identification data signal 41 or an error-containing plug type identification data signal 42 consisting of bits for the number of sorting devices may be used, and sorting may be performed by determining whether or not the identification number for the number of sorting devices corresponds to the number of the sorting devices.

[0238] As described above, according to this embodiment, it is possible to provide a specimen processing system capable of suitably processing specimens using a plug type discrimination device. [Explanation of symbols]

[0239] 11 Imaging data signal 21 Diffuse reflection lighting control signal 31 Specular reflection lighting control signal 41 Species identification data signal 42 Errored plug identification data signal 51 Notification signal 52 Sample container before imaging 53 Sample container after imaging 61 Rotation control signal 71 Imaging data signal 81 Rear lighting control signal 102 1 frame image data signal 103 Dimming Signal 105 Plug top cutout image data signal 112 1 frame image data signal 113 Dimming Signal 115 Dimensional information signal 202 Grayscale image data signal 204 Stored grayscale image data signal 206 Differential image data signal 208 Mask image data signal 252 binary image signal 254 frequency distribution data signal 303 Shape Information Signal 304 Color Information Signal 306 Search Key 308 Species Identification Data 501,512 Sample container 504 Sample container containing a sample that requires pretreatment 505 Sample container containing a sample that does not require pretreatment 507 Sample container containing pretreated sample 513 Sample container containing an error sample

Claims

1. a first irradiation mechanism that irradiates light onto the identified article in order to capture a diffuse reflection image of the identified article; a second irradiation mechanism that irradiates light onto the identified article to obtain a specular reflection image of the identified article; An imaging mechanism for imaging the object to be identified; While a first irradiation mechanism is irradiating light onto the identified article, a plurality of images of the identified article are taken by changing the amount of light emitted by the second irradiation mechanism; A discrimination mechanism that discriminates the type of the discriminated article based on a difference image of a plurality of images captured by the imaging mechanism; An article type discrimination device comprising:

2. 2. The article type discrimination device according to claim 1, The differential image is a differential image of a grayscale image, a mask image is created based on the differential image, and the discrimination mechanism discriminates the type of the discriminated item based on an image of the discriminated item extracted based on the mask image.

3. 2. The article type discrimination device according to claim 1, a position from which the first irradiation mechanism emits light is located within a hemisphere on the side of the imaging mechanism of a virtual sphere with the article to be identified at its center; an object type discriminating device, characterized in that a position from which the second irradiation mechanism emits light is provided in a hemisphere different from a position from which the first irradiation mechanism emits light;

4. 2. The article type discrimination device according to claim 1, An article type discrimination device, wherein light from a common light source is guided to said first irradiation mechanism and said second irradiation mechanism.

5. 5. The article type discrimination device according to claim 4, An article type discrimination device, characterized in that a portion of the light from the common light source is redirected by an optical component that refracts light, and further comprising a light blocking means that blocks at least a portion of the light beam.

6. 6. The article type discrimination device according to claim 5, An article type discrimination device comprising a rotation drive unit for changing the angle of the optical components.

7. In the article type discrimination device according to any one of claims 1 to 5, 2. An article type discrimination device, comprising: a cap for a specimen container;

8. The article type discrimination device according to claim 7 is provided, The sample processing system further comprises a transport mechanism for transporting the sample container to an imaging position, and a display mechanism for displaying the result of discrimination by the item type discrimination device.

9. 9. The sample processing system according to claim 8, an imaging device for imaging the sample container from the side; a backside illumination device that illuminates the specimen container from the backside toward the imaging device; A sample processing system comprising:

10. 10. The sample processing system according to claim 9, a foreign object detection unit that detects foreign objects in a specimen based on an image captured by an imaging device that captures an image from the side, said foreign object detection unit comprising:

Citation Information

Patent Citations

  • Appearance inspection device

    JP2018112568A