Method and laboratory system for determining at least one container information regarding a sample container in a laboratory
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- F HOFFMANN LA ROCHE & CO AG
- Filing Date
- 2023-04-28
- Publication Date
- 2026-04-17
AI Technical Summary
Existing methods for determining container information in laboratory settings are limited in accuracy, completeness, and reliability, as they often rely solely on luminance or color information, or depth information, without effectively combining these for comprehensive inspection.
A method and laboratory system that obtain images with luminance and/or color information and depth maps, and then fuse this information to determine container properties such as presence, position, cap status, and sample level, enabling more accurate and reliable container handling.
The fusion of luminance and color information with depth information allows for more accurate and reliable determination of container information, enhancing the precision and reliability of container handling processes, particularly in laboratory settings.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method and a laboratory system for determining at least one container information, particularly any one, regarding a laboratory sample container.
Background Art
[0002] U.S. Patent Application Publication No. 2019 / 0108396 discloses a method for identifying and tracking objects, which includes using a three-dimensional (3D) scanning system to capture one or more 3D models for one or more objects in a scene, the 3D models including color and geometric information of the one or more objects; calculating, by an analysis agent, one or more descriptors for the one or more 3D models, each descriptor corresponding to a fixed-length feature vector; and obtaining metadata for identifying the one or more objects based on the one or more descriptors.
[0003] U.S. Patent Application Publication No. 2016 / 0018427 discloses combining container identification data from a container inspection unit that analyzes a container containing a liquid and liquid level detection raw data from a liquid level detection unit that analyzes a container containing a liquid to generate a liquid level detection result. The liquid level detection result is compared with additional data from the container inspection unit. The result can be used to plan the path of the container in a laboratory automation system.
[0004] Japanese Patent Application Laid-Open No. 2019-504997 discloses a method and apparatus adapted to quantify a sample from a plurality of side views.
Summary of the Invention
[0005] An object of the present invention is to provide a method and a laboratory system for determining at least one container information, particularly any one, regarding a laboratory sample container, and in particular, a method and a laboratory system having improved characteristics.
[0006] This object is solved by the method and the laboratory system defined in the independent claims. Preferred embodiments are defined in the dependent claims.
[0007] The present invention relates to a method for determining at least one container information regarding a laboratory sample container, a) obtaining an image including luminance and / or color information of a possible area or a potential area of the container; b) obtaining a map including depth information of the same or an identical area in particular; c) determining the container information by fusing, in particular, the luminance and / or color information with the depth information with each other and relates to a method including these steps.
[0008] This makes it possible to determine the container information, in particular by fusing luminance and / or color information with depth information, and thus to inspect the container more accurately, and / or more completely, and / or more reliably, and / or without doubt, than would be possible if only one such information were used alone.
[0009] In particular, the method, determination, acquisition, and / or fusion may be performed automatically.
[0010] The phrase "container property of..." may be used synonymously with the phrase "container information about...". In particular, the property may be a physical property.
[0011] (In particular, each) information may include content and / or values.
[0012] The term "having" may be used synonymously with the term "comprising".
[0013] The container may be made of glass, or (in particular, transparent and / or colorless) plastic or any other (to a certain extent) rigid material. In addition to, or instead of, this, the container may be configured as a tube.
[0014] The term "capturing" may be used synonymously with the term "acquiring".
[0015] Images and maps can be acquired, in particular, from the same or identical viewpoints. In addition to, or instead of, this, the images and / or maps may be digital.
[0016] The image may be a luminance and / or color image. In addition to, or instead of, this, the image may be two-dimensional.
[0017] The terms "representing" or "containing" may be used synonymously with the term "comprising".
[0018] The luminance information may in particular be the luminance information of a given color.
[0019] The term "data" may be used synonymously with the term "information".
[0020] The container may be present in the possible region. In addition to, or instead of, this, a container carrier for transporting, in particular transferring, the container may be present in the possible region. In particular, an empty carrier may be present in the possible region, and there may be a container there. In addition to, or instead of, this, the carrier may have a white color.
[0021] The map may be a depth map. In particular, the term "depth profile" may be used synonymously with the term "depth map". In addition to, or instead of, this, the map may be three-dimensional, or may have two dimensions and one additional third dimension, and the third dimension may be related to the height on a plane defined by the other two dimensions, or may indicate how the height of the upper surface of a specific region changes in two dimensions.
[0022] The depth information may be related to the at least one (in particular, surface) distance of at least one object (in particular, of the scene) from the viewpoint.
[0023] The phrase "distance information" may be used synonymously with the phrase "depth information".
[0024] Depth information may be different from and / or independent of luminance and / or color information, and / or may be complementary to luminance and / or color information, and / or may be correlated with luminance and / or color information.
[0025] The term "combining" may be used synonymously with the term "fusing".
[0026] Step b) may be performed before step a), may be performed simultaneously with step a), and / or may be performed after step a).
[0027] Step c) may be performed after step a) and step b).
[0028] This method, particularly step a), step b), and / or step c), may be performed again and / or repeated, particularly multiple times.
[0029] In particular, step b) may include non-contact measurement of the area. In particular, the non-contact measurement may use ultrasonic waves.
[0030] Images and maps are acquired from a top-down view, or from an upper side or an upper direction, or from above. In other words, light may be received from below. This makes it possible to acquire an image including significant luminance and / or color information and / or a map including significant depth information, and thus, in particular, to determine significant container information. In particular, the terms "important" or "relevant" may be used synonymously with the term "meaningful".
[0031] The luminance and / or color information, and / or depth information relates to at least one boundary between two spatial regions occupied by different objects, in particular a luminance, color, and / or depth boundary. This enables the extraction of luminance and / or color information from an image and / or depth information from a map in the form of features formed by at least one boundary. In particular, the term "edge" may be used synonymously with the term "boundary". In addition or alternatively, the phrase "spatial phase" may be used synonymously with the phrase "spatial region". Additionally or alternatively, the term "material" may be used synonymously with the term "object".
[0032] The container information relates to the presence or absence of a container within the region, particularly the position of the container within the region, the presence or absence of a cap, particularly at the top of the container, the presence of an in-container or container-encapsulated laboratory sample, and / or the level of the sample within the container, or is these. This enables the handling of the container. In particular, step a) may include acquiring an image of the carrier if present, the container if present, the cap if present, and / or the sample if present. In addition or alternatively, step b) may include acquiring a map of the carrier if present, the container if present, the cap if present, and / or the sample if present. Further in addition or alternatively, the term "location" or "place" may be used synonymously with the term "position". Further in addition or alternatively, the container may particularly have an opening at the upper end or upper side. In particular, the opening may be defined by the end and / or outer periphery of the container wall. In addition or alternatively, the container or the opening of the container may be opened and closed particularly by a cap. Further in addition or alternatively, the cap may comprise rubber and / or plastic, or may consist entirely of rubber and / or plastic. Further in addition or alternatively, the cap may have a blue color. Further in addition or alternatively, the cap may be embodied as a lid, particularly a rigid lid, or may be embodied as a foil, particularly a flexible foil. Further in addition or alternatively, the sample may be a liquid sample and / or a blood sample or a urine sample. In particular, the blood sample may have a red color, and / or alternatively the urine sample may have a yellow color. Further in addition or alternatively, typically the sample may not completely fill the container, particularly may not fill up to the opening. Further in addition or alternatively, the map may have two dimensions and one additional third dimension, and the third dimension may relate to the height parallel to the longitudinal axis of the container above two directions (perpendicular to the longitudinal axis of the container and / or parallel to the plane defined by the opening).In particular, the term "vertical" may be used synonymously with the term "longitudinal direction". Additionally, or alternatively, for different cases, the images and maps, in particular, may each be clearly different even if they are different.
[0033] The method comprises d) handling the container, in particular transporting or moving the container, gripping the container, removing the cap, attaching the cap, filling, and / or emptying the container, based on or according to the determined container information and includes.
[0034] This enables the handling of the container, in particular more accurately, and / or reliably, and / or undoubtedly than would be possible if only one such information were used alone, by in particular fusing the luminance and / or color information with the depth information.
[0035] In particular, the handling may be automatic.
[0036] According to an embodiment of the present invention, step a) includes acquiring an image including luminance and / or color information by detecting visible light, particularly red light, green light, and blue light. In addition to or instead of this, step b) includes acquiring a map including depth information by detecting infrared light, particularly near-infrared light. Such light enables interaction with objects in the region, particularly enabling reflection by the objects. In addition to or instead of this, visible light and infrared light enable non-interference with each other's detection. In particular, the terms "sensing" or "receiving" can be used synonymously with the term "detecting". In addition to or instead of this, in particular, each detection may be automatic or may be a detection of the intensity of each light. Further in addition to or instead of this, visible light may have a wavelength in the range of 400 to 700 nanometers (nm). Further in addition to or instead of this, infrared light may have a wavelength longer than that of visible light and / or may have a wavelength in the range up to 700 nm to 1 millimeter (mm), particularly up to 1.4 micrometers (μm).
[0037] In particular, step c), especially this method may not be particularly performed by photogrammetry or may not need to be performed.
[0038] According to an embodiment of the present invention, step b) includes acquiring a map including depth information by time-of-flight measurement. This enables extremely rapid and / or simple acquisition and / or easy processing of the acquired map, particularly processing with a low computational load.
[0039] In particular, the image and the map may be acquired by separate devices, particularly cameras.
[0040] According to one embodiment of the present invention, the image and the map are acquired by, in particular, the same or identical 3D camera, especially a range camera, in particular a time-of-flight camera. Thereby, the image and the map can be acquired from, in particular, the same or identical viewpoints, and thus, furthermore / or, in particular, easy processing of the acquired image and the acquired map, especially processing with a low computational load, becomes possible. In particular, the 3D camera may be electric, especially electronic. In addition to this, or instead, the image and / or the map may not be acquired by a stereo camera, or may not be acquired. Furthermore, in addition to this, or instead, the depth information may be related to, or may represent, the (in particular, vertical) distance of at least one surface of at least one (in particular, scene) object and the plane of the (in particular, scene) 3D camera.
[0041] According to one embodiment of the present invention, step c) includes extracting the luminance and / or color information from the image and / or the depth information from the map in the form of features. In addition to this, or instead, step c) includes classifying the luminance and / or color information, in particular the extracted luminance and / or color information, and / or the depth information, in particular the extracted depth information, and fusing the classified luminance and / or color information and / or the classified depth information. This makes it possible to reduce the generated information space or the amount of generated information, and / or, in particular, enables fusion with a low computational load. In particular, the extraction and / or classification may be performed automatically. In addition to this, or instead, the terms "extrapolate" or "detect" may be used synonymously with the term "extract".
[0042] According to one embodiment of the present invention, step c), in particular the extraction, classification, and / or fusion, is performed by an artificial neural network, rule-based decision-making, and / or machine learning. Thereby, extremely good execution becomes possible.
[0043] Furthermore, the present invention relates to a laboratory system for determining at least one container information, particularly for a laboratory sample container for carrying out the method according to the present invention (particularly the foregoing), the laboratory system comprising an acquisition device and a determination device. The acquisition device is configured to acquire an image (particularly the foregoing) including luminance and / or color information of a potential area (particularly the foregoing) of a container, and a map (particularly the foregoing) including depth information of the area. The determination device is configured to determine container information by fusing luminance and / or color information with depth information.
[0044] The image and the map are acquired from a top-down view. The luminance and / or color information, and / or depth information relates to at least one boundary between two spatial regions occupied by different objects. The container information relates to the presence or absence of a container in the region, the position of the container, the presence or absence of a cap on the container, the presence or absence of an in-chamber sample in the container, and / or the level of the sample in the container.
[0045] The inspection room system includes a handling device. The handling device is configured to transfer, grip, remove a cap, attach a cap, fill, and / or empty a container based on the determined container information. In particular, the handling device may be electric. In addition or alternatively, the handling device may be a transporter or a mover, and in particular may include a carrier, a gripper, a decapper, a capper, a filler, and / or a defiller, and / or may be these. In particular, the mover may be configured to move a container relative to or with respect to an acquisition device. In addition or alternatively, the mover may include a conveyor belt or a band as described in European Patent Application Publication No. 2995958 and / or an inspection room sample distribution system, or may be these.
[0046] This system can achieve the same advantages as described above with respect to the method.
[0047] Particularly, the system, the acquisition device, and / or the determination device may be electrical, particularly electronic.
[0048] The acquisition device may comprise a detector or a sensor, particularly at least two detectors.
[0049] The determination device may comprise a processor and / or a memory, or may be a processor and / or a memory.
[0050] The terms "adapted" or "designed" may be used synonymously with the term "configured".
[0051] The carrier may be configured to align with the acquisition device or with respect to the acquisition device to convey the container.
[0052] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Throughout the drawings, the same elements are denoted by the same reference numerals.
Brief Description of the Drawings
[0053]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Embodiments for Carrying Out the Invention
[0054] FIGS. 1 to 6 show a laboratory system 10 and a method for determining at least one container information coi regarding a laboratory sample container 1.
[0055] The system 10 includes an acquisition device 11 and a determination device 12. The acquisition device 11 is for the possible area 2 of the container 1 configured to obtain, and in particular obtain, an image ibc including luminance and / or color information bci, and a map md including depth information di of region 2. The determination device 12 is configured to determine, and in particular determine, container information coi by fusing the luminance and / or color information bci and the depth information di.
[0056] This method a) in particular, a step of obtaining, by the acquisition device 11, an image ibc including luminance and / or color information bci of the possible region 2 of the container 1; b) in particular, a step of obtaining, by the acquisition device 11, a map md including depth information di of region 2; c) in particular, a step of determining, by the determination device 12, container information coi by fusing the luminance and / or color information bci and the depth information di including.
[0057] Specifically, step a) includes obtaining an image ibc including luminance and / or color information bci by detecting visible light vL, in particular red light rL, green light gL, and blue light bL. In addition to this, or alternatively, step b) includes obtaining a map md including depth information di by detecting infrared light iL, in particular near-infrared light niL.
[0058] Furthermore, step b) includes obtaining a map md including depth information di by time-of-flight measurement TOF.
[0059] Furthermore, the image ibc and the map md are obtained in particular by the system 10, especially by the 3D camera 3 of the acquisition device 11, in particular by the range camera 3', especially by the time-of-flight camera 3''.
[0060] In particular, the system 10, and especially the acquisition device 11, comprises an RGB camera (red, green, and blue). In the illustrated embodiment, the 3D camera and the RGB camera are included in just one camera. In an alternative embodiment, the 3D camera and the RGB camera may be two cameras at one or multiple positions.
[0061] Furthermore, the image ibc and the map md are acquired in a top-down view.
[0062] Furthermore, step c) includes, in particular by the determination device 12, extracting luminance and / or color information bci from the image ibc, and / or depth information di from the map md, in the form of the feature feat. In addition to this, or alternatively, step c) includes, in particular by the determination device 12, classifying the luminance and / or color information bci (in particular the extracted luminance and / or color information bci), and / or the depth information di (in particular the extracted depth information di), and fusing the classified luminance and / or color information bci, and / or the classified depth information di.
[0063] Furthermore, the extraction, classification, and / or fusion in step c) are, in particular, executed by the determination device 12 by means of an artificial neural network AI, rule-based determination, and / or machine learning.
[0064] Furthermore, the luminance and / or color information bci, and / or the depth information di relate, in particular, to at least one boundary bou, especially a luminance, color, and / or depth boundary bcdbou, between two spatial regions 4a, 4b occupied by different objects 4ma, 4mb forming the feature feat.
[0065] In the illustrated embodiment, the acquisition device 11 and / or the 3D camera 2 are located above the region 2. The region 2 extends in the x-y plane. The height is given, in particular, along the z-axis perpendicular to the x-y plane.
[0066] In FIG. 1, there is nothing present, especially on a black flat background. Therefore, the image ibc shows nothing, and the map md shows a uniform depth or height. Therefore, the container information coi relates to the fact that in region 2, there is no part of the handling device 13 having the container carrier 13' for transporting the container 1, and the container 1 is not present.
[0067] In FIG. 2, a carrier 13' in the form of an empty tube holder, especially, is present on the background. Therefore, the image ibc shows an inner circle (especially, a white circle) surrounded by a ring (especially, a white ring) corresponding to the cross-section of the carrier 13' shown especially on the left side of FIG. 2. The map md shows a lower inner part corresponding to the inner circle especially, and a higher surrounding raised part corresponding to the surrounding ring especially.
[0068] Therefore, from the image ibc and the map md especially, a boundary bou between the inner circle or the lower inner part and the surrounding ring or the higher surrounding raised part, and another boundary bou between the surrounding ring and the background are extracted.
[0069] Therefore, the container information coi relates to the fact that in region 2, the carrier 13' is present and the container 1 is not present.
[0070] In FIG. 3, the carrier 13' and the container 1 in the form of an empty tube, especially, are present. Especially, the container 1 is within the carrier 13'. Therefore, the image ibc shows a narrower inner (especially, colorless) circle, a narrower (especially, colorless) ring surrounding it, and another (especially, white) ring surrounding it, corresponding to the cross-sections of the container 1 and the carrier 13' shown especially on the left side of FIG. 3. The map md shows a lower inner part corresponding to the inner circle especially, a narrower and higher surrounding raised part corresponding to the surrounding ring especially, and a lower surrounding raised part corresponding to the other surrounding ring especially.
[0071] Therefore, from the image ibc and the map md in particular, boundaries bou are extracted between the inner circle or the lower inner part and the surrounding ring or the higher surrounding raised part, between the surrounding ring and another surrounding ring or a lower surrounding raised part, and between another surrounding ring and the background, respectively.
[0072] Therefore, the container information coi relates to the presence of the carrier 13' in region 2, the presence of the container 1, the position POS of the container 1, the absence of the cap 5 on the container 1, and the absence of the laboratory sample 6 in the container 1.
[0073] In FIG. 4, there are the carrier 13', in particular the container 1 in the form of a filled tube, and the sample 6, and in particular the sample 6 is inside the container 1. Therefore, the image ibc shows, corresponding to the cross-section of the sample 6, the container 1, and the carrier 13' shown particularly on the left side of FIG. 4, an inner (in particular, red or yellow) circle, a surrounding (in particular, colorless) ring surrounding it, and another (in particular, white) ring surrounding it. The map md shows a not-too-low inner part corresponding to the inner circle in particular, a higher surrounding raised part corresponding to the surrounding ring in particular, and a lower surrounding raised part corresponding to another surrounding ring in particular.
[0074] Therefore, boundaries bou are extracted between the inner circle or the not-too-low inner part and the surrounding ring or the higher surrounding raised part, between the surrounding ring and another surrounding ring or a lower surrounding raised part, and between another surrounding ring and the background, respectively, from the image ibc and the map md in particular.
[0075] Therefore, the container information coi relates to the presence of the carrier 13' in region 2, the presence of the container 1, the position POS of the container 1, the absence of the cap 5 on the container 1, the presence of the sample 6 in the container 1, and the level LE of the sample 6 in the container 1.
[0076] In FIG. 5, there are a carrier 13′, a container 1 in the form of a capped tube in particular, a sample 6, and a cap 5, and in particular, the cap 5 is on the container 1. Accordingly, the image ibc shows a wider inner (in particular, blue) circle surrounded by a (in particular, white) ring corresponding to a cross-section of the cap 5 and the carrier 13′ on the container 1 shown particularly on the left side of FIG. 5. The map md shows a wider and higher inner part corresponding to the inner circle in particular, and a lower surrounding raised part corresponding to the surrounding ring in particular.
[0077] Accordingly, from the image ibc and the map md in particular, a boundary bou between the inner circle or the higher inner part and the surrounding ring or the lower surrounding raised part, and another boundary bou between the surrounding ring and the background are extracted.
[0078] Accordingly, the container information coi relates to the presence of the carrier 13′ in region 2, the presence of the container 1, the position POS of the container 1, and the presence of the cap 5 on the container 1.
[0079] Furthermore, the inspection room system 10 includes a handling device 13. The handling device 13 is configured to handle the container 1 based on the determined container information coi, and in particular, to handle it.
[0080] Furthermore, the method includes the step of d) in particular handling the container 1 based on the determined container information coi by the handling device 13, and in particular transporting or moving the container 1, gripping it, removing the cap, attaching the cap, filling it, and / or emptying it.
[0081] In the illustrated embodiment, the handling device 13 comprises a carrier 13. Such a handling device 13 is used to transfer the container 1 on a background or transfer plane. In particular, the carrier 13’ may be only a part that is movable by external means among the handling devices. For example, the carrier 13’ may comprise a magnet, and an electromagnetic actuator may be arranged below the transfer plane to drive the carrier 13’. Therefore, the combination of the electromagnetic actuator and the carrier 13’ can be regarded as the handling device 13.
[0082] Figure 6 shows further details of the associated information processing or signal processing. The image ibc includes three sub-images corresponding to three colors: red (R), green (G), and blue (B). In principle, other colors may be used. This information, in particular the luminance and / or color information bci, as well as the depth information di, is supplied to a sensor fusion algorithm that preprocesses, normalizes, and / or merges this information. A reliability map is obtained in which each point in the space has a reliability and / or probability. Further, an AI matching algorithm generates container information coi including scene classification. For example, the following may be output: an open tube with liquid - the height of the liquid is, for example, 55 mm, and / or the height of the tube is, for example, 100 mm; a background or background plate - the height of the surface is, for example, 3 mm; a closed tube - the height of the closed tube is, for example, 110 mm; and / or a carrier - the height of the surface of the carrier is, for example, 22 mm.
[0083] Thereby, the system can know whether the tube is overfilled, in particular to avoid spillage. In addition to this, or alternatively, it enables ensuring that the cap has actually been removed, in particular to perform fractionation well. Further, in addition to this, or alternatively, it enables ensuring that the cap is present, in particular for storage and / or centrifugation. Further, in addition to this, or alternatively, it enables ensuring a sufficiently accurate placement of the tube by the carrier so that the tube can be picked up by the gripper.
[0084] As is apparent from the illustrations and the above-described embodiments, the present invention is a method and a laboratory system for determining at least one container information, particularly regarding a laboratory sample container, and provides a method and a laboratory system having particularly improved characteristics.
Claims
1. A method for determining at least one container information (COI) relating to a laboratory sample container (1), a) A step of acquiring an image (ibc) including brightness and / or color information (bci) of the possible region (2) of the container (1), b) A step of obtaining a map (md) that includes depth information (di) of the region (2), c) A step of determining the container information (coi) by fusing the luminance and / or color information (bci) and the depth information (di). A method including, The aforementioned image (ibc) and map (md) were acquired while viewed from above. The luminance and / or color information (bci), and / or depth information (di) are related to at least one boundary (bou) between two spatial regions (4a, 4b) occupied by different objects (4ma, 4mb), The container information (coi) relates to the presence or absence of the container (1) in the region (2), the position (POS) of the container (1), the presence or absence of a cap (5) on the container (1), the presence or absence of a laboratory sample (6) in the container (1), and / or the level (LE) of the sample (6) in the container (1), The aforementioned method, d) Steps to transport, grasp, remove the cap, attach the cap, fill, and / or empty the container (1) based on the determined container information (COI). A method characterized by including
2. Step a) includes obtaining the image (ibc) including the luminance and / or color information (bci) by detecting visible light (vL), and / or The method according to claim 1, step b) comprising obtaining the map (md) containing the depth information (di) by detecting infrared light (iL).
3. The method according to claim 1, step b) comprising obtaining the map (md) containing the depth information (di) by time-of-flight measurement (TOF).
4. The method according to claim 1, wherein the image (ibc) and the map (md) are acquired by a 3D camera (3).
5. Step c) includes extracting the luminance and / or color information (bci) from the image (ibc) and / or the depth information (di) from the map (md) in the form of features (feat), and / or The method according to claim 1, wherein step c) includes classifying the luminance and / or color information (bci) and / or the depth information (di), and fusing the classified luminance and / or color information (bci) and / or the classified depth information (di).
6. Step c) is performed by an artificial neural network (AI), rule-based decision-making, and / or machine learning, according to any one of claims 1 to 5.
7. A laboratory system (10) for determining at least one container information (COI) relating to a laboratory sample container (1), An acquisition device (11) is configured to acquire an image (ibc) including brightness and / or color information (bci) of the possible region (2) of the container (1), and a map (md) including depth information (di) of the region (2), A determination device (12) configured to determine the container information (coi) by fusing the luminance and / or color information (bci) and the depth information (di), Equipped with, The aforementioned image (ibc) and map (md) were acquired while viewed from above. The luminance and / or color information (bci), and / or depth information (di) are related to at least one boundary (bou) between two spatial regions (4a, 4b) occupied by different objects (4ma, 4mb), The container information (coi) relates to the presence or absence of the container (1) in the region (2), the position (POS) of the container (1), the presence or absence of a cap (5) on the container (1), the presence or absence of a laboratory sample (6) in the container (1), and / or the level (LE) of the sample (6) in the container (1), The aforementioned system (10) is A handling device (13) configured to transport, grasp, remove the cap, attach the cap, fill, and / or empty the container (1) based on the determined container information (coi). A laboratory system (10) equipped with the following features.