Visual representation of sample carriers

Abstract

A method, system, chromatography system, and autosampler for a chromatography system, the method comprising: capturing image data with an imaging assembly configured with a field of view toward a placement area of a platform assembly, the placement area configured to hold a sample carrier; and processing the image data with a processing component. The invention also relates to a system comprising a corresponding feature.

Description

Technical Field

[0001] This invention relates to the visual representation of generated sample carriers, particularly in the field of chromatography, preferably in the field of liquid chromatography, more preferably in the field of high performance liquid chromatography (HPLC), and preferably in the field of liquid sample carriers. Background Technology

[0002] Chromatography (such as HPLC) is an analytical method that separates a sample into its components for quantitative analysis of the corresponding amounts of these components. One component used in a chromatographic system is the sampler, which is typically responsible for sample management and the accurate extraction of the sample from the vial. After sample extraction, the sampler uses a switching valve to introduce the sample into the analytical flow path, where it undergoes chromatographic analysis. Each run (i.e., chromatographic analysis) can be performed with different samples (i.e., with different vials). For example, the first vial can be used for the first sample run, the second vial for the second sample run, and so on. Therefore, different samples can be analyzed sequentially, and this list of sequences can be called a sequence list, or, for simplicity, a sequence.

[0003] Typically, samples are provided in vials, which are then manually or, for example, loaded into sample carriers (e.g., sample racks) using an automated loader in an automated chromatography system. Labeling each vial with a barcode increases the traceability of each sample, even in the event of incorrect sorting into the sample rack. Even when using an autosampler, it is necessary to ensure that the correct sample has been analyzed.

[0004] Currently, users must remember the location of sample vials within the sample holder and manually enter them into the sequence. Images or views of the sampler's interior would facilitate a simpler and safer selection of only occupied sample locations within the sample holder. This also allows for further automation of these steps and sequence monitoring. Remote control of sampler loading from a remote location is also expected.

[0005] With current technology, sample loading in the sampler is typically monitored on-site via a door or viewing window facing the sample holder. The absence of a sample vial can be detected by scanning, for example, using a sensor in the needle arm used to extract the sample. For selecting occupied sample locations during sequence generation, the user needs to know which locations are loaded and record this information somewhere.

[0006] Currently, it is generally impossible to observe the sampler from a distance, and sequence generation must be performed blindly without seeing the sample holder inside the sampler. Finding empty sites takes time and can typically only be completed during sequence execution. Subsequent behavior becomes unpredictable—sequence execution may be aborted, or missing samples may be automatically skipped. There is always a risk that a sample may not be analyzed because a specific position in the sequence has already been assigned an analytical method, or that an incorrect method may be used for analysis.

[0007] In a controlled environment, rework and validation are often required to ensure that missing sample locations have been correctly skipped and that all samples have been analyzed correctly. Because sample racks typically require manual loading of small (sometimes custom-made) vials, errors can occur, such as missing vials in the sample area, vials without caps, or vials being loose. To detect such errors or ensure their absence, the user must physically inspect the sample area at the sampler, a process that can be extremely time-consuming.

[0008] JP6048584B2 / US10191620B2 describes an HPLC system with an autosampler capable of capturing an image of a tray from above. This image, along with a graphic representation of the tray, is then presented to the user to facilitate the selection of the correct bottle.

[0009] Currently, it is impossible to observe the sampler from a distance. Personnel must be physically present at the device to inspect the condition of the sample area. Sample missing issues are typically only detectable during sequence execution, cannot be detected in advance, and cannot be inspected on the entire tray at once. Summary of the Invention

[0010] This invention mitigates these drawbacks and provides additional analytical possibilities and customer benefits.

[0011] This invention relates to a method comprising capturing image data using an imaging assembly. The imaging assembly is configured with a field of view facing a placement area of ​​a platform assembly. The placement area is configured to hold a sample carrier. The method further comprises processing the image data using a processing assembly.

[0012] Therefore, this invention enables digital observation of platform components (especially sample carriers positioned thereon). This capability is achieved through image data captured by the imaging component. This, in turn, facilitates remote monitoring of platform components, particularly sample carriers. In other words, this invention reduces the need for on-site monitoring of platform components (especially sample carriers positioned thereon).

[0013] Furthermore, this invention facilitates the on-demand provision of digital views of platform components (particularly sample carriers positioned thereon). Therefore, this invention enables on-demand inspection and monitoring of platform components (particularly sample carriers positioned thereon) without requiring physical proximity to the platform components. This can encourage users to examine the sample carriers more frequently, especially when implementing routines for processing their samples. Consequently, more accurate processing of samples carried by the sample carriers can be achieved. In particular, the risk of samples in the sample carriers not being analyzed or not being analyzed correctly can be reduced. As a further result, the likelihood of detecting errors may be increased.

[0014] Furthermore, processing the image data is advantageous because it enhances the salience of the sample carriers, resulting in a more ergonomic experience for users when inspecting and monitoring them. This can be particularly beneficial where platform components are typically situated in confined spaces, a layout that may require positioning the imaging component adjacent to the platform component. Therefore, the raw image data captured by the imaging component can depict a distorted view of the platform component and the sample carrier positioned upon it. Processing the image data allows for mitigation of this distortion, providing a clearer view. This, in turn, makes it more likely that the platform component and sample carrier can be inspected accurately.

[0015] Furthermore, processing image data allows for enhanced digital views of platform components and the sample carriers on them. This further improves the ergonomics of inspecting and monitoring them.

[0016] In summary, this invention allows users to remotely view platform components in a simple manner, thereby helping them determine platform component occupancy by sample carriers and detection errors. Although platform components are typically located in a limited space, this invention provides these advantages.

[0017] The method may include using a processing component and based on captured image data to detect the shape of at least one surface, preferably the top surface, of a sample carrier disposed on a placement area.

[0018] This method may include using processing components to determine the sample carrier characteristics of the sample carrier.

[0019] The sample carrier may include multiple sample holders, each of which can be configured to hold a sample vial. Sample holders may also be interchangeably referred to as vial positions. It will be understood that a sample holder (i.e., a vial position) may be occupied and thus hold a sample vial, or the sample holder may be unoccupied, i.e., empty and thus not hold a sample vial.

[0020] The characteristics of the sample carrier can indicate the shape of the sample carrier.

[0021] The characteristics of the sample carrier can indicate the shape of the top surface of the sample carrier.

[0022] The characteristics of the sample carrier can indicate the distribution of the sample holder.

[0023] The characteristics of the sample carrier can indicate the number of sample holders.

[0024] The sample holders can be evenly distributed on the top surface of the sample carrier.

[0025] The method may include moving platform components relative to the imaging components according to motion. It will be understood that the motion may be continuous or step-like. Step-like motion may include multiple sub-motions, with pauses between each sub-motion.

[0026] The motion can be a rotation of the platform component relative to the imaging component about a rotation axis parallel to the surface normal of the placement area.

[0027] This method may include capturing images using an imaging component during movement of the platform component. In the case of continuous movement, images can be captured while the platform component is moving. In this case, capturing images with short exposure times to reduce motion blur is advantageous. In the case of step-like movement, images can be captured between sub-movements (i.e., during pauses in between). This mitigates motion blur and allows for longer exposure times. It will be understood that capturing images using an imaging component during movement of the platform component can encompass any of the specific embodiments described above.

[0028] The imaging component can be positioned at a predetermined height above the platform component. Typically, because the platform component is located in a limited space, the available placement location for the imaging component is limited.

[0029] The predetermined height can be up to 700 mm from the top surface of the platform assembly, preferably up to 600 mm, and more preferably up to 550 mm. Similarly, this height will be limited by the limited space in which the platform assembly can be located.

[0030] It will be understood that this is merely an example, and the imaging component can be placed elsewhere. For example, a mirror can be used to create an optical path between the imaging component and the platform component.

[0031] The imaging component can be positioned spaced apart from the central axis, preferably the rotation axis, of the platform component. This increases the extent of the platform component, particularly the portion on which the sample carrier is captured without distortion. In particular, this facilitates obtaining a uniform and consistent perspective view across all or at least a large number of sample vials in the field of view of the imaging component.

[0032] The imaging components can be positioned within a radial interval.

[0033] The radial spacing can be defined by the rotation axis of the platform assembly and the outermost rotation point of the placement area. That is, the radial spacing can extend from the rotation axis of the platform assembly to the outermost rotation point of the placement area.

[0034] Preferably, the radial spacing can be defined by the inward-facing end and the outward-facing end of the sample carrier. The inward-facing end of the sample carrier herein may refer to the end of the sample carrier closest to the central axis of the platform assembly. The outward-facing end of the sample carrier herein may refer to the end of the sample carrier furthest from the central axis of the platform assembly.

[0035] More preferably, the radial spacing can be defined by the inward end of the sample carrier and the vertical central axis of the sample carrier.

[0036] The radial position of the imaging assembly relative to the rotation axis of the placement area can coincide with the radial position of at least one of the radially innermost sample holders relative to the rotation axis. The radial position can indicate the distance from the rotation axis. In this document, the radially innermost sample holder can refer to the sample bottle closest to the central axis of the platform assembly.

[0037] The radial distance between the imaging component and the inward end of the sample carrier can be less than half the distance between the inward end and the outward end of the sample carrier.

[0038] In other words, the imaging component can be positioned above the inner half of the sample carrier. The inner half of the sample carrier, as used herein, can refer to the half of the sample carrier closest to the central axis of the platform component.

[0039] The radial distance between the imaging component and the inward-facing end of the sample carrier can be measured perpendicular to the rotation axis.

[0040] The imaging component can be configured to maintain a substantially consistent viewing angle over at least some of the sample holders in a plurality of sample holders and / or over at least some of the sample bottles disposed within the sample holders.

[0041] The imaging plane of the imaging component can be parallel to the placement area. That is, the optical axis of the imaging component can be perpendicular to the placement area.

[0042] Alternatively, the imaging plane of the imaging component can be angled relative to the placement area. That is, the optical axis of the imaging component can intersect the placement area at an angle different from 90°.

[0043] This method may include using processing components to correct optical distortions in image data. As discussed, this can increase the salience of platform components and sample carriers thereon, and thus help users inspect and monitor them.

[0044] Correcting optical distortion in image data can include using the inherent camera parameters of the imaging component. Inherent camera parameters (also called camera intrinsic parameters) can indicate the focal length, optical center, and / or lens distortion coefficients of the imaging component. Types of optical distortion that can be corrected can include radial distortion (i.e., straight lines appearing as curves) and / or tangential distortion. Correcting optical distortion can include remapping pixels in the image data so that distorted points can be transformed to their correct positions.

[0045] This method may include using a processing component to perform a camera calibration algorithm to determine the inherent camera parameters of the imaging component. This may include capturing images of a known pattern (e.g., a chessboard) from different angles and distances.

[0046] Correcting optical distortions in image data can include performing perspective correction based on the angle of the imaging plane relative to the top surface of the sample carrier.

[0047] Correcting optical distortions in image data can include performing distortion correction based on the optical properties of the imaging components.

[0048] Processing image data can include generating a top-view representation of the sample carrier. This top-view representation of the sample carrier can be generated such that it depicts a distortion-free top view of the sample carrier.

[0049] Optical distortion correction of the image data can be performed before generating the top view representation of the sample carrier. This results in minimal or no optical distortion in the top view representation of the sample carrier.

[0050] The method may include a processing component that separates the sample carrier from the placement area and / or from the background to generate a top view representation of the sample carrier.

[0051] Generally, it will be understood that, in embodiments of the present invention, the processing component may also include a display component, such as a monitor, and the processing component may therefore also be configured to display information to a user, such as a top-down view and / or a bottle image, which will be mentioned below.

[0052] Capturing image data can include capturing an image sequence comprising multiple images, where each image in the sequence depicts a segment of the placement area. This is particularly advantageous if the field of view of the imaging component is smaller than that of the platform component. Therefore, a single image may not be able to capture the entire platform component. However, by capturing an image sequence in which each image depicts a segment of the placement area, it is possible to generate image data corresponding to the entire platform component.

[0053] This method may include capturing image sequences during the movement of the platform components. Therefore, different segments of the placement area can be positioned within the field of view of the imaging component.

[0054] Each image in the image sequence can depict a different segment of the placement area.

[0055] For at least two images in an image sequence, corresponding segments of the platform components depicted on them partially overlap. This facilitates determining the spatial arrangement of the images relative to each other, and particularly for subsequent stitching operations.

[0056] Each segment of the placement area can be represented at least once within the image sequence. In other words, the image data can completely cover the placement area.

[0057] This method may include extracting image segments from an image sequence using a processing component, preferably extracting image segments from each of at least some images in the image sequence using the processing component. An image segment may refer to a usable portion of each image. An image segment may be selected within an image such that the segment corresponds to the portion of the image with minimal distortion.

[0058] At least some of the image segments in the image segment, preferably each image segment can be a sector.

[0059] Each sector may have an axis of rotation at its center. However, it will be understood that this is merely an example.

[0060] Each sector may have an angle of less than 10°, preferably less than 8°, and more preferably less than 5°. Generally, smaller angles are preferred because they allow for better distortion mitigation. Larger segments may result in higher distortion at the splicing area.

[0061] The method may include extracting image segments using the center point or central axis of the placement area of ​​the processing component relative to the platform component, preferably the rotation axis.

[0062] At least some of the image segments may be rectangular, preferably strip-shaped.

[0063] Each image segment can be radially aligned with the central axis, preferably the rotation axis, of the platform component.

[0064] Each image segment in an image segment can depict a sub-segment of equal size to the placement area.

[0065] Image segments can be of equal size.

[0066] This method may include combining image segments using processing components and generating an overview image based on them. The overview image can be generated such that it depicts a distortion-free top view of the placement area.

[0067] An overview image may include an integrated image of all sample carriers positioned on the placement area.

[0068] An overview image may include an integrated image of the entire placement area and all sample carriers set on the placement area.

[0069] For example, an overview image may include a photographic representation of the area where the sampler carrier is placed.

[0070] Optical distortion correction of the image data can be performed before generating the overview image. This way, optical distortion may be virtually nonexistent in the overview image.

[0071] The overview image can be a two-dimensional top view. This makes it particularly easy to identify occupied and unoccupied sample holders and to determine whether the sample bottles include caps.

[0072] The platform component may include at least one platform tracking indicator, and the method may include using the platform tracking indicator to indicate the position and / or orientation of the platform component relative to the field of view of the imaging component. This can facilitate the generation of a top-view representation and / or overview image. In particular, knowledge of the relative position and / or orientation of the platform component and the imaging component can facilitate the stitching of image segments.

[0073] The placement area may include at least one placement tracking indicator, and the method may include using the placement tracking indicator to indicate the position and / or orientation of the placement area relative to the field of view of the imaging component.

[0074] The sample carrier may include at least one carrier tracking indicator, and the method may include using the carrier tracking indicator to indicate the position and / or orientation of the sample carrier relative to the field of view of the imaging component.

[0075] The method may include using an indicator component to indicate a position indicator signal to a processing component and / or an imaging component, the position indicator signal indicating the relative position of the platform component and / or placement area relative to the imaging component.

[0076] The indicator assembly may include at least one visual indicator, which may be positioned within the field of view of the imaging assembly. The at least one visual indicator may indicate the orientation and / or position of the platform assembly and / or placement area. For example, multiple visual indicators may be used, each indicating a corresponding orientation and / or position of the platform assembly and / or placement area. Alternatively or additionally, the orientation of the at least one visual indicator may correspond to the orientation of the platform assembly and / or placement area. The at least one visual indicator may be positioned on the platform assembly, placement area, and / or sample carrier.

[0077] The method may include using processing components to align image segments according to platform tracking indicators, placement tracking indicators, carrier tracking indicators, and / or position indicators.

[0078] This method may include using motion components to move platform components.

[0079] This method may include using a motion component to move, preferably rotate, a platform component relative to an imaging component to modify a segment of the placement area within the field of view of the imaging component. Information about the motion generated by the motion component can be used by a processing component to align the image segment. For example, the motion component may be instructed to rotate "15°". These instructions can be used to infer the relative orientation between the platform component and the imaging component.

[0080] The method may include moving the platform component stepwise using a motion component, wherein for each step, the placement area segment within the field of view of the imaging component may be modified, preferably moving a predetermined distance along a predetermined trajectory, preferably a circular trajectory.

[0081] The method may include using a motion component to rotate a platform component about a rotation axis.

[0082] The method may include using motion components to perform a step-by-step movement sequence of platform components, the step-by-step movement sequence including a predetermined, preferably alternating sequence of movement intervals and stop intervals.

[0083] Capturing an image sequence can include capturing images using an imaging component during stop intervals, preferably capturing images during each stop interval, wherein the images captured during the stop intervals form an image sequence. This can mitigate motion blur that might otherwise be present.

[0084] The method may include using a processing component to synchronize a motion component with an imaging component in order to acquire image data during a stop interval.

[0085] This method may include using a processing component to adjust the duration of the stop interval based on the image capture time required for the imaging component to capture the image.

[0086] This method may include using a processing component to adjust the duration of the stop interval based on the inertial component of the platform component's movement.

[0087] This method may include using an imaging component to capture a sample carrier positioned on a placement area via an image sequence, particularly capturing the sample carrier completely.

[0088] This method may include using an imaging component to capture a sample carrier at a height up to a predetermined maximum height.

[0089] This method may include using a processing component to determine fill status characteristics, each fill status characteristic indicating the presence of a sample vial in a corresponding sample holder. In other words, the processing component can determine a corresponding fill status characteristic for each sample holder of the sample carrier, indicating whether the sample holder is occupied by a sample vial.

[0090] This method may include using processing components to determine the corresponding filling state characteristics of each sample holder.

[0091] The method may include using a processing component to determine bottle characteristics, each bottle characteristic indicating the properties of the corresponding sample bottle set in the sample carrier.

[0092] This method may include using a processing component to determine the corresponding bottle characteristics of each sample vial disposed in a sample carrier.

[0093] Each bottle characteristic may indicate at least one of the following: the presence of a cap; the presence of a suffix; the presence of a specific marking on the sample bottle; the presence of a septum; the color of the bottle; the color of the cap; the color of the sample contained in the bottle; the shape of the bottle, especially the cross-section and / or shape of the bottle opening; the volume of the bottle; the length of the bottle; the filling state of the bottle relative to the sample; the position of the sample bottle within the sample holder; the orientation of the sample bottle within the sample holder; the relative position of the sample bottle relative to the sample carrier; the relative position of the sample bottle relative to the spatial configuration of the sample holder; and markings on the sample bottle, especially markings on the top side of the sample bottle.

[0094] Bottle characteristics can help examine the sample carrier.

[0095] This method may include generating a schematic representation of the sample carrier using a processing component. This schematic representation may include a simplified view of the sample carrier, where selected information is displayed and / or highlighted. Therefore, the sample carrier can be examined more quickly and easily. In other words, the carrier schematic provides information about the sample carrier in an ergonomically improved manner.

[0096] A carrier schematic diagram may include the outline of the sample carrier and / or the outline of the sample holder. In other words, the carrier schematic diagram can indicate the overall structure of the sample carrier and / or sample holder. Therefore, the sample carrier and / or sample holder can be easily identified in the carrier schematic diagram.

[0097] A schematic diagram of the carrier can indicate the geometry of the sample carrier.

[0098] This method may include using a processing component to generate a carrier schematic diagram by processing image data.

[0099] This method may include generating a schematic diagram of the sample carrier by processing a top-view representation of the sample carrier using processing components. Generating a schematic diagram from a top-view representation is easier and more computationally efficient than generating it from raw image data. As explained, the top-view representation may already provide a clearer and distortion-free or nearly distortion-free view of the sample carrier.

[0100] This method may include using processing components to generate a vector schematic diagram based on user input. For example, the user input may indicate the type of sample vector, and the vector schematic diagram may be generated based on this.

[0101] The method may include generating a vector schematic diagram by utilizing a processing component to access a vector schematic diagram database and select a vector schematic diagram from the database. User input indicating the type of sample vector can be used to select a vector schematic diagram from the database.

[0102] Selecting a carrier schematic from a carrier schematic database may include using a carrier label, which preferably indicates the type or ID of the sample carrier. The carrier label may, for example, be affixed to the sample carrier and be visible to the imaging assembly.

[0103] This method may include using processing components to detect carrier tags associated with sample carriers on image data.

[0104] This method may include enhancing the carrier schematic diagram using at least one of the bottle characteristics of the processing components, and generating an enhanced carrier schematic diagram based thereon. Therefore, the enhanced carrier schematic diagram can provide information about the sample carrier, particularly about the bottle therein, in an ergonomically improved manner. This can be especially beneficial for the inspection of the sample carrier.

[0105] This method may include using a processing component to enhance the carrier schematic diagram with the bottle characteristics of each detected sample vial.

[0106] This method may include using processing components to provide an enhanced vector schematic as a basis for sequence creation (such as puncture sequences).

[0107] This method may include using a processing component to switch between providing an overview image and a carrier schematic diagram, preferably with enhanced bottle characteristics, to enable comparison between the generated schematic diagram and a photographic representation including the placement area of ​​the sample carrier. The user can thus switch between the overview image and the carrier schematic diagram. This allows the user to verify and / or supplement the information provided by the carrier schematic diagram by viewing the overview image.

[0108] The method may include using a processing component to generate a schematic view depicting a carrier schematic diagram.

[0109] This schematic view can further depict, preferably schematically depict, the filling state characteristics associated with each corresponding sample holder.

[0110] This schematic view can further depict, preferably schematically depict, the bottle characteristics associated with each corresponding sample vial disposed in the sample carrier.

[0111] The method may include displaying the schematic view on a display device operatively connected to the processing component.

[0112] The method may include displaying, preferably simultaneously, a schematic view and a sequence list input interface on a display device, wherein the sequence list input interface allows a user to input a sequence list indicating an ordered list of sample vials disposed in a sample carrier. Therefore, samples can be analyzed in the desired order.

[0113] For example, the system can be part of a chromatographic system (e.g., a liquid chromatography system). That is, the liquid chromatography system can include the system described. In such a liquid chromatography system, different samples can be used, i.e., different sample vials. For example, a first sample vial can be used for a first sample run, a second sample vial can be used for a second sample run, and so on. Therefore, different samples can be analyzed sequentially, and this list of sequences can be called a sequence listing.

[0114] The position within an ordered list determines the order in which the sequence is executed.

[0115] This method may include generating bottle holder images using processing components, each bottle holder image depicting a top view of the corresponding sample bottle holder. Therefore, the bottle holder images can provide a more detailed and / or magnified view of a single bottle holder (i.e., bottle location). Thus, each bottle holder can be examined individually and as needed.

[0116] This method may include processing the bottle holder image using processing components to enhance the visual depiction of its fill state characteristics and / or bottle properties. Therefore, information about each bottle holder can be obtained more easily.

[0117] The method may include using a processing component, preferably a mask, more preferably a positive mask, and even more preferably a circular positive mask, to cut a bottle holder image from image data and / or from image segments and / or from an overview image. Therefore, the bottle holder image may include little or no distortion.

[0118] This method can be included on a display device, preferably displaying the bottle holder image when the user is being prompted. In other words, the bottle holder image can be displayed on demand.

[0119] This method may include selectively displaying bottle images one at a time, based on prompts provided by the user. This allows the user to scroll through the bottle images.

[0120] This method may include displaying an image of each bottle holder as overlaid on a carrier schematic diagram, preferably overlaid on the corresponding sample bottle holder. Thus, on the one hand, the bottle holder images accurately and clearly show each sample bottle holder; on the other hand, unimportant information can be omitted by showing a carrier schematic diagram instead of an actual image of the sample carrier.

[0121] The method may include using a processing component to combine at least one bottle seat image from the bottle seat images into a carrier schematic diagram.

[0122] The method may include using a processing component to combine multiple bottle holder images into a carrier schematic, wherein each bottle holder image is associated with a separate sample bottle holder.

[0123] The method may include using a processing component to generate a schematic representation of the fill level, including fill state characteristics, and using the processing component to incorporate the fill schematic into the carrier schematic.

[0124] The method may include: using a processing component to determine a confidence threshold for a schematic diagram of the sample carrier representing its actual state; and using the processing component to provide image data and / or a top-down view representation to a user interface when the confidence threshold drops below a predetermined lower confidence threshold. This can alert the user to insufficient accuracy in automatic detection, prompting the user to verify the information, for example, by viewing the top-down view representation, an overview image, and / or the corresponding bottle holder image. Overall, this can improve accuracy and mitigate errors associated with the automatic detection of sample carrier features.

[0125] This method may include overlaying a carrier schematic diagram with a bottle holder image and / or a top-view representation of the sample carrier using processing components. This can facilitate verification of the accuracy of the information indicated by the carrier schematic diagram.

[0126] The method may include displaying an overview image on a display device.

[0127] The method may include using a processing component to overlay a top view representation of the sample carrier with a carrier schematic diagram and / or a bottle holder image.

[0128] This method may include using a processing component to generate a carrier schematic for each sample carrier present in the placement area.

[0129] In other words, the present invention can also cover situations where multiple sample carriers are present in the placement area. In such embodiments, the processes performed and discussed relative to each sample carrier in the placement area can be similarly performed. For example, a corresponding top view representation and / or a corresponding carrier schematic diagram can be generated for each sample carrier in the placement area.

[0130] The method may include: using a processing component to overlay a schematic diagram of the corresponding carrier with a corresponding top view representation of the sample carrier for each sample carrier present in the placement area.

[0131] The method may include providing a combined image comprising an overview image and a carrier schematic using a processing component, preferably by displaying the overview image and the carrier schematic side by side or by combining and aligning the overview image and the carrier schematic, more preferably by the latter.

[0132] The method may include using a processing component to map a bottle geometry, preferably one of a plurality of bottle geometries, to a sample bottle based on bottle characteristics.

[0133] The method may include performing at least one of the following image analyses using a processing component to determine bottle characteristics: brightness contrast detection; color contrast detection; edge detection of image data; sharpening; and / or smoothing or blurring.

[0134] The method may include executing a neural network using a processing component, wherein the neural network may be trained based on a learning sequence including platform component data, placement area data, and / or sample carrier data.

[0135] Neural networks can be trained to determine sample carrier characteristics and / or bottle characteristics.

[0136] Platform component data may involve the geometric properties of the platform components, preferably in the form of an image representation of the platform components, and more preferably in the form of multiple platform component images including different platform component geometries.

[0137] The placement area data may involve the geometric properties of the placement area, preferably in the form of an image representation of the placement area, and more preferably in the form of multiple overview images including different placement area geometries.

[0138] The sample carrier data may involve the geometric properties of the sample carrier, preferably in the form of an image representation of the sample carrier, and more preferably in the form of multiple sample carrier images including different sample carrier geometries.

[0139] The image data may include a side view of the sample carrier, such as an oblique view, and the method may include extracting codes from the image data using a processing component, preferably extracting graphic codes.

[0140] The placement area and / or sample carrier may include codes.

[0141] Image data can include a substantially distorted representation of the sample carrier.

[0142] This method may include using processing components to overlay portions of a carrier schematic onto a top-view representation and / or an overview image, and providing an augmented reality representation of the sample carrier on this basis. In other words, a hybrid view including a carrier schematic and a top-view representation and / or an overview image can be provided.

[0143] The method may include: using a processing component to replace a segment of a top view representation and / or overview image with a carrier schematic or at least a segment of a carrier schematic.

[0144] The method may include: using a processing component to display, for at least one sample vial in a top view representation and / or overview image and / or carrier schematic diagram, the sample name, information relating to the processing method corresponding to the sample vial, and / or the location of the sample vial.

[0145] This method may include using a processing component to receive information related to the geometry of the sample carrier via user input.

[0146] This method may include using a processing component to determine information related to the geometry of the sample carrier by reading information (e.g., a barcode on the sample carrier).

[0147] This method may include using a processing component to determine the sample carrier type corresponding to the sample carrier.

[0148] The sample carrier type can be determined based on user input, or preferably based on the user selecting the sample carrier type from multiple reference sample carrier types.

[0149] The type of sample carrier can be determined based on the geometric characteristics of the sample carrier.

[0150] The method may include using a processing component to determine the sample carrier type by comparing the geometric features of the sample carrier with reference geometric features corresponding to a reference sample carrier type.

[0151] The reference sample carrier type can be stored in a reference database in association with the corresponding reference geometry, and the method may include accessing the reference database using a processing component.

[0152] The method may include: generating a new reference sample carrier type using a processing component when no match is found between the geometric features of the sample carrier and the reference geometric features, and associating the new reference sample carrier type with the geometric features of the sample carrier.

[0153] The method may include using a processing component to add a new reference sample carrier type associated with the geometric features of the sample carrier to a reference database.

[0154] The method may include using a processing component to determine the geometric features of the sample carrier by processing image data, preferably a portion of the image data corresponding to the sample carrier (such as a top view representation).

[0155] The method may include using a processing component to determine the geometric features of the sample carrier by processing an overview image, preferably a portion of the overview image corresponding to the sample carrier.

[0156] The method may include using a processing component to determine the geometric features of a sample carrier by processing an image of the sample carrier, the image being captured when the sample carrier may be empty, and wherein the image data may include the image.

[0157] Geometric features may include the contours of the sample carrier.

[0158] Geometric features may include the bottle position pattern of the sample holder.

[0159] The bottle position pattern can be a two-dimensional pattern.

[0160] The method may include using a processing component to determine a bottle position pattern by determining the corresponding positions, preferably the midpoint positions, of at least some of the sample bottle holders in the sample bottle holder and fitting a pattern to the determined positions.

[0161] Fitting a pattern to a determined location may include using algebraic and / or regression analysis.

[0162] Fitting a pattern to a determined location may include determining the best-fit pattern from a reference pattern library.

[0163] This method may include using a processing component to store the bottle position pattern as a new pattern in a reference pattern library.

[0164] Reference pattern libraries can be stored in a reference database.

[0165] The method may include: using a processing component to determine the quality level of a bottle position pattern; and, if the quality level exceeds a quality threshold level, using the processing component to automatically associate the bottle position pattern with a sample carrier.

[0166] The method may include: displaying a bottle position pattern using a processing component, preferably simultaneously with image data representing a sample carrier; and receiving user input using the processing component to confirm the bottle position pattern.

[0167] This method may include using a processing component to determine the puncture location of the probe based on a bottle position pattern.

[0168] The sample carrier can be a well plate.

[0169] The method may include using a processing component to determine the puncture of a bottle (e.g., a sample bottle), preferably the puncture of a bottle seal (i.e., a septum), and particularly the puncture by a probe.

[0170] This method may include using processing components to adjust image data parameters of image data to determine the puncture and / or puncture location of the bottle.

[0171] Image data parameters can be exposure values, contrast values, and / or lighting parameters.

[0172] This method may include determining the puncture and / or puncture location of the bottle based on contrast differences in image data.

[0173] This method may include using processing components to determine the positional difference between the expected puncture location and the captured puncture location.

[0174] This method may include using processing components to adjust the puncture position of subsequent sample carriers and / or subsequent vials based on positional differences, particularly reducing positional differences.

[0175] The method may include: using a processing component to adjust the puncture position if and only if the positional difference is less than a difference threshold.

[0176] The adjustment of the puncture position can be less than the position difference, wherein the adjustment of the puncture difference can preferably be less than 80% of the puncture difference, more preferably less than 60% of the puncture difference, such as less than 40% of the puncture difference.

[0177] The method may include using a processing component to iteratively determine and / or correct the puncture position of a bottle sequence, particularly by using the processing component to adjust the puncture position of subsequent bottles based on the determined puncture position of the previous bottle.

[0178] This method may include using processing components to determine multiple positional differences, preferably determining positional differences of the intact sample carrier.

[0179] The method may include: averaging multiple location differences using a processing component, and determining the puncture location correction for the sample carrier based on the average difference.

[0180] This method may include using processing components to determine the drift of the puncture location based on multiple location differences, particularly system drift.

[0181] This method may include using processing components to determine wear levels based on location differences.

[0182] The method may include: providing a warning using a processing component and / or stopping subsequent punctures using a processing component when the wear level exceeds a predetermined threshold.

[0183] The method may include using a processing component to extract location marker data from image data, wherein the location marker data defines at least one puncture location, preferably relative to the sample carrier, and correspondingly the sample carrier location on the placement area.

[0184] This method may include using a processing component to set multiple puncture sites based on location marker data.

[0185] This method may include utilizing calibration targets.

[0186] This method may include setting the calibration target on the placement area or on the sample carrier.

[0187] The image data may include at least two representations of the calibrated target at different locations relative to the capture component.

[0188] The method may include using processing components to determine the distance and / or displacement vector between two representations of the calibration target.

[0189] The calibration target may include at least one uniquely identifiable marker.

[0190] The calibration target may include at least two uniquely identifiable markers that can be spaced apart from each other.

[0191] The two representations of the calibration target may each include a representation of at least one uniquely identifiable marker, and the method may include using a processing component to determine the distance and / or displacement vector between the two representations of the uniquely identifiable marker, particularly for each uniquely identifiable marker that may be included in the image data.

[0192] The method may include using processing components to calculate the central perpendicular line of the displacement vector, specifically calculating at least two central perpendicular lines for two uniquely identifiable markers and their corresponding displacement representations.

[0193] This method may include using a processing component to determine the center point of the placement area and / or platform component, particularly the rotation axis, from the intersection of two central vertical lines.

[0194] The platform component may be part of an autosampler for a chromatography system, preferably for a liquid chromatography system, and more preferably for a high-performance liquid chromatography system.

[0195] The present invention also relates to a system comprising: a platform component having a placement area configured to hold a sample carrier; an imaging component configured to have a field of view toward the placement area and configured to capture image data of at least a portion of the placement area; and a processing component configured to process the image data.

[0196] The system can be configured to perform the method according to any one of the foregoing method implementation methods.

[0197] The system may include features corresponding to the methods discussed above and below. For the sake of brevity, a detailed discussion of these features is omitted here.

[0198] The present invention also relates to an autosampler for a chromatography system, wherein the autosampler may include the system according to the present invention.

[0199] The present invention also relates to a chromatography system including an automatic sampler.

[0200] The present invention also relates to the use of the system according to the invention, the autosampler according to the invention, and / or the chromatographic system according to the invention in liquid chromatography, preferably in high performance liquid chromatography.

[0201] The method may include using a system according to the invention, and / or an autosampler according to the invention, and / or a chromatographic system according to the invention.

[0202] The object of this invention may be to enable users to remotely inspect the turntable, its occupancy, and the sample holder in a simple, easy-to-understand, intuitive, and cognitively ergonomic manner. The object of this invention may also be to use image processing techniques to automatically distinguish between occupied and unoccupied locations in the sample carrier and / or to detect specific features corresponding to sample vials, such as the presence of a cap. The object of this invention may also be to achieve the aforementioned objectives using images captured within the limited vertical space of an autosampler (such as an HPLC autosampler).

[0203] The present invention also relates to embodiments numbered as follows.

[0204] The following discussion will cover the implementation methods. These implementation methods are abbreviated as the letter "M" followed by a number. Whenever "implementation method" is mentioned in this document, it refers to these implementation methods.

[0205] M1. A method (100) comprising:

[0206] Image data is captured using an imaging component (104) configured with a field of view (114) facing a placement area (102) of a platform component (101), the placement area (102) being configured to hold a sample carrier (103); the image data is processed using a processing component.

[0207] M2. The method according to the preceding embodiment, wherein the method includes:

[0208] The shape of at least one surface, preferably the top surface, of the sample carrier (103) disposed on the placement area (102) is detected using the processing component and on the captured image data.

[0209] M3. The method according to any one of the foregoing method embodiments, wherein the method includes using the processing component to determine the sample carrier characteristics of the sample carrier (103).

[0210] M4. The method according to any one of the foregoing method embodiments, wherein the sample carrier (103) includes a plurality of sample holders (107), wherein each sample holder (107) is configured to hold a sample bottle (105).

[0211] M5. A method having the features of embodiment M3 according to any one of the foregoing method embodiments, wherein the sample carrier characteristics indicate the shape of the sample carrier (103).

[0212] M6. A method having the features of embodiment M3 according to any one of the foregoing method embodiments, wherein the sample carrier characteristics indicate the shape of the top surface of the sample carrier (103).

[0213] M7. A method having the features of embodiments M3 and M4 according to any one of the foregoing method embodiments, wherein the sample carrier characteristics indicate the distribution of the sample holder (107).

[0214] M8. A method having the features of embodiments M3 and M4 according to any one of the foregoing method embodiments, wherein the sample carrier characteristics indicate the number of sample holders (107).

[0215] M9. A method having the features of embodiment M4 according to any one of the foregoing method embodiments, wherein the sample holder (107) is uniformly distributed on the top surface of the sample carrier (103).

[0216] M10. The method according to any one of the foregoing method embodiments, wherein the method includes moving the platform component (101) relative to the imaging component (104) according to motion.

[0217] M11. The method according to any one of the foregoing method embodiments, wherein the motion is a rotation of the platform assembly (101) relative to the imaging assembly (104) about a rotation axis (106) parallel to the surface normal of the placement area (102).

[0218] M12. The method according to any one of the foregoing two embodiments, wherein the method includes capturing an image using the imaging component (104) during movement of the platform component (101).

[0219] M13. The method according to any one of the foregoing method embodiments, wherein the imaging component (104) is disposed at a predetermined height above the platform component (101).

[0220] M14. According to the method of the preceding embodiment, the predetermined height is at most 700 mm from the top surface (102) of the platform assembly, preferably at most 600 mm, and more preferably at most 550 mm.

[0221] M15. The method according to any one of the foregoing method embodiments, wherein the imaging component (104) is configured to be spaced apart from the central axis, preferably the rotation axis (106) of the platform component (101).

[0222] M16. A method having the features of embodiment M11 according to any one of the foregoing method embodiments, wherein the imaging component (104) is disposed within a radial interval, the radial interval

[0223] Defined by the rotation axis (106) of the platform assembly (101) and the outermost rotation point of the placement area (102),

[0224] Preferably defined by the inward-facing end (109) and the outward-facing end (110) of the sample carrier (103),

[0225] More preferably, it is defined by the inward end (109) of the sample carrier (103) and the vertical central axis of the sample carrier (103).

[0226] M17. A method having the features of embodiments M4 and M11 according to any one of the foregoing method embodiments, wherein the radial position of the imaging component (104) relative to the rotation axis (106) of the placement area (102) coincides with the radial position of at least one radially innermost sample holder (107) of the plurality of sample holders (107) relative to the rotation axis (106).

[0227] M18. A method according to any one of the foregoing method embodiments and having the features of embodiment M15, wherein the radial distance (108) between the imaging component (104) and the inward end (109) of the sample carrier (103) is less than half the distance between the inward end (109) and the outward end (110) of the sample carrier (103).

[0228] In other words, the imaging component can be positioned above the inner half of the sample carrier (103).

[0229] M19. A method having the features of embodiment M15 according to any one of the foregoing method embodiments, wherein the radial distance (108) between the imaging component (104) and the inward end (109) of the sample carrier (103) is measured perpendicular to the rotation axis (106).

[0230] M20. A method having the features of embodiment M4 according to any one of the foregoing method embodiments, wherein the imaging component (104) is configured such that it maintains a substantially consistent viewing angle over at least some of the plurality of sample holders (107) and / or over at least some of the sample bottles (105) disposed within the sample holders (107).

[0231] M21. The method according to any one of the foregoing method embodiments, wherein the imaging plane of the imaging component (104) is parallel to the placement area (102).

[0232] M22. A method according to any of the foregoing method embodiments and without the features of the preceding embodiment, wherein the imaging plane of the imaging component (104) is angled relative to the placement area (102).

[0233] M23. The method according to any one of the foregoing method embodiments, wherein the method includes using the processing component to correct optical distortion of the image data.

[0234] M24. The method according to the previous embodiment, wherein correcting the optical distortion of the image data includes using the inherent camera parameters of the imaging component (104).

[0235] M25. The method according to the previous embodiment, wherein the method includes performing a camera calibration algorithm using the processing component to determine the inherent camera parameters of the imaging component (104).

[0236] M26. The method according to any one of the preceding three embodiments, wherein correcting the optical distortion of the image data includes performing perspective correction based on the angle of the imaging plane relative to the top surface of the sample carrier (103).

[0237] M27. The method according to any one of the foregoing four embodiments, wherein correcting optical distortion of the image data includes performing distortion correction based on the optical properties of the imaging component (104).

[0238] M28. The method according to any one of the foregoing method embodiments, wherein processing the image data includes generating a top view representation of the sample carrier (103).

[0239] M29. A method according to the preceding embodiment and having the features of embodiment M23, wherein the correction of the optical distortion of the image data is performed before generating the top view representation of the sample carrier (103).

[0240] M30. The method according to any one of the preceding two embodiments, wherein the method includes: the processing component separating the sample carrier (103) from the placement area (102) and / or from the background to generate the top view representation of the sample carrier (103).

[0241] Generally, it will be understood that, in embodiments of the present invention, the processing component may further include a display component, such as a monitor, and the processing component may therefore also be configured to display information to a user, such as the top view representation and / or the bottle image, which will be mentioned below.

[0242] M31. The method according to any one of the foregoing method embodiments, wherein capturing the image data includes capturing an image sequence comprising a plurality of images, and wherein each image in the image sequence depicts a segment of the placement region (102).

[0243] M32. A method according to the preceding embodiment and having the features of embodiment M10, wherein the method includes capturing the image sequence during movement of the platform component (101).

[0244] M33. The method according to any one of the two embodiments described above, wherein each image in the image sequence depicts a different segment of the placement area (102).

[0245] M34. The method according to any one of the foregoing three embodiments, wherein for at least two of the images in the image sequence, the corresponding segments of the platform component (101) depicted therein partially overlap.

[0246] M35. The method according to any one of the foregoing four embodiments, wherein each segment of the placement area (102) is represented at least once in the image sequence.

[0247] M36. The method according to any one of the foregoing five embodiments, wherein the method includes extracting image segments from the image sequence using the processing component, preferably extracting image segments from each of at least some images in the image sequence using the processing component.

[0248] M37. The method according to the previous embodiment, wherein at least some of the image segments, preferably each image segment, is fan-shaped.

[0249] M38. A method according to the previous embodiment and having the features of embodiment M11, wherein each sector has the rotation axis (106) at its center.

[0250] M39. The method according to any one of the preceding two embodiments, wherein each sector has an angle of less than 10°, preferably less than 8°, and more preferably less than 5°.

[0251] M40. The method according to any one of the foregoing four embodiments, wherein the method includes extracting the image segment using the center point or central axis, preferably the rotation axis (106), of the placement area (102) of the platform component (101) relative to the processing component.

[0252] M41. The method according to any one of the foregoing five embodiments, wherein at least some of the image segments are rectangular, preferably strip-shaped.

[0253] M42. The method according to any one of the preceding six embodiments, wherein each image segment is radially aligned with the central axis, preferably the rotation axis (106), of the platform component (101).

[0254] M43. The method according to any one of the foregoing seven embodiments, wherein each image segment in the image segment depicts a sub-segment of equal size to the placement area (102).

[0255] M44. The method according to any one of the preceding eight embodiments, wherein the image segments have equal sizes.

[0256] M45. The method according to any one of the foregoing nine embodiments, wherein the method includes combining the image segments using the processing component and generating an overview image thereon.

[0257] M46. The method according to the previous embodiment, wherein the overview image includes an integrated image of all sample carriers (103) disposed on the placement area (103).

[0258] M47. The method according to any one of the preceding two embodiments, wherein the overview image includes an integrated image of the complete placement area (102) and all sample carriers (103) disposed on the placement area (102).

[0259] For example, the overview image may include a photographic representation of the placement area containing the sampler carrier.

[0260] M48. A method according to any one of the foregoing three embodiments and having the features of embodiment M23, wherein the correction of the optical distortion of the image data is performed before generating the overview image.

[0261] M49. The method according to any one of the foregoing four embodiments, wherein the overview image is a two-dimensional top view.

[0262] M50. The method according to any one of the foregoing method embodiments, wherein the platform component (101) includes at least one platform tracking indicator, and wherein the method includes using the platform tracking indicator to indicate the position and / or orientation of the platform component (101) relative to the field of view (114) of the imaging component (104).

[0263] M51. The method according to any one of the foregoing method embodiments, wherein the placement area (102) includes at least one placement tracking indicator, and wherein the method includes using the placement tracking indicator to indicate the position and / or orientation of the placement area (102) relative to the field of view (114) of the imaging component (104).

[0264] M52. The method according to any one of the foregoing method embodiments, wherein the sample carrier (103) includes at least one carrier tracking indicator, and wherein the method includes using the carrier tracking indicator to indicate the position and / or orientation of the sample carrier (103) relative to the field of view (114) of the imaging assembly (104).

[0265] M53. The method according to any one of the foregoing method embodiments, wherein the method includes indicating a position indicator signal to the processing component and / or the imaging component (104) using an indicator component, the position indicator signal indicating the relative position of the platform component (101) and / or the placement area (102) relative to the imaging component (104).

[0266] M54. The method according to the previous embodiment, wherein the indicator component includes at least one visual indicator disposed within the field of view (114) of the imaging component (104); wherein, for example, the orientation of the at least one visual indicator corresponds to the orientation of the platform component (101) and / or the placement area (102).

[0267] M55. A method according to any one of the foregoing method embodiments and having the features of any one of embodiments M36 and M50 to M54, wherein the method includes aligning the image segment using the processing component according to the platform tracking indicator, placement tracking indicator, carrier tracking indicator and / or position indicator.

[0268] M56. The method according to any one of the foregoing method embodiments, wherein the method includes using a motion component to move the platform component (101).

[0269] M57. The method according to the previous embodiment, wherein the method includes: moving, preferably rotating, the platform assembly (101) relative to the imaging assembly (104) by means of the motion component to modify the segment of the placement area (102) in the field of view (114) of the imaging assembly (104).

[0270] M58. The method according to the previous embodiment, wherein the method includes moving the platform component (101) stepwise using the motion component, and wherein, for each step, the placement area segment within the field of view (114) of the imaging component (104) is modified, preferably moving a predetermined distance along a predetermined trajectory, preferably a circular trajectory.

[0271] M59. A method according to any one of the foregoing three embodiments and having the features of embodiment M11, wherein the method includes using the motion component to rotate the platform assembly (101) about the rotation axis (106).

[0272] M60. The method according to any one of the foregoing four embodiments, wherein the method includes performing a step-by-step movement sequence of the platform component (101) using the motion component, the step-by-step movement sequence including a predetermined, preferably alternating sequence of movement intervals and stop intervals.

[0273] M61. A method according to the preceding embodiment and having the features of embodiment M31, wherein capturing the image sequence comprises capturing images using the imaging component (104) during stop intervals, preferably capturing images during each stop interval, and wherein the images captured during the stop intervals form the image sequence.

[0274] M62. The method according to any one of the preceding two embodiments, wherein the method includes using the processing component to synchronize the motion component relative to the imaging component (104) to acquire image data during a stop interval.

[0275] M63. The method according to any one of the foregoing three embodiments, wherein the method includes using the processing component to adjust the duration of the stop interval according to the image capture time required for the imaging component to capture an image.

[0276] M64. The method according to any one of the foregoing four embodiments, wherein the method includes using the processing component to adjust the duration of the stop interval according to the inertial component of the movement of the platform component (101).

[0277] M65. A method having the features of embodiment M31 according to any one of the foregoing method embodiments, wherein the method includes capturing the sample carrier (103) disposed on the placement area (102) by means of the image sequence using the imaging component (104), particularly capturing the sample carrier (103) completely.

[0278] M66. The method according to any one of the foregoing method embodiments, wherein the method includes capturing the sample carrier (103) at a height of up to a predetermined maximum height using the imaging component (104).

[0279] M67. A method according to any one of the foregoing method embodiments and having the features of embodiment M4, wherein the method includes using the processing component to determine a fill state characteristic, each fill state characteristic indicating the presence of a sample vial (105) in a corresponding sample vial holder (107).

[0280] M68. The method according to the previous embodiment, wherein the method includes using the processing component to determine the corresponding filling state characteristics of each sample holder (107).

[0281] M69. The method according to any one of the foregoing method embodiments, wherein the method includes determining bottle characteristics using the processing component, each bottle characteristic indicating the properties of a corresponding sample bottle (105) disposed in the sample carrier (103).

[0282] M70. The method according to the previous embodiment, wherein the method includes using the processing component to determine the corresponding bottle characteristics of each sample vial (105) disposed in the sample carrier (103).

[0283] M71. The method according to any one of the foregoing two embodiments, wherein each bottle characteristic indicates at least one of the following:

[0284] -The presence of the bottle cap;

[0285] -The presence of the bottle cap;

[0286] -The presence of specific markings on the sample vials;

[0287] -The presence of septa;

[0288] -The color of the bottle;

[0289] -The color of the bottle cap;

[0290] - The color of the sample contained in the bottle;

[0291] - The shape of the bottle, particularly the cross-section and / or shape of the bottle opening;

[0292] - The volume of the bottle;

[0293] - The length of the bottle;

[0294] - The filling state of the bottle relative to the sample;

[0295] - The position of the sample vial within the sample vial holder;

[0296] - The orientation of the sample vial within the sample vial holder;

[0297] - The relative position of the sample vial with respect to the sample carrier (103);

[0298] - The relative position of the sample vial with respect to the spatial configuration of the sample vial holder;

[0299] - The markings on the sample vials, particularly the markings on the top side of the sample vials.

[0300] M72. The method according to any one of the foregoing method embodiments, wherein the method includes generating a schematic representation of the carrier including the sample carrier (103) using the processing component.

[0301] M73. The method according to the previous embodiment, wherein the carrier schematic diagram includes the outline of the sample carrier (103) and / or the outline of the sample holder (107) of embodiment M4.

[0302] M74. The method according to any one of the two embodiments described above, wherein the carrier schematic diagram indicates the geometry of the sample carrier (103).

[0303] M75. The method according to any one of the foregoing three embodiments, wherein the method includes generating the carrier schematic diagram by processing the image data using the processing component.

[0304] M76. A method according to any one of the foregoing four embodiments and having the features of embodiment M28, wherein the method includes generating a schematic diagram of the carrier by processing the top view representation of the sample carrier (103) using the processing component.

[0305] M77. The method according to any one of the foregoing five embodiments, wherein the method includes using the processing component to generate the carrier schematic diagram based on user input.

[0306] M78. The method according to any one of the foregoing six embodiments, wherein the method includes generating the carrier schematic diagram by utilizing the processing component to access a carrier schematic diagram database and selecting the carrier schematic diagram in the carrier schematic diagram database.

[0307] M79. The method according to the previous embodiment, wherein selecting the carrier schematic diagram in the carrier schematic diagram database includes using a carrier label, the carrier label preferably indicating the type or ID of the sample carrier (103).

[0308] M80. The method according to the previous embodiment, wherein the method includes using the processing component to detect the carrier tag associated with the sample carrier (103) on the image data.

[0309] M81. A method having the features of embodiments M69 and M72 according to any one of the foregoing method embodiments, wherein the method includes enhancing the carrier schematic diagram with at least one of the bottle characteristics using the processing component, and generating the enhanced carrier schematic diagram on this basis.

[0310] M82. The method according to the previous embodiment, wherein the method includes enhancing the carrier schematic diagram with the bottle characteristics of each detected sample vial using the processing component.

[0311] M83. The method according to any one of the foregoing two embodiments, wherein the method includes using the processing component to provide the enhanced vector schematic as a basis for sequence creation (such as a puncture sequence).

[0312] M84. A method according to any one of the foregoing method embodiments and having the features of embodiments M45 and M72, wherein the method includes using the processing component to switch between providing the overview image and the carrier schematic diagram, preferably the carrier schematic diagram enhanced with bottle characteristics, so that comparison can be made between the generated schematic diagram and the photographic representation including the placement area (102) of the sample carrier (103).

[0313] M85. A method having the features of embodiment M72 according to any one of the foregoing method embodiments, wherein the method includes generating a schematic view depicting the carrier schematic diagram using the processing component.

[0314] M86. A method according to the preceding embodiment and having the features of embodiment M67, wherein the schematic view further depicts, preferably schematically depicts, the filling state characteristics associated with each corresponding sample holder (107).

[0315] M87. A method according to any one of the foregoing two embodiments and having the features of embodiment M69, wherein the schematic view further depicts, preferably schematically depicts, the bottle characteristics associated with each corresponding sample vial (105) disposed in the sample carrier (103).

[0316] M88. The method according to any one of the foregoing three embodiments, wherein the method includes displaying the schematic view on a display device operatively connected to the processing component.

[0317] M89. The method according to the preceding embodiment, wherein the method includes displaying, preferably simultaneously displaying, the schematic view and the sequence list input interface on the display device, wherein the sequence list input interface allows a user to input a sequence list indicating an ordered list of sample vials (105) disposed in a plurality of sample vials (105) in the sample carrier (103).

[0318] For example, the system can be part of a chromatographic system (e.g., a liquid chromatography system). That is, the liquid chromatography system can include the system described. In such a liquid chromatography system, different samples can be used, i.e., different sample vials. For example, a first sample vial can be used for a first sample run, a second sample vial can be used for a second sample run, and so on. Therefore, different samples can be analyzed sequentially, and a list of this sequence can be called a sequence listing.

[0319] M90. According to the method described in the previous embodiment, the position within the ordered list determines the execution order of the sequence.

[0320] M91. A method according to any one of the foregoing method embodiments and having the features of embodiment M4, wherein the method includes generating bottle holder images using the processing component, each bottle holder image depicting a top view of a corresponding sample bottle holder (107).

[0321] M92. A method according to a previous embodiment and having features of embodiments M67 and / or M69, wherein the method includes processing the bottle holder image using the processing component to enhance the visual depiction thereon of the filling state characteristics and / or the bottle characteristics.

[0322] M93. The method according to any one of the foregoing two embodiments, wherein the method comprises: using the processing component to cut the bottle image from the image data and / or from the image segment of embodiment M36 and / or from the overview image of embodiment M45, preferably using a mask, more preferably using a positive mask, and even more preferably using a circular positive mask.

[0323] M94. A method according to any one of the foregoing three embodiments and having the features of embodiment M88, wherein the method includes displaying the bottle image on the display device, preferably when prompted by a user.

[0324] M95. The method according to the preceding embodiment, wherein the method includes selectively displaying the bottle images one at a time according to prompts provided by the user.

[0325] M96. A method according to any one of the foregoing two embodiments and having the features of embodiment M72, wherein the method includes displaying each bottle holder image as superimposed on the carrier schematic diagram, preferably superimposed on the corresponding sample bottle holder (107).

[0326] M97. A method according to any one of the foregoing six embodiments and having the features of embodiment M72, wherein the method includes using the processing component to combine at least one of the bottle seat images into the carrier schematic diagram.

[0327] M98. A method having the features of embodiment M72 according to any one of the preceding seven embodiments, wherein the method includes combining a plurality of the bottle holder images into the carrier schematic diagram using the processing component, wherein each bottle holder image is associated with a separate sample bottle holder (107).

[0328] M99. A method having the features of embodiments M42 and M72 according to any one of the foregoing method embodiments, wherein the method includes generating a schematic representation of the fill level diagram including the fill state characteristics using the processing component, and incorporating the fill level diagram into the carrier diagram using the processing component.

[0329] M100. A method according to any one of the foregoing method embodiments and having the features of embodiment M72, wherein the method comprises: using the processing component to determine a confidence threshold of the carrier schematic diagram representing the actual state of the sample carrier (103), and when the confidence threshold drops below a predetermined lower confidence threshold, using the processing component to provide the image data and / or the top view representation of embodiment M28 to a user interface.

[0330] M101. A method having the features of embodiment M72 according to any one of the foregoing method embodiments, wherein the method includes using the processing component to overlay the carrier schematic diagram with the bottle seat image of embodiment M91 and / or with the top view representation of the sample carrier (103) of embodiment M28.

[0331] M102. A method according to any one of the foregoing method embodiments and having the features of embodiments M45 and M88, wherein the method includes displaying the overview image on the display device.

[0332] M103. A method having the features of embodiment M28 according to any one of the foregoing method embodiments, wherein the method includes using the processing component to overlay the top view representation of the sample carrier (103) with the carrier schematic diagram of embodiment M72 and / or the bottle holder image of embodiment M91.

[0333] M104. A method according to any one of the foregoing method embodiments and having the features of embodiment M72, wherein the method includes generating a carrier schematic diagram for each sample carrier (103) present on the placement area (102) using the processing component.

[0334] M105. A method according to the preceding embodiment and having the features of embodiment M28, wherein the method includes: using the processing component to overlay a schematic diagram of the corresponding carrier with a corresponding top view representation of the sample carrier (103) present on the placement area (102).

[0335] M106. A method according to any one of the foregoing two embodiments and having the features of embodiment M45, wherein the method includes providing a combined image including the overview image and the carrier schematic diagram using the processing component, preferably by displaying the overview image and the carrier schematic diagram side by side or by combining and aligning the overview image and the carrier schematic diagram, more preferably by the latter.

[0336] M107. A method having the features of embodiment M69 according to any one of the foregoing method embodiments, wherein the method includes using the processing component to map the bottle geometry, preferably a bottle geometry among a plurality of bottle geometries, to a sample bottle (105) based on the bottle characteristics.

[0337] M108. The method according to the preceding embodiment, wherein the method includes performing at least one of the following image analyses using the processing component to determine the bottle characteristics:

[0338] Brightness and contrast detection

[0339] Color contrast detection;

[0340] Edge detection of the image data,

[0341] Sharpen, and / or

[0342] Smooth or blurry.

[0343] M109. The method according to any one of the foregoing two embodiments, wherein the method includes executing a neural network using the processing component, and wherein the neural network is trained based on a learning sequence including platform component data, placement area data and / or sample carrier data.

[0344] M110. The method according to the previous embodiment, wherein the neural network is trained to determine sample carrier characteristics and / or bottle characteristics.

[0345] M111. The method according to any one of the preceding two embodiments, wherein the platform component data relates to the geometric properties of the platform component (101), preferably in the form of an image representation of the platform component (101), more preferably in the form of multiple platform component images including different platform component geometries.

[0346] M112. The method according to any one of the three embodiments described above, wherein the placement area data relates to the geometric properties of the placement area (102), preferably in the form of an image representation of the placement area (102), more preferably in the form of multiple overview images including different placement area geometries.

[0347] M113. The method according to any one of the foregoing four embodiments, wherein the sample carrier data relates to the geometric properties of the sample carrier (103), preferably in the form of an image representation of the sample carrier (103), more preferably in the form of multiple sample carrier images including different sample carrier geometries.

[0348] M114. The method according to any one of the foregoing method embodiments, wherein the image data includes a side view, such as an oblique view, of the sample carrier (103), and wherein the method includes extracting code from the image data using the processing component, preferably extracting graphic code.

[0349] M115. The method according to any one of the foregoing method embodiments, wherein the placement area (102) and / or the sample carrier (103) includes code.

[0350] M116. The method according to any one of the foregoing method embodiments, wherein the image data includes a substantially distorted representation of the sample carrier (103).

[0351] M117. A method having the features of embodiment M72 according to any of the foregoing method embodiments, wherein the method includes using the processing component to overlay a portion of the carrier schematic diagram onto the top view representation of embodiment M28 and / or the overview image of embodiment M45, and on this basis providing an augmented reality representation of the sample carrier (103).

[0352] M118. A method having the features of embodiments M28 and / or M45 according to any of the foregoing method embodiments, wherein the method comprises: using the processing component to replace a segment of the top view representation and / or the overview image with the carrier schematic diagram of embodiment M72 or at least a segment of the carrier schematic diagram.

[0353] M119. A method having the features of embodiment M4 according to any one of the foregoing method embodiments, wherein the method comprises: using the processing component to display, in the top view representation of embodiment M28 and / or the overview image of embodiment M45 and / or the carrier schematic diagram of embodiment M72, at least one sample bottle (105): sample name, information relating to the processing method corresponding to the sample bottle, and / or the position of the sample bottle.

[0354] M120. The method according to any one of the foregoing method embodiments, wherein the method includes receiving information relating to the geometry of the sample carrier (103) via user input using the processing component.

[0355] M121. The method according to any one of the foregoing method embodiments, wherein the method includes using the processing component to determine information related to the geometry of the sample carrier (103) by reading information (e.g., a barcode on the sample carrier (103)).

[0356] M122. The method according to any one of the foregoing method embodiments, wherein the method includes using the processing component to determine the sample carrier type corresponding to the sample carrier (103).

[0357] M123. The method according to the previous embodiment, wherein the sample carrier type is determined based on user input, preferably based on the user selecting a sample carrier type from a plurality of reference sample carrier types.

[0358] M124. The method according to any one of the preceding two embodiments, wherein the determination of the sample carrier type is based on the geometric features of the sample carrier (103).

[0359] M125. The method according to the previous embodiment, wherein the method includes using the processing component to determine the sample carrier type by comparing the geometric features of the sample carrier (103) with reference geometric features corresponding to a reference sample carrier type.

[0360] M126. The method according to the previous embodiment, wherein the reference sample carrier type is stored in a reference database in association with a corresponding reference geometry, and wherein the method includes accessing the reference database using the processing component.

[0361] M127. The method according to any one of the preceding two embodiments, wherein the method comprises: generating a new reference sample carrier type using the processing component when no match is found between the geometric features of the sample carrier (103) and the reference geometric features, and associating the new reference sample carrier type with the geometric features of the sample carrier (103).

[0362] M128. The method according to the two embodiments described above, wherein the method includes using the processing component to add the new reference sample carrier type associated with the geometric features of the sample carrier (103) to the reference database.

[0363] M129. The method according to any one of the foregoing five embodiments, wherein the method includes using the processing component to determine the geometric features of the sample carrier (103) by processing the image data, preferably a portion of the image data corresponding to the sample carrier (103) (such as the top view representation of embodiment M28).

[0364] M130. A method according to any one of the foregoing six embodiments and having the features of embodiment M45, wherein the method includes using the processing component to determine the geometric features of the sample carrier (103) by processing the overview image, preferably a portion of the overview image corresponding to the sample carrier (103).

[0365] M131. The method according to any one of the preceding seven embodiments, wherein the method includes using the processing component to determine the geometric features of the sample carrier (103) by processing an image of the sample carrier (103), the image being captured when the sample carrier (103) is empty, and wherein the image data includes the image.

[0366] M132. The method according to any one of the preceding eight embodiments, wherein the geometric features include the outline of the sample carrier (103).

[0367] M133. A method according to any one of the foregoing nine embodiments and having the features of embodiment M4, wherein the geometric features include a bottle position pattern of the sample bottle holder (107).

[0368] M134. The method according to the previous embodiment, wherein the bottle position pattern is a two-dimensional pattern.

[0369] M135. The method according to any one of the foregoing two embodiments, wherein the method includes using the processing component to determine the bottle position pattern by determining the corresponding positions, preferably the midpoint positions, of at least some of the sample bottle holders (107) and fitting a pattern to the determined positions.

[0370] M136. The method according to the preceding embodiment, wherein fitting the pattern to the determined position includes using algebraic and / or regression analysis.

[0371] M137. The method according to any one of the foregoing two embodiments, wherein fitting the pattern to the determined position includes determining the best-fitting pattern from a reference pattern library.

[0372] M138. The method according to any one of the foregoing five embodiments, wherein the method includes using the processing component to store the bottle position pattern as a new pattern in a reference pattern library.

[0373] M139. A method according to any one of the foregoing two embodiments and having the features of embodiment M126, wherein the reference pattern library is stored in the reference database.

[0374] M140. The method according to any one of the foregoing seven embodiments, wherein the method includes: determining the quality level of the bottle position pattern using the processing component; and automatically associating the bottle position pattern with the sample carrier (103) using the processing component if the quality level exceeds a quality threshold level.

[0375] M141. The method according to any one of the preceding eight embodiments, wherein the method comprises: displaying the bottle position pattern using the processing component, preferably simultaneously with image data representing the sample carrier (103); and receiving user input using the processing component to confirm the bottle position pattern.

[0376] M142. The method according to any one of the foregoing nine embodiments, wherein the method includes using the processing component to determine the puncture location of the probe based on a bottle position pattern.

[0377] M143. The method according to any one of the foregoing embodiments, wherein the sample carrier (103) is a well plate.

[0378] M144. The method according to any one of the foregoing method embodiments, wherein the method includes determining a puncture of a bottle (e.g., a sample bottle) using the processing component, preferably a puncture of a bottle seal (i.e., a septum), particularly a puncture performed by a probe.

[0379] M145. The method according to the preceding embodiment, wherein the method includes using the processing component to adjust image data parameters of the image data to determine the puncture and / or puncture location of the bottle.

[0380] M146. The method according to the preceding embodiment, wherein the image data parameters are exposure values, contrast values, and / or illumination parameters.

[0381] M147. The method according to any one of the foregoing two embodiments, wherein the method includes determining the puncture and / or puncture location of the bottle based on contrast differences in the image data.

[0382] M148. The method according to any one of the foregoing method embodiments, wherein the method includes using the processing component to determine the positional difference between the expected puncture location and the captured puncture location.

[0383] M149. The method according to the preceding embodiment, wherein the method includes using the processing component to adjust the puncture position of the subsequent sample carrier and / or subsequent vial based on the positional difference, particularly reducing the positional difference.

[0384] M150. The method according to the preceding embodiment, wherein the method includes using the processing component to adjust the puncture position if and only if the positional difference is less than a difference threshold.

[0385] M151. The method according to any one of the foregoing two embodiments, wherein the adjustment of the puncture position is less than the position difference, wherein the adjustment of the puncture difference is preferably less than 80% of the puncture difference, more preferably less than 60% of the puncture difference, such as less than 40% of the puncture difference.

[0386] M152. A method having the features of embodiment M144 according to any one of the foregoing method embodiments, wherein the method includes iteratively determining and / or correcting the puncture positions of the bottle sequence using the processing component, particularly adjusting the puncture positions of subsequent bottles based on the determined puncture positions of previous bottles using the processing component.

[0387] M153. A method having the features of embodiment M148 according to any one of the foregoing method embodiments, wherein the method includes determining a plurality of positional differences using the processing component, preferably determining positional differences of the intact sample carrier (103).

[0388] M154. The method according to the previous embodiment, wherein the method includes: averaging the plurality of positional differences using the processing component, and determining the puncture position correction of the sample carrier (103) based on the average difference.

[0389] M155. The method according to any one of the foregoing two embodiments, wherein the method includes using the processing component to determine the drift of the puncture position, particularly the system drift, based on the plurality of positional differences.

[0390] M156. A method having the features of embodiment M148 according to any of the foregoing method embodiments, wherein the method includes using the processing component to determine the wear level based on the location difference.

[0391] M157. The method according to the preceding embodiment, wherein the method includes providing a warning and / or stopping subsequent punctures using the processing component when the wear level exceeds a predetermined threshold.

[0392] M158. The method according to any one of the foregoing method embodiments, wherein the method includes extracting location marker data from the image data using the processing component, wherein the location marker data defines at least one puncture location, preferably relative to the sample carrier (103), corresponding to the sample carrier position on the placement area (102).

[0393] M159. The method according to the preceding embodiment, wherein the method includes using the processing component to set multiple puncture locations based on the location marker data.

[0394] M160. The method according to any one of the foregoing method embodiments, wherein the method includes utilizing a calibration target.

[0395] M161. The method according to the previous embodiment, wherein the method includes setting the calibration target on the placement area (102) or the sample carrier (103).

[0396] M162. The method according to any one of the foregoing two embodiments, wherein the image data includes at least two representations of the calibration target at different locations relative to the capture component.

[0397] M163. The method according to the preceding embodiment, wherein the method includes using the processing component to determine the distance and / or displacement vector between the two representations of the calibration target.

[0398] M164. The method according to any one of the foregoing four embodiments, wherein the calibration target includes at least one uniquely identifiable marker.

[0399] M165. The method according to any one of the foregoing five embodiments, wherein the calibration target comprises at least two uniquely identifiable markers spaced apart from each other.

[0400] M166. A method according to any one of the foregoing method embodiments having the features of embodiments M162 and M164, wherein each of the two representations of the calibration target includes a representation of the at least one uniquely identifiable marker, and wherein the method includes using the processing component to determine a distance and / or displacement vector between the two representations of the uniquely identifiable marker, particularly for each uniquely identifiable marker included in the image data.

[0401] M167. A method having the features of embodiment M163 or M166 according to any of the foregoing method embodiments, wherein the method includes calculating the central perpendicular line of the displacement vector using the processing component, in particular calculating at least two central perpendicular lines representing two uniquely identifiable markers and their corresponding displacements.

[0402] M168. The method according to the previous embodiment, wherein the method includes using the processing component to determine the center point of the placement area (102) and / or the platform component (101), in particular the rotation axis (106), from the intersection of two central vertical lines.

[0403] M169. The method according to any one of the foregoing embodiments, wherein the platform component is part of an autosampler for a chromatography system, preferably for a liquid chromatography system, and more preferably for a high performance liquid chromatography system.

[0404] M170. A method according to any one of the foregoing embodiments and having the features of embodiments M45 and M72, wherein the method includes providing a combined image including the overview image and the carrier schematic diagram using the processing component, preferably by displaying the overview image and the carrier schematic diagram side by side or by combining and aligning the overview image and the carrier schematic diagram, more preferably by the latter.

[0405] The system implementation methods will now be discussed. These implementation methods are abbreviated as the letter "S" followed by a number. Whenever "system implementation method" is mentioned in this document, it refers to these implementation methods.

[0406] S1. A system (100) comprising:

[0407] Platform component (101), the platform component having a placement area (102) configured to hold a sample carrier (103).

[0408] An imaging component (104) is configured to have a field of view (114) facing the placement area (102) and to capture image data of at least a portion of the placement area (102);

[0409] A processing component configured to process the image data.

[0410] S2. The system according to the preceding embodiment, wherein the system is configured to perform the method according to any one of the foregoing method embodiments.

[0411] The following will discuss other implementation methods.

[0412] A1. An autosampler for a chromatography system, wherein the autosampler comprises the system according to any one of the foregoing system embodiments.

[0413] A2. A chromatography system comprising an autosampler according to a previous embodiment.

[0414] A3. Use of the system according to any one of the foregoing system embodiments, the autosampler according to embodiment A1, and / or the chromatographic system according to embodiment A2 in liquid chromatography, preferably in high performance liquid chromatography.

[0415] Other implementation methods will be discussed below.

[0416] M171. The method according to any one of the foregoing method embodiments, wherein the method includes utilizing the system according to any one of the foregoing system embodiments, and / or the autosampler according to embodiment A1, and / or the chromatographic system according to embodiment A2.

[0417] The invention will now be described with reference to the accompanying drawings, which illustrate embodiments of the invention. These embodiments are to be described by way of example only and are not intended to limit the invention. Attached Figure Description

[0418] Figure 1 A system for capturing image data of a platform component having a placement area configured to hold a sample carrier is schematically depicted.

[0419] Figure 2 A flowchart is depicted for a method of capturing and processing image data of a platform component having a placement area configured to hold a sample carrier;

[0420] Figure 3 A flowchart is depicted for a method used to determine the type of sample carrier;

[0421] Figure 4 An overview image generated from image data is depicted;

[0422] Figure 5A An image depicting a platform component with calibration patterns set on it in its first pose is shown;

[0423] Figure 5B A second image depicts a platform component with calibration patterns disposed thereon in a second pose of the platform component; and

[0424] Figure 6 A flowchart depicts a method for adjusting the puncture position;

[0425] Figure 7The processing components are described. Detailed Implementation

[0426] It should be noted that not all figures are accompanied by all reference numerals. Instead, in some figures, certain reference numerals have been omitted for the sake of simplicity and brevity. Embodiments of the invention will now be described with reference to the accompanying drawings.

[0427] Figure 1 This is a schematic side view of system 100. System 100 may be part of an autosampler, preferably configured to extract a sample from a sample vial and introduce the sample into an analytical stream. More preferably, the autosampler may be part of a chromatographic system such as a high-performance liquid chromatography (HPLC) system.

[0428] System 100 includes a platform assembly 101. Platform assembly 101 can be configured to move, preferably rotate about a rotation axis 106. Therefore, platform assembly 101 can also be interchangeably referred to as a turntable 101. The rotation axis 106 can be the vertical central axis 106 of platform assembly 101. Therefore, Figure 1 Only a portion of the platform assembly 101 located on one side of the rotation axis 106 may be depicted, and the platform assembly 101 may further extend on the other sides of the rotation axis 106.

[0429] Platform assembly 101 may include a placement area 102, which may be the top surface of platform assembly 101 or a portion thereof. Placement area 102 may preferably extend perpendicular to the rotation axis 106. That is, rotation axis 106 may be parallel to the normal of placement area 102. Specifically, placement area 102 may extend horizontally, while rotation axis 106 may be vertical. When system 101 is in use, the vertical direction is parallel to the direction of gravity.

[0430] The placement area 102 and platform assembly 101 can be configured to hold one or more sample carriers 103. For simplicity, Figure 1 A single sample carrier 103 is shown. The sample carrier 103 can be positioned on a placement area 102 such that it may include an inward end 109 and an outward end 110. The inward end 109 and the outward end 110 may be opposite each other. The inward end 109 may refer to the end of the sample carrier 103 closest to the vertical central axis of the platform assembly 101. The outward end 109 may refer to the end of the sample carrier 103 furthest from the vertical central axis of the platform assembly 101. Therefore, a line connecting the inward end 109 and the outward end 110 may be formed along the radius of the platform assembly 101. In other words, the sample carrier 103 may extend radially from the inward end 109 to the outward end 110.

[0431] The sample carrier 103 can be configured to hold one or more sample vials 105. Specifically, the sample carrier 103 may include one or more sample vial holders 107 (see [link to sample holder]). Figure 4 Each sample vial holder is configured to receive a sample vial 105. Each sample vial 105 can be filled with a sample.

[0432] System 100 also includes an imaging assembly 104. The imaging assembly 104 is arranged such that it includes a field of view 114 facing the placement area 102. Figure 1 In the diagram, the field of view 114 of the imaging component is schematically represented by dashed lines radiating from the imaging component 104.

[0433] Imaging component 104 can therefore capture image data of placement area 102 and sample carriers 103 placed thereon. Preferably, imaging component 104 can capture image data of all sample carriers 103 placed on placement area. However, as depicted, imaging component 104 may include a limited field of view 114 that may not cover the entire placement area 102, and therefore not all sample carriers 103 placed on that placement area.

[0434] Platform assembly 101 can be configured to rotate about rotation axis 106 and relative to imaging assembly 104. For example, the system may include motion assembly 130 configured to move platform assembly 101 about rotation axis 106. This allows the portion of placement area 102 within the field of view 114 of imaging assembly 104 to change. Additionally, system 100 can be configured to synchronize image data acquisition by imaging assembly 104 with the rotation of platform assembly 101. This allows the entirety or at least a large portion of placement area 102 to be captured by imaging assembly 104.

[0435] Typically, the vertical spacing of system 100 (i.e., the space above placement area 102) may be limited. In other words, the vertical position of imaging component 104 may be directly adjacent to placement area 102 in the vertical direction. On the one hand, this limits the portion of placement area 102 covered by field of view 114. On the other hand, a small vertical distance between imaging component 104 and placement area 102 may cause optical distortion in the image data captured by placement area 102. Optical distortion may include "fisheye" distortion and / or pincushion effect.

[0436] Suitable optical components (e.g., a fisheye lens) can be used to increase the field of view 114 of the imaging assembly; however, this may increase optical distortion and may make the image data appear unnatural. For example, sample vial 105 may be presented normally from above when it is directly below the imaging assembly 104, while at the edge of the field of view 114, sample vial 105 may be captured from the side.

[0437] To mitigate these issues, the imaging assembly 104 may include a horizontal position away from the vertical central axis of the platform assembly 101. That is, the imaging assembly 104 may be positioned off-center relative to the platform assembly. The imaging assembly 104 may be aligned with the sample vial 105 closest to the center of the platform assembly 104. For example, as Figure 1 As depicted, the imaging assembly 104 is generally positioned above the second sample vial 105 from the inside out. In particular, the imaging assembly 104 can be positioned at a distance 108 from the inward end 109 of the sample carrier 103.

[0438] The imaging component 104 can be positioned at a distance 118 from the rotation axis 106.

[0439] The distances 108 and 118 can be radial distances, that is, measured radially relative to the rotation axis 106. In particular, the distances 108 and 118 can be measured from the optical axis of the imaging component 104.

[0440] As discussed, off-center placement of the imaging assembly 104 allows for better image capture of the sample carrier 103 with a more uniform and consistent viewing angle of the sample vial 105. Positioning the camera further outward, i.e., further away from the vertical central axis of the platform assembly 101, will result in the inner sample vial 105 tilting inward (i.e., toward the rotation axis 106) and the outer sample vial 105 tilting outward (i.e., away from the rotation axis 106) when viewed in an image captured by the imaging assembly 104, thus producing an image with lower uniformity of viewing angle for the sample vial 105. On the other hand, further inward placement of the imaging assembly 104 relative to the rotation axis 106 can enhance the effect of the side view of the outer sample vial 105 and may also require a larger field of view 114 to enable the imaging assembly 104 to capture the entire radial extension of the sample carrier 103.

[0441] Figure 2 It describes what can be made by Figure 1 The flowchart of the system execution method. Figure 2 In the following description, refer to Figure 1 Components of the system.

[0442] In S2, the method includes capturing image data. For example, image data can be captured using imaging component 104. Preferably, capturing image data may include capturing a sequence of images, wherein each image in the sequence corresponds to a different relative pose between placement region 102 and imaging component 104.

[0443] S2 may preferably include a rotating platform assembly 101 and image capture. These two steps may be performed iteratively until the entire placement area 102 (or at least all portions of the sample carrier 103) can be imaged. Therefore, the image data may include images of the entire placement area 102 (or at least all portions of the sample carrier 103). That is, the placement area can be rotated 360° while images are captured.

[0444] In S3, the method may include correcting optical distortions in the image data. S3 may preferably be performed by processing component 120 (see...). Figure 1 The optical distortion correction can be performed based on the inherent camera parameters of the imaging component 104. S3 can also be based on the camera's position relative to the turntable, as discussed in further detail below. Correcting optical distortion allows the image data to more accurately represent the placement area 102 and / or the sample carrier 103.

[0445] In S4, the method may include extracting image segments from the image data. S4 may be performed by processing component 120. Image segments can be extracted from each image captured in S2. The image segments may be longitudinally distributed in the radial direction relative to the central axis (such as the rotation axis 106) of platform component 101. The image segments may be narrower in the direction orthogonal to the radial direction. That is, the image segments may be narrow and long, with their length dimension extending approximately in the radial direction.

[0446] The image segments can be sector-shaped. Each sector can be radially aligned relative to the rotation axis 106. For example, each sector can include the rotation axis 106 at its center. Furthermore, these sectors can preferably have small angles. Therefore, these sectors can be narrow and long. This ensures that the bottle can be imaged consistently at similar angles, preferably from directly above. That is, if the image segment is chosen to be wide (rather than narrow), for example, with a large angle, the imaging segment will include a lateral view seen from a first side of the sample bottle, and as the platform assembly rotates, it will include a view seen from directly above, and then a lateral view seen from a second side of the sample bottle. The narrower the image segment (e.g., the smaller the angle of the sector), the more constant the viewing angle, because the lateral view is truncated. This improves the optical quality of the image segment.

[0447] In S10, the method may further include extracting bottle holder images. Preferably, this method includes extracting a corresponding bottle holder image for each bottle holder of the sample carrier 103. Each bottle holder image may depict a top view of the corresponding bottle holder of the sample carrier 103. Bottle holder images can be extracted directly from image data, but it is more preferable to extract bottle holder images from image segments, as this increases the likelihood that the bottle holder images depict a top view of the corresponding bottle holder.

[0448] It will be understood that bottle holder images are different from image segments discussed herein. Each bottle holder image may depict a single bottle holder, while image segments may each depict multiple bottle holders. Typically, image segments may each depict the portion of placement area 102 and sample carrier 103 that extends radially relative to the rotation axis 106 within the field of view 114.

[0449] It will be further understood that when the bottle holder is occupied, the corresponding bottle holder image naturally shows a top view of the sample bottle in the bottle holder image.

[0450] In S12, the method may include combining image segments, and in S14, the method may include generating an overview image based thereon. Preferably, S12 and S14 may be performed by processing component 120. S12 and S14 may include aligning image segments. This alignment may utilize positional information indicating the relative pose between imaging component 101 and placement area 102. S12 and S14 may include stitching image segments to generate an overview image.

[0451] As discussed, although each image of the image data captured in S2 depicts only a portion of the placement area 102 due to the limited field of view 114 of the imaging component 104, the image data can include a larger portion of the image, and preferably includes images of the entire placement area (or at least all portions of the sample carrier 103). At least two advantages can be achieved by extracting and combining image segments:

[0452] First, the overview image can depict the entire placement area 102, and thus depict all sample carriers 103 that can be placed on the placement area.

[0453] Secondly, the overview image can depict the placement area 102 with a more uniform viewing angle. In particular, the maximum viewing angle on the entire overview image is the same as the maximum viewing angle on a single image segment. In short, the overview image depicts all parts of the placement area 102 as viewed essentially from directly overhead.

[0454] Exemplary overview image in Figure 4 As shown in the figure. The exemplary overview image was generated from image data of placement areas 102 including four sample carriers 103-4 to 103-7.

[0455] In S16, the method may include generating a schematic diagram of the carrier. The schematic diagram of the carrier may also be interchangeably referred to as a schematic image or schematic representation. It can depict a schematic representation of the sample carrier 103.

[0456] Preferably, the carrier schematic diagram can depict a schematic representation of the entire placement area 102, and therefore a schematic representation of all sample carriers 103 placed on that placement area. Thus, the carrier schematic diagram can depict an overview schematic diagram of the placement area 102. This differs from an overview image, which instead depicts a photographic representation of the placement area 102.

[0457] The carrier schematic diagram may include the outline of the sampler carrier 103 placed on the placement area 102. That is, the carrier schematic diagram can provide an abstract view of the geometry of the sampler carrier. The sample holder geometry can be obtained directly from the overview image through image processing, selected or defined by the user, or obtained from other device information, such as a barcode on the sample carrier.

[0458] Using the geometry of the sample holder, a portion of an overview image depicting the sample holder or one or more image segments depicting the sample holder can preferably be processed by a processing component to extract more information that can be enhanced into a schematic image.

[0459] In other words, the carrier schematic diagram may include more information related to the sample carrier 103. For example, the carrier schematic diagram may be enhanced with fill state characteristics, each fill state characteristic indicating the presence of a sample vial 105 in the corresponding sample vial holder 107. Fill state characteristics may be schematically depicted within the carrier schematic diagram. Alternatively or additionally, the carrier schematic diagram may be enhanced with vial characteristics, each vial characteristic indicating the properties of a corresponding sample vial 105 disposed in the sample carrier 103. Vial characteristics may be schematically depicted within the carrier schematic diagram.

[0460] Various methods and algorithms can be used and combined to extract more information from processed images, such as:

[0461] Only the circular segment where each sample vial is expected to be located can be extracted from image data, image segments, and / or overview images using a positive mask to hide surrounding artifacts that would interfere with clear optical perception.

[0462] Image filtering can be performed to produce a sharper, optically enhanced image through contrast and color enhancement, sharpening or smoothing, and edge detection. This allows for clearer acquisition of information such as the presence of the bottle, the presence of the cap, the cap color, and the septum.

[0463] Similarly, pre-trained computer-based neural networks can be used to recognize specific features such as the presence of a bottle, the presence of a cap, the absence of a bottle, or a specific mark on a bottle or cap.

[0464] In addition, computer-based analysis can be used to determine the extraction of image information such as cover color or septum diameter.

[0465] Then, a filtered image or symbol / label of information obtained from the processed image can be added to the corresponding position in the geometric representation and displayed on a display device.

[0466] Both overall and schematic images can be stored. These images can be displayed on demand, for example, by activating their display via control elements in software, particularly software used for sequencing. For instance, via a user interface, the overview image and vector schematic can be selectively hidden or displayed in the same location. Different types of cross-gradients between the vector schematic and the overview image are possible. Different types of overlap between the vector schematic and the overview image are also possible. This allows users to compare the vector schematic with the overview image.

[0467] A schematic diagram of the carrier can be provided for sequence creation. The enhanced representation can replace the simpler rotary representation that does not include the added information.

[0468] Steps S4 to S16 can be executed by the processing component 120.

[0469] Figure 3 A method for automatically determining the type of sample carrier (such as sample carrier geometry) is described.

[0470] In S20, sample carrier 103 can be obtained (see Figure 1 The image of the sample carrier in S20 can be, for example, in S2 (see S2). Preferably, the sample carrier can be empty, i.e., no sample vial is provided in the sample carrier. Figure 2 The image data in S20 is acquired during the capture of the image data. Alternatively, the sample carrier image in S20 may be obtained in S2 (see S2). Figure 2 It was captured in and further processed with S4 (see S4) Figure 1 The same optical distortion-corrected image can also be obtained from S14 (see S14). Figure 2 Extract the sample carrier image from S20 from the overview image generated in the image.

[0471] For example, by cutting Figure 4 The sample carrier image in S20 is obtained by taking the portion corresponding to sample carrier 103-6 (which is empty) from the overview image depicted in the image. The sample carrier image allows for the determination of the sample carrier type of sample carrier 103-6.

[0472] In S22, the bottle position can be determined by processing the sample carrier image. The bottle position can be a corresponding location, such as the corresponding center point of the sample bottle holder 107 on the sample carrier 103. For example, using image recognition techniques such as filtering, edge detection, and circle fitting, the center point of the bottle position can be detected in the sample carrier image. While it may not be necessary to detect all sample bottle positions, detecting as many bottle positions as possible may be advantageous.

[0473] In S24, a geometric pattern can be fitted to the determined bottle position. The geometric pattern can be a two-dimensional pattern. That is, the X and / or Y directions of the bottle position can be determined. Preferably, the direction can be determined based on as many identified adjacent bottle positions as possible. S24 may include selecting the best-fit pattern from a reference pattern library. This library may include predefined patterns representing various positional arrangements of sample bottle holders within the sample carrier. Alternatively, algebraic and regression analysis can be used to fit the geometric pattern.

[0474] After the pattern is fitted, S24 can evaluate the quality of the fit. This quality control step ensures that the fitted pattern accurately represents the spatial arrangement of the sample holders in the sample carrier.

[0475] In some cases, the fitted bottle position pattern can be displayed to the user simultaneously with image data representing the sample carrier. The user can be prompted to manually verify the accuracy of the fitted pattern. For example, the determined pattern can be overlaid on an image of the sample carrier. This combined image of the sample carrier with the determined pattern overlaid can be displayed to the user to determine whether it is the correct pattern or whether the pattern is sufficiently similar to the original shape of the sample carrier.

[0476] If the bottle position pattern is new or significantly deviates from the existing reference pattern, it can be stored as a new pattern in the reference pattern library for future use.

[0477] The pattern can also be used without user interaction, allowing the computer to determine whether the pattern has been adequately recognized by using the quality value of pattern recognition.

[0478] Figure 4 An exemplary overview image constructed from multiple captured and processed images is shown. In this example, four sample carriers 103-4 to 103-7 are disposed on placement area 102. As depicted, the overview image depicts a top-view photographic representation of all sample carriers 103-4 to 103-7 disposed on placement area 102.

[0479] Therefore, even if the imaging component 104 (see Figure 1Since the field of view 114 may not cover the entire placement area 102, the present invention can also generate a top-view photographic representation of the entire placement area 102. Additionally, an overview image can be generated, thereby reducing optical distortion. Figure 4 As can be seen in the exemplary overview image, the viewpoint is essentially the same throughout the entire overview image. Furthermore, all sample vials 105 and sample holders 107 appear in the image as if they were viewed from above. Conversely, it is noted herein that this is not the case if, for example, an imaging component with a large field of view is used to fully capture the placement area 102 in a single image. In this example, in particular, the corners of the image will appear tilted outwards away from the image center.

[0480] One aspect of the invention may be the calibration between the position of the imaging component and the position of the center of the platform component, wherein the center may be on the rotation axis 106 (see...). Figure 1 On. This calibration can facilitate according to Figure 2 The method, and in particular, corrects optical distortion of image data in S4 and / or combines image segments in S12.

[0481] Figure 5A The image shows a photographic representation of a segment of placement area 102 comprising at least a portion of three sample carriers 103-1, 103-2, and 103-3. A calibration pattern 201 (e.g., a checkerboard 201) can be used to determine the position of the camera relative to the center of placement area 102, and this calibration pattern can be disposed on placement area 102. Preferably, calibration pattern 201 can be fixed to placement area 102 such that it does not move relative to placement area 102. Calibration pattern 201 can be fixed at least for the duration of the calibration process. Calibration pattern 201 can be captured by imaging assembly 104 in at least two different poses of placement area 102. That is, calibration pattern 202 can be captured before and after rotation of placement area 102. Figure 5B It shows the relationship with Figure 5A The photograph shows the same placement area 102, but placement area 102 has been rotated.

[0482] In both images, uniquely identifiable markers 202 of the calibration pattern 201 (e.g., corner points 202 of a square) can be detected and matched with each other. Specifically, a first set of uniquely identifiable markers 202 (e.g., corner points 202 of a square) can be detected from the first image corresponding to the first pose of the placement region 102. Figure 5A (as shown), and a second set of uniquely identifiable markers 202 (such as) can be detected from a second image corresponding to a second pose of placement region 102. Figure 5B(As shown). Given that marker 202 is uniquely identifiable, the first set of uniquely identifiable markers 202 can be matched with the second set of uniquely identifiable markers 202. In other words, for at least some of the uniquely identifiable markers 202, their positions in each pose of the placement area 102 can be determined.

[0483] Based on this, displacement 203 can be calculated for at least some uniquely identifiable markers 202. This is in Figure 5A and Figure 5B As shown by arrows 203-1 and 203-2, these two arrows indicate the positions of the two uniquely identifiable markers 202 before and after the pose change, respectively.

[0484] Furthermore, a corresponding central vertical line 204 can be determined for each displacement 203. This is in Figure 5A and Figure 5B The figures are shown via lines 204-1 and 204-2. Since the pose change is performed via rotational motion, the displacement of each point (and therefore marked 202) is bisected by a vertical radius. This is based on the fundamental principle that the vertical radius, acting as the vertical bisector of a chord, divides the chord into two equal segments. The central perpendiculars 204 of all displacements 203 intersect at the center of the placement area, which lies on the rotation axis 106.

[0485] Figure 6 A flowchart depicts a method for adjusting or calibrating the puncture position. As discussed, Figure 1 The system can be part of an automated sampler, wherein a needle arm (not shown) can be used to extract a sample from a sample vial 105 disposed in a sample carrier 103. For this purpose, the needle arm can pierce the cap of the sample vial 105, allowing the needle to reach the sample inside the vial 105. Therefore, calibrating the puncture position of the needle arm may be advantageous, ensuring that the needle arm accurately and successfully punctures the sample vial 105 and extracts the sample from it. Such calibration can also help mitigate positional deviations of the needle arm.

[0486] In S60, the method may include capturing an image of the punctured sample vial. This can be achieved using... Figure 1 Systems and / or Figure 2 The method is to capture images. In particular, after puncturing a particular sample vial 105, the particular sample vial 105 can be moved within the field of view 114 of the imaging assembly 104 so that its image can be captured.

[0487] In S62, automatic algorithmic image processing can be used to detect the puncture location. The puncture location may include a contrast that differs from the rest of the cap of the sample vial 105. Therefore, for example, the puncture location can be determined using the contrast difference.

[0488] To optimally detect the puncture site, specific types of illumination from the sample carrier can be used when capturing images. For example, grazing light can be used to improve image contrast.

[0489] In S64, the detected puncture location can be compared with the expected puncture location. The expected puncture location represents the position where the sample vial 105 should be punctured. For example, the expected puncture location could be the center of the sample vial cap. The expected puncture location can be determined, for example, based on the position of the sample carrier in the image and / or based on the position of the punctured sample vial. The positional difference between the detected puncture location and the expected puncture location can be determined. For example, the degree to which the detected puncture location deviates from the center can be determined.

[0490] In S66, it can be determined whether the detected puncture site is a false positive. That is, the plausibility of the detected puncture site can be checked. This can be performed, for example, by comparing the positional difference determined in S64 with a difference threshold. The difference threshold can be a predetermined parameter. If the difference is small, i.e., less than the difference threshold, the puncture site is likely to have been correctly detected in S62. In this case, the method can proceed to S68, where the puncture site for future punctures is calibrated based on the positional difference. However, if the difference is large, i.e., greater than the threshold, the puncture site detected in S62 is likely to be a false positive and is therefore ignored in S67.

[0491] In S68, calibrating the puncture position may include adjusting the position of the sample vial for subsequent punctures according to a certain proportion of the determined positional difference. That is, the adjustment to the puncture position can be less than the puncture difference, preferably less than 80% of the puncture difference, more preferably less than 60% of the puncture difference, such as less than 40% of the puncture difference. For example, in the case of a puncture difference of one millimeter, a correction of 0.3 millimeters can be made, that is, approximately one-third of the deviation. This avoids over-adjustment, but the puncture position can be optimized through several punctures.

[0492] If the insertion site cannot be detected, no correction is performed. However, multiple puncture points can usually be identified for each sample carrier. Therefore, it is sufficient to only occasionally identify and correct the puncture site.

[0493] Adjusting the puncture site can also be based on images not specifically taken after each injection. For example, a set of images captured subsequently or taken randomly can be used. Alternatively, images taken at the end of the puncture sequence can be used.

[0494] This process can also be used to initially adjust the puncture site using a properly prepared sample carrier.

[0495] Figure 7A processing component 120 is depicted. The processing component 120 may be a data processing system 120. The processing component 120 may be integrated with the imaging component 104 (see [link]). Figure 1 The processing component 120 is connected during operation. Therefore, the processing component 120 can control the imaging component 104. The processing component can also be connected to the motion component 130 (see...). Figure 1 The processing component 120 is connected during operation. The processing component 120 can therefore control the motion component 130. The processing component 120 can preferably control the imaging component 104 and the motion component 130 according to a schedule (i.e., in a synchronized manner). The processing component 120 can access image data captured by the imaging component 104. The processing component 120 can process the image data to generate an overview image (see...). Figure 4 (and / or a schematic diagram of the carrier. For example, processing component 120 can perform...) Figure 2 Steps S4 to S16 of the described method. Processing component 120 can also perform... Figure 3 The methods and / or Figure 6 The method described.

[0496] Processing component 120 may include processing unit 750, which may be single or multiple, and may be, but is not limited to, CPU (Central Processing Unit), GPU (Graphics Processing Unit), DSP (Digital Signal Processor), APU (Accelerator Processing Unit), ASIC (Application-Specific Integrated Circuit), ASIP (Application-Specific Instruction Set Processor), or FPGA (Field-Programmable Gate Array). Processing unit 750 may include one or more microcontroller units.

[0497] In addition, the processing component 120 may include a memory component 740, which may be single or multiple, and may be, but is not limited to, volatile or non-volatile memory, such as random access memory (RAM), dynamic RAM (DRAM), synchronous dynamic RAM (SDRAM), static RAM (SRAM), flash memory, magnetoresistive RAM (MRAM), ferroelectric RAM (F-RAM), or parametric RAM (P-RAM).

[0498] Furthermore, processing component 120 may include external communication component 730. External communication component 730 may be configured to send data to and / or receive data from external devices. External communication component 730 may include antennas (e.g., Wi-Fi antenna, NFC antenna, 4G / 3G / 4G / 5G antenna, etc.), USB ports / plugs, LAN ports / plugs, contact pads providing electrical connectivity, smart card readers, etc. External communication component 730 may send and / or receive data based on a communication protocol. The data may be stored in memory component 740 and may be executed by processing unit 750. External communication component 730 may be connected to internal communication component 760. Therefore, data received by external communication component 730 may be provided to memory component 740 and / or processing unit 750. Similarly, data stored in memory component 740 and / or data generated by processing unit 750 may be provided to external communication component 730 for transmission to external devices.

[0499] Furthermore, the processing component 120 may include an internal communication component 760 configured to allow internal components 710-750 of the processing component 120 to communicate with each other. The internal communication component may, for example, include a bus connector 760.

[0500] Processing component 120 may include an input user interface 710 that allows a user of processing component 120 to provide at least one input to processing component 120. For example, input user interface 710 may include buttons, keyboards, touchpads, mice, touchscreens, joysticks, etc.

[0501] Processing component 120 may include an output user interface 720. For example, output user interface 710 may include a display 720. Display 720 may allow processing component 120 to display a graphical representation generated by behavior tree editor module 310.

[0502] Although the invention has been described with reference to specific embodiments, it should be understood that these embodiments are not intended to limit the scope of the invention, but are merely illustrative.

[0503] Whenever relative terms such as “about,” “substantially,” or “approximately” are used in this specification, such terms should also be interpreted as including precise terms. That is, for example, “substantially straight” should be interpreted as including “(perfectly) straight.”

[0504] Whenever steps are described above or otherwise in the appended claims, it should be noted that the order in which steps are listed herein may be accidental. That is, unless otherwise stated or unless it is clear to a person skilled in the art, the order in which steps are described may be accidental. That is, when this document states, for example, that a method includes steps (A) and (B), this does not necessarily mean that step (A) precedes step (B), but it is also possible that step (A) is performed (at least partially) concurrently with step (B), or that step (B) precedes step (A). Furthermore, when step (X) is considered to precede another step (Z), this does not mean that there are no steps between steps (X) and (Z). That is, step (X) preceding step (Z) covers the case where step (X) is performed directly before step (Z), but also covers the case where one or more steps (Y1) are performed after step (X) is performed... and then step (Z) is performed. When terms such as "after" or "before" are used, corresponding factors also need to be considered.

[0505] Although preferred embodiments have been described above with reference to the accompanying drawings, those skilled in the art will understand that these embodiments are provided for illustrative purposes only and should in no way be construed as limiting the scope of the invention as defined by the claims.

Claims

1. A method comprising: Image data is captured using an imaging component configured with a field of view facing a placement area of ​​a platform component, the placement area being configured to hold a sample carrier; The image data is processed using a processing component.

2. The method of claim 1, wherein, The sample carrier includes multiple sample holders, each of which is configured to hold a sample vial. The method includes using the processing component to determine a filling state characteristic, each filling state characteristic indicating the presence of a sample vial in the corresponding sample vial holder.

3. The method of claim 1, wherein, The method includes moving the platform component relative to the imaging component according to motion; The capture of the image data includes capturing an image sequence comprising multiple images, wherein each image in the image sequence depicts a segment of the placement area.

4. The method according to claim 3, wherein, The method includes extracting image segments from the image sequence using the processing component; and The method includes combining the image segments using the processing component and generating an overview image based thereon.

5. The method according to claim 1, wherein, Processing the image data includes generating a top-view representation of the sample carrier, and The method includes the processing component separating the sample carrier from the placement area and / or from the background to generate the top view representation of the sample carrier.

6. The method according to claim 5, wherein, The method includes using the processing component to correct optical distortion of the image data; The correction of the optical distortion of the image data is performed before the top view representation of the sample carrier is generated.

7. The method according to claim 1, wherein, The method includes using the processing component to generate a schematic representation of the carrier, including the sample carrier.

8. The method according to claim 5, in, The method includes using the processing component to generate a schematic representation of the carrier, including the sample carrier; The method includes generating a schematic diagram of the carrier by processing the top view representation of the sample carrier using the processing component.

9. The method according to claim 7, wherein, The method includes: The processing component is used to determine bottle characteristics, each bottle characteristic indicating the properties of the corresponding sample bottle disposed in the sample carrier, and The processing component is used to enhance the carrier schematic diagram with at least one of the bottle characteristics, and an enhanced carrier schematic diagram is generated on this basis.

10. The method according to claim 2, in, The method includes using the processing component to generate a schematic representation of the carrier, including the sample carrier; The method includes generating bottle holder images using the processing component, each bottle holder image depicting a top view of a corresponding sample bottle holder, and The method includes using the processing component to combine at least one of the bottle seat images into the carrier schematic diagram.

11. The method according to claim 4, in, The method includes using the processing component to generate a schematic representation of the carrier, including the sample carrier; The method includes using the processing component to provide a combined image including the overview image and the carrier schematic diagram.

12. A system comprising: A platform component having a placement area configured to hold a sample carrier; An imaging component, the imaging component being configured to have a field of view facing the placement area and being configured to capture image data of at least a portion of the placement area; A processing component configured to process the image data; and The system is configured to perform the method according to any one of the preceding claims.

13. An automatic sampler for a chromatography system, wherein, The automatic sampler includes a system, and wherein the system includes: A platform component having a placement area configured to hold a sample carrier; An imaging component, the imaging component being configured to have a field of view facing the placement area and being configured to capture image data of at least a portion of the placement area; A processing component, configured to process the image data; and The system is configured to perform the method according to any one of claims 1 to 11.

14. A chromatographic system comprising an autosampler, wherein, The automatic sampler includes a system, and wherein the system includes: A platform component having a placement area configured to hold a sample carrier; An imaging component, the imaging component being configured to have a field of view facing the placement area and being configured to capture image data of at least a portion of the placement area; A processing component, configured to process the image data; and The system is configured to perform the method according to any one of claims 1 to 11.

Images