Computer-implemented method for segmenting measurement data of an object

Abstract

A mass damper device includes a tubular housing (10) having a first longitudinal end (11) and a second longitudinal end (12), at least one damping mass (30) received in the tubular housing with a circumferential gap therebetween, and a first elastic element (51) and a second elastic element (52). At least one end closure (13, 14) is disposed at the first or second longitudinal end. The housing (10) and the end closure have cooperating mounting surfaces (11a, 12a, 13a, 14a) that define longitudinal mounting positions for the first and second end closures. The mounting surfaces (11a, 12a, 13a, 14a) are arranged such that the first resilient element (51) and the second resilient element (52) are compressed between the damping mass (30) and the end closures (13, 14) when the first and second end closures are attached to the housing in the longitudinal mounting position.

Description

[Technical Field]

[0001] The present invention relates to a computer-implemented method for segmenting measurement data of an object. [Background technology]

[0002] For quality assurance purposes, manufactured objects are measured and compared with the desired specifications to determine whether they conform to the desired specifications. In this case, measurements can be performed, for example, as dimensional measurements. Dimensional measurements can be performed, for example, by scanning various points on the object's surface. Furthermore, measurements can be performed, for example, by computed tomography, and the resulting measurement data can be analyzed. In this case, the object's internal surfaces can also be checked. In this case, the measurement data can be in the form of volume data or converted into volume data. To enable different regions of the object to be distinguished from one another in the measurement data, the measurement data can be segmented into different regions. This is particularly interesting, for example, during visualization, reverse engineering, multi-component functional analysis, and simulation of materials and material properties. Furthermore, the measurement data can be preprocessed before performing the method. For example, artifact corrections, such as metal artifacts based on the segmented geometry, beam hardening, and scattered radiation correction, as well as data filters, such as Gaussian filters and median filters, can be applied to the measurement data.

[0003] However, segmenting volume data of measurement objects consisting of multiple materials has been difficult to achieve satisfactorily because it requires adapting a specific segmentation algorithm for each material transition between two specific materials. For example, when analyzing grayscale values, a lower threshold is required to detect material transitions between materials with relatively small grayscale values in the measurement data than to detect material transitions between materials with relatively large grayscale values in the measurement data. Therefore, segmenting these volume data based on a global threshold is not very promising. In particular, when there are artifacts in the measurement data, many algorithms are unable to correctly segment different materials. Furthermore, correct segmentation is not sufficient to provide accurate measurement results for all material transitions, i.e., to accurately determine the location of material transitions. Summary of the Invention

[0004] It is therefore considered an object of the present invention to provide an improved computer-implemented method for segmenting measurement data of an object, which method provides for correct detection of material transitions from measurement data relating to the object.

[0005] The main features of the invention are set out in claims 1 and 15. Claims 2 to 14 relate to the construction.

[0006] The present invention provides a computer-implemented method for segmenting measurement data of an object having at least one material transition region, wherein the measurement data is used to generate a digital object representation having the at least one material transition region, the digital object representation comprising spatially resolved multiple image information items about the object, the computer-implemented method comprising the steps of determining the measurement data, segmenting at least two homogeneous regions in the digital object representation, and determining the location of at least one material transition region between the at least two homogeneous regions.

[0007] Therefore, the present invention separates the step of segmenting regions of different materials from the step of determining material transition regions. In this case, to identify regions of different materials, homogeneous regions in the object representation are first determined. Digital object representations can be two-dimensional or three-dimensional. Four-dimensional object representations are also possible if the temporal dimension is considered in addition to the spatial dimension.

[0008] In this case, a homogeneous region is understood to mean a region having a consistent material or a consistent mixture of materials. The image information may be, for example, grayscale values obtained from measurement data by computer tomography during dimensional measurement of an object.

[0009] A region where measurement data or image information is located between two thresholds, such as an upper threshold and a lower threshold, is considered homogeneous, i.e., a region where local measurement data are similar or have similar values, i.e., high local similarity. Therefore, image information associated with a homogeneous region of a digital object representation may have a narrow range of grayscale values, for example. Therefore, a homogeneous region may not be absolutely homogeneous but may have variations within an acceptable range. The threshold may be preset or determined when determining the homogeneous region. However, the homogeneity of a region does not necessarily have to be defined by grayscale values. As another example, a region having fibrous materials with similar fiber orientations can also be considered homogeneous, even if the grayscale values themselves are not homogeneous. However, the pattern defined by the texture resulting from the fibers is homogeneous. The material of the region or the entire object may be, for example, a single material; i.e., the material transition in a material transition region may be a transition between different material structures or from a single material to a background, in this example.

[0010] In another example, the precise determination of the material transition region in the step of determining the location of at least one material transition region between at least two homogeneous regions may include a small search region in which the material transition region is searched. A coarse segmentation may then optionally be performed prior to the step of segmenting the at least two homogeneous regions in the digital object representation. The result of this coarse segmentation may be the detection of homogeneous regions or regions of similar texture. A more precise segmentation may then be performed in the step of segmenting the at least two homogeneous regions in the digital object representation.

[0011] For example, if the local similarity is reduced, a material transition region between homogeneous regions may be determined. Otherwise, the corresponding homogeneous regions are merged. In this case, a material transition region may have, for example, a material surface, two adjacent material surfaces, multiple material transitions separated by narrow material regions, or an internal structure transition such as an individual material.

[0012] A material transition region may include, for example, a transition between biomaterials, a weld seam, a region of different fiber orientation, etc. A material transition region need not have a distinct material surface. As a further example, a material transition region may be approximated or represented as a surface in both measurements and CAD models.

[0013] Furthermore, at least one material transition region may be, for example, a multi-material transition region. The term multi-material does not only refer to regions of multiple homogeneous individual materials. The presence of fibers or voids may identify separate material regions, even if the underlying material remains the same. Regions with different properties may be explicitly interpreted as separate materials, especially in the case of the same or similar material composition. The background of a CT scan, typically the air surrounding the object, may also be a material in the measurement data.

[0014] That is, the object comprises at least two materials in the measurement data from which a material transition, eg a surface, is determined in addition to image information representing the background of the object.

[0015] According to a further example, the step of segmenting at least two homogeneous regions may comprise the substeps of determining at least two homogeneous regions in the measurement data and / or digital object representation, analyzing the local similarity of a plurality of spatially resolved image information items to obtain at least one predicted position of a material transition region, and adapting the extent of each homogeneous region until a boundary region of each homogeneous region is located at the at least one predicted position of a material transition region, and the step of determining the position of at least one material transition region between the at least two homogeneous regions may comprise the substep of determining the position of the at least one material transition region in, and preferably around, the at least one boundary region.

[0016] In this example, different algorithms are used, exploring different representations of the measurement data. Using different algorithms, each with its own advantages and disadvantages, allows the strengths of the algorithms used to be optimally utilized. For example, image information from the measurement data can be first analyzed with one algorithm, where each image information item is compared with, for example, locally neighboring image information items. This can be called presegmentation. Furthermore, this can be advantageously performed, for example, on three-dimensional measurement data. However, two-dimensional measurement data, which can also be linked to three-dimensional measurement data, can also be used. Similar image information items are then combined to form homogeneous regions. In this way, at least one homogeneous region is determined. In this case, the algorithm used to determine the homogeneous region may be inaccurate, resulting in the boundary of the homogeneous region not coinciding with the location of a material transition region that may border the homogeneous region. Further algorithms can be used to analyze the local similarity of the image information. This analysis of local similarity can be used to identify regions where the image information is slightly similar to neighboring image information. These regions can be identified as the predicted locations of material transition regions. In this case, the predicted position may result, for example, from the desired shape of the object or from another representation of the measurement data. The boundary region of the homogeneous region is then adapted by a further algorithm, for example by shifting its position. In this case, the extent of the homogeneous region can be changed. The position of the boundary region is adjusted until the boundary region constitutes the predicted position of the material transition region. Thus, shortcomings of individual algorithms can be compensated for by using further algorithms. In this case, the boundary region is understood to mean the part of the homogeneous region that borders the homogeneous region. In this case, the boundary region may have a predefined extent within the homogeneous region. The perimeter of the boundary region is understood to mean the part of the homogeneous region and the part of the region located outside the homogeneous region and directly adjacent to the boundary region. This perimeter has a shorter extent within the homogeneous region than a homogeneous region without the boundary region.

[0017] In this example, regions with local similarity values above a certain threshold can be identified as material transition regions between different material regions in the local similarity representation. Regions bordering this material transition region are then assigned entirely to the material that had the largest proportion of this region after pre-segmentation. In this case, it may be possible that a closed material transition region is not formed between material regions. This can be achieved, for example, by a morphological operation known as "closing," in which the corresponding material transition regions are expanded together and the small regions between them are removed.

[0018] In a further example, the local similarity representation may alternatively or additionally be pre-segmented, for example using a watershed transform or region growing techniques to generate contiguous regions. The local similarity representation may also be filtered or otherwise operated on to obtain more stable results, for example using a Gaussian filter.

[0019] Furthermore, the local similarity analysis may be based on, for example, a variation sequence of the spatially resolved plurality of image information items and / or a local variance of the spatially resolved plurality of image information items.

[0020] If the image information is grayscale values, for example, the gradient of spatially resolved grayscale values can be represented by a change sequence. If the homogeneous region is texture-based, for example, the local variance of the image information can be used to determine the local similarity. In this case, the gradient representation is preferably the absolute value of the local gradient, which indicates an increase in value near the material transition region.

[0021] In a further example, the step of segmenting at least two homogeneous regions may include a step of aligning a digital representation of the desired shape with the digital object representation, and at least two homogeneous regions in the measurement data and / or digital object representation may be determined based on the digital representation of the desired shape.

[0022] Thus, for example, predicted locations of material transition regions can be collected from the desired shape to obtain at least a rough pre-alignment of the measurement data. In this case, the desired shape may be a CAD model of the object. Regions of the desired shape or regions of the CAD model can then be assigned to corresponding regions in the measurement data. Thus, the computer-implemented method can utilize prior knowledge from the desired shape when determining the location of material transitions. This can be performed as part of pre-segmentation.

[0023] Alternatively or additionally, information about the shape of the object obtained from measurements using other sensors, for example optical techniques such as strip light projection, can also be used.

[0024] Further, the matching step may include the substeps of determining a digital representation of the material transition region of the object, for example from a local similarity of the image information, and matching the digital representation of the desired shape and the digital representation of the material transition region to each other.

[0025] In this example, the material transition regions of the object, determined from the local similarity of the image information, are fitted to the digital representation of the desired shape to align the digital object representation. In this case, a representation of the local similarity of grayscale values can first be calculated. This representation can indicate areas where material transition regions may exist in the measurement data, for example, by increasing grayscale values, but cannot provide more detailed information about the type of each material transition region. The representation determined by the local similarity can then be directly fitted to the CAD. In this way, a rough but fast alignment is possible.

[0026] Furthermore, the matching step may include, for example, the substeps of determining at least a portion of the material transition region in the digital object representation, and matching the digital representation of the desired shape and the digital object representation to each other based on the at least a portion of the material transition region.

[0027] In this case, only a portion of the material transition region is determined. This portion can be determined, for example, by an algorithm that determines the material transition region, and this determination can be rough, i.e., not necessarily all of the material transition region is correctly captured. In this case, it may be sufficient to determine only the material transition region relative to the air outside the object. This may be sufficient for a rough match. This material transition region determination may optionally be performed using a fast algorithm, such as Iso50, or on reduced-resolution data to save time. However, local similarities may also be analyzed to determine the material transition region. The match between the digital object representation and the desired representation is, in this example, based on only a portion of the material transition region.

[0028] By way of further example, at least one portion of the surface may be determined using a fast algorithm.

[0029] In this way, a portion of the surface may be determined in a relatively short time, which may then be used, for example, to quickly roughly match the digital object representation, which may then be, for example, more finely matched in a subsequent step. Furthermore, after the portion of the surface has been quickly determined, the material transition region may be more accurately determined.

[0030] According to one example, the step of segmenting at least two homogeneous regions may include the substeps of analyzing a frequency distribution of a plurality of spatially resolved image information items, said frequency distribution being based on the frequency of identical image information items among a plurality of spatially resolved image information items relating to said object, and determining said at least two homogeneous regions based on said frequency distribution.

[0031] If the image information is, for example, grayscale values, the frequency distribution is a grayscale value histogram. Based on the analysis of the frequency distribution, typical grayscale values of existing homogeneous regions are identified. The typical grayscale values can be used to simplify the determination of homogeneous regions. In this case, the grayscale value histogram can also be automatically analyzed according to deviations indicative of specific materials to identify the grayscale values of individual materials. This automation can avoid waiting for user input, which is particularly useful when evaluating a large number of measurement values, for example, inline. Identical image information items in this case are image information items that have the same value, for example, as a grayscale value, or are located in a grayscale value range that is smaller than the range of grayscale values used to determine the homogeneous regions.

[0032] In a further example, the step of segmenting at least two homogeneous regions in the digital object representation may include a sub-step of analysing the object representation for regions of contiguous identical image information items among a plurality of spatially resolved image information items relating to the object in order to segment the homogeneous regions, and a material may be assigned to each homogeneous region.

[0033] In this example, the measurement data is automatically analyzed to identify continuous areas with as homogeneous grayscale values as possible, i.e., identical image information items. From the determined continuous areas, conclusions can be drawn about the typical grayscale values of the existing material. This information can be used as a pre-segmentation during segmentation. In this case, it is also possible to automatically analyze the grayscale value histogram according to deviations that indicate a particular material, in order to examine the grayscale values of the volume in relation to continuous grayscale value areas that are as homogeneous as possible. This automation eliminates waiting for user input, which is particularly useful, for example, when evaluating a large number of measurement values inline.

[0034] According to a further example, the method may include, prior to the step of segmenting at least two homogeneous regions in the digital object representation, a step of generating a label field defining the homogeneous regions using spatially resolved label values in the measurement data and / or the digital object representation, wherein at least one distance value of a distance field is assigned to each label value, the distance value representing the distance to the nearest boundary of the homogeneous region, and the step of segmenting the digital object representation may be performed based on the label field and the distance field.

[0035] A label field assigns a material to a location in the digital object representation. For this purpose, different values or ranges of image information, such as grayscale values, can be assigned. For example, in each case, a specific range between two thresholds can be assigned to different materials. At the same time, homogeneous regions are defined by the assignment. The label field implicitly represents the approximate location of the material transition region. In this case, a distance value from the distance field is assigned to each label value, and the distance value defines the shortest distance to the nearest interface of the associated homogeneous region. The distance field represents the location of the surface. The definitive material transition region of different materials can be stored with subvoxel accuracy using a single distance field, which may even be unsigned. In this case, the distance field can represent or store the location of the surface. In this case, label values can also be assigned to multiple distance values, thus, for example, in areas of overlap of homogeneous regions, allowing different homogeneous regions to be assigned. Together with the label field, it is possible to determine which material transition region is involved for each region of the surface. This is indicated by the material displayed adjacent to the label field. Because the label field is often used in determining the surface shape, the distance field is a particularly efficient way to describe or store this.

[0036] In a further example, the step of determining the location of at least one material transition region may include the substep of providing a selection of different types of material transition regions by user input and / or evaluation rules, and determining the location of the material transition region in the segmented digital object representation based solely on material transition regions of the selected type with greater accuracy than the step of analyzing the local similarity.

[0037] Therefore, the determination of the location of material transition regions is limited to specific types of material transition regions defined by user input, corresponding matrices, or evaluation rules, so that the determination of material transition region types that are not selected and whose locations are not required is not performed, which can save calculation time and capacity.

[0038] A type of material transition area is understood to mean, for example, a transition between two specific materials or between two different material structures within one material. A type of material transition may be, for example, a transition between PVC and steel.

[0039] According to a further example, the step of determining the location of at least one material transition region may include the sub-steps of providing, by user input and / or evaluation rules, regions in the digital object representation having required probe points, and providing a selection of material transition regions whose location is to be determined based on the provided regions in the digital object representation having required probe points.

[0040] Therefore, the determination of the location of the material transition region is limited to regions in the object representation where probe points are required according to user input or evaluation rules, i.e., the determination of the location of the material transition region is limited to regions of interest. The regions of interest in the object representation for the location of the material transition region may be, for example, manually transmitted, defined in evaluation rules, or derived from evaluation rules, for example, all material transition regions where fitting points are required. Therefore, material transition regions where no probe points are required are excluded from the determination. This allows for further savings in computational power.

[0041] After the step of segmenting at least two homogeneous regions in the digital object representation, the method may include the steps of: predefining, e.g., by user input and / or evaluation rules, types of material transition regions of geometric elements of the object to be fitted to the segmented digital object representation; and fitting geometric elements of the object to the segmented digital object representation based on regions of or probe points within the object representation having a material transition region of the predefined type between the homogeneous regions.

[0042] Thus, when adapting feature elements, for example to perform dimensional measurements, only probe points located in material transition regions of a type predefined by user input or evaluation rules are taken into account. By manually defining the evaluation rules or the feature elements to be probed, it is possible to define the expected materials in the material transition regions to be searched for. In this case, the orientation and placement of the respective materials are also taken into account. Only probe points located in this material transition region are then set; a warning is issued if probe points in a different material transition region are set. Optionally, this can also be defined on an individual probe point basis. This avoids unnecessary adaptation of feature elements.

[0043] According to a further example, the method may include, after the step of segmenting at least two homogeneous regions in the digital object representation, a step of fitting a geometric element of the object to the segmented digital object representation based on a material transition region between the homogeneous regions, a step of determining a material of the homogeneous region in the material transition region to which the geometric element is fitted, and a step of outputting information related to the material of the determined homogeneous region in the material transition region together with the result regarding the fitting of the geometric element.

[0044] Thus, when fitting the shape elements, it is determined which materials are involved in the determined material transition region, and this information may be output as part of the measurement result, for example as meta-information.

[0045] The type of material transition region and the materials involved may be visualized, for example, by color coding, as a 3D / 2D view of the measurement data, or as a representation or list of the fitted geometric elements.

[0046] The invention also relates to a computer program product executable on a computer and comprising instructions which, when executed on a computer, cause the computer to carry out the method described above.

[0047] The advantages, effects and developments of the computer program product result from the advantages, effects and developments of the method described above. Therefore, in this respect, reference is made to the above description. A computer program product can be understood to mean, for example, a data storage medium storing computer program elements having computer-executable instructions. Alternatively or additionally, a computer program product can also be understood to mean, for example, a permanent or volatile data memory, such as a flash memory or a main memory, having computer program elements. However, this does not exclude further types of data memory having computer program elements.

[0048] Further features, details and advantages of the invention will become apparent from the following description of exemplary embodiments, based on the claims and the drawings. [Brief explanation of the drawings]

[0049] [Figure 1] FIG. 1 shows a flowchart of a computer-implemented method. [Figure 2] FIG. 10 shows a flowchart including substeps of an exemplary embodiment of the segmenting step. [Figure 3]FIG. 10 shows a flowchart including substeps of a further exemplary embodiment of the segmenting step. [Figure 4] FIG. 10 shows a flowchart including substeps of an exemplary embodiment of the determining step. [Figure 5] FIG. 10 shows a flowchart including substeps of an exemplary embodiment of the matching step. [Figure 6a] 1 is a schematic diagram illustrating the sequence of steps of an exemplary embodiment of the method. [Figure 6b] 1 is a schematic diagram illustrating the sequence of steps of an exemplary embodiment of the method. [Figure 6c] 1 is a schematic diagram illustrating the sequence of steps of an exemplary embodiment of the method. [Figure 6d] 1 is a schematic diagram illustrating the sequence of steps of an exemplary embodiment of the method. [Figure 6e] 1 is a schematic diagram illustrating the sequence of steps of an exemplary embodiment of the method. [Figure 7] FIG. 1 is a schematic diagram illustrating a multi-material transition region. DETAILED DESCRIPTION OF THE INVENTION

[0050] A computer-implemented method for segmenting measurement data of an object is generally indicated by the reference numeral 100. The computer-implemented method 100 will first be described with reference to FIG.

[0051] 1 is a flowchart of one embodiment of a computer-implemented method 100 for segmenting measurement data obtained by measuring an object, where the object has at least one material transition region.

[0052] In a first step 102, measurement data relating to the object is determined. In this case, the measurement data can be determined, for example, by computed tomography (CT) measurements. However, other methods for determining the measurement data, such as magnetic resonance tomography, are not excluded. The measurement data are used to generate a digital object representation having at least one material transition region. The digital object representation is composed of a plurality of spatially resolved image information items relating to the object.

[0053] If the measurement data is CT data, it does not necessarily have to consist of only a single grayscale value per voxel. It can also be multimodal data, i.e., data from multiple sensors or data from a multi-energy CT scan, resulting in multiple grayscale values at each voxel. Furthermore, results from analyses of the original measurement data can also be used in method 100 as additional spatially resolved grayscale values, such as fiber orientation or local porosity. Additional information, which may be referred to as color channels, can therefore be interpreted as colored voxel data, even if colors in the visible spectrum are not represented. This additional information can be advantageously used in method 100.

[0054] In optional step 114, a digital representation of the object's desired shape is aligned with the digital object representation from the measurement data determined in step 102. The digital representation of the object's desired shape may, for example, be a CAD representation of the object created prior to manufacturing the object. The shape in the CAD model does not necessarily need to be described as a surface or material transition region. Instead, or in addition, it may be implicitly represented as a stack of images, a voxel volume, or a distance field. This can be particularly useful during additive manufacturing. Furthermore, this information can be directly converted into a label field without complex transformations. However, further representations of the desired shape are not thereby excluded.

[0055] At least two homogeneous regions in the measurement data and / or the digital object representation are determined based on the digital representation of the desired shape. Because the material transition regions and the object or regions of the object having homogeneous material are known in the digital representation of the desired shape, the homogeneous regions in the measurement data or the digital object representation generated from the measurement data can be inferred from the digital representation of the desired shape after matching in step 114.

[0056] During matching, i.e., when fitting the geometric regions of the desired shape to the measured data, it is possible to take into account which materials are involved in the grayscale value transitions and how they are arranged. The material arrangement can reveal the direction of the material transitions. This information is usually known for the desired shape and can easily be determined locally in each case from the measured data. This prevents the assignment of inconsistent material transition regions, which would lead to incorrect matching.

[0057] Matching can also be achieved by non-rigid mapping between the measured data and the desired shape.

[0058] In a further optional step 130, label fields defining homogeneous regions by spatially resolved label values in the measurement data and / or digital object representation may be created during any pre-segmentation.

[0059] The label field can be combined with a signed or unsigned distance field. In this case, at least one distance value in the distance field is assigned to each label value. In this case, the distance value describes the distance to the nearest interface of the homogeneous region. A separate distance field may be created for each material.

[0060] The interface of the homogeneous region is located in the material transition region. In this case, label values can be assigned to multiple distance fields, and therefore multiple distance values. That is, the material transition regions of each material in the object can be represented by separate distance fields. By using distance fields, the size of the homogeneous region can be recorded with minimal memory usage and computational effort.

[0061] In this case, it is possible to use known knowledge that, for example, only contiguous regions of a certain volume of a particular material of an object can occur in the measurement area. This can be taken into account when creating the label field, so that larger contiguous regions are not assigned to this material. This reduces errors during segmentation.

[0062] For example, a certain maximum size screw may exist within the measurement area. If at some point in the measurement volume a large area is assigned to this material, the method can determine that the assignment was presumptively incorrect.

[0063] In principle, matching or registration with a desired shape, such as a CAD model, can be performed by matching the material transition regions from the measurement to the corresponding material transition regions of the desired shape. That is, the pose where the best match is found is searched for. In this case, it is also possible to explicitly identify specific features of the shape, such as corners or edges, to find the appropriate assignment. In this case, the user or evaluation rules can select which materials, material transitions, or components of the desired shape to consider and which not. Furthermore, knowing the type of transition in the measurement data can prevent incorrect assignments and therefore incorrect registrations.

[0064] Also, the registration between the measured data and the desired shape can be performed non-rigidly.

[0065] Furthermore, when creating the label field, the measurement data can be searched for known geometric elements (e.g., screws) from a database. If a geometric element or a similar geometric element within a predefined range is identified within the measurement volume, knowledge of the desired shape can be used in further evaluation, for example, by assigning a material label corresponding to a range of grayscale values of the pre-segmentation or by matching the associated desired shape to the geometric element. Furthermore, alternatively or additionally, a corresponding evaluation plan can be automatically invoked. In a further example, objects can be automatically identified or named in the scene tree. Searching for known geometric elements from a database can be performed in a further step of method 100.

[0066] In a further step 104, at least two homogeneous regions are segmented from the digital object representation. If an optional pre-segmentation has been performed, step 104 may be called main segmentation. In this case, homogeneous regions in the digital object representation are determined and delimited from each other. If a label field according to step 130 is used, step 104 is performed based on the label field and the distance field.

[0067] Information from other sensors can be used in step 104. When adapting the location of the material transition region, the surface information obtained by these sensors is used to extend the material transition region in this direction or to prevent the material transition region from extending beyond the surface determined in this way.

[0068] After step 104, step 140 may optionally be performed. In step 140, material transition regions are predefined by geometric elements of the object input by a user and / or collected from evaluation rules. In this case, the geometric elements are intended to fit into the material transition regions of the segmented digital object representation. For example, a cylinder may be fitted into a cylindrical homogenous region bounded by a corresponding material transition region.

[0069] In a further optional step 142, geometric elements of the object are fitted to the segmented digital object representation. In this case, predefined material transition regions located between homogeneous regions are searched for. Regions of the object representation or probe points within the object representation having such predefined material transition regions are used to fit geometric elements of the object to the segmented digital object representation.

[0070] Furthermore, small cavities inside the material or material particles in the air may be identified and removed, for example, from the measurement data, since these are usually unwanted inaccurate segmentations caused by noise. Furthermore, the segmented surface may be smoothed to minimize the influence of noise. Such measures are typically considered after each step and are particularly useful for improving the stability of the results and reducing the computational time required for subsequent steps.

[0071] In step 106, the location of at least one material transition region located between at least two homogeneous regions is determined, where the regions between the two homogeneous regions are determined from the segmented digital object representation, and the locations of the material transition regions are assumed to be in these regions between the two homogeneous regions and are determined.

[0072] Different measurement data can be used in steps 130, 104 and 106. Different volume data sets obtained from different measurement data, for example MRT or ultrasound, can be used in the pre-segmentation of step 130, while the main segmentation can be performed on CT data, although this requires that the data sets of the different modalities are aligned with each other.

[0073] Alternatively or in addition to steps 140 and 142, geometric elements of the object may be adapted to the segmented digital object representation based on material transition regions between the homogeneous regions in a further optional step 144. In contrast to step 140, in this step, rather than predefined material transition regions, the material transition regions determined from the determination of the location of at least one material transition region between at least two homogeneous regions in step 106 are used.

[0074] In a subsequent, optional step 146, the material of the homogeneous region in the material transition region to which the shape element is fitted is determined. This can be done, for example, by image information. If the image information is grayscale values, a specific range of grayscale values can be assigned to a specific material. This allows the material of the homogeneous region to be determined.

[0075] In a further optional step 148, information related to the determined materials in the homogeneous regions in the material transition region is output as meta-information of the results related to the fit of the geometric elements. The information related to the determined materials can be compared with known knowledge of the object. For example, a specific material may be provided for a specific geometric element in the object. In that case, the materials determined for the corresponding geometric elements should be the same material. In case of a mismatch, a misfit or a defect in the manufacture of the object can be determined.

[0076] 2 shows optional substeps of step 104 and step 106. A first optional substep 107 comprises determining at least two homogeneous regions in the measurement data and / or digital object representation. To this end, the image information is analyzed to determine whether homogeneous regions exist, e.g., regions within a range of grayscale values or regions with similar textures.

[0077] In a further optional sub-step 108, the local similarities of the spatially resolved image information items are analyzed. In this case, for example, the change sequences of the spatially resolved image information items may be analyzed. Alternatively or additionally, the local variance of the spatially resolved image information items may be analyzed. The local variance may be calculated more quickly and robustly in material transition regions than using the change sequences. From the local similarities, predicted positions of material transition regions between different components of the object may be determined. The predicted positions of these material transition regions are the positions of the predicted boundaries of the homogeneous regions determined in sub-step 107.

[0078] In a further optional sub-step 110, the homogeneous regions are then adapted. For this purpose, the extent of each homogeneous region is modified so that the boundary region of each homogeneous region is placed at the predicted location of the material transition region. The predicted locations of the material transition regions thus become the boundaries of the homogeneous regions in the object representation.

[0079] In a further optional sub-step 112 of step 106, the position of the at least one material transition region in the at least one boundary region is determined according to sub-step 110. In this case, the periphery of the at least one boundary region may also be included when determining the position of the at least one material transition region. Since the boundary region is located at the predicted location of the material transition region, the search radius of the at least one material transition region is limited to the boundary region or to the boundary region and its periphery.

[0080] Alternatively or additionally, pre-segmentation may already be performed on the local similarity representation, for example using a watershed transform or region growing techniques to generate contiguous regions. The local similarity representation may also be filtered or otherwise operated on to obtain more stable results, for example using a Gaussian filter.

[0081] In a further optional sub-step of this variant of pre-segmentation, these contiguous regions may then be assigned to specific materials, for example by analyzing image information, which may be in the form of greyscale values, associated with the regions in the original measurement data.

[0082] Further pre-segmentation methods can model location-dependent electrical resistance within the volume, for example, based on gradients of image information present as grayscale values. Small starting regions are then defined for each material or component. This may be performed using a desired shape, such as a region-of-interest template or a CAD representation. Potential lines provide excellent estimates of material transition regions, especially in biological structures.

[0083] Machine learning algorithms can also be used for pre-segmentation. Furthermore, prior knowledge determined by other modalities or sensors, e.g., multi-sensors, can alternatively or additionally be used for pre-segmentation.

[0084] The result of the pre-segmentation is a preliminary label field and possibly a distance field.

[0085] The label field and / or the distance field may be stored at various resolutions to increase accuracy or reduce the amount of data. If necessary, additional distance fields and descriptions of local normal directions within the normal field may be added to provide a more detailed description of corners and material transition regions where many materials meet. Criteria requiring higher resolution may be local, such as the presence of corners or multiple edges, the presence of multiple materials, or strong changes or spatial variations in normals.

[0086] 3 shows a further exemplary embodiment of step 104 that can be used alternatively or additionally. In this case, step 104 comprises an optional sub-step 124 in which a frequency distribution of the spatially resolved image information items is analyzed. In this case, the frequency distribution is based on the frequency of identical image information items among the spatially resolved image information items of the object. This may be, for example, a histogram of the image information. If the image information is, for example, greyscale values, this is a greyscale value histogram. In this case, identical image information items are greyscale values at different locations of the digital object representation that have the same value.

[0087] In a further optional sub-step 126, at least two homogeneous regions are determined based on the frequency distribution. If different materials have different grayscale value ranges, for example, the grayscale value ranges for a particular material can be derived from a grayscale value histogram. These determined grayscale value ranges can then determine the homogeneous regions.

[0088] In a further optional sub-step 128, which can be used as an alternative to or in addition to sub-steps 124 and 126, the object representation is analyzed for contiguous regions of the same image information item among a plurality of spatially resolved image information items relating to the object. The analysis is used to segment homogeneous regions and to assign a material to each homogeneous region. As a result of determining contiguous regions of the same image information item, at least contiguous regions are already homogeneous. The analysis of different contiguous regions makes it possible to merge contiguous regions with similar image information.

[0089] 4 illustrates one embodiment of step 106. In optional sub-step 132, a selection of different types of material transition regions is provided. This may be performed by user input and / or by evaluation rules. The selection of the type of material transition region makes it possible, for example, to provide specific material transition regions that are of interest when checking the quality of the object.

[0090] In a further optional sub-step 134, after sub-step 132, the positions of at least the material transition regions of the selected type can be determined. In this case, the positions are determined with very high precision, which is higher than in the case of the above-mentioned sub-step 108. However, in this case, sub-step 108 does not have to be performed beforehand, i.e., sub-steps 134 and 108 can be performed alternatively or in combination. If only the positions of the material transition regions of the selected type are determined with precision, the positions of the remaining material transition regions are not determined or are not determined with precision, which can save calculation time.

[0091] In an optional sub-step 136, alternatively or additionally to step 106, regions within the digital object representation with required probe points may be provided. These regions may be provided by user input and / or by evaluation rules. The provided regions with required probe points may, for example, be of interest when checking the quality of the object.

[0092] In a further optional sub-step 138, it is possible to select and provide material transition regions to be located in or at provided areas of the digital object representation where probe points are required and where it is intended to determine their positions. This sub-step makes it possible to save computation time, since material transition regions are selected and provided only in areas where probe points are required, and to omit determining the positions of the material transition regions in other areas where probe points are not required.

[0093] 5 illustrates one embodiment of step 114. In optional sub-step 116, digital representations of material transition regions of the object may be determined from the local similarity of the image information. For example, material transition regions may be assumed to be within regions of the digital object representation if the local similarity of the image information is lower in these regions than outside of the regions.

[0094] In a further optional sub-step 118, the digital representation of the desired shape and the digital representation of the material transition region may be fitted to one another after sub-step 116. Since the material transition region may in particular comprise a surface or material boundary of the object that is also present in the desired shape, the material transition region may be aligned with a surface or material boundary that is present in the desired shape. Thus, the measurement data in the form of the digital object representation may be at least approximately aligned to the desired shape.

[0095] In a further optional sub-step 120, which can be performed as an alternative to or in addition to sub-steps 116 and 118, at least a portion of the material transition region in the digital object representation may be determined. This portion of the material transition region may be used in a further sub-step 122 to match the digital representation of the desired shape and the digital object representation to each other. For the matching of the digital object representation with the desired shape, it is therefore not necessary to know or determine all of the material transition region. To match measurement data of the form of the digital object representation to the desired shape, only a portion of the material transition region may be required, for example the outer surface of the object.

[0096] Optional step 130 and some further steps of method 100 are explained in more detail below with the aid of FIGS. 6a to 6e, which illustrate the use of label fields in connection with method 100. In this case, FIG. 6a schematically illustrates a digital representation 10 of image information from measurement data relating to a cross-section of an object. This schematic digital object representation may be, for example, a cross-sectional representation of a computed tomography measurement. In this case, the image information may be grayscale values, which for reasons of clarity are not illustrated as grayscale values in FIG. 6a. Only transition regions, where the grayscale values change significantly, are illustrated as lines.

[0097] The object has subregions 12, 14, 16, and 18, each of which forms a homogeneous region of image information. Subregion 12 is separated from subregion 14 by material transition region 20. Subregion 12 is also separated from subregions 16 and 18 by material transition region 22. Material transition region 24 is located between subregion 16 and subregion 18. However, while transition regions 26, 28, and 30 are also visible in digital representation 10 of the image information, they are due to shadowing or other artifacts and are not material transition regions.

[0098] In this case, conventional algorithms have the problem of being unable to distinguish the transition regions 26, 28, 30 from the material transition regions 20, 22, 24. Therefore, an optional pre-segmentation can first be performed in which the image information is analyzed.

[0099] In this case, Figure 6b shows the representation 10 of the image information from Figure 6a using a grid as the label field 32. The label field 32 may have any desired resolution, for example, coarser than the voxel or pixel resolution, and may have voxel / pixel or subvoxel / subpixel accuracy. The label field 32 and / or the distance field will most likely have the same structure and resolution as the measurement data. However, for example, a lower resolution, thus larger cells, or an anisotropic resolution, thus a rectangular prism instead of a cube, can be selected. Furthermore, the structure can also be adapted, for example, a tetrahedron instead of a cube. Furthermore, it is not absolutely necessary to be able to represent material transition regions with subvoxel accuracy with the help of one or more distance fields. This may only be necessary when or after determining the location of the material transition regions. Therefore, it is possible to work only with the label field during segmentation and use the distance field only when determining the location of the material transition regions, thereby saving computation time and storage space.

[0100] If the image information is grayscale values, for example, grayscale values below a certain threshold can be assigned to a first material, e.g., air, indicated by a "circle" in Figure 6b. Grayscale values above a further threshold can be assigned to a second material, indicated by a "+" in Figure 6b. Grayscale values between the two thresholds can be assigned to a third material, indicated by an "x" in Figure 6b.

[0101] The label field can be combined with the distance field.

[0102] Furthermore, for example, in the case of a connector with pin numbers 1 through 9, information from the desired shape associated with each part of the object can be used to obtain information associated with each material. Therefore, it is possible to separate regions of the same material into different parts of the object. This makes the evaluation of the measurement data clearer. Ideally, the regions are listed or displayed in a hierarchical structure already defined in the desired shape.

[0103] Similarly, areas of the same material that are separated or not connected by label fields can also be automatically separated.

[0104] In the next step according to FIG. 6c, a representation 34 is determined, which is obtained by analyzing the local similarities of the image information. This may be, for example, a gradient representation. Here, the material transition regions 20, 22, and 24 are clearly distinguishable. The transition regions 26 to 30 are not visible in this representation. However, in contrast to the representation 10 of the image information, the individual subregions of the object cannot be qualitatively distinguished from one another. That is, the material of the subregions cannot be inferred from the representation according to FIG. 6c.

[0105] The representation 34 is linked to the label field 32, as shown by way of example in FIG. 6d. In this case, it becomes clear that the homogeneous regions are not bounded by the material transition regions 20, 22, and 24 in all sections. Therefore, the boundaries of the homogeneous regions are shifted during the main segmentation in step 104, which is used when performing optional step 130, by relabeling the homogeneous regions, for example, from "o" to "x" at arrows 36 and 40, and from "+" to "x" at arrow 38. The regions labeled "o" at arrows 36 and 40 have disappeared in FIG. 6e and now belong to the region labeled "x." At arrow 38, the region labeled "+" has decreased, while the region labeled "o" has increased. A similar process is performed at arrows 42, 44, and 46. At arrows 46 and 44, two previously separate homogeneous regions labeled "+" have grown together, and the region labeled "x" has disappeared.

[0106] Alternatively or additionally, individual regions belonging to one material can be marked in the digital object representation to create a label field. This marking is then intelligently and automatically extended to the next material transition region. It is also possible for the material transition region to be indicated by the user and then automatically increased until it collides with another material transition region, eliminating the need for precise marking. Furthermore, operations such as opening, closing, contraction and expansion, inversion, and smoothing tools such as Boolean operations or filters can be used to process the regions of the label field.

[0107] Furthermore, it is possible to emphasize areas where material transitions exist based on user feedback. In this case, anchor points can be set and processed as meta-information at the material transition areas, or image information can be directly modified in the representation of local similarity.

[0108] Alternatively, defective material transition regions can also be removed or weakened. After processing, the label field is recalculated based on this. In this case, a warning can be issued if no meaningful material transition region is found at the user-defined position.

[0109] Surface-based determination of local data quality can also be used, where each material transition region can be assigned a quality value that represents the accuracy of the material transition region.

[0110] The local similarity representation can be calculated from the measured data, specifically from the volume data, in different ways. For example, the Sobel operator, the Laplace filter, or the Canny algorithm can be used. The algorithm to be used and how to parameterize it can be determined manually by the user. For example, the algorithm that produces the best results when creating the label field can be selected based on a preview image. Furthermore, to achieve the best results, the local similarity representation can be processed by filtering before fitting the label field. For example, a Gaussian filter can be used to minimize the negative impact of noise on the results when fitting the label field.

[0111] Some algorithms may segment even smaller regions incorrectly after adapting the label field. To fix this, an optional substep can be performed.

[0112] In this case, small regions can be removed by applying morphological operations such as opening and closing to the individual material regions.

[0113] Furthermore, continuous areas smaller than the defined maximum size can be removed and assigned to the surrounding material. Areas surrounded by two or more other materials can be given a different or larger maximum size, or can not be removed at all, while areas surrounded by only one other material can still be treated with the above maximum size. In this way, for example, a thin layer of material between two materials can be retained.

[0114] Figure 6e shows the result of the main segmentation, where the boundaries of the label fields roughly correspond to the material transition regions 20, 22, 24. Thus, the components or materials 12, 14, 16 are segmented.

[0115] For example, material transition regions, which can represent local surfaces, can be calculated with greater precision based on the adapted label field. Further specialized algorithms can be used for this purpose. In this case, the exact location of the material transition region is searched for in a small surrounding area, e.g., a few voxels. This is usually a prerequisite for accurate dimensional measurements intended to be performed on CT data.

[0116] For this purpose, in principle, different algorithms may be used, for example algorithms that operate directly on the measurement data, which are able to determine the local position of the surface, for example by means of local or global thresholds or by searching for maximum gradients or turning points in the grey value profile.

[0117] Furthermore, the exact local location of the material transition region can be determined in the local similarity representation or gradient or variance representation, for example, by fitting a second-order polynomial to the grayscale value profile. The location of the extremum of this polynomial can be used as the location of the surface.

[0118] However, the above description does not preclude further algorithms.

[0119] Knowledge about the,possibly approximate direction of the surface normals of surfaces,or materials placed in material transition regions, can be,derived from the label field and the representation implicitly stored therein.,This knowledge can be used by some algorithms to obtain more,rigorous results.,This knowledge can alternatively be gleaned from the desired,shape, e.g., a CAD model, if available.

[0120] This is then done in combination with any required or available information about the starting surface, and an algorithm is then used to calculate the exact position of the surface.

[0121] Additionally, cone beam artifacts, sampling artifacts and noise can be reduced before or after label field creation.

[0122] FIG. 7 illustrates an example of a multi-material transition region. In this example, materials 48, 54, and 56 are shown. In this example, material 48 is located between materials 54 and 56 and has a very short range compared to the other two materials. Material transition region 52 is located between materials 48 and 54. Material transition region 50 is located between materials 48 and 56. Collectively, the two material transition regions 50 and 52 form a multi-material transition region that is difficult to resolve using conventional methods. Conventional segmentation methods typically detect such regions as a single material transition region. However, the computer-implemented method 100 of the present invention described above can detect multiple material transition regions that are very close together.

[0123] The present invention is not limited to the single embodiment described above, but various modifications are possible. In particular, the exemplary embodiments described above may be combined with one another. Furthermore, the steps of method 100 may be carried out in any desired order, where this is logically possible.

[0124] All features and advantages that emerge from the claims, description and drawings, including design details, spatial arrangements and method steps, may be essential to the invention either alone or in various combinations.

Claims

1. 1. A computer-implemented method for segmenting measurement data of an object having at least one material transition region, wherein the measurement data is used to generate a digital object representation having the at least one material transition region, the digital object representation comprising a plurality of spatially resolved image information items relating to the object; determining the measurement data; segmenting at least two homogeneous regions in said digital object representation; determining a location of at least one material transition region between the at least two homogeneous regions; Including, prior to the step of segmenting at least two homogeneous regions in said digital object representation, generating a label field defining the homogeneous region by spatially resolved label values in the measurement data and / or the digital object representation; At least one distance value in a distance field is assigned to each label value; The distance value represents the distance to the nearest interface of the homogeneous region; A computer-implemented method, wherein segmenting the digital object representation is performed based on the label field and the distance field.

2. The method of claim 1 , wherein the at least one material transition region is a multi-material transition region.

3. The step of segmenting at least two homogeneous regions comprises: determining at least two homogeneous regions in the measurement data and / or digital object representation; a sub-step of analyzing the local similarity of the spatially resolved plurality of image information items to obtain at least one predicted location of a material transition region; adapting the extent of each homogeneous region until a boundary region of each homogeneous region is located at said at least one predicted location of a material transition region; Including, determining a location of at least one material transition region between the at least two homogeneous regions; 3. A method according to claim 1 or 2, comprising the sub-step of determining the position of said at least one material transition region in, and preferably around, said at least one boundary region.

4. 4. The method of claim 3, wherein the analysis of local similarity is based on a variation sequence of the spatially resolved plurality of image information items and / or a local variance of the spatially resolved plurality of image information items.

5. Prior to the step of segmenting at least two homogeneous regions, aligning a digital representation of a desired shape with said digital object representation; determining at least two homogeneous regions in the measurement data and / or the digital object representation based on the digital representation of a desired shape; The step of matching comprises: determining a digital representation of the material transition region of the object from the local similarities of the image information items; matching the digital representation of the desired shape and the digital representation of the material transition region to one another; 5. The method of claim 3 or 4, comprising:

6. The step of matching comprises: determining at least a portion of the material transition region in the digital object representation; matching the desired shape digital representation and the digital object representation to one another based on at least a portion of the material transition region; 6. The method of claim 5, comprising:

7. The step of segmenting at least two homogeneous regions comprises: a sub-step of analysing a frequency distribution of the spatially resolved plurality of image information items, said frequency distribution being based on the frequency of identical image information items among the spatially resolved plurality of image information items relating to said object; determining the at least two homogeneous regions based on the frequency distribution; 7. The method of any one of claims 1 to 6, comprising:

8. Segmenting at least two homogeneous regions in the digital object representation comprises: a sub-step of analysing the object representation for regions of contiguous identical image information items among a plurality of spatially resolved image information items relating to said object in order to segment homogeneous regions; 8. The method of claim 1, wherein a material is allocated to each homogeneous region.

9. determining a location of at least one material transition region; providing a selection of different types of material transition regions by user input and / or evaluation rules; determining locations of material transition regions in the segmented digital object representation based solely on material transition regions of the selected type with greater accuracy than the step of analyzing the local similarity of claim 3; 9. The method of any one of claims 1 to 8, comprising:

10. determining a location of at least one material transition region; providing an area within said digital object representation with required probe points according to user input and / or evaluation rules; providing a selection of a material transition region to be located based on the provided region in the digital object representation having required probe points; 10. The method of any one of claims 1 to 9, comprising:

11. after the step of segmenting at least two homogeneous regions in said digital object representation, predefining, by user input and / or evaluation rules, types of material transition regions of geometric elements of the object to be fitted to the segmented digital object representation; adapting shape elements of the object to the segmented digital object representation based on regions of the object representation or probe points within the object representation having material transition regions of a predefined type between the homogenous regions; 11. The method of any one of claims 1 to 10, comprising:

12. After the step of determining the location of at least one material transition region between the at least two homogeneous regions, fitting geometric elements of the object to the segmented digital object representation based on material transition regions between the homogenous regions; determining a material of the homogeneous region in the material transition region to which the shape element is fitted; outputting information related to the material of the determined homogeneous region in the material transition region together with the result of the fitting of the shape element; 12. The method of any one of claims 1 to 11, comprising:

13. A computer program executable on a computer and comprising instructions which, when executed on a computer, cause the computer to carry out the method of any one of claims 1 to 12.

Images