Transmission function design method and device based on vision and frequency, equipment and medium

Through the combination of visual and frequency characteristics, the frequency and visual characteristics of volume data are extracted, and the distribution of transmission functions is generated using key equal values, the problems of low efficiency and insufficient generalization ability of transmission functions in volume data visualization are solved, and more efficient and good quality transmission function design is achieved.

CN120047596AActive Publication Date: 2025-05-27CALCULATION AERODYNAMICS INST CHINA AERODYNAMICS RES & DEV CENT

Patent Information

Application Number
CN202510518330.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-24
Publication Date
2025-05-27
Estimated Expiration
2045-04-24

AI Technical Summary

Technical Problem

The prior art has low efficiency in the design of transmission functions in volume data visualization, and lacks the ability to generalize different volume data.

Method used

The transmission function design method based on vision and frequency is adopted. By dividing the volume data into scalar value sub-intervals and projecting it into a two-dimensional space based on the number of voxels, frequency characteristics and visual characteristics are extracted, and the one-dimensional transmission function is distributed in combination with key equal values.

Benefits of technology

It improves the efficiency and quality of transmission function design, enhances feature recognition and noise resistance, and improves the generalization ability of different volume data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120047596A_ABST
    Figure CN120047596A_ABST
Patent Text Reader

Abstract

The invention discloses a transmission function design method and device based on vision and frequency, equipment and a medium, and relates to the technical field of visualization, and the method comprises the steps: projecting each scalar value subinterval of volume data to a first preset two-dimensional space in a scatter mode, and obtaining a frequency feature image; traversing the midpoint of each scalar value subinterval in the frequency feature image to extract the contour image of the contour surface image of the corresponding contour point; calculating a similarity index between any two adjacent contour images, and projecting the contour images to a second preset two-dimensional space in the form of scatter points to obtain a visual feature image; and performing point distribution processing on a one-dimensional transmission function based on the frequency feature image, the visual feature image and the key equivalence meeting a preset equivalence condition to obtain a target transmission function. Therefore, according to the method, the frequency features, the visual features and the key equivalence of the volume data scalar value subintervals are processed respectively, the feature recognition can be enhanced, and the design efficiency and quality of the transmission function are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of visualization technology, and in particular to a method, device, equipment and medium for designing a transfer function based on vision and frequency. Background Art

[0002] In order to improve the efficiency of transfer function design in volume data visualization, the commonly used methods include: 1. Providing interactive guidance to users through visibility histograms to better design transfer functions; the calculation time overhead of visibility histograms in this method is large, and only visibility guidance is provided. 2. Using Gaussian mixture models to explore volume data. This method relies on the clustering results of Gaussian mixture models in two-dimensional feature space (such as scalar values ​​and gradient sizes) to perform initial feature separation on volume data, which makes this method generally ineffective when the two-dimensional feature space distribution results of some data sets are chaotic. 3. Clustering is performed by calculating the similarity index of isosurfaces in space for feature segmentation and using feature visibility for interactive guidance; in this method, it takes a lot of time to calculate the similarity index of isosurfaces and clustering algorithms, and the noise problem caused by some key isovalues ​​is not considered. 4. Helping users explore the design space of transfer functions by using deep learning and differentiable rendering; this method requires true values, that is, the already adjusted transfer functions to train the neural network, and the images generated by the neural network may have errors, and the effect is generally good for data sets with more subtle features.

[0003] It can be seen that how to design volume rendering transfer functions and improve the generalization ability for different volume data is a problem to be solved in this field. Summary of the invention

[0004] In view of this, the purpose of the present invention is to provide a method, device, equipment and storage medium for designing a transfer function based on vision and frequency, respectively processing the frequency characteristics, visual characteristics and key equivalent values ​​of volume data, avoiding the confusion caused by direct projection of volume data, and generating the points of the transfer function through an algorithm to enhance feature recognition. The specific scheme is as follows:

[0005] In a first aspect, the present application provides a method for designing a transfer function based on vision and frequency, comprising:

[0006] Dividing the volume data into a plurality of scalar value sub-intervals, and projecting each of the scalar value sub-intervals into a first preset two-dimensional space in the form of scattered points based on the number of voxels, so as to obtain a frequency characteristic image corresponding to the volume data;

[0007] Traversing the midpoints of each of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint;

[0008] Calculating similarity indexes between two contour images corresponding to any adjacent scalar value subintervals, and projecting the calculated similarity indexes into a second preset two-dimensional space in the form of scattered points to obtain a visual feature image corresponding to the volume data;

[0009] A one-dimensional transfer function is arranged based on the frequency characteristic image, the visual characteristic image, and key equivalent values ​​that meet preset equivalent conditions to obtain a target transfer function corresponding to the volume data; the key equivalent values ​​are equivalent points in a two-dimensional space constructed based on the frequency characteristic image and the visual characteristic image.

[0010] Optionally, projecting each of the scalar value subintervals in the form of scattered points to a first preset two-dimensional space based on the number of voxels includes:

[0011] Counting the number of voxels in each of the scalar value subintervals to obtain a frequency feature;

[0012] Based on the frequency characteristics, each of the scalar value subintervals is projected into a first preset two-dimensional space in the form of scattered points; the first preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding frequency characteristics.

[0013] Optionally, projecting each of the scalar value subintervals in the form of scattered points to a first preset two-dimensional space based on the number of voxels to obtain a frequency characteristic image corresponding to the volume data includes:

[0014] Projecting each of the scalar value subintervals into the first preset two-dimensional space in the form of scattered points based on the number of voxels, and determining the gradient change of adjacent scattered points in the first preset two-dimensional space by using a preset frequency feature region segmentation algorithm based on gradient change;

[0015] Based on the gradient change, extreme points and corresponding boundary points are determined from the first preset two-dimensional space, and scattered points in the first preset two-dimensional space are divided into regions using the extreme points and the corresponding boundary points to obtain a frequency characteristic image corresponding to the volume data.

[0016] Optionally, traversing the midpoints of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint includes:

[0017] Traversing the midpoints of each scalar value subinterval in the frequency characteristic image by using a preset isosurface extraction algorithm to extract isosurfaces of corresponding isovalue points according to the midpoints to obtain an isosurface image;

[0018] The isosurface image is converted into a grayscale image, and contour extraction is performed on the grayscale image to obtain a contour image corresponding to the isosurface image.

[0019] Optionally, the calculating of the similarity index between two contour images corresponding to any adjacent scalar value subintervals, and projecting the calculated similarity indexes into a second preset two-dimensional space in the form of scattered points to obtain a visual feature image corresponding to the volume data, includes:

[0020] The similarity index between two contour images corresponding to any adjacent scalar value subintervals is calculated, and the corresponding calculation results are averaged and smoothed to obtain several similarity indexes;

[0021] The several similarity indices are projected into a second preset two-dimensional space in the form of scattered points, and the sparsity of the scattered point distribution in the second preset two-dimensional space is divided by a preset visual feature region segmentation algorithm to obtain a visual feature image corresponding to the volume data; the second preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding similarity index.

[0022] Optionally, performing point arrangement processing on a one-dimensional transfer function based on the frequency feature image, the visual feature image, and a key equivalent value that meets a preset equivalent condition to obtain a target transfer function corresponding to the volume data includes:

[0023] Normalizing the similarity index and the frequency feature, and projecting the normalized result into a target two-dimensional space constructed based on the visual feature and the frequency feature;

[0024] Based on preset equivalent conditions, several equivalent points in the target two-dimensional space are determined as key equivalent values, and based on the frequency feature image, the visual feature image, and the key equivalent values, a one-dimensional transfer function is processed to obtain a target transfer function corresponding to the volume data.

[0025] Optionally, performing point arrangement processing on a one-dimensional transfer function based on the frequency feature image, the visual feature image, and a key equivalent value that meets a preset equivalent condition to obtain a target transfer function corresponding to the volume data includes:

[0026] Performing point distribution processing on the one-dimensional transfer function based on the frequency characteristic image, the visual characteristic image, and the key equivalent value that meets the preset equivalent condition to obtain an initial transfer function corresponding to the volume data;

[0027] The frequency characteristic image and / or the visual characteristic image and / or the key equivalent value and / or the initial transfer function are modified based on the interactive instructions, and finally a target transfer function is obtained, so that the volume data can be visualized using the target transfer function to obtain a corresponding visualization image.

[0028] In a second aspect, the present application provides a transfer function design device based on vision and frequency, comprising:

[0029] A frequency characteristic projection module, used for dividing the volume data into a plurality of scalar value sub-intervals, and projecting each of the scalar value sub-intervals into a first preset two-dimensional space in the form of scattered points based on the number of voxels, so as to obtain a frequency characteristic image corresponding to the volume data;

[0030] A contour image extraction module, used for traversing the midpoints of each of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint;

[0031] A point arrangement module is used to arrange points for a one-dimensional transfer function based on the frequency characteristic image, the visual characteristic image, and key equivalent values ​​that meet preset equivalent conditions to obtain a target transfer function corresponding to the volume data; the key equivalent values ​​are equivalent points in a two-dimensional space constructed based on the frequency characteristic image and the visual characteristic image.

[0032] In a third aspect, the present application provides an electronic device, including:

[0033] Memory, used to store computer programs;

[0034] A processor is used to execute the computer program to implement the above-mentioned transfer function design method based on vision and frequency.

[0035] In a fourth aspect, the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the above-mentioned vision- and frequency-based transfer function design method.

[0036] It can be seen that in the present application, the volume data is first divided into a number of scalar value sub-intervals, and each of the scalar value sub-intervals is projected to the first preset two-dimensional space in the form of scattered points based on the number of voxels to obtain a frequency characteristic image corresponding to the volume data; then the midpoints of each of the scalar value sub-intervals in the frequency characteristic image are traversed to extract the contour image of the isosurface image of the isovalue point corresponding to the midpoint; then the similarity index between the two contour images corresponding to any adjacent scalar value sub-intervals is calculated, and the calculated similarity indexes are projected to the second preset two-dimensional space in the form of scattered points to obtain the visual feature image corresponding to the volume data; then, based on the frequency feature image, the visual feature image, and the key equivalent value that meets the preset equivalent condition, the one-dimensional transfer function is arranged to obtain the target transfer function corresponding to the volume data; the key equivalent value is the equivalent point in the two-dimensional space constructed based on the frequency feature image and the visual feature image. In this way, the present application processes the frequency characteristics and visual characteristics corresponding to the volume data separately, and then projects the frequency characteristics and visual characteristics into two-dimensional space to obtain key equivalent values, and then uses the frequency characteristics, visual characteristics and key equivalent values ​​to generate the point distribution of the one-dimensional transfer function through an algorithm to obtain the corresponding target transfer function; in this way, the frequency characteristics, visual characteristics and key equivalent values ​​of the volume data are processed separately, avoiding the confusion caused by directly projecting the volume data into two-dimensional space, which can enhance feature recognition and noise resistance, and improve the design efficiency and quality of the transfer function. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0038] Figure 1 A flow chart of a method for designing a transfer function based on vision and frequency disclosed in this application;

[0039] Figure 2 A flow chart of a specific method for designing a transfer function based on vision and frequency disclosed in this application;

[0040] Figure 3 A specific frequency characteristic image after region segmentation disclosed in this application;

[0041] Figure 4 A specific visual feature image after region segmentation disclosed in this application;

[0042] Figure 5A schematic diagram of a two-dimensional space constructed based on visual features and frequency features disclosed in this application;

[0043] Figure 6 A specific flowchart of extracting frequency features and segmenting feature regions disclosed in this application;

[0044] Figure 7 A specific flowchart of extracting visual features and segmenting feature regions disclosed in this application;

[0045] Figure 8 A flowchart of a specific extraction of key equivalent values ​​and generation of one-dimensional transfer function points disclosed in this application;

[0046] Fig. 9 This is a schematic diagram of the structure of a transfer function design device based on vision and frequency disclosed in this application;

[0047] Fig.10 This is a structural diagram of an electronic device disclosed in this application. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0049] See also Figure 1 As shown, the embodiment of the present invention discloses a transfer function design method based on vision and frequency, comprising:

[0050] Step S11, dividing the volume data into a plurality of scalar value sub-intervals, and projecting each of the scalar value sub-intervals into a first preset two-dimensional space in the form of scattered points based on the number of voxels, so as to obtain a frequency characteristic image corresponding to the volume data.

[0051] It is understandable that volume data is a data set composed of voxels in three-dimensional space, which is usually generated by scanning or simulating three-dimensional objects, such as computer tomography or magnetic resonance imaging data in medical imaging, and fluid or thermodynamic simulation data in scientific computing and engineering simulation. In the process of visualizing these volume data, the scalar value of the volume data is divided into several equidistant scalar value sub-intervals; it is understandable that each scalar value sub-interval corresponds to several voxels, and the number of voxels is regarded as the frequency characteristic of the scalar value sub-interval; these scalar value sub-intervals are then projected into the first preset two-dimensional space in the form of scattered points, so that the frequency characteristic image corresponding to the volume data can be obtained.

[0052] In a specific embodiment, the projecting of each of the scalar value subintervals in the form of scattered points to the first preset two-dimensional space based on the number of voxels may include: counting the number of voxels in each of the scalar value subintervals to obtain a frequency feature; projecting each of the scalar value subintervals in the form of scattered points to the first preset two-dimensional space based on the frequency feature; the first preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding frequency feature. Specifically, firstly, the number of voxels in each scalar value subinterval is counted to obtain the frequency features corresponding to each scalar value subinterval; then, based on the midpoint of the interval of a single scalar value subinterval and the corresponding frequency feature, a single scalar value subinterval is projected in the form of scattered points to the first preset two-dimensional space. In a specific embodiment, the horizontal and vertical coordinates of the first preset two-dimensional space here are the midpoint of the scalar value subinterval and the logarithm of the frequency feature corresponding to the interval, and finally the frequency feature image is projected.

[0053] In another specific embodiment, projecting each of the scalar value subintervals in the form of scattered points to a first preset two-dimensional space based on the number of voxels to obtain a frequency characteristic image corresponding to the volume data may include: projecting each of the scalar value subintervals in the form of scattered points to the first preset two-dimensional space based on the number of voxels, and determining the gradient change of adjacent scattered points in the first preset two-dimensional space by a preset frequency characteristic region segmentation algorithm based on gradient change; determining extreme points and corresponding boundary points from the first preset two-dimensional space based on the gradient change, and using the extreme points and the corresponding boundary points to divide the scattered points of the first preset two-dimensional space into regions to obtain the frequency characteristic image corresponding to the volume data. Specifically, the scalar value subinterval is projected to the first preset two-dimensional space in the form of scattered points according to the number of voxels in each scalar value subinterval, and the gradient change of each scattered point in the first preset two-dimensional space can be further determined. The gradient change of each adjacent scattered point is determined by a pre-set frequency characteristic region segmentation algorithm based on gradient change to determine whether a certain scattered point is an extreme point, and then the scattered points in the first preset two-dimensional space are divided into regions using the extreme points and the corresponding boundary points, and a frequency characteristic image after regional segmentation can be obtained. The frequency characteristic image after regional segmentation is as follows Figure 2 shown.

[0054] Step S12, traversing the midpoints of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint.

[0055] In an embodiment of the present application, after obtaining the frequency characteristic image, the midpoints of each scalar value subinterval in the frequency characteristic image can be traversed to extract the isosurfaces of the corresponding isovalue points, and the corresponding isosurface images can be rendered to obtain the corresponding isosurface images, and then the contour images of the isosurface images can be extracted. In a specific embodiment, the traversing of the midpoints of each scalar value subinterval in the frequency characteristic image to extract the contour images of the isosurface images of the isovalue points corresponding to the midpoints can include: traversing the midpoints of each scalar value subinterval in the frequency characteristic image by a preset isosurface extraction algorithm to extract the isosurfaces of the corresponding isovalue points according to the midpoints to obtain the isosurface images; converting the isosurface images into grayscale images, and performing contour extraction on the grayscale images to obtain the contour images corresponding to the isosurface images. Specifically, the midpoints of each scalar value sub-interval in the frequency feature image can be traversed through a preset isosurface extraction algorithm, such as Marching Cubes (for structured grids) or Marching Tetrahedra (for unstructured grids) to extract isosurfaces, and then the corresponding isosurface images are rendered; further, in the process of contour extraction, the isosurface image is first converted into a grayscale image, and then the edge extraction algorithm can be used to extract contours to obtain a contour image corresponding to the isosurface image.

[0056] Step S13, calculating the similarity index between two contour images corresponding to any adjacent scalar value subintervals, and projecting the calculated similarity indexes into a second preset two-dimensional space in the form of scattered points to obtain a visual feature image corresponding to the volume data.

[0057] Furthermore, in order to obtain the visual features of the volume data, after obtaining several contour images, the similarity index between two contour images corresponding to any adjacent scalar value sub-intervals can be calculated, and the similarity index is the SSIM value (Structural Similarity); then the similarity index is projected into a second preset two-dimensional space in the form of scattered points, and the visual feature image corresponding to the volume data can be obtained.

[0058] In a specific embodiment, the similarity index between two contour images corresponding to any adjacent scalar value subintervals is calculated, and the calculated similarity indexes are projected to a second preset two-dimensional space in the form of scattered points to obtain the visual feature image corresponding to the volume data, which may include: calculating the similarity index between two contour images corresponding to any adjacent scalar value subintervals, and performing mean smoothing on the corresponding calculation results to obtain several similarity indexes; projecting the several similarity indexes to the second preset two-dimensional space in the form of scattered points, and dividing the sparsity of the scattered point distribution in the second preset two-dimensional space by a preset visual feature region segmentation algorithm to obtain the visual feature image corresponding to the volume data; the second preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding similarity index. Specifically, the similarity index between two contour images corresponding to any adjacent scalar value subintervals is calculated, and the corresponding calculation results need to be mean smoothed to reduce noise, and finally several similarity indexes can be obtained; then, the midpoint of the interval is used as the horizontal coordinate, and the finally obtained similarity index is used as the vertical coordinate, and projected to the second preset two-dimensional space in the form of scattered points. Furthermore, according to the distribution of scattered points in the two-dimensional space, the region can be divided by a pre-set visual feature region segmentation algorithm, which can be specifically divided into sparse sets and dense sets, and the corresponding dividing points are used to segment the visual feature region, and finally the visual feature image after the region division can be obtained. The visual feature image after region segmentation is as follows Figure 3 shown.

[0059] Step S14, performing point arrangement processing on the one-dimensional transfer function based on the frequency characteristic image, the visual characteristic image, and the key equivalent value that meets the preset equivalent condition to obtain the target transfer function corresponding to the volume data; the key equivalent value is the equivalent point in the two-dimensional space constructed based on the frequency characteristic image and the visual feature image.

[0060] In an embodiment of the present application, after obtaining the frequency characteristic image and visual feature image corresponding to the volume data through the above steps, a new two-dimensional space can be constructed based on the frequency characteristics and visual features therein, and key equivalent values ​​can be screened out from the two-dimensional space through preset equivalent conditions; then, based on the frequency characteristic image, the visual feature image, and the key equivalent values ​​that meet the preset equivalent conditions, the one-dimensional transfer function is arranged, so that the target transfer function corresponding to the volume data can be obtained.

[0061] In a specific embodiment, the point arrangement processing of the one-dimensional transfer function based on the frequency feature image, the visual feature image, and the key equivalent value that meets the preset equivalent condition to obtain the target transfer function corresponding to the volume data may include: normalizing the similarity index and the frequency feature, and projecting the normalized result to the target two-dimensional space constructed based on the visual feature and the frequency feature; determining a number of equivalent points in the target two-dimensional space as key equivalent values ​​based on the preset equivalent condition, and point arrangement processing of the one-dimensional transfer function based on the frequency feature image, the visual feature image, and the key equivalent value to obtain the target transfer function corresponding to the volume data. Specifically, firstly, the frequency features (the number of voxels in each scalar value subinterval) corresponding to the frequency feature image and the visual features (similarity index) corresponding to the visual feature image are normalized to obtain the normalized result, i.e., the two normalized features; then, the normalized result is projected into a two-dimensional space, specifically, a two-dimensional space is constructed with the similarity index as the horizontal coordinate and the frequency as the vertical coordinate; in the two-dimensional space, equal values ​​can be screened by preset equal value conditions, such as screening the equal values ​​corresponding to the scattered points within a certain range in the upper left corner, and screening out the key equal values ​​that meet the preset equal value conditions; the two-dimensional space constructed based on the visual features and frequency features is as follows: Figure 4 As shown. Subsequently, the control points of the one-dimensional transfer function can be arranged based on the frequency feature image, the visual feature image, and the key equivalent value, so as to finally arrange the points to obtain the target transfer function corresponding to the volume data.

[0062] In another specific embodiment, the point arrangement processing of the one-dimensional transfer function based on the frequency characteristic image, the visual characteristic image, and the key equivalent value to obtain the target transfer function corresponding to the volume data may include: the point arrangement processing of the one-dimensional transfer function based on the frequency characteristic image, the visual characteristic image, and the key equivalent value to obtain the initial transfer function corresponding to the volume data; modifying the frequency characteristic image and / or the visual characteristic image and / or the key equivalent value and / or the initial transfer function based on the interactive instruction, and finally obtaining the target transfer function, so as to use the target transfer function to visualize the volume data and obtain the corresponding visualized image. Specifically, in the process of obtaining the initial transfer function corresponding to the volume data through the algorithm, the relevant personnel can intervene in the data in the process by means of the human-computer interaction interface, issue the interactive instruction, and modify the frequency characteristic image and / or the visual characteristic image and / or the target two-dimensional space and / or the generated point arrangement in the process to generate the target transfer function that meets the expectations of the relevant personnel. Further, the target transfer function obtained through the final interaction can visualize the corresponding volume data, and then obtain the visualized image corresponding to the volume data.

[0063] It can be seen that the present application does not directly count the feature information of each voxel in the volume data, but counts the feature information in units of isovalue intervals (isovalue points), which reduces the amount of data and speeds up the feature extraction. After calculating the frequency information of the volume data and the visual information of the extracted isovalue surface respectively, the two features are not directly projected into the subspace for clustering and then dividing the feature area, but the two feature information are divided into feature areas respectively, and then the frequency information and visual information are projected into two-dimensional space to obtain the key isovalue, and finally the divided frequency feature interval, visual feature interval and key isovalue are used to generate the distribution of one-dimensional transfer function through the algorithm to obtain the target transfer function. This effectively speeds up the speed of segmenting the feature area and enhances the feature recognition and noise resistance.

[0064] like Figure 5 As shown, the embodiment of the present application discloses a method for designing a transfer function based on vision and frequency, which specifically includes:

[0065] In this embodiment, 1. extract the frequency features of the volume data and segment the feature regions. Specifically, the volume data scalar value is divided into multiple equidistant scalar value subintervals, and the number of voxels in each subinterval of the scalar value in the volume data is counted, and then the statistical result (frequency feature) is projected into the scalar value-frequency two-dimensional space in the form of scattered points; then the frequency features projected into the two-dimensional space are segmented using the frequency feature regional segmentation algorithm (algorithm 1 described below) to obtain the frequency feature region, and generate a frequency feature segmentation image (i.e., the frequency feature image after regional segmentation in the above embodiment). 2. Perform visual feature extraction and feature region segmentation on the volume data. Specifically, the midpoints of each scalar value subinterval are traversed in turn, and the isosurfaces corresponding to the isovalue points are extracted for rendering to obtain isosurface images; then the isosurface images are converted into grayscale images and then contours are extracted to obtain isosurface contour images, and then the structural similarity index (visual features) of the two isosurface contour images before and after are calculated; then the calculated ssim value (structural similarity index) is first mean-smoothed, and then projected into the scalar value-ssim value two-dimensional space in the form of scattered points, and the visual feature region segmentation algorithm (algorithm 2 described below) is used for region segmentation to obtain the visual feature region and generate the visual feature segmentation image (i.e., the visual feature image segmented by the region in the above embodiment). 3. Extract key equivalent values ​​and generate one-dimensional transfer function points. Specifically, the frequency features and visual features are normalized, and then projected into two-dimensional space with the visual features as the horizontal coordinates and the frequency features as the vertical coordinates, and the key equivalent values ​​are obtained by specifying the threshold; then the visual feature region, the frequency feature region and the key equivalent value array are used to generate one-dimensional transfer function control points using the one-dimensional transfer function point generation algorithm (algorithm 3 described below). 4. Generate visualization images under the interactive guidance of relevant personnel. Specifically, interactive frequency segmentation images, visual segmentation images, and visual-frequency projection images are generated. Users can directly control the selection of segmentation results and key equivalent values ​​by interacting with the images; and the one-dimensional transfer function control points generated by user interaction can generate a one-dimensional transfer function that meets the user's expectations, so as to finally generate a visualization image corresponding to the volume data.

[0066] Specifically, Figure 6The figure shows the process of extracting frequency features and segmenting feature regions. First, the frequency feature extraction process will be carried out; this process first divides the scalar value into multiple equal-value intervals according to the interval length d, and then performs frequency statistics on the number of voxels in each equal-value interval to obtain the frequency feature. Then, the frequency feature is projected into two-dimensional space in the form of scattered points with the midpoint of the equal-value interval as the horizontal coordinate and the logarithm of the interval frequency as the vertical coordinate, and a frequency feature image will be generated. Users can repeatedly optimize the parameter d through the image to achieve better frequency feature extraction effects until the generated frequency feature image meets the user's expectations. Then, the frequency feature region segmentation will be carried out; after the frequency feature is extracted, the frequency feature region segmentation algorithm based on gradient change (Algorithm 1) will be used to perform frequency feature region segmentation. The frequency feature region segmentation algorithm based on gradient change first determines whether a certain scattered point is an extreme point according to the gradient change of adjacent scattered points. If the slopes of the n consecutive scattered points after a certain point become smoother than the slope of the previous scattered point, the point is considered to be an extreme point; then it is determined whether the slope of the line between the point and the previous extreme point and the slope of the line between the point and the next nth scattered point are positive first and then negative to determine whether it is a maximum point. After all extreme points are extracted, the frequency feature region is segmented according to the maximum points and boundaries. The parameter n controls the sensitivity of the algorithm to extreme points. The larger the parameter n, the less sensitive it is to extreme points, but the stronger the anti-noise ability. The smaller the parameter n, the more sensitive it is to extreme points, but the weaker the anti-noise ability. After the frequency feature region is segmented, a frequency feature region segmentation image will be generated. The image is further annotated with frequency segmentation information based on the frequency feature image. Users can repeatedly optimize the parameter n through the image to achieve better frequency feature segmentation effects until the generated frequency feature segmentation image meets the user's expectations.

[0067] Among them, Algorithm 1 is a frequency feature region segmentation algorithm based on gradient change: This algorithm transforms the frequency feature region division problem into the problem of finding the maximum point of the frequency feature in the scattered point projection in two-dimensional space with the midpoint of the equal value interval as the horizontal coordinate and the frequency as the vertical coordinate. The extreme point is found by using the continuous change of the gradient between the scattered points, and then whether it is a maximum point is determined by judging the slope change trend between the scattered points before and after the extreme point. This algorithm is highly versatile and fast, and the time complexity of the algorithm is O (n), where n is the number of equal value intervals. The specific steps are as follows:

[0068] Step 1. Initialize the parameter n, frequency feature array F, extreme point array A=[0], maximum value array B=[0], the subscript of the first smoothing point record=-1, and the number of continuously smoothed scattered points count=0.

[0069] Step 2. Traverse array F from i=1, and compare the absolute values ​​of the slope k1 of the frequency F[A[lastIndex]] of the last element in array A and the slope k2 of F[i-1] and F[A[lastIndex]] (i.e., determine whether the slope has become smooth).

[0070] Step 3. If the slope becomes smooth, count++; if the slope becomes unsmooth, count=0 and continue; if it just starts to become smooth (record=-1?), then record the first smoothing point as the pending extreme point record=i.

[0071] Step 4. If n consecutive scattered points become smooth, that is, count==n, then compare the slope k3 between F[A[lastIndex]] and F[record] points and the slope change of the distance k4 between F[record] and F[record+n] to determine whether it is a maximum value. If it is a maximum value, add it to the maximum value array B, and regardless of whether it is a maximum value, add it to the extreme value array A, set the traversal index i to record+1, set count to 0, and set record to -1.

[0072] Step 5. Repeat Step 2, Step 3, and Step 4 until the frequency feature array is traversed. Add the boundaries of array F, i.e., F[0] and F[lastIndex], to array B as the final frequency division point array.

[0073] Specifically, Figure 7The figure shows the process of extracting visual features and segmenting feature regions. After completing the frequency feature region segmentation, the visual feature extraction process will be performed first; this process can use the isosurface extraction algorithm MarchingCubes or Marching Tetrahedra to extract isosurfaces according to the midpoints of the frequency feature isovalue intervals in turn, and then extract the rendered image of the isosurface from the direction v facing the two largest dimensions of the volume data and the perspective of the center point of the volume data. For each isosurface image extracted from the midpoint value, it is converted into a grayscale image and the contour is extracted using the Canny algorithm (a widely used edge extraction algorithm) to obtain a contour image. The SSIM values ​​of the current contour image and the next contour image are calculated in turn to obtain visual features. During this period, the isosurface rendering images generated according to the midpoints of the frequency feature isovalue intervals will be generated as animations, and users can adjust the perspective v according to the animation to obtain better visual information extraction results. In the case of large differences in the three dimensions of the volume data, the user generally does not need to adjust the parameter v. However, in the case of small or even no differences in the dimensions of the volume data (such as 256x256x254), the user may need to adjust the parameter v by observing the animation to obtain better visual information extraction. The viewing angle v can be adjusted at any time by interrupting the animation, without waiting for the animation rendering to end. Then the visual feature segmentation is performed. After the visual features are extracted, the visual feature region segmentation algorithm based on sparse clustering (Algorithm 2) is used to segment the visual features into feature regions. The algorithm first smoothes the extracted visual features to reduce noise, and then projects the ssim value after smoothing into the two-dimensional space in the form of scattered points with the midpoint of the equal value interval as the horizontal coordinate and the vertical coordinate as the vertical coordinate. According to the different sparseness of the scattered points in the two-dimensional space, the sparse clustering method is used to classify the scattered points into sparse sets and dense sets, and the parameter p is used to realize the division of sparse sets and dense sets, indicating that the density before p% is dense sets, and vice versa. After the sparse classification is completed, the dividing point between sparse sets and sparse densities is extracted to segment the visual feature region, and a visual feature region segmentation image is generated. The user can repeatedly optimize the parameter p through the image to achieve better visual feature segmentation effect until the generated visual feature segmentation image meets the user's expectations.

[0074] Among them, Algorithm 2 is a visual feature region segmentation algorithm based on sparse clustering. This algorithm transforms the problem of visual feature region division into the problem of finding the inflection point of the scattered point projection of the visual feature in two-dimensional space with the midpoint of the isovalue interval as the horizontal coordinate and the structural similarity index of the isosurface contour image as the vertical coordinate. The scattered points are divided into dense sets and sparse sets according to the density of the scattered points in two-dimensional space, and then the inflection point is found through the boundary between the two sets. The time complexity of this algorithm is O(n^2), but since n is the number of isovalue intervals instead of voxels, the time efficiency of this algorithm is still very fast. The specific steps are as follows:

[0075] Step 1. Initialize the parameter p, initialize the partition point array A to be empty, and V to be the visual feature array obtained by the visual information extraction process.

[0076] Step 2. Perform mean smoothing on the visual feature array V, and set the mean interval to 6. Normalize it in two-dimensional space to obtain a two-dimensional array X, where the first dimension is the scalar value of the equal-value point and the second dimension is the ssim value.

[0077] Step 3. Copy n elements at the beginning and end of array X to reduce the impact of the boundary on density classification. n is generally set to 4.

[0078] Step 4. Perform density-based clustering on the array X. The neighboring elements are generally set to 9 to obtain a sparse set S and a dense set D. The parameter p is used to control the ratio of the sparse set to the dense set.

[0079] Step 5. Traverse the dense set D. If the equal values ​​of the two elements before and after are not adjacent (that is, D[i+1,0]-D[i,0]>2d), add this point and the next point to the partition point array A.

[0080] Step 6. If the first and last elements of X are not in A, add the first and last elements of X to A. A is the final array of visual area division points.

[0081] Specifically, Figure 8The figure shows the process of extracting key equivalent values ​​and generating one-dimensional transfer function points. After obtaining frequency features and visual features, these two features will be used to obtain key equivalent values. The specific method is to normalize these two features, and then project them into two-dimensional space in the form of scattered points with the ssim value as the horizontal coordinate and the frequency as the vertical coordinate. In this visual-frequency projection space, the closer the scattered point is to the upper left corner, the more important its corresponding equivalent value is. Users can update the corresponding equivalent value to the one-dimensional transfer function point distribution in real time by clicking to select a scattered point or setting the ssim threshold and frequency threshold, and can remove or add it to obtain a better volume rendering effect. Then the one-dimensional transfer function point distribution is generated; after the frequency feature region segmentation, the visual feature region segmentation and the key equivalent value extraction, the segmentation information and key equivalent value information of the visual and frequency features are obtained, and the one-dimensional transfer function point distribution generation algorithm (Algorithm 3) is used to generate the one-dimensional transfer function point distribution. The algorithm divides the points in the one-dimensional transfer function into fixed points and variable points. Fixed points are used to fix the boundary of the feature, and variable points are used to control the transparency of the feature. The advantage of this is that the transparency change of a certain feature can be isolated from the impact of other features. The variable point consists of the midpoint of the visual feature area segmentation area, the midpoint of the frequency feature area segmentation area, and the key equivalent point; the fixed point consists of the visual feature area division point, the frequency feature area division point, and two adjacent points of the key equivalent value. The adjacent point depends on the parameter d in the frequency feature extraction, that is, the key equivalent point plus or minus parameter d. The default transparency of the fixed point is 0, and the default transparency of the variable point is 0.5.

[0082] Among them, Algorithm 3 is a one-dimensional transfer function point generation algorithm. This algorithm divides the points in the one-dimensional transfer function into fixed points and variable points, and uses the frequency feature area, visual feature area and key values ​​of the data to generate fixed points and variable points. The algorithm has a fast execution time and a time complexity of O(nlogn). The specific steps are as follows:

[0083] Step 1. Initialize arrays V, F, K, A, B, where V is the visual feature partition point array, F is the frequency feature partition point array, K is the key point array, and A and B are empty intermediate arrays.

[0084] Step 2. Merge the visual feature partition point array V and the frequency feature partition point array F into the frequency visual partition point array FV.

[0085] Step 3. Traverse the key point array K and take K[i]+d, K[i]-d to the intermediate array A

[0086] Step 4. Merge the intermediate array K and the frequency visual partition point array A, remove duplicates and sort them as the fixed point array.

[0087] Step 5. Traverse the frequency visual division points FV, ​​take the midpoint between FV[i] and FV[i+1] and add it to the intermediate array B.

[0088] Step 6. Merge the intermediate array B and the key point array K, remove duplicates, and sort them as the change point array.

[0089] Specifically, after generating the point layout of the one-dimensional transfer function, the transfer function interactive guidance is intended to meet the needs of users who may need to further explore the volume data features or need to modify the point layout of the transfer function. In this step, this embodiment will provide users with visual information interactive guidance, frequency information interactive guidance, and key equivalent interactive guidance. These interactive guidance are presented to users in the form of interactive images. The interactive guidance is initialized as a visual feature region segmentation map, a frequency feature region segmentation map, and a visual-frequency scatter plot. Without changing the core parameters d and v, the user can update the generated one-dimensional transfer function point layout in real time by interacting with the segmentation of the two segmentation maps and selecting the visual-frequency scatter plot. In addition, after the one-dimensional transfer function control points (fixed points and variable points) are generated, the user can only control the transparency and color of the variable points through the transfer function editor and then repeatedly tune by observing the changes in the volume visualization image with the naked eye. Each variable point represents a feature, and the transparency adjustment of each variable point will not affect other features. This transfer function interactive process greatly improves the efficiency of transfer function design.

[0090] It can be seen that the segmentation of the features of volume data in this application depends on the three attribute features of the visual features, frequency features, and key equivalent values ​​of the volume data. These three attribute features are all in units of scalar values, not voxels, and the segmentation of volume data is to segment the three attribute features separately and then combine them. This method greatly avoids the confusion that may occur when the traditional projection of volume data features in units of voxels into two-dimensional space, and improves the generalization ability of visualization technology for different volume data. In addition, in the process of generating one-dimensional transfer function control points, the application will also generate a variety of volume data feature information such as volume data visual feature images, frequency feature images, key equivalent distribution images, and isosurfaces. Users can update the transfer function points by interacting with this information. Since the segmentation algorithm is based on scalar values ​​instead of voxels, this makes the interactive experience very smooth. In addition, this information can also provide interactive guidance to users, help users analyze and understand the internal details and features of volume data, and assist users to further quickly optimize and freely explore the transfer function through the transfer function editor (such as color configuration and transparency adjustment, etc.).

[0091] like Fig. 9 As shown, the embodiment of the present application discloses a transfer function design device based on vision and frequency, comprising:

[0092] A frequency characteristic projection module 11 is used to divide the volume data into a plurality of scalar value sub-intervals, and project each of the scalar value sub-intervals into a first preset two-dimensional space in the form of scattered points based on the number of voxels, so as to obtain a frequency characteristic image corresponding to the volume data;

[0093] A contour image extraction module 12, used for traversing the midpoints of each of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint;

[0094] A visual feature projection module 13 is used to calculate the similarity index between two contour images corresponding to any adjacent scalar value subintervals, and project the calculated similarity indexes into a second preset two-dimensional space in the form of scattered points to obtain a visual feature image corresponding to the volume data;

[0095] The point arrangement module 14 is used to arrange points for the one-dimensional transfer function based on the frequency characteristic image, the visual characteristic image, and key equivalent values ​​that meet the preset equivalent conditions to obtain the target transfer function corresponding to the volume data; the key equivalent values ​​are equivalent points in the two-dimensional space constructed based on the frequency characteristic image and the visual characteristic image.

[0096] It can be seen that the present application processes the frequency characteristics and visual characteristics corresponding to the volume data separately, and then projects the frequency characteristics and visual characteristics into a two-dimensional space to obtain key equivalent values, and then uses the frequency characteristics, visual characteristics and key equivalent values ​​to generate a one-dimensional transfer function through an algorithm to obtain the corresponding target transfer function; in this way, the frequency characteristics, visual characteristics and key equivalent values ​​of the volume data are processed separately, which avoids the confusion caused by directly projecting the volume data and can enhance feature recognition and noise resistance.

[0097] In a specific embodiment, the frequency feature projection module 11 may include:

[0098] A voxel counting unit, used for counting the number of voxels in each of the scalar value subintervals to obtain a frequency feature;

[0099] The first projection unit is used to project each of the scalar value subintervals in the form of scattered points to a first preset two-dimensional space based on the frequency characteristics; the first preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding frequency characteristics.

[0100] In another specific embodiment, the frequency characteristic projection module 11 may include:

[0101] a gradient change determination unit, configured to project each of the scalar value subintervals into the first preset two-dimensional space in the form of scattered points based on the number of voxels, and determine the gradient change of adjacent scattered points in the first preset two-dimensional space by using a preset frequency characteristic region segmentation algorithm based on gradient change;

[0102] The first region division unit is used to determine extreme points and corresponding boundary points from the first preset two-dimensional space based on the gradient change, and use the extreme points and the corresponding boundary points to divide the scattered points of the first preset two-dimensional space into regions to obtain a frequency characteristic image corresponding to the volume data.

[0103] In a specific embodiment, the contour image extraction module 12 may include:

[0104] An isosurface image extraction unit is used to traverse the midpoints of each scalar value subinterval in the frequency characteristic image by using a preset isosurface extraction algorithm to extract isosurfaces of corresponding isovalue points according to the midpoints to obtain an isosurface image;

[0105] The contour image extraction unit is used to convert the isosurface image into a grayscale image and perform contour extraction on the grayscale image to obtain a contour image corresponding to the isosurface image.

[0106] In a specific embodiment, the visual feature projection module 13 may include:

[0107] A similarity calculation unit is used to calculate the similarity index between two contour images corresponding to any adjacent scalar value sub-intervals, and perform mean smoothing processing on the corresponding calculation results to obtain a number of similarity indexes;

[0108] A second projection unit is used to project the several similarity indices into a second preset two-dimensional space in the form of scattered points, and divide the sparsity of the scattered point distribution in the second preset two-dimensional space by a preset visual feature region segmentation algorithm to obtain a visual feature image corresponding to the volume data; the second preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding similarity index.

[0109] In another specific embodiment, the point distribution module 14 may include:

[0110] A third projection unit, used for normalizing the similarity index and the frequency feature, and projecting the normalized result to a target two-dimensional space constructed based on the visual feature and the frequency feature;

[0111] A point arrangement unit is used to determine a number of equal-value points in the target two-dimensional space as key equal-values ​​based on preset equal-value conditions, and to arrange points for a one-dimensional transfer function based on the frequency feature image, the visual feature image, and the key equal-values ​​to obtain a target transfer function corresponding to the volume data.

[0112] In another specific embodiment, the point distribution module 14 may include:

[0113] A function generation module, configured to perform point distribution processing on a one-dimensional transfer function based on the frequency feature image, the visual feature image, and the key equivalent value, so as to obtain an initial transfer function corresponding to the volume data;

[0114] An interactive modification module is used to modify the frequency characteristic image and / or the visual characteristic image and / or the key equivalent value and / or the initial transfer function based on interactive instructions, and finally obtain a target transfer function, so as to use the target transfer function to visualize the volume data and obtain a corresponding visualization image.

[0115] Furthermore, the present application also discloses an electronic device. Fig.10 This is a structural diagram of an electronic device 20 according to an exemplary embodiment. The content in the diagram cannot be regarded as any limitation on the scope of use of the present application.

[0116] Fig.10 A schematic diagram of the structure of an electronic device 20 provided in an embodiment of the present application. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 is used to store a computer program, which is loaded and executed by the processor 21 to implement the relevant steps in the visual and frequency-based transfer function design method disclosed in any of the aforementioned embodiments. In addition, the electronic device 20 in this embodiment may specifically be an electronic computer.

[0117] In this embodiment, the power supply 23 is used to provide working voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and the external device, and the communication protocol it follows is any communication protocol that can be applied to the technical solution of the present application, and is not specifically limited here; the input and output interface 25 is used to obtain external input data or output data to the outside world, and its specific interface type can be selected according to specific application needs and is not specifically limited here.

[0118] In addition, the memory 22, as a carrier for storing resources, can be a read-only memory, a random access memory, a disk or an optical disk, etc. The resources stored thereon can include an operating system 221, a computer program 222, etc., and the storage method can be temporary storage or permanent storage.

[0119] The operating system 221 is used to manage and control the hardware devices and computer program 222 on the electronic device 20, and can be Windows Server, Netware, Unix, Linux, etc. In addition to including a computer program that can be used to complete the vision and frequency-based transfer function design method performed by the electronic device 20 disclosed in any of the aforementioned embodiments, the computer program 222 can further include a computer program that can be used to complete other specific tasks.

[0120] Furthermore, the present application also discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, the aforementioned vision-based and frequency-based transfer function design method is implemented. The specific steps of the method can be referred to the corresponding contents disclosed in the aforementioned embodiments, and will not be repeated here.

[0121] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0122] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0123] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0124] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0125] The technical solution provided by the present application is introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for general technicians in this field, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A transfer function design method based on vision and frequency, characterized in that: include: Dividing the volume data into a plurality of scalar value sub-intervals, and projecting each of the scalar value sub-intervals into a first preset two-dimensional space in the form of scattered points based on the number of voxels, so as to obtain a frequency characteristic image corresponding to the volume data; Traversing the midpoints of each of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint; Calculating similarity indexes between two contour images corresponding to any adjacent scalar value subintervals, and projecting the calculated similarity indexes into a second preset two-dimensional space in the form of scattered points to obtain a visual feature image corresponding to the volume data; A one-dimensional transfer function is arranged based on the frequency characteristic image, the visual characteristic image, and key equivalent values ​​that meet preset equivalent conditions to obtain a target transfer function corresponding to the volume data; the key equivalent values ​​are equivalent points in a two-dimensional space constructed based on the frequency characteristic image and the visual characteristic image.

2. The method for designing a transfer function based on vision and frequency according to claim 1, characterized in that: The projecting each of the scalar value subintervals in the form of scattered points to a first preset two-dimensional space based on the number of voxels includes: Counting the number of voxels in each of the scalar value subintervals to obtain a frequency feature; Based on the frequency characteristics, each of the scalar value subintervals is projected into a first preset two-dimensional space in the form of scattered points; the first preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding frequency characteristics.

3. The method for designing a transfer function based on vision and frequency according to claim 2, characterized in that: The projecting each of the scalar value subintervals in the form of scattered points to a first preset two-dimensional space based on the number of voxels to obtain a frequency characteristic image corresponding to the volume data includes: Projecting each of the scalar value subintervals into the first preset two-dimensional space in the form of scattered points based on the number of voxels, and determining the gradient change of adjacent scattered points in the first preset two-dimensional space by using a preset frequency feature region segmentation algorithm based on gradient change; Based on the gradient change, extreme points and corresponding boundary points are determined from the first preset two-dimensional space, and scattered points in the first preset two-dimensional space are divided into regions using the extreme points and the corresponding boundary points to obtain a frequency characteristic image corresponding to the volume data.

4. The method for designing a transfer function based on vision and frequency according to claim 1, characterized in that: The step of traversing the midpoints of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint includes: Traversing the midpoints of each scalar value subinterval in the frequency characteristic image by using a preset isosurface extraction algorithm to extract isosurfaces of corresponding isovalue points according to the midpoints to obtain an isosurface image; The isosurface image is converted into a grayscale image, and contour extraction is performed on the grayscale image to obtain a contour image corresponding to the isosurface image.

5. The method for designing a transfer function based on vision and frequency according to any one of claims 1 to 4, characterized in that: The similarity index between two contour images corresponding to any adjacent scalar value subintervals is calculated, and a plurality of similarity indexes obtained by calculation are projected into a second preset two-dimensional space in the form of scattered points to obtain a visual feature image corresponding to the volume data, including: The similarity index between two contour images corresponding to any adjacent scalar value subintervals is calculated, and the corresponding calculation results are averaged and smoothed to obtain several similarity indexes; The several similarity indices are projected into a second preset two-dimensional space in the form of scattered points, and the sparsity of the scattered point distribution in the second preset two-dimensional space is divided by a preset visual feature region segmentation algorithm to obtain a visual feature image corresponding to the volume data; the second preset two-dimensional space is a two-dimensional space constructed according to the midpoint of the scalar value subinterval and the corresponding similarity index.

6. The method for designing a transfer function based on vision and frequency according to claim 5, characterized in that: The one-dimensional transfer function is subjected to point arrangement processing based on the frequency feature image, the visual feature image, and the key equivalent value that meets the preset equivalent condition to obtain the target transfer function corresponding to the volume data, including: Normalizing the similarity index and the frequency feature, and projecting the normalized result into a target two-dimensional space constructed based on the visual feature and the frequency feature; Based on preset equivalent conditions, several equivalent points in the target two-dimensional space are determined as key equivalent values, and based on the frequency feature image, the visual feature image, and the key equivalent values, a one-dimensional transfer function is processed to obtain a target transfer function corresponding to the volume data.

7. The method for designing a transfer function based on vision and frequency according to claim 6, characterized in that: The performing point arrangement processing on the one-dimensional transfer function based on the frequency feature image, the visual feature image, and the key equivalent value to obtain the target transfer function corresponding to the volume data includes: Performing point processing on a one-dimensional transfer function based on the frequency feature image, the visual feature image, and the key equivalent value to obtain an initial transfer function corresponding to the volume data; The frequency characteristic image and / or the visual characteristic image and / or the key equivalent value and / or the initial transfer function are modified based on the interactive instructions, and finally a target transfer function is obtained, so that the volume data can be visualized using the target transfer function to obtain a corresponding visualization image.

8. A transfer function design device based on vision and frequency, characterized in that: include: A frequency characteristic projection module, used for dividing the volume data into a plurality of scalar value sub-intervals, and projecting each of the scalar value sub-intervals into a first preset two-dimensional space in the form of scattered points based on the number of voxels, so as to obtain a frequency characteristic image corresponding to the volume data; A contour image extraction module, used for traversing the midpoints of each of the scalar value subintervals in the frequency characteristic image to extract a contour image of an isosurface image of an isovalue point corresponding to the midpoint; A visual feature projection module, used to calculate a similarity index between two contour images corresponding to any adjacent scalar value subintervals, and project the calculated similarity indexes into a second preset two-dimensional space in the form of scattered points to obtain a visual feature image corresponding to the volume data; A point arrangement module is used to arrange points for a one-dimensional transfer function based on the frequency characteristic image, the visual characteristic image, and key equivalent values ​​that meet preset equivalent conditions to obtain a target transfer function corresponding to the volume data; the key equivalent values ​​are equivalent points in a two-dimensional space constructed based on the frequency characteristic image and the visual characteristic image.

9. An electronic device, characterized in that: include: Memory, used to store computer programs; A processor, configured to execute the computer program to implement the vision and frequency-based transfer function design method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: Used to store a computer program, which, when executed by a processor, implements the vision- and frequency-based transfer function design method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Visualization method capable of displaying volume data characteristics rapidly

    CN103778658A

  • Prioritized image visualization from scalable compressed data

    US20060031372A1

Cited By

  • Pose estimation method and system based on key voxel block selection

    CN120747224A