Three-dimensional visual display method and system for diagnosis and treatment

By processing real-time images in the three-dimensional visualization technology of medical images, we obtain a triangular finite element grid and render only the editable area. The rendering efficiency and fluency are improved by using OpenGL and OpenCL technologies, and the low rendering efficiency in the existing technology is solved. The problem has achieved a more efficient diagnosis and treatment process.

CN118982610AActive Publication Date: 2024-11-19HUIDI KAIDE (BEIJING) MEDICAL TECHNOLOGY CO LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202410993624.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-11-19
Estimated Expiration
2044-07-23

Smart Images

  • Figure CN118982610A_ABST
    Figure CN118982610A_ABST
Patent Text Reader

Abstract

The invention discloses a three-dimensional visualization display method and system for diagnosis and treatment, and relates to the technical field of three-dimensional visualization, and the method comprises the steps: collecting a real-time image, and obtaining the position coordinate information of a pixel point; performing unit division and equipotential processing on the image to obtain extreme points, and connecting the extreme points with critical decomposition unit vertexes to obtain a triangular finite element grid; fitting triangular meshes in the triangular finite element mesh into a plurality of primitives, and determining an editable target area and an editing state of the primitives in the target area in the plurality of primitives to be rendered; creating a buffer object based on the editable triangular mesh, and sharing the buffer object; and processing and rendering the editable triangular mesh, outputting a pixel color value, and performing three-dimensional visual display. According to the method, only the primitives in the target area need to be refreshed and rendered, and all the primitives on the image do not need to be traversed and rendered, so that the refreshing time of each time is shortened, and the rendering efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of three-dimensional visualization technology, and more particularly to a three-dimensional visualization display method and system for diagnosis and treatment. Background Art

[0002] The three-dimensional reconstruction technology of the human body is mainly characterized by medicine and information engineering. The three-dimensional anatomical structure of human tissue is reconstructed in a virtual reality environment. The medical images obtained by modern medical research and clinical diagnosis are diverse, such as CT images, X-rays, nuclear medicine images, magnetic resonance imaging (MRI) images, ultrasound images, and various electronic endoscope images, etc. However, these images provide two-dimensional images without processing; faced with two-dimensional images, clinicians can only estimate the size and shape of the lesion based on experience, and conceive the three-dimensional geometric relationship between the lesion and its surrounding tissues, which brings great difficulties to the accuracy and convenience of diagnosis and treatment.

[0003] The three-dimensional visualization technology of medical images is to display the information data obtained by digital imaging equipment such as MRI and CT on the computer in a three-dimensional effect, thereby providing structural information that cannot be obtained by traditional means; after reconstructing the three-dimensional image with a computer and realistically displaying the three-dimensional image of the human organs on the screen, clinicians can easily perform operations such as translation, rotation, and dissection on the reconstructed image, and can also improve preoperative evaluation and even perform visual simulation surgery. In this way, medical workers can more fully understand the nature of the disease and the three-dimensional structural relationship of its surrounding tissues, thereby helping medical workers to make accurate diagnoses and formulate correct surgical plans, and ultimately achieve the purpose of improving the accuracy and scientificity of diagnosis and treatment.

[0004] However, the three-dimensional visualization technology based on medical images in the prior art usually uses computers to reconstruct three-dimensional images and realistically displays stereoscopic images of human organs on the screen. At this time, most of the three-dimensional images reconstructed by computer rendering are useless images. The three-dimensional visualization rendering of useless images reduces the rendering efficiency, increases the image refresh time, and reduces the smoothness of the display interface, which is not conducive to real-time surgical procedures. At the same time, the selection of the data source for reconstructing the three-dimensional image also affects the accuracy and efficiency of stereoscopic imaging.

[0005] Therefore, how to propose a three-dimensional visualization display method and system for diagnosis and treatment, obtain a triangular finite element mesh by processing real-time images, mark the triangular finite element mesh, and only refresh and render the graphics elements in the editable target area, thereby improving the reliability of the data source, shortening the time of each refresh, improving the rendering efficiency, and improving the fluency of the display interface is a problem that technical personnel in this field urgently need to solve. Summary of the invention

[0006] In view of this, the present invention provides a three-dimensional visualization display method and system for diagnosis and treatment, which obtains a triangular finite element mesh by processing a real-time image, identifies the triangular finite element mesh, and only refreshes and renders the primitives in the editable target area, thereby shortening the time of each refresh, improving the rendering efficiency, and improving the fluency of the display interface. In order to achieve the above purpose, the present invention adopts the following technical solutions:

[0007] A three-dimensional visualization display method for diagnosis and treatment, comprising:

[0008] Collect real-time images and obtain pixel position coordinate information of the collected images;

[0009] The image is divided into units and equipotentialized to obtain extreme points, and the extreme points and critical decomposition unit vertices are connected to obtain a triangular finite element mesh;

[0010] Fitting a triangular mesh in a triangular finite element mesh into a plurality of primitives, determining an editable target region among the plurality of primitives to be rendered, and determining an editing state of the primitives in the target region;

[0011] Creating a buffer object based on an editable triangle mesh through OpenGL, and sharing the buffer object with OpenGL using an OpenCL API function;

[0012] The editable triangle mesh is processed and rendered through OpenCL, the pixel color value is output, and passed to OpenGL, and the renderable data is output through OpenGL for 3D visualization.

[0013] Optionally, the performing unit division and equalization processing on the image to obtain extreme points includes:

[0014] Extract frames and decompose units of the collected image to obtain multiple decomposition units;

[0015] Set the grayscale threshold of the equipoint, calculate all the equipoints in the outermost layer of the frame-sampling image, and connect all the equipoints to obtain the equipoint lines in the outermost layer of the frame-sampling image.

[0016] Optionally, the connecting the extreme points and the critical decomposition unit vertices to obtain a triangular finite element mesh includes:

[0017] Using the quadratic error function, calculate the minimum point of the decomposition unit through which the equipotential line passes;

[0018] Divide the decomposition unit to obtain the unique minimum point, and remove the minimum points that the equipotential lines do not pass through;

[0019] Connect the minimum points and critical decomposition unit vertices to obtain a triangular finite element mesh.

[0020] Optionally, the connecting the minimum point and the critical decomposition unit vertices to obtain a triangular finite element mesh comprises:

[0021] If one vertex of one of the edges of the critical decomposition unit is located inside the equipotential line and the other vertex is located outside the equipotential line, the vertex located inside the equipotential line is used to connect the two adjacent minimum points;

[0022] If one of the edges of the critical decomposition unit is located inside the equipotential line, the two vertices of the edge located inside the equipotential line and the minimum point of the critical decomposition unit are connected to form a triangular finite element mesh;

[0023] If all the edges of the critical decomposition unit are located inside the equipotential line, the diagonal vertices of the critical decomposition unit are directly connected to form a triangular finite element mesh.

[0024] Optionally, before determining the editing status of the primitives in the target area, the method also includes: creating a map matching the primitives in the triangular finite element mesh to be rendered, forming a layer composed of the map; and superimposing the layer containing the map on the layer corresponding to the primitives in the corresponding triangular finite element mesh.

[0025] Optionally, after determining the editing status of the graphic element in the target area, the method includes: when it is determined that the editing status of the graphic element in the target area is an editable state, refreshing the graphic element in the target area at a preset frequency and rendering the graphic element in the target area; when the editing status of the graphic element in the target area is a non-editable state, displaying a map matching the graphic element.

[0026] Optionally, determining the editing status of the graphic element in the target area includes:

[0027] Obtain the number of primitives in the target area, calculate the number of primitives per unit area based on the number of primitives in the target area, and determine the editing status of the primitives in the target area according to the number of primitives per unit area and the threshold value;

[0028] Divide the multiple graphics elements to be rendered into multiple fields of view, each field of view includes a number of graphics elements, and obtain the number of fields of view in the target area; determine the editing status of the graphics elements in the target area according to the number of fields of view in the target area and the threshold value;

[0029] A first ratio of the number of graphic elements in a unit area to a threshold value and a second ratio of the number of fields of view in a target area to a threshold value are obtained, and the editing state of the graphic elements in the target area is determined by combining the weights of the first ratio and the second ratio.

[0030] Optionally, it also includes: when the editing status of the graphic element in the target area is editable, switching the layer where the graphic element is located to the layer to be displayed; when the editing status of the graphic element in the target area is non-editable, switching the layer where the map is located to the layer to be displayed; for non-target areas outside the target area, switching the layer where the map is located in the non-target area to the layer to be displayed.

[0031] Optionally, the processing and rendering of the editable triangular mesh through OpenCL includes: writing an OpenCL kernel through the OpenCL parallel algorithm, performing data alignment processing on the editable triangular mesh data and color space conversion processing on the RGB channels of each pixel of the triangular mesh data, outputting the pixel color value, and passing it to OpenGL for display.

[0032] Optionally, a three-dimensional visualization display system for diagnosis and treatment comprises:

[0033] Acquisition module: used to collect real-time images and obtain pixel position coordinate information of the collected images;

[0034] Mesh construction module: used to perform unit division and equalization processing on the image to obtain extreme points, connect the extreme points and boundary image unit vertices to obtain a triangular finite element mesh;

[0035] Fitting module: used to fit the triangular mesh in the triangular finite element mesh into several primitives;

[0036] Annotation module: used to determine an editable target area among multiple graphics elements to be rendered and determine the editing status of the graphics elements in the target area;

[0037] Rendering module: used to create a buffer object based on the editable triangle mesh through OpenGL, share the buffer object with OpenGL using the OpenCL API function, process and render the editable triangle mesh through OpenCL, output pixel color values, and pass them to OpenGL;

[0038] Visualization module: Outputs renderable data through OpenGL for 3D visualization.

[0039] It can be seen from the above technical solutions that, compared with the prior art, the present invention discloses a three-dimensional visualization display method and system for diagnosis and treatment, which has the following beneficial effects:

[0040] The present invention proposes a three-dimensional visualization display method for diagnosis and treatment, comprising: collecting real-time images, obtaining pixel position coordinate information of the collected images; performing unit division and equipotential processing on the images to obtain extreme points, connecting the extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh; fitting the triangular mesh in the triangular finite element mesh into a plurality of primitives, determining an editable target area among the plurality of primitives to be rendered and determining the editing status of the primitives in the target area; creating a buffer object based on the editable triangular mesh through OpenGL, and sharing the buffer object with OpenGL using an OpenCL API function; processing and rendering the editable triangular mesh through OpenCL, outputting pixel color values, passing them to OpenGL, outputting renderable data through OpenGL, and performing three-dimensional visualization display. The present invention discloses obtaining a triangular finite element mesh by processing a real-time image, marking the triangular finite element mesh, and in an editable state, only the primitives in the target area need to be refreshed and rendered, without traversing all the primitives on the image and rendering all the primitives, thereby shortening the time of each refresh and improving the rendering efficiency. In addition, each rendering reduces the cost and improves the fluency of the display interface; in a non-editable state, there is no need to render the primitives, only the maps matching the primitives need to be displayed, reducing the cost. The OpenCL parallel algorithm is used to reduce the operation time, thereby accelerating the rendering. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0042] Figure 1 A schematic flow chart of a three-dimensional visualization display method for diagnosis and treatment provided by the present invention.

[0043] Figure 2 A structural framework diagram of a three-dimensional visualization display system for diagnosis and treatment provided by the present invention. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] The embodiment of the present invention discloses a three-dimensional visualization display method for diagnosis and treatment, such as Figure 1 As shown, it includes: collecting real-time images, obtaining pixel position coordinate information of the collected images; performing unit division and equiposition processing on the images to obtain extreme points, connecting the extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh; fitting the triangular mesh in the triangular finite element mesh into a plurality of primitives, determining an editable target area among a plurality of primitives to be rendered and determining the editing status of the primitives in the target area; creating a buffer object based on the editable triangular mesh through OpenGL, and using the API function of OpenCL to share the buffer object with OpenGL; processing and rendering the editable triangular mesh through OpenCL, outputting pixel color values, passing them to OpenGL, and outputting renderable data through OpenGL for three-dimensional visualization display.

[0046] Furthermore, the step of performing unit division and equalization processing on the image to obtain extreme points includes:

[0047] Extract frames and decompose units of the collected image to obtain multiple decomposition units;

[0048] Set the grayscale threshold of the equipoint, calculate all the equipoints in the outermost layer of the frame-sampling image, and connect all the equipoints to obtain the equipoint lines in the outermost layer of the frame-sampling image.

[0049] The equivalent line expression is as follows: {(x i ,y i ), g(x i ,y i )=d}, where d is the grayscale threshold. (x i ,y i ) is the coordinate of the plane point; g(x i ,y i ) is the coordinate function.

[0050] In a specific embodiment, real-time images are collected and pixel position coordinate information of the collected images is obtained, including: scanning a portion to be measured by a medical device to obtain a slice image, obtaining position coordinate information of all pixels of the slice image, and decomposing the slice image into units to obtain a plurality of decomposition units, wherein the decomposition units of the slice image units are square units, and each square unit has a side length of 1 unit length.

[0051] Furthermore, the connecting of extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh includes:

[0052] Using the quadratic error function, calculate the minimum point M of the decomposition unit through which the equipotential line passes;

[0053] M(x)=∑ i (zi ·(xk i )) 2 ;

[0054] In the formula, k i 、z i They represent the position and unit normal vector of the intersection of the equipotential line and the decomposition unit respectively, i = 1, 2, ..., n; n is twice the total number of units.

[0055] Divide the decomposition unit to obtain a unique minimum point, and determine whether the minimum point of each decomposition unit is unique. If not, redivide the decomposition unit with n minimum points to remove the minimum points that the equipotential line does not pass through.

[0056] Connect the minimum points and critical decomposition unit vertices to obtain a triangular finite element mesh.

[0057] Furthermore, the step of connecting the minimum value point and the critical decomposition unit vertices to obtain a triangular finite element mesh includes:

[0058] If one vertex of one of the edges of the critical decomposition unit is located inside the equipotential line and the other vertex is located outside the equipotential line, the vertex located inside the equipotential line is used to connect the two adjacent minimum points;

[0059] If one of the edges of the critical decomposition unit is located inside the equipotential line, the two vertices of the edge located inside the equipotential line and the minimum point of the critical decomposition unit are connected to form a triangular finite element mesh;

[0060] If all the edges of the critical decomposition unit are located inside the equipotential line, the diagonal vertices of the critical decomposition unit are directly connected to form a triangular finite element mesh.

[0061] Furthermore, before determining the editing status of the primitives in the target area, the method also includes: creating a map matching the primitives of the triangular finite element mesh to be rendered, forming a layer composed of the map; and superimposing the layer containing the map on the layer corresponding to the primitives of the corresponding triangular finite element mesh.

[0062] Furthermore, after determining the editing status of the graphic element in the target area, the method includes: when it is determined that the editing status of the graphic element in the target area is an editable state, refreshing the graphic element in the target area at a preset frequency and rendering the graphic element in the target area; when the editing status of the graphic element in the target area is a non-editable state, displaying a map matching the graphic element.

[0063] Furthermore, the determining the editing status of the graphic element in the target area includes:

[0064] Obtain the number of primitives in the target area, calculate the number of primitives per unit area based on the number of primitives in the target area, and determine the editing status of the primitives in the target area according to the number of primitives per unit area and the threshold value;

[0065] Divide the multiple graphics elements to be rendered into multiple fields of view, each field of view includes a number of graphics elements, and obtain the number of fields of view in the target area; determine the editing status of the graphics elements in the target area according to the number of fields of view in the target area and the threshold value;

[0066] A first ratio of the number of graphic elements in a unit area to a threshold value and a second ratio of the number of fields of view in a target area to a threshold value are obtained, and the editing state of the graphic elements in the target area is determined by combining the weights of the first ratio and the second ratio.

[0067] In a specific implementation, the number of primitives in the target area is obtained; the number of primitives per unit area is calculated based on the number of primitives in the target area; when the number of primitives per unit area is less than or equal to a preset first number threshold, the editing state of the primitives in the target area is determined to be an editable state; when the number of primitives per unit area is greater than the preset first number threshold, the editing state of the primitives in the target area is determined to be a non-editable state;

[0068] Alternatively, multiple graphics elements to be rendered are divided into multiple fields of view, each field of view includes a number of graphics elements, the editing status of the graphics elements displayed in the target area is determined, and the number of fields of view in the target area is obtained; when the number of fields of view in the target area is less than or equal to a preset second number threshold, the editing status of the graphics elements in the target area is determined to be an editable state; when the number of fields of view in the target area is greater than a preset second number threshold, the editing status of the graphics elements in the target area is determined to be a non-editable state.

[0069] Obtain a first ratio of the number of graphics elements in a unit area to a first quantity threshold, and a second ratio of the number of fields of view in a target area to a second quantity threshold, and determine the editing status of the graphics elements in the target area by combining the first ratio and the second ratio weights, wherein the sum of the first ratio and the second ratio weights is 1.

[0070] When it is determined that the editing state of the graphics element in the target area is an editable state, the graphics element in the target area is refreshed at a preset refresh frequency. Each refresh traverses the graphics element in the target area and renders the graphics element in the target area without traversing all the graphics elements on the image and rendering all the graphics element. Therefore, the time of each refresh is shortened, the rendering efficiency is improved, and the computing cost of the computer device is reduced each time rendering, thereby improving the fluency of the display interface.

[0071] In the editable state, an editing operation is performed on the graphic element in the target area, and the editing operation includes at least one of rotation, scaling, rendering, modification and deletion.

[0072] Furthermore, it also includes: when the editing status of the graphic element in the target area is editable, the layer where the graphic element is located is switched to the layer to be displayed; when the editing status of the graphic element in the target area is non-editable, the layer where the map is located is switched to the layer to be displayed; for non-target areas outside the target area, the layer where the map is located in the non-target area is switched to the layer to be displayed.

[0073] Furthermore, the processing and rendering of the editable triangular mesh through OpenCL includes: writing an OpenCL kernel through the OpenCL parallel algorithm, performing data alignment processing on the editable triangular mesh data and color space conversion processing on the RGB channels of each pixel of the triangular mesh data, outputting the pixel color value, and passing it to OpenGL for display.

[0074] In a specific embodiment, the specific steps of processing and rendering the editable triangular mesh include:

[0075] The minimum value points and critical decomposition unit vertex data of the editable triangular mesh in the triangular finite element mesh are stored in a structure array, each structure represents the attribute of a vertex;

[0076] Create a shared context to share data and resources between OpenCL and OpenGL;

[0077] Create a vertex buffer object in OpenGL and transfer the data of the triangle mesh model to the buffer object;

[0078] Use OpenCL API functions to associate OpenGL buffer objects with OpenCL buffer objects in a shared context so that OpenCL can read and process vertex data in its kernel.

[0079] Write an OpenCL kernel to process and render triangular mesh model data, and perform vertex transformation, lighting calculation, shading and other operations in the kernel;

[0080] Call the OpenCL kernel, pass the triangular mesh model data to the kernel for rendering operations, output the pixel color value, and pass it to OpenGL for display.

[0081] Furthermore, before starting, the OpenCL environment is initialized; the OpenCL parallel algorithm is loaded; after rendering, the rendering processing time corresponding to the current video frame is calculated; and the OpenCL parallel algorithm to be loaded is re-determined according to the rendering processing time.

[0082] In a specific embodiment, a three-dimensional visualization display system for diagnosis and treatment, such as Figure 2 As shown, including:

[0083] Acquisition module: used to collect real-time images and obtain pixel position coordinate information of the collected images;

[0084] Mesh construction module: used to perform unit division and equalization processing on the image to obtain extreme points, connect the extreme points and boundary image unit vertices to obtain a triangular finite element mesh;

[0085] Fitting module: used to fit the triangular mesh in the triangular finite element mesh into several primitives;

[0086] Annotation module: used to determine an editable target area among multiple graphics elements to be rendered and determine the editing status of the graphics elements in the target area;

[0087] Rendering module: used to create a buffer object based on the editable triangle mesh through OpenGL, share the buffer object with OpenGL using the OpenCL API function, process and render the editable triangle mesh through OpenCL, output pixel color values, and pass them to OpenGL;

[0088] Visualization module: Outputs renderable data through OpenGL for 3D visualization.

[0089] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0090] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A three-dimensional visualization display method for diagnosis and treatment, characterized in that: include: Collect real-time images and obtain pixel position coordinate information of the collected images; Perform unit division and equiposition processing on the image to obtain extreme points, connect the extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh; Fitting a triangular mesh in a triangular finite element mesh into a plurality of primitives, determining an editable target area among the plurality of primitives to be rendered, and determining an editing state of the primitives in the target area; Creating a buffer object based on an editable triangle mesh through OpenGL, and sharing the buffer object with OpenGL using an OpenCL API function; The editable triangle mesh is processed and rendered through OpenCL, and the pixel color value is output and passed to OpenGL. The renderable data is output through OpenGL for 3D visualization.

2. A three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: The unit division and equalization processing of the image to obtain extreme points includes: Extract frames and decompose units on the collected image to obtain multiple decomposition units; Set the grayscale threshold of the equipoint, calculate all the equipoints in the outermost layer of the frame-drawing image, and connect all the equipoints to obtain the equipotential lines in the outermost layer of the frame-drawing image.

3. A three-dimensional visualization display method for diagnosis and treatment according to claim 2, characterized in that: The connecting of extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh includes: Using the quadratic error function, calculate the minimum point of the decomposition unit through which the equipotential line passes; Divide the decomposition unit to obtain the unique minimum point, and remove the minimum points that the equipotential line does not pass through; Connect the minimum points and critical decomposition unit vertices to obtain a triangular finite element mesh.

4. A three-dimensional visualization display method for diagnosis and treatment according to claim 3, characterized in that: The method of connecting the minimum point and the critical decomposition unit vertices to obtain a triangular finite element mesh includes: If one vertex of one edge of the critical decomposition unit is inside the equipotential line and the other vertex is outside the equipotential line, the two adjacent minimum points are connected by the vertex inside the equipotential line; If one of the edges of the critical decomposition unit is inside the equipotential line, the two vertices of the edge inside the equipotential line and the minimum point of the critical decomposition unit are connected to form a triangular finite element mesh; If all edges of the critical decomposition element are located inside the equipotential line, the diagonal vertices of the critical decomposition element are directly connected to form a triangular finite element mesh.

5. The three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: Before determining the editing status of the primitives in the target area, the method also includes: creating a map matching the primitives in the triangular finite element mesh to be rendered, forming a layer composed of the map; and superimposing the layer containing the map on the layer corresponding to the primitives in the corresponding triangular finite element mesh.

6. A three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: After determining the editing status of the graphic element in the target area, the method includes: when it is determined that the editing status of the graphic element in the target area is an editable state, refreshing the graphic element in the target area at a preset frequency and rendering the graphic element in the target area; when the editing status of the graphic element in the target area is a non-editable state, displaying a map matching the graphic element.

7. A three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: Determining the editing status of the graphic element in the target area includes: Obtain the number of primitives in the target area, calculate the number of primitives per unit area based on the number of primitives in the target area, and determine the editing status of the primitives in the target area according to the number of primitives per unit area and a threshold value; Divide the multiple primitives to be rendered into multiple fields of view, each field of view includes a number of primitives, and obtain the number of fields of view in the target area; determine the editing status of the primitives in the target area according to the number of fields of view in the target area and a threshold value; A first ratio of the number of graphic elements per unit area to a threshold value and a second ratio of the number of fields of view in a target area to a threshold value are obtained, and the editing status of the graphic elements in the target area is determined by combining the weights of the first ratio and the second ratio.

8. A three-dimensional visualization display method for diagnosis and treatment according to claim 7, characterized in that: Also includes: When the editing status of the element in the target area is editable, the layer where the element is located is switched to the layer to be displayed; When the editing status of the element in the target area is non-editable, the layer where the map is located is switched to the layer to be displayed; for the non-target area outside the target area, the layer where the map is located in the non-target area is switched to the layer to be displayed.

9. The three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: The processing and rendering of the editable triangle mesh through OpenCL includes: writing an OpenCL kernel through the OpenCL parallel algorithm, performing data alignment processing on the editable triangle mesh data and color space conversion processing of the RGB channels of each pixel of the triangle mesh data, outputting the pixel color value, and passing it to OpenGL for display.

10. A three-dimensional visualization display system for diagnosis and treatment, characterized in that: include: Acquisition module: used to collect real-time images and obtain the pixel position coordinate information of the collected images; Mesh construction module: used to perform unit division and equalization processing on the image to obtain extreme points, connect the extreme points and boundary image unit vertices to obtain a triangular finite element mesh; Fitting module: used to fit the triangular mesh in the triangular finite element mesh into several primitives; Annotation module: used to determine an editable target area among multiple graphics elements to be rendered and to determine the editing status of the graphics elements in the target area; Rendering module: used to create a buffer object based on the editable triangle mesh through OpenGL, share the buffer object with OpenGL using OpenCL API functions, process and render the editable triangle mesh through OpenCL, output pixel color values, and pass them to OpenGL; Visualization module: Outputs renderable data through OpenGL for 3D visualization.

Citation Information

Patent Citations

  • Accelerated rendering method for contours

    CN102903139A

  • Semiconductor device rendering method and device, equipment and storage medium

    CN115328607A

  • Apparatus and method for volume processing and rendering

    US20040125103A1

  • Method and device for controlling equipment based on multiple-input / one-output control

    US20090037002A1