A three-dimensional visualization display method and system for diagnosis and treatment

Abstract

The present invention discloses a three-dimensional visualization display method and system for diagnosis and treatment, which relates to the field of three-dimensional visualization technology, including: collecting real-time images and obtaining pixel point position coordinate information; performing unit division and equipotential processing on the image to obtain extreme points, connecting the extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh; fitting the triangular mesh in the triangular finite element mesh into a number of primitives, determining an editable target area among multiple primitives to be rendered and determining the editing status of the primitives in the target area; creating a buffer object based on the editable triangular mesh and sharing the buffer object; the editable triangular mesh is processed and rendered, and the pixel color value is output for three-dimensional visualization display. The present invention only needs to refresh and render the primitives in the target area, without traversing all the primitives on the image and rendering all the primitives, thereby shortening the time of each refresh and improving the rendering efficiency.

Description

Technical Field

[0001] This invention relates to the field of three-dimensional visualization technology, and more specifically to a three-dimensional visualization display method and system for diagnosis and treatment. Background Art

[0002] Human body 3D reconstruction technology is characterized by medicine and information engineering. It reconstructs the three-dimensional anatomical structure of human tissues in a virtual reality environment. The medical images obtained by modern medical research and clinical diagnosis are diverse, such as CT images, X-rays, nuclear medicine images, magnetic resonance (MRI) images, ultrasound images, and various electronic endoscopic images. However, these images provide two-dimensional images without processing. Faced with two-dimensional images, clinicians can only estimate the size and shape of lesions based on experience and imagine the three-dimensional geometric relationship between the lesions and the surrounding tissues. This brings great difficulty to the accuracy and convenience of diagnosis and treatment.

[0003] Three-dimensional visualization technology for medical images involves visually displaying information obtained from digital imaging equipment such as MRI and CT scans in a three-dimensional effect on a computer, thus providing structural information that cannot be obtained through traditional methods. After reconstructing three-dimensional images using a computer and displaying realistic three-dimensional images of human organs on the screen, clinicians can easily perform operations such as translation, rotation, and segmentation on the reconstructed images. They can also improve preoperative assessments and even conduct visual simulations of surgery. This allows medical professionals to better understand the nature of the disease and the three-dimensional structural relationships of surrounding tissues, thereby helping them make accurate diagnoses and develop correct surgical plans, ultimately improving the accuracy and scientific rigor of diagnosis and treatment.

[0004] However, existing medical image-based 3D visualization technologies typically use computers to reconstruct 3D images and display realistic stereoscopic images of human organs on the screen. In this case, most of the 3D images reconstructed by computer rendering are useless images. Rendering useless images in 3D visualization reduces rendering efficiency, increases image refresh time, reduces the smoothness of the display interface, and is not conducive to real-time surgical procedures. At the same time, the selection of the data source for reconstructing 3D images also affects the accuracy and efficiency of stereoscopic imaging.

[0005] Therefore, how to propose a three-dimensional visualization display method and system for diagnosis and treatment, which obtains triangular finite element meshes by processing real-time images, identifies the triangular finite element meshes, and refreshes and renders only the primitives in the editable target area, improves the reliability of the data source, shortens the time of each refresh, improves rendering efficiency, and improves the smoothness of the display interface is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0006] In view of this, the present invention provides a three-dimensional visualization display method and system for diagnosis and treatment. By processing real-time images to obtain a triangular finite element mesh, marking the triangular finite element mesh, and only refreshing and rendering primitives within the editable target area, the refresh time is shortened, rendering efficiency is improved, and the smoothness of the display interface is enhanced. To achieve the above objectives, the present invention adopts the following technical solution:

[0007] A three-dimensional visualization method for diagnosis and treatment, comprising:

[0008] Acquire real-time images and obtain the pixel coordinate information of the acquired images;

[0009] The image is divided into units and isotropically processed to obtain extreme points. The extreme points and the vertices of the critical decomposition units are connected to obtain a triangular finite element mesh.

[0010] The triangular mesh in the triangular finite element mesh is fitted into several primitives. The editable target area and the editing status of the primitives in the target area are determined among the multiple primitives to be rendered.

[0011] Create a buffer object based on an editable triangular mesh using OpenGL, and share the buffer object with OpenGL using OpenCL API functions;

[0012] The editable triangular mesh is processed and rendered using OpenCL, and the pixel color values ​​are output and passed to OpenGL. OpenGL then outputs renderable data for 3D visualization.

[0013] Optionally, the step of dividing the image into units and isotropically processing to obtain extreme points includes:

[0014] The acquired image is subjected to frame extraction and unit decomposition to obtain multiple decomposition units;

[0015] Set the grayscale threshold for each position, calculate all the positions on the outermost layer of the frame-drawing image, and connect all the positions to obtain the equipotential lines on the outermost layer of the frame-drawing image.

[0016] Optionally, the process of connecting the extreme points and the vertices of the critical decomposition elements to obtain the triangular finite element mesh includes:

[0017] Using the quadratic error function, calculate the minimum point of the decomposition unit through which the equipotential line passes;

[0018] The decomposition unit is divided to obtain a unique minimum point, and the minimum points that the equipotential line does not pass through are removed;

[0019] Connecting the minimum point and the vertices of the critical decomposition element yields a triangular finite element mesh.

[0020] Optionally, the process of connecting the minimum point and the critical decomposition element vertex to obtain the triangular finite element mesh includes:

[0021] If one vertex of one edge of a critical decomposition unit is inside the equipotential line and the other vertex is outside the equipotential line, then connect the two adjacent minimum points with the vertex inside the equipotential line.

[0022] If one of the edges of the critical decomposition element is located inside the equipotential line, then connect the two vertices of the edge located inside the equipotential line and the minimum point of the critical decomposition element to form a triangular finite element mesh.

[0023] If all edges of the critical decomposition element are located inside the equipotential lines, then directly connect the diagonal vertices of the critical decomposition element to form a triangular finite element mesh.

[0024] Optionally, before determining the editing state of the primitives in the target area, the method further includes: creating a texture that matches the primitives of the triangular finite element mesh to be rendered, forming a layer composed of textures; and overlaying the layer containing the textures onto the layer corresponding to the primitives of the triangular finite element mesh.

[0025] Optionally, after determining the editing state of the elements in the target area, the process includes: when the editing state of the elements in the target area is determined to be editable, refreshing the elements in the target area at a preset frequency and rendering the elements in the target area; when the editing state of the elements in the target area is determined to be non-editable, displaying a texture that matches the elements.

[0026] Optionally, determining the editing status of elements in the target area includes:

[0027] Get the number of elements in the target area, calculate the number of elements per unit area based on the number of elements in the target area, and determine the editing status of the elements in the target area based on the number of elements per unit area and the threshold value.

[0028] Divide the multiple primitives to be rendered into multiple fields of view, each field of view including several primitives, and obtain the number of fields of view within the target area; determine the editing status of the primitives in the target area based on the number of fields of view within the target area and the threshold value;

[0029] Obtain the first ratio of the number of primitives per unit area to a threshold, and the second ratio of the number of fields of view within the target area to a threshold. Combine the weights of the first and second ratios to determine the editing status of primitives in the target area.

[0030] Optionally, it also includes: when the editing state of the graphic element in the target area is editable, switching the layer where the graphic element is located to the layer to be displayed; when the editing state of the graphic element in the target area is not editable, switching the layer where the texture is located to the layer to be displayed; for non-target areas outside the target area, switching the layer where the texture is located in the non-target area to the layer to be displayed.

[0031] Optionally, the processing and rendering of the editable triangular mesh using OpenCL includes: writing an OpenCL kernel using an OpenCL parallel algorithm, performing data alignment processing on the editable triangular mesh data and color space conversion processing on the RGB channels of each pixel of the triangular mesh data, outputting pixel color values, and passing them to OpenGL for display.

[0032] Optionally, a three-dimensional visualization display system for diagnosis and treatment includes:

[0033] Acquisition module: Used to acquire real-time images and obtain the pixel coordinate information of the acquired images;

[0034] Mesh construction module: used to divide the image into units and perform isotropic processing to obtain extreme points, connect the extreme points and boundary image unit vertices to obtain a triangular finite element mesh;

[0035] Fitting module: Used to fit the triangular mesh in the triangular finite element mesh into several primitives;

[0036] Annotation module: Used to determine the editable target area among multiple primitives to be rendered and to determine the editing status of the primitives in the target area;

[0037] Rendering module: Used to create a buffer object based on an editable triangular mesh using OpenGL, share the buffer object with OpenGL using OpenCL API functions, process and render the editable triangular mesh using OpenCL, output pixel color values, and pass them to OpenGL;

[0038] Visualization module: Outputs renderable data through OpenGL for 3D visualization.

[0039] As can be seen from the above technical solution, compared with the prior art, the present invention discloses a three-dimensional visualization display method and system for diagnosis and treatment, which has the following beneficial effects:

[0040] This invention proposes a three-dimensional visualization display method for diagnosis and treatment, comprising: acquiring real-time images and obtaining pixel position coordinate information of the acquired images; performing cell division and isotropic processing on the images to obtain extreme points, connecting the extreme points and the vertices of the critical decomposition units to obtain a triangular finite element mesh; fitting the triangular mesh in the triangular finite element mesh into several primitives, determining the editable target region and the editing state of the primitives in the target region among the multiple primitives to be rendered; creating a buffer object based on the editable triangular mesh using OpenGL, and sharing the buffer object with OpenGL using OpenCL API functions; processing and rendering the editable triangular mesh using OpenCL, outputting pixel color values, passing them to OpenGL, and outputting renderable data through OpenGL for three-dimensional visualization display. This invention discloses a method for obtaining triangular finite element meshes by processing real-time images, and marking these meshes. In editable mode, only the primitives within the target area need to be refreshed and rendered, eliminating the need to traverse and render all primitives in the image. This shortens the refresh time and improves rendering efficiency. Furthermore, it reduces costs and improves the smoothness of the display interface with each rendering. In non-editable mode, no primitive rendering is required; only textures matching the primitives are displayed, further reducing costs. The OpenCL parallel algorithm reduces computation time, thereby accelerating rendering. Attached Figure Description

[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0042] Figure 1 This is a schematic diagram of a three-dimensional visualization display method for diagnosis and treatment provided by the present invention.

[0043] Figure 2 This invention provides a structural framework diagram of a three-dimensional visualization display system for diagnosis and treatment. Detailed Implementation

[0044] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0045] This invention discloses a three-dimensional visualization display method for diagnosis and treatment, such as... Figure 1 As shown, the process includes: acquiring real-time images and obtaining pixel coordinate information of the acquired images; performing cell division and isotropic processing on the images to obtain extreme points, connecting the extreme points and the vertices of the critical decomposition units to obtain a triangular finite element mesh; fitting the triangular mesh in the triangular finite element mesh into several primitives, determining the editable target region and the editing state of the primitives in the target region among the multiple primitives to be rendered; creating a buffer object based on the editable triangular mesh using OpenGL, and sharing the buffer object with OpenGL using OpenCL API functions; processing and rendering the editable triangular mesh using OpenCL, outputting pixel color values, passing them to OpenGL, and outputting renderable data through OpenGL for 3D visualization display.

[0046] Furthermore, the process of dividing the image into units and isotropically converting it to obtain extreme points includes:

[0047] The acquired image is subjected to frame extraction and unit decomposition to obtain multiple decomposition units;

[0048] Set the grayscale threshold for each position, calculate all the positions on the outermost layer of the frame-drawing image, and connect all the positions to obtain the equipotential lines on the outermost layer of the frame-drawing image.

[0049] The expression for equipotential lines is as follows: {(x i ,y i ), g(x i ,y i )=d}, where d is the grayscale threshold. (x i ,y i g(x) represents the coordinates of a point in the plane; i ,y i ) is a coordinate function.

[0050] In a specific embodiment, acquiring real-time images and obtaining pixel position coordinate information of the acquired images includes: scanning the area to be tested using a medical device to obtain a slice image, obtaining the position coordinate information of all pixels in the slice image, decomposing the slice image into units to obtain several decomposition units, and the decomposition units after the slice image unit decomposition are square units, each square unit having a side length of 1 unit length.

[0051] Furthermore, the process of connecting the extreme points and the vertices of the critical decomposition elements to obtain the triangular finite element mesh includes:

[0052] Using the quadratic error function, calculate the minimum point M of the decomposition unit through which the equipotential line passes;

[0053] M(x) = ∑ i (zi ·(xk i )) 2 ;

[0054] In the formula, k i 、z i These represent the position of the intersection point of the equipotential line and the decomposition unit, and the unit normal vector, respectively, i = 1, 2, ..., n; n is twice the total number of units.

[0055] The decomposition unit is divided to obtain a unique minimum point. It is determined whether the minimum point of each decomposition unit is unique. If not, the decomposition unit with n minimum points is further divided, and the minimum points that the equipotential line does not pass through are removed.

[0056] Connecting the minimum point and the vertices of the critical decomposition element yields a triangular finite element mesh.

[0057] Furthermore, the process of connecting the minimum point and the vertices of the critical decomposition element to obtain the triangular finite element mesh includes:

[0058] If one vertex of one edge of a critical decomposition unit is inside the equipotential line and the other vertex is outside the equipotential line, then connect the two adjacent minimum points with the vertex inside the equipotential line.

[0059] If one of the edges of the critical decomposition element is located inside the equipotential line, then connect the two vertices of the edge located inside the equipotential line and the minimum point of the critical decomposition element to form a triangular finite element mesh.

[0060] If all edges of the critical decomposition element are located inside the equipotential lines, then directly connect the diagonal vertices of the critical decomposition element to form a triangular finite element mesh.

[0061] Furthermore, before determining the editing state of the primitives in the target area, the process includes: creating a texture that matches the primitives of the triangular finite element mesh to be rendered, forming a layer composed of textures; and overlaying the layer containing the textures onto the layer corresponding to the primitives of the triangular finite element mesh.

[0062] Furthermore, after determining the editing state of the elements in the target area, the process includes: when the editing state of the elements in the target area is determined to be editable, refreshing the elements in the target area at a preset frequency and rendering the elements in the target area; when the editing state of the elements in the target area is determined to be non-editable, displaying a texture that matches the elements.

[0063] Furthermore, determining the editing status of elements in the target area includes:

[0064] Get the number of elements in the target area, calculate the number of elements per unit area based on the number of elements in the target area, and determine the editing status of the elements in the target area based on the number of elements per unit area and the threshold value.

[0065] Divide the multiple primitives to be rendered into multiple fields of view, each field of view including several primitives, and obtain the number of fields of view within the target area; determine the editing status of the primitives in the target area based on the number of fields of view within the target area and the threshold value;

[0066] Obtain the first ratio of the number of primitives per unit area to a threshold, and the second ratio of the number of fields of view within the target area to a threshold. Combine the weights of the first and second ratios to determine the editing status of primitives in the target area.

[0067] In a specific implementation, the number of graphic elements within the target area is obtained; the number of graphic elements per unit area is calculated based on the number of graphic elements within the target area; when the number of graphic elements per unit area is less than or equal to a preset first quantity threshold, the editing state of the graphic elements in the target area is determined to be editable; when the number of graphic elements per unit area is greater than the preset first quantity threshold, the editing state of the graphic elements in the target area is determined to be non-editable.

[0068] Alternatively, multiple primitives to be rendered are divided into multiple fields of view, each field of view including several primitives. The editing state of the primitives displayed in the target area is determined, and the number of fields of view in the target area is obtained. When the number of fields of view in the target area is less than or equal to a preset second threshold, the editing state of the primitives in the target area is determined to be editable. When the number of fields of view in the target area is greater than the preset second threshold, the editing state of the primitives in the target area is determined to be non-editable.

[0069] The first ratio of the number of primitives per unit area to a first quantity threshold and the second ratio of the number of fields of view within the target area to a second quantity threshold are obtained. The editing status of primitives in the target area is determined by combining the weights of the first and second ratios. The sum of the weights of the first and second ratios is 1.

[0070] When the editable state of the graphic elements in the target area is determined to be editable, the graphic elements in the target area are refreshed at a preset refresh frequency. Each refresh traverses the graphic elements in the target area and renders the graphic elements in the target area, without having to traverse all graphic elements on the image and render all graphic elements. Therefore, the refresh time is shortened and the rendering efficiency is improved. Each rendering reduces the computing cost of the computer equipment and improves the smoothness of the display interface.

[0071] In editable mode, editing operations are performed on the primitives in the target area, including at least one of rotation, scaling, rendering, modification, and deletion.

[0072] Furthermore, it also includes: when the editing state of the graphic element in the target area is editable, switching the layer where the graphic element is located to the layer to be displayed; when the editing state of the graphic element in the target area is not editable, switching the layer where the texture is located to the layer to be displayed; for non-target areas outside the target area, switching the layer where the texture is located in the non-target area to the layer to be displayed.

[0073] Furthermore, the processing and rendering of the editable triangular mesh using OpenCL includes: writing an OpenCL kernel using an OpenCL parallel algorithm, performing data alignment processing on the editable triangular mesh data, and color space conversion processing on the RGB channels of each pixel of the triangular mesh data, outputting pixel color values, and passing them to OpenGL for display.

[0074] In a specific embodiment, the specific steps for processing and rendering the editable triangular mesh include:

[0075] The minimum point and critical decomposition element vertex data of the editable triangular mesh in the triangular finite element mesh are stored in a structure array, and each structure represents the attribute of a vertex;

[0076] Create a shared context that allows OpenCL and OpenGL to share data and resources;

[0077] In OpenGL, create a vertex buffer object and pass the data of the triangular mesh model to the buffer object;

[0078] Using OpenCL API functions, OpenGL buffer objects are associated with OpenCL buffer objects in a shared context, allowing OpenCL to read and process vertex data within its kernel;

[0079] Write an OpenCL kernel to process and render triangular mesh model data, and perform vertex transformation, lighting calculation, shading and other operations in the kernel;

[0080] The OpenCL kernel is invoked, the triangular mesh model data is passed to the kernel for rendering, the pixel color values ​​are output and passed to OpenGL for display.

[0081] Furthermore, the OpenCL environment is initialized before starting; the OpenCL parallel algorithm is loaded. After rendering, the rendering processing time corresponding to the current video frame is calculated; based on the rendering processing time, the OpenCL parallel algorithm to be loaded is re-determined.

[0082] In a specific implementation, a three-dimensional visualization display system for diagnosis and treatment, such as... Figure 2 Shown, including:

[0083] Acquisition module: Used to acquire real-time images and obtain the pixel coordinate information of the acquired images;

[0084] Mesh construction module: used to divide the image into units and perform isotropic processing to obtain extreme points, connect the extreme points and boundary image unit vertices to obtain a triangular finite element mesh;

[0085] Fitting module: Used to fit the triangular mesh in the triangular finite element mesh into several primitives;

[0086] Annotation module: Used to determine the editable target area among multiple primitives to be rendered and to determine the editing status of the primitives in the target area;

[0087] Rendering module: Used to create a buffer object based on an editable triangular mesh using OpenGL, share the buffer object with OpenGL using OpenCL API functions, process and render the editable triangular mesh using OpenCL, output pixel color values, and pass them to OpenGL;

[0088] Visualization module: Outputs renderable data through OpenGL for 3D visualization.

[0089] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0090] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not limited to the embodiments shown herein but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A three-dimensional visualization display method for diagnosis and treatment, characterized in that: include: Collect real-time images and obtain pixel position coordinate information of the collected images; Perform unit division and equiposition processing on the image to obtain extreme points, connect the extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh; The connecting of extreme points and critical decomposition unit vertices to obtain a triangular finite element mesh includes: Using the quadratic error function, calculate the minimum point of the decomposition unit through which the equipotential line passes; Divide the decomposition unit to obtain the unique minimum point, and remove the minimum points that the equipotential line does not pass through; Connect the minimum points and critical decomposition unit vertices to obtain a triangular finite element mesh; The method of connecting the minimum point and the critical decomposition unit vertices to obtain a triangular finite element mesh includes: If one vertex of one edge of the critical decomposition unit is inside the equipotential line and the other vertex is outside the equipotential line, the two adjacent minimum points are connected by the vertex inside the equipotential line; If one of the edges of the critical decomposition unit is inside the equipotential line, the two vertices of the edge inside the equipotential line and the minimum point of the critical decomposition unit are connected to form a triangular finite element mesh; If all edges of the critical decomposition unit are located inside the equipotential line, the diagonal vertices of the critical decomposition unit are directly connected to form a triangular finite element mesh; Fitting a triangular mesh in a triangular finite element mesh into a plurality of primitives, determining an editable target area among the plurality of primitives to be rendered, and determining an editing state of the primitives in the target area; Creating a buffer object based on an editable triangle mesh through OpenGL, and sharing the buffer object with OpenGL using an OpenCL API function; The editable triangle mesh is processed and rendered through OpenCL, and the pixel color value is output and passed to OpenGL. The renderable data is output through OpenGL for 3D visualization.

2. A three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: The unit division and equipotential processing of the image to obtain extreme points includes: Extract frames and decompose units on the collected image to obtain multiple decomposition units; Set the grayscale threshold of the equipoint, calculate all the equipoints in the outermost layer of the frame-drawing image, and connect all the equipoints to obtain the equipotential lines in the outermost layer of the frame-drawing image.

3. A three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: Before determining the editing status of the primitives in the target area, the method also includes: creating a map matching the primitives in the triangular finite element mesh to be rendered, forming a layer composed of the map; and superimposing the layer containing the map on the layer corresponding to the primitives in the corresponding triangular finite element mesh.

4. A three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: After determining the editing status of the graphic element in the target area, the method includes: when it is determined that the editing status of the graphic element in the target area is an editable state, refreshing the graphic element in the target area at a preset frequency and rendering the graphic element in the target area; when the editing status of the graphic element in the target area is a non-editable state, displaying a map matching the graphic element.

5. The three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: Determining the editing status of the graphic element in the target area includes: Obtain the number of primitives in the target area, calculate the number of primitives per unit area based on the number of primitives in the target area, and determine the editing status of the primitives in the target area according to the number of primitives per unit area and a threshold value; Divide the multiple primitives to be rendered into multiple fields of view, each field of view includes a number of primitives, and obtain the number of fields of view in the target area; determine the editing status of the primitives in the target area according to the number of fields of view in the target area and a threshold value; A first ratio of the number of graphic elements per unit area to a threshold value and a second ratio of the number of fields of view in a target area to a threshold value are obtained, and the editing status of the graphic elements in the target area is determined by combining the weights of the first ratio and the second ratio.

6. A three-dimensional visualization display method for diagnosis and treatment according to claim 5, characterized in that: Also includes: When the editing status of the element in the target area is editable, the layer where the element is located is switched to the layer to be displayed; When the editing status of the element in the target area is non-editable, the layer where the map is located is switched to the layer to be displayed; for the non-target area outside the target area, the layer where the map is located in the non-target area is switched to the layer to be displayed.

7. A three-dimensional visualization display method for diagnosis and treatment according to claim 1, characterized in that: The processing and rendering of the editable triangle mesh through OpenCL includes: writing an OpenCL kernel through the OpenCL parallel algorithm, performing data alignment processing on the editable triangle mesh data and color space conversion processing of the RGB channels of each pixel of the triangle mesh data, outputting the pixel color value, and passing it to OpenGL for display.

8. A three-dimensional visualization display system for diagnosis and treatment, characterized in that: include: Acquisition module: used to collect real-time images and obtain pixel position coordinate information of the collected images; A mesh construction module is used to perform unit division and equiposition processing on the image to obtain extreme points, connect the extreme points and the vertices of the boundary image units to obtain a triangular finite element mesh; the connection of the extreme points and the critical decomposition unit vertices to obtain a triangular finite element mesh includes: Using the quadratic error function, calculate the minimum point of the decomposition unit through which the equipotential line passes; Divide the decomposition unit to obtain the unique minimum point, and remove the minimum points that the equipotential line does not pass through; Connect the minimum points and critical decomposition unit vertices to obtain a triangular finite element mesh; The method of connecting the minimum point and the critical decomposition unit vertices to obtain a triangular finite element mesh includes: If one vertex of one edge of the critical decomposition unit is inside the equipotential line and the other vertex is outside the equipotential line, the two adjacent minimum points are connected by the vertex inside the equipotential line; If one of the edges of the critical decomposition unit is inside the equipotential line, the two vertices of the edge inside the equipotential line and the minimum point of the critical decomposition unit are connected to form a triangular finite element mesh; If all edges of the critical decomposition unit are located inside the equipotential line, the diagonal vertices of the critical decomposition unit are directly connected to form a triangular finite element mesh; Fitting module: used to fit the triangular mesh in the triangular finite element mesh into several primitives; Annotation module: used to determine an editable target area among multiple graphics elements to be rendered and to determine the editing status of the graphics elements in the target area; Rendering module: used to create a buffer object based on the editable triangle mesh through OpenGL, share the buffer object with OpenGL using OpenCL API functions, process and render the editable triangle mesh through OpenCL, output pixel color values, and pass them to OpenGL; Visualization module: Outputs renderable data through OpenGL for 3D visualization.

Images