Interactive naked eye 3D measurement system, method and device, electronic device and storage medium

Abstract

The invention discloses an interactive naked-eye 3D measurement system, method and device, an electronic device and a storage medium. The interactive naked-eye 3D measurement system comprises a data reading module, an image preprocessing module, a 3D image visualization module, a 3D interaction module and a 3D space object measurement module. The data reading module is used for identifying and reading set image data; the image preprocessing module is used for carrying out image filtering and denoising operation on the image data; the 3D image visualization module is used for performing 3D reconstruction and visualization processing on the preprocessed image; the 3D interaction module is used for performing interaction or / and rotation or / and pickup operation on the visual 3D data; the 3D space object measuring module is used for measuring and calculating the distance between two points of an object in the space. According to the interactive naked-eye 3D measurement system, method and equipment, the electronic equipment and the storage medium, 3D measurement and naked-eye 3D display of medical data can be efficiently, accurately and visually completed.

Description

Technical Field

[0001] The present invention belongs to the field of measurement technology and relates to a 3D measurement system, and in particular to an interactive naked-eye 3D measurement system, method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of industrial manufacturing, quality control, biomedicine and other fields, the demand for high-precision measurement technology is also increasing. Traditional measurement methods such as calipers and micrometers can no longer meet the high-precision and high-efficiency measurement needs, and cannot intuitively display the three-dimensional shape of the measured object. 3D measurement and display technology can quickly and accurately obtain the three-dimensional data of objects, and can comprehensively and meticulously display the shape and structure of objects. It is a more accurate and reliable measurement method.

[0003] In the biomedical field, 3D measurement technology is also widely used in human morphology measurement, surgical navigation, medical image analysis, etc. The morphology of biological tissue is the most complex among three-dimensional objects, so three-dimensional measurement of it has extremely important practical significance in the medical field. For example, in plastic surgery, 3D measurement technology can accurately measure and evaluate the facial features of patients, providing more accurate surgical plans and treatment effect evaluation for plastic surgery. In neurosurgery, it can help doctors obtain accurate information about the lesion site more efficiently, while improving the success rate of surgery and reducing surgical time and patient trauma.

[0004] However, traditional measurement technology is inefficient, easily affected by environmental and human factors, and it is difficult to intuitively display the three-dimensional shape of objects; in addition, traditional measurement methods cannot accurately and visually complete the 3D measurement of medical data.

[0005] In view of this, there is an urgent need to design a new 3D measurement system to overcome at least some of the above-mentioned defects of the existing 3D measurement. Summary of the invention

[0006] The present invention provides an interactive naked-eye 3D measurement system, method, device, electronic device and storage medium, which can efficiently, accurately and visually complete 3D measurement and naked-eye 3D display of medical data.

[0007] To solve the above technical problem, according to one aspect of the present invention, the following technical solution is adopted:

[0008] An interactive naked-eye 3D measurement system, the interactive naked-eye 3D measurement system comprising:

[0009] A data reading module, used to identify and read set image data;

[0010] An image preprocessing module is used to perform image filtering and denoising operations on image data;

[0011] 3D image visualization module, used to perform 3D reconstruction and visualization on pre-processed images;

[0012] A 3D interaction module, used to perform interaction and / or rotation and / or picking operations on the visualized 3D data;

[0013] The 3D space object measurement module is used to measure and calculate the distance between two points of an object in space.

[0014] As an implementation mode of the present invention, the data reading module is used to automatically identify the input medical data type and parse and read the data.

[0015] The image preprocessing module is used to perform image filtering operations on the read data to remove noise in the image and improve the accuracy of 3D reconstruction and measurement.

[0016] The 3D image visualization module is used to perform 3D reconstruction on the image preprocessed data and output and display it in a 3D display format.

[0017] The 3D interactive module is used to use interactive rotation and interactive picking technology to perform rotation and picking operations on the visualized 3D data.

[0018] The 3D space object measurement module is used to calculate the distance between any two points in the space object using 3D interactive technology for visualized 3D data, and output accurate results.

[0019] As an implementation mode of the present invention, in the data reading step, the input DICOM type medical data is automatically identified and read;

[0020] In the image preprocessing step, an image filtering operation is performed on the read medical data. Image preprocessing is an important part of medical image processing and analysis. By image filtering, the noise introduced in the acquisition process of the medical image is removed, and the accuracy of 3D reconstruction and measurement is further improved. The data is filtered using an adaptive median filtering algorithm. The algorithm dynamically adjusts the window size of the median filter according to preset conditions, and maximizes the retention of detail information contained in the medical image while removing image noise.

[0021] In the 3D image visualization step, the preprocessed medical image is 3D reconstructed and displayed in a naked-eye 3D format, and the 3D reconstruction result is output in a naked-eye 3D format.

[0022] As an embodiment of the present invention, in the 3D interaction step, in the naked eye 3D display mode, 3D interactive rotation technology and 3D picking technology are adopted, and the conversion relationship between the 3D model world coordinate system and the naked eye 3D display device coordinate system is utilized, combined with external input devices such as keyboard keys or mouse movement, rotation and clicking, to complete the movement or interactive rotation of the 3D reconstruction result at any angle and interactive picking operations;

[0023] In the 3D space object measurement step, in the naked eye 3D display mode, by combining 3D interactive technology, the measurement start and end points are selected by clicking the mouse to complete the distance calculation between any two points of the 3D model in the space; the Euclidean distance is used to describe the distance between any two points in the space. The formula is described as follows:

[0024]

[0025] Among them, (x1, y1, z1) and (x2, y2, z2) represent the coordinates of any two points in space, and Di s represents the spatial distance between the two points.

[0026] According to another aspect of the present invention, the following technical solution is adopted: an interactive naked-eye 3D measurement method, the interactive naked-eye 3D measurement method comprising:

[0027] Data reading step: identifying and reading image data;

[0028] Image preprocessing step: perform image filtering and denoising operations on the input data to improve image quality;

[0029] 3D image visualization step: 3D reconstruction and visualization of the preprocessed data;

[0030] 3D interaction step: interact and / or rotate and / or pick up the visualized 3D data;

[0031] 3D space object measurement steps: measure and calculate the distance between two points of an object in space.

[0032] As an implementation mode of the present invention, in the data reading step, the input DICOM type medical data is automatically identified and read;

[0033] In the image preprocessing step, an image filtering operation is performed on the read medical data. Image preprocessing is an important part of medical image processing and analysis. Image filtering is used to remove the noise introduced by the medical image during the acquisition process, further improving the accuracy of 3D reconstruction and measurement. An adaptive median filtering algorithm is used to filter the data. The algorithm dynamically adjusts the window size of the median filter according to preset conditions, thereby removing image noise while maximally retaining the detail information contained in the medical image.

[0034] As an embodiment of the present invention, in the 3D image visualization step, the preprocessed medical image is 3D reconstructed and displayed in a naked eye 3D format, and the 3D reconstruction result is output in a naked eye 3D format;

[0035] In the 3D interaction step, in the naked-eye 3D display mode, 3D interactive rotation technology and 3D picking technology are adopted, and the conversion relationship between the 3D model world coordinate system and the naked-eye 3D display device coordinate system is utilized, combined with external input devices such as keyboard keys or mouse movement, rotation and clicking, to complete the movement or interactive rotation of any angle and interactive picking operations on the 3D reconstruction results.

[0036] As an implementation mode of the present invention, in the 3D space object measurement step, in the naked eye 3D display mode, by combining 3D interactive technology, the measurement start and end points are selected by clicking the mouse to complete the distance calculation between any two points of the 3D model in the space; the Euclidean distance is used to describe the distance between any two points in the space. The formula is described as follows:

[0037]

[0038] Among them, (x1, y1, z1) and (x2, y2, z2) represent the coordinates of any two points in space, and Dis represents the spatial distance between the two points.

[0039] As an embodiment of the present invention, the 3D reconstruction (ray casting algorithm) in the 3D image visualization step includes:

[0040] (1) Emitting light: Starting from the viewpoint, emit a ray along the line of sight;

[0041] (2) Ray intersection detection: Determine whether the ray intersects with an object in the scene. If so, continue to propagate; otherwise, terminate the ray.

[0042] (3) Texture mapping: If the light intersects with an object, the texture image is mapped to the corresponding area on the surface of the object according to the texture mapping technology;

[0043] (4) Lighting calculation: Calculate the color value in the direction of light according to the principles of physical optics;

[0044] (5) Depth buffer: During the light propagation process, the depth buffer is used to record the depth value of the pixel to facilitate the realization of shadow effects;

[0045] (6) Composite image: Finally, all rendered light rays are combined into a complete image.

[0046] Finally, the 3D reconstruction results are output in 3D format (left-right format), and a reasonable parallax between the left and right views is set, and the final results are visualized on a naked-eye 3D screen.

[0047] According to another aspect of the present invention, the following technical solution is adopted: an electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.

[0048] According to another aspect of the present invention, the following technical solution is adopted: a storage medium stores computer program instructions, and the computer program instructions implement the steps of the above method when executed by a processor.

[0049] The beneficial effects of the present invention are as follows: the interactive naked-eye 3D measurement system, method, device, electronic device and storage medium proposed in the present invention can efficiently, accurately and visually complete the 3D measurement and naked-eye 3D display of medical data.

[0050] Naked-eye 3D technology is a display technology that can achieve stereoscopic visual effects without the need for external equipment, which can bring more realistic, vivid and stereoscopic visual effects. Combining naked-eye 3D technology with 3D measurement technology has important application scenarios in medical fields including surgical navigation, imaging diagnosis, medical training, etc. It can significantly improve doctors' clinical imaging diagnosis and analysis experience and provide doctors with more accurate information reference.

[0051] The present invention can combine naked-eye 3D technology with 3D measurement technology, so that the real 3D measurement effect can be viewed in real time without wearing any auxiliary equipment, which can bring better-quality and more efficient medical services and experience to doctors and patients.

[0052] The present invention improves the measurement accuracy of biological tissues in the medical field, improves the clinical diagnosis efficiency of doctors and the medical service experience of patients. By combining naked-eye 3D technology with 3D measurement technology, the present invention can largely solve the problem that traditional measurement methods cannot complete 3D measurement of medical data efficiently, accurately and visually, so as to assist doctors in conducting more comprehensive and intuitive clinical diagnosis and analysis and improve patients' medical experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 Schematic diagram of the composition of an interactive naked-eye 3D measurement system in one embodiment of the present invention.

[0054] Figure 2 Flow chart of interactive naked-eye 3D measurement in one embodiment of the present invention.

[0055] Figure 3 The figure is a flow chart of an adaptive median filtering algorithm in one embodiment of the present invention.

[0056] Figure 4 FIG. 4 is a schematic diagram of a ray casting algorithm in one embodiment of the present invention.

[0057] Figure 5 FIG. 4 is a flow chart of a three-dimensional volume rendering algorithm in one embodiment of the present invention.

[0058] Figure 6 Schematic diagram of a binocular virtual camera setting method in one embodiment of the present invention.

[0059] Figure 7 Schematic diagram of the composition of an interactive naked-eye 3D measurement device in one embodiment of the present invention.

[0060] Figure 8 FIG. 4 is a schematic diagram of the composition of an electronic device in one embodiment of the present invention. DETAILED DESCRIPTION

[0061] The preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0062] In order to further understand the present invention, preferred embodiments of the present invention are described below in conjunction with examples. However, it should be understood that these descriptions are only for further illustrating the features and advantages of the present invention, rather than limiting the claims of the present invention.

[0063] The description in this section is only for several typical embodiments, and the present invention is not limited to the scope of the embodiments. The same or similar prior art means and some technical features in the embodiments are mutually replaced within the scope of the present invention.

[0064] The description of the steps in each embodiment in the specification is only for the convenience of explanation, and the implementation method of the present application is not limited by the order of implementation of the steps.

[0065] The term “connection” in the specification includes both direct connection and indirect connection.

[0066] The present invention discloses an interactive naked-eye 3D measurement system. Figure 1 FIG. 1 is a schematic diagram of the composition of an interactive naked-eye 3D measurement system according to an embodiment of the present invention; please refer to FIG. Figure 1 The interactive naked-eye 3D measurement system includes: a data reading module 1, an image preprocessing module 2, a 3D image visualization module 3, a 3D interaction module 4 and a 3D space object measurement module 5.

[0067] The data reading module 1 is used to identify and read the set image data. In one embodiment of the present invention, the data reading module 1 is used to automatically identify the input medical data type and parse and read the data. The data reading module 1 can automatically identify and read the input DICOM type medical data (including but not limited to X-ray, computed tomography (CT), magnetic resonance imaging (MRI) and ultrasound, etc.), and the DICOM data type can be raw data without compression processing (including but not limited to Implicit VR Little Endian, Explicit VR Little Endian, Explicit VR Big Endian, etc.); it can also be data processed by lossless compression (including but not limited to JPEG Lossless, JPEG 2000, RLE Loss less, ImageCompression, etc.); it can also be data processed by lossy compression processing (including but not limited to Defau lt Transfer Syntax for Lossy, JPEG 12Bit Image Compression, LOSSY (8bit), MPEG2 image Compression, etc.).

[0068] The image preprocessing module 2 is used to perform image filtering and denoising operations on the image data; in one embodiment of the present invention, the image preprocessing module 2 can perform image filtering operations on the read medical data. Image preprocessing is an important part of medical image processing and analysis. Through image filtering, the noise introduced by the medical image during the acquisition process can be removed, and the accuracy of 3D reconstruction and measurement can be further improved. In this example, an adaptive median filtering algorithm is used to filter the data. The adaptive median filtering algorithm dynamically adjusts the window size of the median filter according to preset conditions, which can maximize the retention of detail information contained in the image while removing image noise. When the pixel at the center point of the filter window is noise, it is replaced by the gray median of the neighborhood, otherwise the current pixel value is not changed. The adaptive median filter can process impulse noise with a higher noise probability, smooth non-impulse noise, and at the same time better maintain image details and avoid image edge blur.

[0069] like Figure 3 As shown, specifically, after inputting the image, define S xy is a rectangular subwindow centered at point (x, y) with a size of m*n (in this case, m*n is 5*5), i.e., the initial filtering window. The filter is at S xy Operate within the range. min , Z max , Z med S xyThe minimum grayscale value, maximum grayscale value and median grayscale value in Z xy is the gray value of point (x, y); S max is the maximum filtering window size. The method consists of two parts: step A and step B.

[0070] Step A: A1 = Z med -Z min , A2=Z med -Z max , if A1>0 and A2<0, then jump to step B; otherwise, increase the window size; if the increased size ≤ S max , then repeat A; otherwise, output Z med .

[0071] Step B: B1 = Z xy -Z min , B2=Z xy -Z max , if B1>0 and B2<0, then output Z xy ; Otherwise, output Z med .

[0072] After this step, the preprocessed image data is finally output. This method can remove the noise contained in the input data to the maximum extent and avoid edge blurring, thereby maximizing the retention of information contained in the image, restoring image details, and further improving the accuracy of subsequent 3D reconstruction and 3D measurement.

[0073] The 3D image visualization module 3 is used to perform 3D reconstruction and visualization processing on the preprocessed image; in one embodiment of the present invention, the 3D image visualization module 3 is used to perform 3D reconstruction on the image preprocessed data, and output and display it in a 3D display format. The 3D image visualization module can perform 3D reconstruction on the preprocessed medical image and display it in a naked eye 3D format. The 3D reconstruction method adopted is volume rendering technology, which includes but is not limited to direct volume rendering technology (Direct Volume Rendering, DVR), indirect volume rendering technology (Indirect Volume Rendering, IVR) and maximum density projection (Maximum Intensity Projection, MI R); wherein the direct volume rendering technology includes but is not limited to ray casting algorithm (Ray Casting), snowball throwing method (Splatting), shear-warp algorithm (Shear-warp), etc. Finally, the 3D reconstruction result is output in a naked eye 3D format, and the naked eye 3D format adopted in this example is a side-by-side format (Side-by-Side).

[0074] In one embodiment, direct volume rendering technology, namely ray casting algorithm, is used to perform 3D reconstruction on the pre-processed image data. Figure 4 As shown in the figure, the algorithm emits a ray from each pixel of the image along a fixed direction (usually the direction of sight), and the ray passes through the entire image sequence. In this process, the image sequence is sampled to obtain color information, and the color value is accumulated according to the light absorption model until the ray passes through the entire image sequence. The final color value is the color of the rendered image. The specific process of the algorithm is as follows Figure 5 As shown, the basic steps are as follows:

[0075] (1) Emitting light: Starting from the viewpoint, emit a ray along the line of sight.

[0076] (2) Ray intersection detection: Determine whether the ray intersects with an object in the scene. If so, the ray continues to propagate; otherwise, the ray is terminated.

[0077] (3) Texture mapping: If the light intersects with an object, the texture image is mapped to the corresponding area on the object's surface based on texture mapping technology.

[0078] (4) Lighting calculation: Based on the principles of physical optics, calculate the color value in the direction of the light.

[0079] (5) Depth buffer: During the light propagation process, the depth buffer is used to record the depth value of the pixel to facilitate the realization of shadow effects.

[0080] (6) Composite image: Finally, all rendered light rays are combined into a complete image.

[0081] The 3D reconstruction result is output in naked-eye 3D format. In this example, a virtual binocular camera is set up to display the 3D reconstruction result in a side-by-side format, that is, the width of the picture remains unchanged, the length becomes 1 / 2 of the original, and the left and right images have relative parallax.

[0082] like Figure 6 As shown, in this embodiment, EyeAngle is used to control the disparity value of the output image. EyeAngle is the angle between the virtual binocular camera and the center of the model in three-dimensional space, which is used to simulate the angle value of the separation of human eyes, thereby forming a 3D reconstruction result with parallax. In this example, EyeAngle is set to 5 degrees, and finally the image is rendered in combination with the OpenGL graphics library.

[0083] The rendered content is output to the naked-eye 3D display device for real-time display. The naked-eye 3D device is responsible for processing the input 3D format content through an algorithm and displaying it in real-time in the form of naked-eye 3D. Users can experience realistic and three-dimensional 3D effects without wearing any auxiliary equipment, and have a good sense of immersion.

[0084] The 3D interaction module 4 is used to perform interaction and / or rotation and / or picking operations on the visualized 3D data; in one embodiment of the present invention, the 3D interaction module 4 is used to use interactive rotation and interactive picking techniques to rotate and pick up the visualized 3D data. The 3D interaction module 4 is used to use 3D interactive rotation technology and 3D picking technology in the naked eye 3D display mode, combined with hardware devices such as a mouse, through mouse movement, rotation and clicking, etc., using the conversion relationship between the 3D model world coordinate system and the naked eye 3D display device coordinate system, to complete the interactive rotation and interactive picking operations of any angle of the 3D reconstruction result, so as to meet the user's observation of the measured object from any spatial position.

[0085] In one embodiment, the selection of any model in the space can be completed by clicking the mouse; the rotation of any angle around the X, Y, Z axis or the center of the object and the translation in any direction can be completed by the mouse and keyboard; the scaling of the object can be completed by scrolling the mouse wheel or clicking and holding the right button of the mouse to drag.

[0086] The 3D space object measurement module 5 is used to measure and calculate the distance between two points of an object in space; in one embodiment of the present invention, the 3D space object measurement module 5 is used to use 3D interactive technology to calculate the distance between any two points in the space object for visualized 3D data, and output accurate results. The 3D space object measurement module 5 is used in the naked eye 3D display mode, by combining 3D interactive technology, using mouse clicks to select the measurement start and end points, to complete the distance calculation between any two points of the 3D model in space. In this example, the Euclidean distance is used to describe the distance between any two points in space. The formula is described as follows:

[0087]

[0088] Among them, (x1, y1, z1) and (x2, y2, z2) represent the coordinates of any two points in space, and Dis represents the spatial distance between the two points.

[0089] In the measurement mode, first select the object to be measured by clicking the mouse, and select the measurement start point and measurement end point. At this time, the spatial position coordinates of the two points will be displayed, and the spatial straight-line distance between the two points will be output and displayed in millimeters (mm).

[0090] The present invention discloses an interactive naked-eye 3D measurement device. Figure 7FIG. 1 is a schematic diagram of the composition of an interactive naked-eye 3D measurement device according to an embodiment of the present invention; please refer to FIG. Figure 7 In one usage scenario of the present invention, the interactive naked-eye 3D measurement device includes a naked-eye 3D display device and an interactive 3D measurement system; the naked-eye 3D display device includes a naked-eye 3D display screen and a computer host, and the composition of the interactive 3D measurement system can be seen in the above description.

[0091] The present invention further discloses an interactive naked-eye 3D measurement method, Figure 2 This is a flow chart of an interactive naked-eye 3D measurement method according to an embodiment of the present invention; the interactive naked-eye 3D measurement method comprises:

[0092] [Step S1] Data reading step: identifying and reading set image data;

[0093] In one embodiment of the present invention, in the data reading step, the input DICOM type medical data (including but not limited to X-ray, computed tomography (CT), magnetic resonance imaging (MRI) and ultrasound, etc.) is automatically identified and read, and the DICOM data type can be raw data without compression processing (including but not limited to Implicit VR Little Endian, Explicit VR Little Endian, Explicit VR Big Endian, etc.); it can also be data after lossless compression processing (including but not limited to JPEG Loss less, JPEG 2000, RLE Loss less, Image Compression, etc.); it can also be data after lossy compression processing (including but not limited to Defau ltTransfer Syntax for Lossy, JPEG 12Bit Image Compression, LOSSY (8bit), MPEG2image Compression, etc.);

[0094] [Step S2] Image preprocessing step: performing image filtering and denoising operations on the input data to improve image quality;

[0095] In one embodiment of the present invention, in the image preprocessing step, an image filtering operation is performed on the read medical data. Image preprocessing is an important part of medical image processing and analysis. Image filtering is used to remove the noise introduced by the medical image during the acquisition process, thereby further improving the accuracy of 3D reconstruction and measurement. In this example, an adaptive median filtering algorithm is used to filter the data. The adaptive median filtering algorithm dynamically adjusts the window size of the median filter according to preset conditions, thereby removing image noise while maximizing the retention of detail information contained in the medical image.

[0096] like Figure 3 As shown, after inputting the image, define S xy is a rectangular subwindow centered at point (x, y) with a size of m*n (in this case, m*n is 5*5), i.e., the initial filtering window. The filter is at S xy Operate within the range. min , Z max , Z med S xy The minimum grayscale value, maximum grayscale value and median grayscale value in Z xy is the gray value of point (x, y); S max is the maximum filtering window size. The method consists of two parts: step A and step B.

[0097] Step A: A1 = Z med -Z min , A2=Z med -Z max , if A1>0 and A2<0, then jump to step B; otherwise, increase the window size; if the increased size ≤ S max , then repeat A; otherwise, output Z med .

[0098] Step B: B1 = Z xy -Z min , B2=Z xy -Z max , if B1>0 and B2<0, then output Z xy ; Otherwise, output Z med .

[0099] [Step S3] 3D image visualization step: 3D reconstruction and visualization of the preprocessed data;

[0100] In one embodiment of the present invention, in the 3D image visualization step, the preprocessed medical image is 3D reconstructed and displayed in a naked-eye 3D format; the 3D reconstruction method adopted is volume rendering technology, which includes but is not limited to direct volume rendering technology (Direct Volume Rendering, DVR), indirect volume rendering technology (Indirect Volume Rendering, IVR) and maximum density projection (Maximum Intensity Projection, MIR); wherein the direct volume rendering technology includes but is not limited to ray casting algorithm (Ray Casting), snowballing method (Splatting), shear-warp algorithm (Shear-warp), etc.; finally, the 3D reconstruction result is output in a naked-eye 3D format, and the naked-eye 3D format adopted in this example is the side-by-side format (Side-by-Side).

[0101] In one embodiment, a direct volume rendering technique, namely ray casting algorithm, is used to perform 3D reconstruction on the pre-processed image data. Figure 4 As shown in the figure, the algorithm emits a ray from each pixel of the image along a fixed direction (usually the direction of sight), and the ray passes through the entire image sequence. In this process, the image sequence is sampled to obtain color information, and the color value is accumulated according to the light absorption model until the ray passes through the entire image sequence. The final color value is the color of the rendered image. The specific process of the algorithm is as follows Figure 5 As shown, the basic steps are as follows:

[0102] (1) Emitting light: Starting from the viewpoint, emit a ray along the line of sight.

[0103] (2) Ray intersection detection: Determine whether the ray intersects with an object in the scene. If so, the ray continues to propagate; otherwise, the ray is terminated.

[0104] (3) Texture mapping: If the light intersects with an object, the texture image is mapped to the corresponding area on the object's surface based on texture mapping technology.

[0105] (4) Lighting calculation: Based on the principles of physical optics, calculate the color value in the direction of the light.

[0106] (5) Depth buffer: During the light propagation process, the depth buffer is used to record the depth value of the pixel to facilitate the realization of shadow effects.

[0107] (6) Composite image: Finally, all rendered light rays are combined into a complete image.

[0108] The 3D reconstruction result is output in naked-eye 3D format. In this example, a virtual binocular camera is set up to display the 3D reconstruction result in a side-by-side format, that is, the width of the picture remains unchanged, the length becomes 1 / 2 of the original, and the left and right images have relative parallax.

[0109] like Figure 6 As shown, in this embodiment, EyeAngle is used to control the disparity value of the output image. EyeAngle is the angle between the virtual binocular camera and the center of the model in three-dimensional space, which is used to simulate the angle value of the separation of human eyes, thereby forming a 3D reconstruction result with parallax. In this example, EyeAngle is set to 5 degrees, and finally the image is rendered in combination with the OpenGL graphics library.

[0110] The rendered content is output to the naked-eye 3D display device for real-time display. The naked-eye 3D device is responsible for processing the input 3D format content through an algorithm and displaying it in real-time in the form of naked-eye 3D. Users can experience realistic and three-dimensional 3D effects without wearing any auxiliary equipment, and have a good sense of immersion.

[0111] [Step S4] 3D interaction step: interacting, rotating and picking up the visualized 3D data;

[0112] In one embodiment of the present invention, in the 3D interaction step, in the naked-eye 3D display mode, 3D interactive rotation technology and 3D picking technology are used, combined with hardware devices such as a mouse, through keyboard keys and / or mouse movement, rotation and clicking, etc., using the conversion relationship between the 3D model world coordinate system and the naked-eye 3D display device coordinate system, to complete the movement or interactive rotation of any angle and interactive picking operations on the 3D reconstruction results.

[0113] [Step S5] 3D space object measurement step: measuring and calculating the distance between two points of an object in space.

[0114] In one embodiment of the present invention, in the 3D space object measurement step, in the naked eye 3D display mode, by combining 3D interactive technology, the measurement start and end points are selected by clicking the mouse to complete the distance calculation between any two points of the 3D model in the space; the Euclidean distance is used to describe the distance between any two points in the space. The formula is described as follows:

[0115]

[0116] Among them, (x1, y1, z1) and (x2, y2, z2) represent the coordinates of any two points in space, and Dis represents the spatial distance between the two points.

[0117] The present invention also discloses an electronic device, Figure 8FIG. 1 is a schematic diagram of the composition of an electronic device in an embodiment of the present invention; please refer to FIG. Figure 8 At the hardware level, the electronic device includes a memory, a processor and at least one network interface; the processor may be a microprocessor, and the memory may include a memory, such as a random access memory (RAM), or a non-volatile memory (non-volatile memory), etc. Of course, the electronic device may also be provided with other hardware as required.

[0118] The processor, network interface and memory may be interconnected via an internal bus, which may be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus may include an address bus, a data bus, a control bus, etc. The memory is used to store programs (which may include operating system programs and application programs); the program may include program code, which may include computer operation instructions. The memory may include internal memory and non-volatile memory, and provides instructions and data to the processor.

[0119] In one embodiment, the processor can read the corresponding program from the non-volatile memory into the memory and then run it; the processor can execute the program stored in the memory and is specifically used to perform the following operations (such as Figure 2 shown):

[0120] [Step S1] Data reading step: identifying and reading set image data;

[0121] [Step S2] Image preprocessing step: performing image filtering and denoising operations on the input data to improve image quality;

[0122] [Step S3] 3D image visualization step: 3D reconstruction and visualization of the preprocessed data;

[0123] [Step S4] 3D interaction step: interacting, rotating and picking up the visualized 3D data;

[0124] [Step S5] 3D space object measurement step: measuring and calculating the distance between two points of an object in space.

[0125] The present invention further discloses a storage medium having computer program instructions stored thereon, which, when executed by a processor, implements the following steps of the method of the present invention (eg Figure 2 shown):

[0126] [Step S1] Data reading step: identifying and reading set image data;

[0127] [Step S2] Image preprocessing step: performing image filtering and denoising operations on the input data to improve image quality;

[0128] [Step S3] 3D image visualization step: 3D reconstruction and visualization of the preprocessed data;

[0129] [Step S4] 3D interaction step: interacting, rotating and picking up the visualized 3D data;

[0130] [Step S5] 3D space object measurement step: measuring and calculating the distance between two points of an object in space.

[0131] In summary, the interactive naked-eye 3D measurement system, method, device, electronic device and storage medium proposed in the present invention can efficiently, accurately and visually complete the 3D measurement and naked-eye 3D display of medical data.

[0132] Naked-eye 3D technology is a display technology that can achieve stereoscopic visual effects without the need for external equipment, which can bring more realistic, vivid and stereoscopic visual effects. Combining naked-eye 3D technology with 3D measurement technology has important application scenarios in medical fields including surgical navigation, imaging diagnosis, medical training, etc. It can significantly improve doctors' clinical imaging diagnosis and analysis experience and provide doctors with more accurate information reference.

[0133] The present invention can combine naked-eye 3D technology with 3D measurement technology, so that the real 3D measurement effect can be viewed in real time without wearing any auxiliary equipment, which can bring better-quality and more efficient medical services and experience to doctors and patients.

[0134] The present invention can improve the measurement accuracy of biological tissues in the medical field, enhance the efficiency of doctors' clinical diagnosis and the medical service experience of patients. By combining naked-eye 3D technology with 3D measurement technology, the present invention can largely solve the problem that traditional measurement methods cannot complete 3D measurement of medical data efficiently, accurately and visually, so as to assist doctors in conducting more comprehensive and intuitive clinical diagnosis and analysis and enhance patients' medical experience.

[0135] It should be noted that the present application can be implemented in software and / or a combination of software and hardware; for example, it can be implemented using an application-specific integrated circuit (ASIC), a general-purpose computer, or any other similar hardware device. In some embodiments, the software program of the present application can be executed by a processor to implement the above steps or functions. Similarly, the software program of the present application (including related data structures) can be stored in a computer-readable recording medium; for example, a RAM memory, a magnetic or optical drive or a floppy disk and the like. In addition, some steps or functions of the present application can be implemented in hardware; for example, as a circuit that cooperates with a processor to perform various steps or functions.

[0136] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0137] The description and application of the present invention here are illustrative, and it is not intended to limit the scope of the present invention to the above-mentioned embodiments. The effects or advantages involved in the embodiments may not be embodied in the embodiments due to interference from various factors, and the description of the effects or advantages is not used to limit the embodiments. The deformation and change of the embodiments disclosed here are possible, and the replacement of the embodiments and the various equivalent parts are well known to those of ordinary skill in the art. It should be clear to those skilled in the art that the present invention can be implemented in other forms, structures, arrangements, proportions, and with other components, materials and parts without departing from the spirit or essential features of the present invention. Other deformations and changes can be made to the embodiments disclosed here without departing from the scope and spirit of the present invention.

Claims

1. An interactive naked-eye 3D measurement system, characterized in that: The interactive naked-eye 3D measurement system comprises: A data reading module, used to identify and read set image data; An image preprocessing module is used to perform image filtering and denoising operations on image data; 3D image visualization module, used to perform 3D reconstruction and visualization on pre-processed images; A 3D interaction module, used to perform interaction and / or rotation and / or picking operations on the visualized 3D data; The 3D space object measurement module is used to measure and calculate the distance between two points of an object in space.

2. The interactive naked-eye 3D measurement system according to claim 1, characterized in that: The data reading module is used to automatically identify the type of medical data input and parse and read the data. The image preprocessing module is used to perform image filtering operations on the read data to remove noise in the image and improve the accuracy of 3D reconstruction and measurement. The 3D image visualization module is used to perform 3D reconstruction on the image preprocessed data and output and display it in a 3D display format. The 3D interactive module is used to use interactive rotation and interactive picking technology to perform rotation and picking operations on the visualized 3D data. The 3D space object measurement module is used to calculate the distance between any two points in the space object using 3D interactive technology for visualized 3D data, and output accurate results.

3. The interactive naked-eye 3D measurement system according to claim 1, characterized in that: In the data reading step, the input DICOM type medical data is automatically identified and read; In the image preprocessing step, an image filtering operation is performed on the read medical data. Image preprocessing is an important part of medical image processing and analysis. By image filtering, the noise introduced in the acquisition process of the medical image is removed, and the accuracy of 3D reconstruction and measurement is further improved. The data is filtered by an adaptive median filtering algorithm. The adaptive median filtering algorithm dynamically adjusts the window size of the median filter according to preset conditions, and maximizes the retention of detail information contained in the image while removing image noise. In the 3D image visualization step, the preprocessed medical image is 3D reconstructed and displayed in a naked-eye 3D format, and the 3D reconstruction result is output in a naked-eye 3D format.

4. The interactive naked-eye 3D measurement system according to claim 1, characterized in that: In the 3D interaction step, in the naked-eye 3D display mode, 3D interactive rotation technology and 3D picking technology are used, combined with an external input device, by moving, rotating and clicking the mouse, and utilizing the conversion relationship between the 3D model world coordinate system and the naked-eye 3D display device coordinate system, to complete interactive rotation and interactive picking operations of any angle of the 3D reconstruction result; In the 3D space object measurement step, in the naked eye 3D display mode, by combining 3D interactive technology, the measurement start and end points are selected by clicking the mouse to complete the distance calculation between any two points of the 3D model in the space; the Euclidean distance is used to describe the distance between any two points in the space. The formula is described as follows: Among them, (x1, y1, z1) and (x2, y2, z2) represent the coordinates of any two points in space, and Dis represents the spatial distance between the two points.

5. An interactive naked-eye 3D measurement method, characterized in that: The interactive naked-eye 3D measurement method comprises: Data reading step: identifying and reading image data; Image preprocessing step: perform image filtering and denoising operations on the input data to improve image quality; 3D image visualization step: 3D reconstruction and visualization of the preprocessed data; 3D interaction step: interact and / or rotate and / or pick up the visualized 3D data; 3D space object measurement steps: measure and calculate the distance between two points of an object in space.

6. The interactive naked-eye 3D measurement method according to claim 5, characterized in that: In the data reading step, the input DICOM type medical data is automatically identified and read; In the image preprocessing step, an image filtering operation is performed on the read medical data. Image preprocessing is an important part of medical image processing and analysis. By image filtering, the noise introduced in the acquisition process of the medical image is removed, and the accuracy of 3D reconstruction and measurement is further improved. The data is filtered using an adaptive median filtering algorithm. The algorithm dynamically adjusts the window size of the median filter according to preset conditions, and maximizes the retention of detail information contained in the medical image while removing image noise. In the 3D image visualization step, the preprocessed medical image is 3D reconstructed, and the 3D reconstruction result is output in a naked eye 3D format; In the 3D interaction step, in the naked-eye 3D display mode, 3D interactive rotation and 3D interactive picking technologies are adopted, and the conversion relationship between the 3D model world coordinate system and the naked-eye 3D display device coordinate system is utilized, combined with the keyboard keys and / or mouse movement, rotation and click of the external input device, to complete the movement or interactive rotation and interactive picking operations of the 3D reconstruction result at any angle; In the 3D space object measurement step, in the naked eye 3D display mode, by combining 3D interactive technology, the measurement start and end points are selected by clicking the mouse to complete the distance calculation between any two points of the 3D model in the space; the Euclidean distance is used to describe the distance between any two points in the space. The formula is described as follows: Among them, (x1, y1, z1) and (x2, y2, z2) represent the coordinates of any two points in space, and Dis represents the spatial distance between the two points.

7. The interactive naked-eye 3D measurement method according to claim 5, characterized in that: The 3D reconstruction in the 3D image visualization step includes: (1) Emitting light: Starting from the viewpoint, emit a ray along the line of sight; (2) Ray intersection detection: Determine whether the ray intersects with an object in the scene. If so, continue to propagate; otherwise, terminate the ray. (3) Texture mapping: If the light intersects with an object, the texture image is mapped to the corresponding area on the surface of the object according to the texture mapping technology; (4) Lighting calculation: Calculate the color value in the direction of light according to the principles of physical optics; (5) Depth buffer: During the light propagation process, the depth buffer is used to record the depth value of the pixel to facilitate the realization of shadow effects; (6) Composite image: Finally, all rendered light rays are combined into a complete image. Finally, the 3D reconstruction results are output in 3D format, and a reasonable parallax between the left and right views is set, and the final results are visualized on a naked-eye 3D screen.

8. An interactive naked-eye 3D measurement device, characterized in that: The interactive naked-eye 3D measurement device comprises a naked-eye 3D display device and the interactive 3D measurement system according to any one of claims 1 to 4.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 5 to 7 are implemented.

10. A storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the steps of the method according to any one of claims 5 to 7 are implemented.

Images