Tissue measurement device based on mixed reality
By constructing a three-dimensional tissue model and using a virtual cutting tool to cut the lesion, the problem of inaccurate lesion measurement in existing technologies has been solved, achieving more accurate lesion measurement and supporting more accurate disease diagnosis and treatment.
Patent Information
- Application Number
- CN202410484989.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-22
- Publication Date
- 2025-10-24
AI Technical Summary
Existing technologies are unable to accurately measure the entire lesion, which affects the accuracy of disease diagnosis and treatment.
By constructing a three-dimensional tissue model and cutting it using a virtual cutting tool, a partial tissue model including the lesion is obtained, and then measurements are taken to obtain accurate measurement results of the lesion.
It improves the accuracy of lesion measurement, provides more precise measurement results, and supports more accurate disease diagnosis and treatment.
Smart Images

Figure CN120833460A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of mixed reality, and particularly relates to a tissue measurement device based on mixed reality. BACKGROUND
[0002] A lesion is a part of the body where a pathological change occurs. For example, a part of a lung is destroyed by tubercle bacillus, and this part is a lesion of pulmonary tuberculosis. A localized pathological tissue with pathogenic microorganisms is called a lesion.
[0003] Lesion measurement is of great significance to patient health examination and subsequent diagnosis and treatment, and is related to the focus of diagnosis and treatment. With the development of medical imaging technology, three-dimensional image analysis is used to analyze the internal structure of an organ to determine whether there is a disease in the organ, which becomes an auxiliary means for disease diagnosis. In the prior art, CT technology is used to obtain lesion parameters to estimate and measure the lesion. However, the prior art cannot accurately measure the whole lesion. SUMMARY
[0004] Therefore, it is necessary to provide a tissue measurement device based on mixed reality to accurately measure the whole lesion.
[0005] In a first aspect, the present application provides a tissue measurement device, which comprises a virtual display unit, at least one processor and at least one memory. The virtual display unit is connected with the memory and the processor respectively. The memory stores executable instructions, and the processor executes the executable instructions to realize a tissue measurement method. The method comprises the following steps:
[0006] A three-dimensional tissue model is constructed according to tissue image data, and the virtual display unit is controlled to display the three-dimensional tissue model;
[0007] A virtual cutting tool is constructed to cut the three-dimensional tissue model to obtain a partial tissue model. The partial tissue model includes a lesion;
[0008] The partial tissue model is measured to obtain a measurement result of the lesion.
[0009] In one embodiment, the three-dimensional tissue model is constructed according to the tissue image data, which comprises the following steps:
[0010] A three-dimensional model file is obtained;
[0011] The three-dimensional model file is parsed and rendered to obtain a candidate three-dimensional model;
[0012] The candidate three-dimensional model is rendered according to the tissue image data to obtain the three-dimensional tissue model.
[0013] In one of the embodiments, the virtual cutting tool comprises a virtual cutting panel and a virtual pose controller; the virtual cutting tool cuts the three-dimensional tissue model to obtain a partial tissue model, comprising:
[0014] drawing the virtual cutting panel and the virtual pose controller;
[0015] adjusting the panel pose of the virtual cutting panel through the virtual pose controller to obtain a cutting position of the three-dimensional tissue model;
[0016] performing surface segmentation processing on the three-dimensional tissue model according to the cutting position to obtain the partial tissue model.
[0017] In one of the embodiments, the virtual pose controller comprises a rotation controller and a movement controller; adjusting the panel pose of the virtual cutting panel through the virtual pose controller to obtain a cutting position of the three-dimensional tissue model, comprising:
[0018] obtaining an operation position of the user operating the rotation controller and the movement controller;
[0019] adjusting the panel pose of the virtual cutting panel according to the operation position;
[0020] determining the panel pose as the cutting position of the three-dimensional tissue model.
[0021] In one of the embodiments, the measurement result comprises a distance measurement result and an angle measurement result; measuring the partial tissue model to obtain a measurement result of the lesion, comprising:
[0022] adding a collision body component to the partial tissue model;
[0023] adding a distance marker point and an angle marker point to the partial tissue model based on the collision body component;
[0024] determining the distance measurement result according to the distance marker point, and determining the angle measurement result according to the angle marker point.
[0025] In one of the embodiments, adding a distance marker point and an angle marker point to the partial tissue model based on the collision body component, comprising:
[0026] obtaining a distance hand input position and an angle hand input position of the user in the partial tissue model based on the collision body component;
[0027] in a case where it is detected that the user performs a preset interactive operation, adding a marker point to the distance hand input position and adding a marker point to the angle hand input position;
[0028] determining the marker point added to the distance hand input position as the distance marker point, and determining the marker point added to the angle hand input position as the angle marker point.
[0029] In one of the embodiments, the distance measurement result is determined according to the distance marker points, including:
[0030] Obtaining coordinate information of the distance marker points;
[0031] Determining a coordinate distance between the distance marker points as the distance measurement result.
[0032] In one of the embodiments, the angle measurement result is determined according to the angle marker points, including:
[0033] Obtaining coordinate information of the angle marker points;
[0034] Taking the angle marker point corresponding to the target measurement angle as a center point, determining an included angle value between the angle marker points according to the coordinate information of the angle marker points;
[0035] Determining the included angle value as the angle measurement result.
[0036] In one of the embodiments, the measurement result includes a surface area measurement result and a volume measurement result; the measurement result of the lesion is obtained by measuring the partial tissue model, including:
[0037] Taking the cutting surface of the partial tissue model as a symmetry surface, constructing a bounding box of the partial tissue model;
[0038] Determining the surface area measurement result and the volume measurement result according to the bounding box and a plurality of triangular facets of the partial tissue model.
[0039] In one of the embodiments, the surface area measurement result and the volume measurement result are determined according to the bounding box and the plurality of triangular facets of the partial tissue model, including:
[0040] Dividing the bounding box into a plurality of sub-bounding boxes with the longest side length of the plurality of triangular facets as a height;
[0041] Determining the surface area measurement result and the volume measurement result according to each sub-bounding box and the plurality of triangular facets.
[0042] In one of the embodiments, the surface area measurement result and the volume measurement result are determined according to each sub-bounding box and the plurality of triangular facets, including:
[0043] Removing candidate triangular facets in which a vertex is located in a sub-bounding box in which the cutting surface is located and intersects with the cutting surface;
[0044] Filling the cross section with the vertex of the candidate triangular facet to obtain a target triangular facet of the partial tissue model;
[0045] Determining the surface area measurement result and the volume measurement result according to the number of the target triangular facets and coordinate information of the target triangular facets.
[0046] In one embodiment, determining a surface area measurement result and a volume measurement result based on the number of target triangles and coordinate information of the target triangles includes:
[0047] Determine the side length of the target triangle according to the coordinate information of the target triangle;
[0048] Determine the surface area measurement based on the number and edge lengths of the target triangles;
[0049] The volume measurement result is determined according to the number of target triangles and the coordinate information of the vertices of the target triangles.
[0050] In a second aspect, an embodiment of the present application further provides a tissue measurement device, comprising:
[0051] A model display module is used to construct a three-dimensional tissue model based on tissue image data and control a virtual display unit to display the three-dimensional tissue model;
[0052] A model cutting module is used to construct a virtual cutting tool to cut the three-dimensional tissue model to obtain a partial tissue model; the partial tissue model includes a lesion;
[0053] The result determination module is used to measure part of the tissue model and obtain the measurement result of the lesion.
[0054] In a third aspect, embodiments of the present application further provide a computer device comprising a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of any embodiment of the first aspect.
[0055] In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any one of the embodiments of the first aspect above.
[0056] In a fifth aspect, embodiments of the present application further provide a computer program product, which includes a computer program that, when executed by a processor, implements the steps in any one of the embodiments of the first aspect.
[0057] The mixed reality based tissue measurement device constructs a three-dimensional tissue model according to the tissue image data, controls the virtual display unit to display the three-dimensional tissue model, and then constructs a virtual cutting tool to cut the three-dimensional tissue model to obtain a partial tissue model including a lesion, and then measures the partial tissue model to obtain a measurement result of the lesion. In this method, the three-dimensional tissue model constructed from the tissue image data is displayed in the virtual reality unit of the tissue measurement device, and then the virtual cutting tool is used to cut the three-dimensional tissue model to measure the lesion to obtain the measurement result of the lesion. This is equivalent to obtaining the three-dimensional tissue model by post-processing the tissue image data after obtaining the tissue image data, cutting the three-dimensional tissue model to obtain the partial tissue model including the lesion, and then measuring the lesion to obtain the measurement result of the lesion. Therefore, the lesion can be measured more accurately, and the accuracy of the measurement result of the lesion is improved. BRIEF DESCRIPTION OF DRAWINGS
[0058] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the drawings needed to be used in the embodiments or the related art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.
[0059] Figure 1 A flowchart of a tissue measurement method in an embodiment;
[0060] Figure 2 A schematic diagram of a three-dimensional tissue model of a liver in an embodiment;
[0061] Figure 3 A flowchart of obtaining a measurement result in an embodiment;
[0062] Figure 4 A flowchart of determining a measurement result in an embodiment;
[0063] Figure 5 A schematic diagram of a bounding box of a partial tissue model in an embodiment;
[0064] Figure 6 A schematic diagram of a triangular facet of a partial tissue model in an embodiment;
[0065] Figure 7 A flowchart of a tissue measurement method in another embodiment;
[0066] Figure 8 A structural schematic diagram of a tissue measurement device in an embodiment. DETAILED DESCRIPTION
[0067] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not intended to limit the present application.
[0068] Lesion, i.e. the part of the body where the lesion occurs. For example, a part of the lung is destroyed by tubercle bacillus, and this part is the lesion of pulmonary tuberculosis. A localized lesion tissue with pathogenic microorganisms is called a lesion.
[0069] In medical treatment, the lesion measurement function is a basic function requirement, and the lesion measurement is of great significance to the health examination and subsequent diagnosis and treatment of patients, and is related to the focus of the entire diagnosis and treatment.
[0070] With the development of medical imaging technology, the three-dimensional shape of the internal structure of the organ is analyzed by using a three-dimensional image analyzer to analyze and judge whether there is a disease in the organ, which becomes an auxiliary means for disease diagnosis. In the prior art, the lesion parameters are obtained by CT technology to estimate and measure the lesion, but the overall measurement of the lesion cannot be accurately performed in the prior art.
[0071] Based on this, the present application proposes a tissue measurement device, which displays a three-dimensional tissue model constructed by tissue image data in a virtual reality unit of the tissue measurement device, so that the three-dimensional tissue model can be cut using a virtual cutting tool and then the lesion is measured to obtain the measurement result of the lesion. After obtaining the tissue image data, the three-dimensional tissue model is obtained by post-processing the tissue image data, and the part of the tissue model including the lesion is obtained by cutting the three-dimensional tissue model, so that the lesion can be more accurately measured, and the accuracy of the lesion measurement result is improved.
[0072] It should be noted that the beneficial effects or technical problems solved by the embodiments of the present application are not limited to this, but also other implicit or related problems. For specific details, please refer to the description of the following embodiments.
[0073] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described again in some embodiments. The embodiments of the present application will be described below with reference to the drawings.
[0074] In an exemplary embodiment, as Figure 1As shown, a tissue measurement method is provided, which is described by taking a processor in a tissue measurement device as an example, wherein the tissue measurement device is a mixed reality device, including a virtual display unit, at least one processor and at least one memory, the virtual display unit is connected with the memory and the processor respectively, the memory stores executable instructions, and the processor executes the executable instructions to realize the tissue measurement method, which includes the following steps 201 to 203. Wherein:
[0075] S201, constructing a three-dimensional tissue model according to tissue image data, and controlling the virtual display unit to display the three-dimensional tissue model.
[0076] Wherein, the tissue image data is the image data of the tissue to be measured, and the tissue to be measured can be an organ of a patient, such as lung, liver, heart, stomach, etc. The image data can be obtained by image acquisition of the tissue to be measured by a medical imaging device, which can be CT, ultrasound and magnetic resonance, etc.
[0077] Optionally, before measurement, the medical imaging device can be used to image the tissue to be measured to obtain the tissue image data of the tissue to be measured. After the medical imaging device completes the acquisition, the tissue image data of the tissue to be measured can be stored in a medical image database. When it is necessary to construct a three-dimensional tissue model of the tissue to be measured, the server where the medical image database is located can be requested to obtain the tissue image data of the tissue to be measured.
[0078] The virtual display unit refers to a display that can provide images and video output of a virtual reality environment, so that the user can experience the existence of the virtual reality environment. Taking a mixed display device as a head-mounted glasses as an example, the virtual display unit therein can be two left and right lenses.
[0079] In one embodiment, constructing a three-dimensional tissue model according to tissue image data can include the following steps:
[0080] Step one, obtaining a three-dimensional model file.
[0081] Wherein, the three-dimensional model file refers to a file that can describe the shape, structure and appearance of a three-dimensional object, which is widely used in engineering, design, game development, virtual reality, etc. It is helpful to accurately simulate and display objects in the real world. Among them, the three-dimensional model file usually contains detailed geometric data, texture and material information, etc. so as to render and visualize in software. Taking a three-dimensional model file of liver organ as an example, the three-dimensional model file records the structure information and contour information of the liver, etc.
[0082] Exemplarily, in the mixed reality device, a preview button of the 3D model can be clicked using the hand input control provided by the mixed reality device, and the Unity rendering engine in the mixed reality device will request the three-dimensional model file from the server, and the server will pull the three-dimensional model file and send it upon receiving the request.
[0083] Step two, parse and render the three-dimensional model file to obtain a candidate three-dimensional model.
[0084] After obtaining the three-dimensional model file, the three-dimensional model file is parsed and rendered to obtain a candidate three-dimensional model.
[0085] Step three, render the candidate three-dimensional model according to the tissue image data to obtain a three-dimensional tissue model.
[0086] After the candidate three-dimensional model is rendered, the server saved tissue image data is requested, and then the candidate three-dimensional model is parsed and rendered according to the obtained tissue image data, so as to obtain a three-dimensional tissue model.
[0087] Further, a display instruction is sent to the virtual reality unit to display the three-dimensional tissue model.
[0088] S202, constructing a virtual cutting tool to cut the three-dimensional tissue model to obtain a partial tissue model; the partial tissue model includes a lesion.
[0089] In one embodiment, the virtual cutting tool includes a virtual cutting panel and a virtual pose controller, and constructing a virtual cutting tool to cut the three-dimensional tissue model to obtain a partial tissue model includes:
[0090] Step one, draw a virtual cutting panel and a virtual pose controller.
[0091] Step two, adjust the panel pose of the virtual cutting panel through the virtual pose controller to obtain a cutting position of the three-dimensional tissue model.
[0092] The virtual cutting panel is used to determine the cutting position of the three-dimensional tissue model. The virtual pose controller includes a rotation controller and a movement controller. As Figure 2 shown, it is a display of a three-dimensional tissue model of a liver in a mixed reality device. Wherein A is a rotation controller for controlling the rotation of the virtual cutting panel; B is a movement controller for controlling the movement of the virtual cutting panel along the normal direction of the virtual cutting panel; C is a virtual cutting panel.
[0093] The panel pose refers to the position and direction of the virtual cutting panel relative to the three-dimensional tissue model. When the user operates the virtual cutting panel by rotating the controller, the direction of the virtual cutting panel relative to the three-dimensional tissue model changes, and when the user operates the virtual cutting panel by moving the controller, the position of the virtual cutting panel relative to the three-dimensional tissue model changes.
[0094] The hand input control of the mixed reality device can provide a close-range detection, when the hand is close to the rotation controller A, the rotation controller A changes color, when the user rotates A, the virtual cutting panel C follows the hand rotation; when the hand is close to the movement controller B, the movement controller B changes color, when the user moves B, the virtual cutting panel C follows the hand movement along the normal direction of the virtual cutting panel C.
[0095] It can be understood that the user can operate the rotation controller A and the movement controller B through the close-range detection to adjust the panel pose of the virtual cutting panel C to obtain the cutting position of the three-dimensional tissue model.
[0096] For example, the operation position of the user operating the rotation controller and the movement controller can be obtained, and then the panel pose of the virtual cutting panel is adjusted according to the operation position, and then the panel pose is determined as the cutting position of the three-dimensional tissue model.
[0097] Step three, according to the cutting position, surface segmentation processing is performed on the three-dimensional tissue model to obtain a partial tissue model.
[0098] After confirming the cutting position of the three-dimensional tissue model, the user can click the Mesh segmentation button provided by the mixed reality device with the hand, that is, according to the cutting position, surface segmentation processing is performed on the three-dimensional tissue model, and then Unity can render two models after segmentation, one of which is a partial tissue model including the lesion.
[0099] S203, measuring the partial tissue model to obtain a measurement result of the lesion.
[0100] After obtaining the partial tissue model, different measurement methods can be used to process the partial tissue model to obtain the measurement result. For example, to obtain the surface area measurement result and the volume measurement result, the surface area measurement method and the volume measurement method are respectively used to measure the partial tissue model.
[0101] The method for measuring the tissue provided in the embodiments of the present application comprises the following steps: constructing a three-dimensional tissue model according to tissue image data, and controlling the virtual display unit to display the three-dimensional tissue model, then constructing a virtual cutting tool to cut the three-dimensional tissue model to obtain a partial tissue model, the partial tissue model comprises a lesion, and then measuring the partial tissue model to obtain a measurement result of the lesion. In the method, the three-dimensional tissue model constructed according to the tissue image data is displayed in the virtual reality unit of the tissue measurement device, so that the virtual cutting tool can be used to cut the three-dimensional tissue model, and then the measurement of the lesion is performed to obtain the measurement result of the lesion. In other words, after the tissue image data is obtained, the three-dimensional tissue model is obtained by post-processing the tissue image data, and the partial tissue model comprising the lesion is obtained by cutting the three-dimensional tissue model, so that the lesion can be measured more accurately, and the accuracy of the measurement result of the lesion is improved.
[0102] When the user has a demand for distance calculation or angle calculation of two positions in the partial tissue model, a mark point can be added to the model for measurement. Based on this, the following embodiment describes a method for determining a measurement result.
[0103] In an exemplary embodiment, as shown in Figure 3 the measurement result comprises a distance measurement result and an angle measurement result; the partial tissue model is processed to obtain a measurement result of the lesion, comprising:
[0104] S301, adding a collision body component to the partial tissue model.
[0105] The mixed reality device can provide a plurality of types of collision bodies for the user, and the user can select a target type of collision body based on a preset human-computer interaction operation. When the user confirms that the collision body is to be added, the mixed reality device can add the collision body component to the partial tissue model.
[0106] S302, adding distance mark points and angle mark points to the partial tissue model based on the collision body component.
[0107] After the collision body component is added, the user can use the hand input control of the mixed reality device to add mark points on the surface of the 3D model by using hand ray collision detection.
[0108] In one embodiment, adding distance mark points and angle mark points to the partial tissue model based on the collision body component can comprise the following steps:
[0109] Step one, based on the collision body component, obtaining a distance hand input position and an angle hand input position of the user in the partial tissue model.
[0110] Optionally, after adding the collision component to the partial tissue model, the hand ray collision detection can be used to detect the hand input position on the surface of the partial tissue model.
[0111] For example, when the user uses the index finger to point to a position on the partial tissue model, the corresponding position on the surface of the partial tissue model can be detected and acquired.
[0112] The distance hand input position and the angle hand input position can be distinguished based on different hands in different directions. For example, the distance hand input position can be based on the left hand input of the user, and the angle hand input position can be based on the right hand input of the user.
[0113] Step two, in the case where the user performs the preset interaction operation, a mark point is added to the distance hand input position, and a mark point is added to the angle hand input position.
[0114] For example, the user can use the hand pinch input operation to add mark points to the distance hand input position and the angle hand input position, respectively.
[0115] The color of the mark point at the distance hand input position is different from the color of the mark point at the angle hand input position.
[0116] Step three, the mark point added to the distance hand input position is determined as a distance mark point, and the mark point added to the angle hand input position is determined as an angle mark point.
[0117] The mark point added to the distance hand input position is the distance mark point, and the mark point added to the angle hand input position is the angle mark point.
[0118] S303, according to the distance mark point, a distance measurement result is determined; and according to the angle mark point, an angle measurement result is determined.
[0119] The distance and the angle can be calculated according to the coordinate information of the mark point.
[0120] For example, for distance measurement, the coordinate information of the distance mark point can be acquired, and then the coordinate distance between the distance mark points is determined as the distance measurement result.
[0121] Similarly, for angle measurement, the coordinate information of the angle mark point can be acquired, and then the angle between the angle mark points is determined as the angle measurement result, with the angle mark point corresponding to the target measurement angle as the center point.
[0122] The method for measuring the tissue provided in the embodiments of the present application adds a collision component to part of the tissue model, and then adds a distance marker point and an angle marker point to part of the tissue model based on the collision component. Finally, the distance measurement result is determined according to the distance marker point, and the angle measurement result is determined according to the angle marker point. In this method, the collision component is added to part of the tissue model, so that the user can add the marker points related to the distance and the angle based on the collision component, and then the distance and the angle can be calculated based on the added marker points, thereby providing an optional way for quickly determining the distance measurement result and the angle measurement result.
[0123] When the user has the demand for calculating the surface area and the volume of part of the tissue model, the calculation can be performed based on the triangular facets of part of the tissue model and the bounding box. Based on this, the following embodiment describes the way of determining the measurement result.
[0124] In an exemplary embodiment, as shown in Figure 4 The measurement result includes a surface area measurement result and a volume measurement result. The measurement result of the tissue to be measured is determined according to each part of the tissue model, including:
[0125] S401, constructing a bounding box of part of the tissue model with the cutting surface of part of the tissue model as a symmetry plane.
[0126] For example, the user inputs "construct a bounding box" through voice, and after the mixed reality device recognizes the voice content, the mixed reality device shows the user the options related to the construction of the bounding box, which can include multiple bounding box types and multiple symmetry planes, etc., for the user to select. After the user selects the required option, the user triggers the determination function, that is, the bounding box of part of the tissue model can be constructed.
[0127] S402, determining the surface area measurement result and the volume measurement result according to the bounding box and the plurality of triangular facets of part of the tissue model.
[0128] In the related art, there is also a scheme for measuring the surface area and the volume by using the bounding box. The bounding box approximation calculation method is adopted, that is, the bounding box is constructed as close to the model as possible, and then the surface area and the volume of the bounding box are calculated. However, the surface area and the volume calculated by this method are quite different from the true results, that is, the measurement accuracy of the measurement method in the prior art is low.
[0129] In order to improve the measurement accuracy of the surface area and the volume in the embodiments of the present application, the surface area and the volume of the bounding box are not directly calculated and taken as the surface area and the volume of part of the tissue model, but the surface area and the volume of part of the tissue model are still calculated based on the triangular facets of part of the tissue model and the bounding box.
[0130] In one embodiment, determining the surface area measurement and the volume measurement according to the bounding box and the plurality of triangular facets of the partial tissue model can include the following steps:
[0131] Step 1, dividing the bounding box into a plurality of sub-bounding boxes with the longest side length of the plurality of triangular facets as the height.
[0132] Taking the segment V of the liver as an example, as shown in FIG. 1, a bounding box of a partial tissue model is shown; as shown in FIG. 2, triangular facets of the partial tissue model are shown. The triangular facets are generated when the three-dimensional tissue model is cut. Figure 5 Figure 6 As an example, the longest side of the triangular facets of the partial tissue model is determined, and the bounding box of the partial tissue model is divided into a plurality of sub-bounding boxes with the longest side length as the height.
[0133] As an example, the longest side of the triangular facets of the partial tissue model is determined, and the bounding box of the partial tissue model is divided into a plurality of sub-bounding boxes with the longest side length as the height.
[0134] Step 2, determining the surface area measurement and the volume measurement according to the sub-bounding boxes and the plurality of triangular facets.
[0135] In order to reduce the amount of calculation, in the embodiment of the present application, the number of vertices of the partial tissue model is reduced by using a three-dimensional model reduction algorithm, and then the amount of calculation is reduced and the calculation efficiency is improved when calculating the surface area and the volume.
[0136] In one embodiment, determining the surface area measurement and the volume measurement according to the sub-bounding boxes and the plurality of triangular facets can include the following steps:
[0137] Step 1, removing candidate triangular facets in which the vertices are in the sub-bounding box where the cutting plane is located and intersect the cutting plane.
[0138] The triangular facets in the sub-bounding box where the cutting plane is located are the only ones that can intersect the cutting plane.
[0139] Optionally, the triangular facets of the partial tissue model are traversed, and if the vertices of the triangular facets all belong to the sub-bounding box where the cutting plane is located, it is determined whether the triangular facets intersect the cutting plane; if so, the triangular facet information is deleted from the partial tissue model.
[0140] Step 2, filling the profile with the vertices of the candidate triangular facets to obtain target triangular facets of the partial tissue model.
[0141] After the intersecting candidate triangular facets are deleted, the profile is filled with the vertices of the candidate triangular facets to obtain new triangular facets, and the new triangular facets and the remaining original triangular facets are the target triangular facets of the partial tissue model.
[0142] Step 3, determining the surface area measurement and the volume measurement according to the number of the target triangular facets and the coordinate information of the target triangular facets.
[0143] Optionally, the surface area and the volume can be determined based on preset calculation formulas.
[0144] In one embodiment, the surface area measurement and the volume measurement are determined according to the number of the target triangular facets and the coordinate information of the target triangular facets, including: determining the edge length of the target triangular facets according to the coordinate information of the target triangular facets; determining the surface area measurement according to the number of the target triangular facets and the edge length; and determining the volume measurement according to the number of the target triangular facets and the coordinate information of the vertices of the target triangular facets.
[0145] The calculation formulas of the surface area and the volume are as follows.
[0146] (1)
[0147] (2)
[0148] wherein, the surface area measurement; the number of the target triangular facets; , and are the edge lengths of the triangular facets, respectively; the volume measurement; , and are the vertex coordinates of the triangular facets, respectively.
[0149] It should be noted that, under the premise that the grid of the part of the tissue model is sufficiently refined and the number of the grid units is large, the deletion of the intersecting grid has little effect on the accuracy of the calculation result.
[0150] In addition, the mixed reality device also provides a measurement saving function and a measurement result deleting function. The poses of the distance marker points, the angle marker points and the virtual cutting panel can be uploaded to a server, and when the three-dimensional tissue model is previewed again, the measurement results and the measurement marker points will be synchronously displayed. The server synchronously deletes the recorded measurement information, and when the three-dimensional tissue model is previewed again, the measurement related information will be removed.
[0151] The tissue measurement method provided in the embodiments of the present application takes the cutting surface of the partial tissue model as a symmetry surface, constructs a bounding box of the partial tissue model, and then determines the surface area measurement result and the volume measurement result according to the bounding box and the plurality of triangular facets of the partial tissue model. In the method, the surface area measurement result and the volume measurement result of the partial tissue model are calculated by constructing the bounding box of the partial tissue model and then combining the plurality of triangular facets of the partial tissue model, which provides an optional way for quickly determining the surface area measurement result and the volume measurement result.
[0152] In addition, in an exemplary embodiment, the present application also provides an optional example of a tissue measurement method, which, as shown in Figure 7 may include the following steps:
[0153] S601, acquire a three-dimensional model file.
[0154] S602, parse and render the three-dimensional model file to obtain a candidate three-dimensional model.
[0155] S603, render the candidate three-dimensional model according to the tissue image data to obtain a three-dimensional tissue model, and control a virtual display unit to display the three-dimensional tissue model.
[0156] S604, draw a virtual cutting surface panel and a virtual pose controller.
[0157] S605, acquire the operation position of the user operating the rotation controller and the movement controller.
[0158] S606, adjust the panel pose of the virtual cutting surface panel according to the operation position.
[0159] S607, determine the panel pose as the cutting position of the three-dimensional tissue model.
[0160] S608, perform surface segmentation processing on the three-dimensional tissue model according to the cutting position to obtain a partial tissue model.
[0161] The partial tissue model includes a lesion.
[0162] S609, measure the partial tissue model to obtain a measurement result of the lesion.
[0163] The processes of S601-S609 described above can refer to the description of the method embodiments described above, and have similar implementation principles and technical effects, which will not be described here.
[0164] It should be understood that although the steps in the flowcharts involved in the embodiments described above are shown in sequence according to the arrows, the steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, the execution of the steps is not strictly limited in sequence, and the steps can be executed in other orders. Moreover, at least some of the steps in the flowcharts involved in the embodiments described above can include multiple steps or multiple stages, which are not necessarily executed at the same time but can be executed at different times, and the execution of the steps or stages is not necessarily sequential but can be executed in rotation or alternation with at least some of the other steps or the steps or stages in the other steps.
[0165] Based on the same inventive concept, the embodiments of the present application also provide an organization measurement device for implementing the organization measurement method described above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, and therefore the specific limitations in one or more organization measurement device embodiments provided below can refer to the limitations of the organization measurement method described above, which will not be repeated here.
[0166] In one exemplary embodiment, as shown in Figure 8 An organization measurement device 1 is provided, comprising a position acquisition module 10, a model cutting module 20 and a result determination module 30, wherein:
[0167] The model display module 10 is configured to construct a three-dimensional organization model according to the organization image data, and control a virtual display unit to display the three-dimensional organization model.
[0168] The model cutting module 20 is configured to construct a virtual cutting tool to cut the three-dimensional organization model to obtain a partial organization model; the partial organization model comprises a lesion.
[0169] The result determination module 30 is configured to measure the partial organization model to obtain a measurement result of the lesion.
[0170] In one embodiment, the model display module 10 is further configured to:
[0171] acquire a three-dimensional model file; parse and render the three-dimensional model file to obtain a candidate three-dimensional model; render the candidate three-dimensional model according to the organization image data to obtain the three-dimensional organization model.
[0172] In one embodiment, the model cutting module 20 is further configured to:
[0173] draw a virtual cutting panel and a virtual pose controller; adjust the panel pose of the virtual cutting panel through the virtual pose controller to obtain a cutting position of the three-dimensional tissue model; and perform surface segmentation processing on the three-dimensional tissue model according to the cutting position to obtain a partial tissue model.
[0174] In one of the embodiments, the model cutting module 20 is further configured to:
[0175] obtain an operation position of the user operating the rotation controller and the movement controller; adjust the panel pose of the virtual cutting panel according to the operation position; and determine the panel pose as the cutting position of the three-dimensional tissue model.
[0176] In one of the embodiments, the result determination module 30 is further configured to:
[0177] add a collision component to the partial tissue model; add a distance marker point and an angle marker point to the partial tissue model based on the collision component; determine the distance measurement result according to the distance marker point; and determine the angle measurement result according to the angle marker point.
[0178] In one of the embodiments, the result determination module 30 is further configured to:
[0179] obtain a distance hand input position and an angle hand input position of the user in the partial tissue model based on the collision component; add a marker point to the distance hand input position and add a marker point to the angle hand input position in a case where it is detected that the user performs a preset interactive operation; determine the marker point added to the distance hand input position as the distance marker point, and determine the marker point added to the angle hand input position as the angle marker point.
[0180] In one of the embodiments, the result determination module 30 is further configured to:
[0181] obtain coordinate information of the distance marker point; and determine a coordinate distance between the distance marker points as the distance measurement result.
[0182] In one of the embodiments, the result determination module 30 is further configured to:
[0183] obtain coordinate information of the angle marker point; determine an included angle value between the angle marker points according to the coordinate information of the angle marker point, with a center point being the angle marker point corresponding to the target measurement angle; and determine the included angle value as the angle measurement result.
[0184] In one of the embodiments, the result determination module 30 is further configured to:
[0185] The cutting surface of the partial tissue model is taken as a symmetry surface to construct a bounding box of the partial tissue model; and the surface area measurement result and the volume measurement result are determined according to the bounding box and the plurality of triangular facets of the partial tissue model.
[0186] In one of the embodiments, the result determining module 30 is further configured to:
[0187] The plurality of triangular facets are divided into a plurality of sub bounding boxes with the longest side length of the plurality of triangular facets as the height; and the surface area measurement result and the volume measurement result are determined according to the plurality of sub bounding boxes and the plurality of triangular facets.
[0188] In one of the embodiments, the result determining module 30 is further configured to:
[0189] The candidate triangular facets in the plurality of triangular facets, whose vertexes are located in the sub bounding box of the cutting surface and intersect with the cutting surface, are removed; the target triangular facets of the partial tissue model are obtained by filling the cross section with the vertexes of the candidate triangular facets; and the surface area measurement result and the volume measurement result are determined according to the number of the target triangular facets and the coordinate information of the target triangular facets.
[0190] In one of the embodiments, the result determining module 30 is further configured to:
[0191] The edge length of the target triangular facets is determined according to the coordinate information of the target triangular facets; the surface area measurement result is determined according to the number of the target triangular facets and the edge length; and the volume measurement result is determined according to the number of the target triangular facets and the coordinate information of the vertexes of the target triangular facets.
[0192] The modules in the tissue measurement device can be realized by software, hardware or a combination thereof. The modules can be embedded in or independent of the processor of the computer device in hardware form, or stored in the memory of the computer device in software form, so as to be called and executed by the processor to perform the operations corresponding to the modules.
[0193] In one of the embodiments, a computer device is provided, which includes a memory and a processor, and the memory stores a computer program. When the processor executes the computer program, the following steps are implemented:
[0194] The three-dimensional tissue model is constructed according to the tissue image data, and the virtual display unit is controlled to display the three-dimensional tissue model; the virtual cutting tool is constructed to cut the three-dimensional tissue model to obtain a partial tissue model; the partial tissue model includes a lesion; and the measurement result of the lesion is obtained by measuring the partial tissue model.
[0195] The processor in the embodiments of the present application implements the steps, and the implementation principle and technical effects are similar to those of the above-mentioned tissue measurement method, which will not be described here.
[0196] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:
[0197] A three-dimensional tissue model is constructed based on tissue imaging data, and a virtual display unit is controlled to display the three-dimensional tissue model; a virtual cutting tool is constructed to cut the three-dimensional tissue model to obtain a partial tissue model; the partial tissue model includes a lesion; the partial tissue model is measured to obtain a measurement result of the lesion.
[0198] The implementation principles and technical effects of the steps implemented when the computer program in the embodiment of the present application is executed by the processor are similar to the principles of the above-mentioned tissue measurement method and will not be repeated here.
[0199] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:
[0200] A three-dimensional tissue model is constructed based on tissue imaging data, and a virtual display unit is controlled to display the three-dimensional tissue model; a virtual cutting tool is constructed to cut the three-dimensional tissue model to obtain a partial tissue model; the partial tissue model includes a lesion; the partial tissue model is measured to obtain a measurement result of the lesion.
[0201] The implementation principles and technical effects of the steps implemented when the computer program in the embodiment of the present application is executed by the processor are similar to the principles of the above-mentioned tissue measurement method and will not be repeated here.
[0202] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0203] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.
[0204] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist, it should be considered as the scope of the present application.
[0205] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.
Claims
1. A tissue measurement device, characterized by, The tissue measurement device comprises a virtual display unit, at least one processor and at least one memory, the virtual display unit is connected with the memory and the processor respectively, the memory stores executable instructions, and the processor executes the executable instructions to realize a tissue measurement method, the method comprises: constructing a three-dimensional tissue model according to tissue image data, and controlling the virtual display unit to display the three-dimensional tissue model; constructing a virtual cutting tool to cut the three-dimensional tissue model to obtain a partial tissue model; the partial tissue model comprises a lesion; measuring the partial tissue model to obtain a measurement result of the lesion.
2. The tissue measurement device of claim 1, wherein, The three-dimensional tissue model is constructed according to the tissue image data, which comprises: obtaining a three-dimensional model file; parsing and rendering the three-dimensional model file to obtain a candidate three-dimensional model; rendering the candidate three-dimensional model according to the tissue image data to obtain the three-dimensional tissue model.
3. The tissue measurement device according to claim 1 or 2, characterized in that The virtual cutting tool comprises a virtual cutting panel and a virtual pose controller. The virtual cutting tool is constructed to cut the three-dimensional tissue model to obtain a partial tissue model, which comprises: drawing the virtual cutting panel and the virtual pose controller; adjusting the panel pose of the virtual cutting panel through the virtual pose controller to obtain a cutting position of the three-dimensional tissue model; performing surface segmentation processing on the three-dimensional tissue model according to the cutting position to obtain the partial tissue model.
4. The tissue measurement device of claim 3, wherein, The virtual pose controller comprises a rotation controller and a movement controller; adjusting the panel pose of the virtual cutting panel through the virtual pose controller to obtain a cutting position of the three-dimensional tissue model comprises: obtaining an operation position of the rotation controller and the movement controller operated by a user; adjusting the panel pose of the virtual cutting panel according to the operation position; determining the panel pose as the cutting position of the three-dimensional tissue model.
5. The tissue measurement device according to claim 1 or 2, characterized by The measurement result comprises a distance measurement result and an angle measurement result; measuring the partial tissue model to obtain a measurement result of the lesion comprises: adding a collision body component to the partial tissue model; adding a distance marker point and an angle marker point to the partial tissue model based on the collision body component; determining the distance measurement result according to the distance marker point, and determining the angle measurement result according to the angle marker point.
6. The tissue measurement device of claim 5, wherein, Adding a distance marker point and an angle marker point to the partial tissue model based on the collision body component comprises: obtaining a distance hand input position and an angle hand input position of a user in the partial tissue model based on the collision body component; in a case where it is detected that the user performs a preset interaction operation, adding a marker point to the distance hand input position and adding a marker point to the angle hand input position; determining the marker point added to the distance hand input position as the distance marker point, and determining the marker point added to the angle hand input position as the angle marker point.
7. The tissue measurement device according to claim 1 or 2, characterized by The measurement results include surface area measurement results and volume measurement results; the measurement on the partial tissue model to obtain the measurement results of the lesion includes: Taking the cutting surface of the partial tissue model as a symmetry surface, a bounding box of the partial tissue model is constructed; According to the bounding box and a plurality of triangular facets of the partial tissue model, the surface area measurement results and the volume measurement results are determined.
8. The tissue measurement device of claim 7, wherein, The determination of the surface area measurement results and the volume measurement results according to the bounding box and the plurality of triangular facets of the partial tissue model includes: The bounding box is divided into a plurality of sub-bounding boxes with the longest side length of the plurality of triangular facets as the height; According to each of the sub-bounding boxes and the plurality of triangular facets, the surface area measurement results and the volume measurement results are determined.
9. The tissue measurement device of claim 8, wherein, The determination of the surface area measurement results and the volume measurement results according to each of the sub-bounding boxes and the plurality of triangular facets includes: Removing candidate triangular facets in the plurality of triangular facets, whose vertexes are in the sub-bounding box where the cutting surface is located and intersect with the cutting surface; Filling the cross section with the vertexes of the candidate triangular facets to obtain target triangular facets of the partial tissue model; According to the number of the target triangular facets and the coordinate information of the target triangular facets, the surface area measurement results and the volume measurement results are determined.
10. The tissue measurement device of claim 9, wherein, The determination of the surface area measurement results and the volume measurement results according to the number of the target triangular facets and the coordinate information of the target triangular facets includes: According to the coordinate information of the target triangular facets, the side length of the target triangular facets is determined; According to the number of the target triangular facets and the side length, the surface area measurement results are determined; According to the number of the target triangular facets and the coordinate information of the vertexes of the target triangular facets, the volume measurement results are determined.
