Transcranial Doppler intracranial vascular navigation positioning method and system based on augmented reality

Through augmented reality-based technology, the craniocerebral vascular navigation and flow velocity measurement of transcranial Doppler equipment are realized, solving the problems of complex equipment operation and differences in flow velocity measurement, achieving comprehensive exploration and accurate measurement, and reducing the risk of infection.

CN118177973BActive Publication Date: 2024-12-06BRAIN-COMPUTER INTERACTION & HUMAN-COMPUTER INTEGRATION HAIHE LAB
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202410364484.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-03-28
Publication Date
2024-12-06
Estimated Expiration
2044-03-28

AI Technical Summary

Technical Problem

The existing transcranial Doppler equipment is complex and costly, making it difficult to fully detect cerebrovascular. The fully automatic probe is installed on the patient's head to increase the risk of infection. The existing virtual reality or augmented reality technology is not used in the cranial brain of TCD. Vascular navigation.

Method used

Using augmented reality-based method, three-dimensional vascular projection and spatial positioning are performed by exporting craniocerebral image data, combining machine learning and human-computer interaction technology to achieve comprehensive navigation and flow rate measurement of craniocerebral blood vessels, and use a virtual navigation probe to guide the probe position. , shorten operating time and reduce flow velocity measurement differences.

Benefits of technology

The comprehensive exploration of craniocerebral blood vessels is achieved, which shortens the time for operators to find target blood vessels, solves the problem of flow velocity measurement differences caused by operator heterogeneity, and reduces the complexity of operation and infection risk.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118177973B_ABST
    Figure CN118177973B_ABST
Patent Text Reader

Abstract

The present invention discloses a transcranial Doppler intracranial vascular navigation positioning method and system based on augmented reality, and relates to the field of medical ultrasound technology. The positioning method includes the following steps: S1, exporting multi-modal cranial imaging vascular data and converting it into a data format recognized by augmented reality AR; S2, spatial positioning and tracking of the cranium by AR equipment; S3, correctly projecting and mapping the three-dimensional blood vessels to the cranium position; S4, constructing an application based on AR equipment imaging to realize human-computer interaction function; S5, adding an in vitro virtual navigation probe at the bilateral bone window, measuring the cerebral vascular flow velocity along the direction of the virtual navigation probe, and the TCD device collects and saves the flow velocity of the target blood vessel. The present invention adopts the above-mentioned transcranial Doppler intracranial vascular navigation positioning method and system based on augmented reality, which can comprehensively explore cranial and cerebral blood vessels, shorten the time for operators to find target blood vessels, and solve the problem of differences in target blood vessel flow velocity measurement due to operator heterogeneity.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of medical ultrasound technology, and in particular to a transcranial Doppler intracranial blood vessel navigation positioning method and system based on augmented reality. Background Art

[0002] Transcranial Doppler (TCD) is the main equipment for non-invasive detection of cerebral vascular flow velocity. Although it has the advantages of being non-invasive and low-cost, and has important clinical application prospects in patients with critical neurological diseases, the high cost and long period of operator training limit its widespread application. At present, the main solution to the above problems is the "fully automatic probe monitoring system". However, the system is expensive and can only track the flow velocity of some arteries in the cerebral blood vessels, and cannot automatically detect and analyze other cerebral blood vessels. And the fully automatic probe requires a head frame device to be installed on the patient's head, which increases the operation time and infection risk. The virtual reality or augmented reality technology currently used in the clinic of neurological critical care is mainly used in the fields of teaching training of simulated operations, intraoperative navigation, etc., and there is no cranial vascular navigation system suitable for TCD. Therefore, the present invention provides a transcranial Doppler intracranial vascular navigation positioning method and system based on augmented reality. Summary of the invention

[0003] The purpose of the present invention is to provide a transcranial Doppler intracranial vascular navigation positioning method and system based on augmented reality, which can comprehensively explore the cranial and cerebral blood vessels, shorten the operator's time to find the target blood vessel, and solve the problem of target blood vessel flow velocity measurement differences caused by operator heterogeneity.

[0004] To achieve the above object, the present invention provides a transcranial Doppler intracranial vascular navigation and positioning method based on augmented reality, comprising the following steps:

[0005] S1. Export multi-modal cranial imaging vascular data and convert it into data format for augmented reality (AR) recognition;

[0006] S2, AR devices spatially locate and track the brain;

[0007] S3, correctly project and map the three-dimensional blood vessels to the brain position;

[0008] S4. Build applications based on AR device imaging to realize human-computer interaction functions;

[0009] S5. Add an in vitro virtual navigation probe at the bilateral bone windows, measure the cerebral vascular flow velocity along the direction of the virtual navigation probe, and use the TCD device to collect and save the flow velocity of the target blood vessel.

[0010] Furthermore, the specific operation of step S1 is: exporting the data of cranial computed tomography angiography CTA or cranial magnetic resonance angiography MRA images of patients who are to undergo TCD examination, using image rendering methods to pre-process the image data by denoising, smoothing, and contrast adjustment, extracting blood vessels and surface features of interest based on machine learning methods, creating a 3D model or volume data, and exporting a 3D model file for AR recognition.

[0011] Furthermore, the specific operation of step S2 is: input the 3D model file recognized by AR, and the AR device uses sensors and cameras to perceive the body and environment of the patient who is to undergo TCD examination in real time, perform spatial positioning and tracking, and ensure the understanding of the position, direction and proportion of the brain.

[0012] Furthermore, the specific operation of step S3 is: the AR system projects the three-dimensional image of the cranial and cerebrovascular vessels to the correct position according to the position and direction of the brain, spatially aligns and adjusts the image to adapt to the movement or change of the human body, and maintains the correct position and proportion of the projection.

[0013] Furthermore, the specific operation of step S4 is: comprehensively utilizing sensor technology, computer vision, natural language processing, and user interface design technology, setting up human-computer interaction functions such as zooming, dragging, and rotating, and constructing an interactive and immersive AR application, which allows users to interact with the projected vascular image to ensure that the posture and proportion of the cerebral blood vessels match the brain.

[0014] Furthermore, the specific operation of step S5 is: according to the positional relationship between the target blood vessel and the bilateral bone windows, a spatial marker is added as a virtual navigation probe at the temporal window at the front and upper edge of the auricle, or at the occipital window behind the occipital bone, to guide the planned probe position direction, and the probe is moved along the direction of the virtual navigation probe to measure the cerebral vascular flow velocity.

[0015] The present invention also provides a system for the above-mentioned augmented reality-based transcranial Doppler intracranial vascular navigation and positioning method, including a data acquisition system, a data processing system connected to the data acquisition system, a control center, an AR device, a TCD device, and a data output system; the data acquisition system, the data processing system, the AR device, the TCD device, and the data output system are connected to the control center.

[0016] Furthermore, the data acquisition system combines machine learning to train the collected data, imports it into the AR device, generates a navigation probe, and the TCD probe detects the blood flow direction and velocity of the blood vessel along the direction of the navigation probe;

[0017] Data acquisition system, used for data acquisition, including

[0018] (1) An imaging system that uses stereoscopic image rendering to generate three-dimensional images of body surface features superimposed on cranial and cerebrovascular vessels: exporting three-dimensional images in DICOM format at intervals of 2 to 3 degrees (such as images of hyaline ossified cerebrovascular vessels, etc.);

[0019] (2) An imaging system that does not use stereoscopic image rendering to generate three-dimensional images of body surface features superimposed on cerebral blood vessels: uses medical image segmentation and processing software to calibrate and collect blood vessels and body surface feature markers; trains deep neural networks and other machine learning methods to automatically segment the three-dimensional images of body surface feature markers superimposed on cerebral blood vessels;

[0020] The collected images are preprocessed by denoising, smoothing and contrast adjustment using image rendering methods;

[0021] Data processing system, used for data processing, using 3D reconstruction tools such as 3D Slicer, ITK-SNAP, Blender, etc. to stack DICOM images into 3D models, export them into AR-usable file formats, and import the files into AR devices;

[0022] The data output system is used for data output. It collects real-time images of the skull in the real world through the camera of the AR device, and uses the AR interactive interface to superimpose the transparent 3D image with the skull. After the superposition is satisfactory, the target blood vessels and target bone windows are selected, and the navigation module of the AR device generates a navigation probe to guide the direction of the probe.

[0023] The advantages and positive effects of the augmented reality-based transcranial Doppler intracranial vascular navigation positioning method and system of the present invention are:

[0024] 1. The present invention uses AR to accurately and individually display the location of the patient's cranial and cerebrovascular vessels, shortening the operator's time in finding the target blood vessels.

[0025] 2. The present invention standardizes the angle and direction of the probe in an AR manner, thereby solving the problem of differences in target blood vessel flow velocity measurements due to operator heterogeneity.

[0026] 3. Compared with the existing automatic probe which can only detect part of the cerebral arteries, the present invention can fully detect the cerebral blood vessels.

[0027] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a flow chart of a positioning method in an embodiment of the present invention;

[0029] Figure 2 It is a structural diagram of a positioning system in an embodiment of the present invention;

[0030] Figure 3 The application scenario in the embodiment of the present invention Figure 1 ;

[0031] Figure 4 The application scenario in the embodiment of the present invention Figure 2 . DETAILED DESCRIPTION

[0032] The technical solution of the present invention is further described below through the accompanying drawings and embodiments.

[0033] Unless otherwise defined, the technical terms or scientific terms used in the present invention should be understood by people with ordinary skills in the field to which the present invention belongs. The words "first", "second" and similar words used in the present invention do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0034] Example 1

[0035] like Figure 1 As shown, the transcranial Doppler intracranial vascular navigation positioning method based on augmented reality includes the following steps:

[0036] S1. Export multimodal cranial imaging vascular data and convert it into data format recognized by augmented reality (AR): Export the cranial computed tomography angiography (CTA) or cranial magnetic resonance angiography (MRA) image data of patients who are to undergo TCD examination. Process and reconstruct the above data to create a 3D model or volume data, and export the 3D model file recognized by AR.

[0037] S2. Spatial positioning and tracking of the brain by AR equipment: AR equipment uses sensors and cameras to perceive the body and environment of the patient to be examined by TCD in real time, and performs spatial positioning and tracking to ensure the position, direction and proportion of the brain.

[0038] S3. Correctly project and map the 3D blood vessels to the brain: The AR system projects the 3D image of the brain blood vessels to the correct position according to the position and orientation of the brain. The image is spatially aligned and adjusted to adapt to the movement or change of the human body and maintain the correct position and proportion of the projection.

[0039] S4. Build applications based on AR device imaging to achieve human-computer interaction functions: Comprehensively utilize sensor technology, computer vision, natural language processing, and user interface design technologies to set up human-computer interaction functions such as zooming, dragging, and rotating to build a more interactive and immersive AR application. The application allows users to interact with the projected vascular image to ensure that the cerebral blood vessels match the posture and proportion of the skull.

[0040] S5. Add an in vitro virtual navigation probe at the bilateral bone windows: According to the positional relationship between the target blood vessels and the bilateral bone windows, add a spatial marker as a virtual navigation probe at the temporal window at the front and upper edge of the auricle, or at the occipital window behind the occipital bone to guide the planned probe position direction, and move the probe along the direction of the virtual navigation probe to measure the cerebral vascular flow velocity.

[0041] S6. The TCD device collects and saves the flow rate of the target blood vessel.

[0042] Example 2

[0043] like Figure 2 As shown, the system of the transcranial Doppler intracranial vascular navigation positioning method based on augmented reality includes a data acquisition system, a data processing system connected to the data acquisition system, a control center, an AR device, a TCD device, and a data output system; the data acquisition system, the data processing system, the AR device, the TCD device, and the data output system are connected to the control center.

[0044] The data acquisition system combines machine learning to train the collected data, imports it into the AR device, generates a navigation probe, and the TCD probe detects the blood flow direction and velocity of the blood vessel along the direction of the navigation probe.

[0045] Data acquisition system, used for data acquisition, including

[0046] (1) An imaging system that uses stereoscopic image rendering to generate three-dimensional images of body surface features superimposed on cranial and cerebrovascular vessels: exporting three-dimensional images in DICOM format at intervals of 2 to 3 degrees (such as images of hyaline ossified cerebrovascular vessels, etc.);

[0047] (2) An imaging system that does not use stereoscopic image rendering to generate three-dimensional images of body surface features superimposed on cerebral blood vessels: uses medical image segmentation and processing software to calibrate and collect blood vessels and body surface feature markers; and trains deep neural networks and other machine learning methods to automatically segment the three-dimensional images of body surface feature markers superimposed on cerebral blood vessels.

[0048] The image rendering method is used to preprocess the collected images by denoising, smoothing and contrast adjustment.

[0049] The data processing system is used for data processing, using 3D reconstruction tools such as 3D Slicer, ITK-SNAP, Blender, etc. to stack DICOM images into 3D models, export them into AR-usable file formats, and import the files into AR devices.

[0050] The data output system is used for data output. It collects real-time images of the skull in the real world through the camera of the AR device, and uses the AR interactive interface to superimpose the transparent 3D image with the skull. After the superposition is satisfactory, the target blood vessels and target bone windows are selected, and the navigation module of the AR device generates a navigation probe to guide the direction of the probe. Figure 3 and Figure 4 This is a scene diagram for practical application of the present invention.

[0051] Therefore, the present invention adopts the above-mentioned augmented reality-based transcranial Doppler intracranial vascular navigation positioning method and system, which can comprehensively explore the cranial and cerebral blood vessels, shorten the operator's time to find the target blood vessels, and at the same time solve the problem of target blood vessel flow velocity measurement differences caused by operator heterogeneity.

[0052] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that they can still modify or replace the technical solution of the present invention with equivalents, and these modifications or equivalent replacements cannot cause the modified technical solution to deviate from the spirit and scope of the technical solution of the present invention.

Claims

1. A transcranial Doppler intracranial vascular navigation positioning method based on augmented reality, characterized in that: The following steps are involved: S1. Export multi-modal cranial imaging vascular data and convert it into data format for augmented reality (AR) recognition; The specific operation is as follows: export the data of the brain computed tomography angiography (CTA) or brain magnetic resonance angiography (MRA) images of the patient who is to undergo TCD examination, use image rendering methods to perform denoising, smoothing, and contrast adjustment preprocessing on the image data, extract the blood vessels and body surface features of interest based on machine learning methods, create a 3D model or volume data, and export the 3D model file for AR recognition; S2, AR devices spatially locate and track the brain; The specific operation is as follows: input the 3D model file recognized by AR, and the AR device uses sensors and cameras to perceive the body and environment of the patient to be examined by TCD in real time, perform spatial positioning and tracking, ensure the position, direction and proportion of the brain, and obtain a three-dimensional image of the brain and blood vessels; S3, correctly project and map the three-dimensional image to the brain position; The specific operation is as follows: the AR system projects the three-dimensional image of the cranial and cerebrovascular vessels to the correct position according to the position and orientation of the brain, and spatially aligns and adjusts the image to adapt to the movement or change of the human body and maintain the correct position and proportion of the projection; S4. Build applications based on AR device imaging to realize human-computer interaction functions; The specific operation is: comprehensively utilize sensor technology, computer vision, natural language processing and user interface design technology, set up human-computer interaction functions such as zooming, dragging and rotating, and build an interactive and immersive AR application. The application allows users to interact with the projected vascular image to ensure that the posture and proportion of the cerebral blood vessels match the skull; S5. Add an in vitro virtual navigation probe at the bilateral bone windows, measure the cerebral vascular flow velocity along the direction of the virtual navigation probe, and use the TCD device to collect and save the flow velocity of the target blood vessel; The specific operation is as follows: according to the positional relationship between the target blood vessels and the bilateral bone windows, a spatial marker is added as a virtual navigation probe at the temporal window at the anterior upper edge of the auricle, or at the occipital window behind the occipital bone, to guide the direction of the planned probe position, and the probe is moved along the direction of the virtual navigation probe to measure the cerebral vascular flow velocity.

2. A system for implementing the augmented reality based transcranial Doppler intracranial vascular navigation and positioning method as claimed in claim 1, characterized in that: It includes a data acquisition system, a data processing system connected to the data acquisition system, a control center, AR equipment, TCD equipment, and a data output system; the data acquisition system, the data processing system, the AR equipment, the TCD equipment, and the data output system are connected to the control center.

3. The system of the transcranial Doppler intracranial vascular navigation and positioning method based on augmented reality according to claim 2, characterized in that: The data acquisition system combines machine learning to train the collected data, imports it into the AR device, generates a navigation probe, and the TCD probe detects the blood flow direction and velocity of the blood vessel along the direction of the navigation probe; Data acquisition system, used for data acquisition, including: (1) An imaging system that uses stereoscopic image rendering to generate three-dimensional images of body surface features superimposed on cranial and cerebrovascular vessels: the three-dimensional images are exported in DICOM format at intervals of 2 to 3 degrees; (2) An imaging system that does not use stereoscopic image rendering to generate three-dimensional images of body surface features superimposed on cerebral blood vessels: uses medical image segmentation and processing software to calibrate and collect blood vessels and body surface feature markers; trains deep neural network machine learning methods to automatically segment the three-dimensional images of body surface feature markers superimposed on cerebral blood vessels; The image rendering method is used to preprocess the collected images by denoising, smoothing and contrast adjustment.

4. The system of the transcranial Doppler intracranial vascular navigation and positioning method based on augmented reality according to claim 2, characterized in that: The data processing system is used for data processing, stacking DICOM images into a three-dimensional model using a three-dimensional reconstruction tool, and exporting the model into a file format usable by AR, and then importing the file into an AR device.

5. The system of the transcranial Doppler intracranial vascular navigation and positioning method based on augmented reality according to claim 2, characterized in that: The data output system is used for data output. It collects real-time images of the skull in the real world through the camera of the AR device, and uses the AR interactive interface to superimpose the transparent 3D image with the skull. After the superposition is satisfactory, the target blood vessels and target bone windows are selected, and the navigation module of the AR device generates a navigation probe to guide the direction of the probe.

Citation Information

Patent Citations

  • Intracranial cerebral blood flow three-dimensional image acquisition device and method

    CN105816202A

  • Guided-transcranial ultrasound imaging using neural networks and associated devices, systems, and methods

    CN111670009A

  • Method and device for constructing model for predicting intracranial aneurysm rupture

    CN113744883A

  • Mixed reality system integrated with surgical navigation system

    US20210065451A1

  • Methods and systems for guiding the acquisition of cranial ultrasound data

    WO2020239979A1