Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Lumen Image Preprocessing Method for Differentiating Specular Reflection Regions and Blood Vessels

A technology of image preprocessing and mirror reflection, which is applied in medical science, surgery, computer-aided planning/modeling, etc., can solve the problem of not reflecting the multi-view three-dimensional shape of the inner cavity, surface projection imaging distortion, and affecting the continuity of doctors' surgical operations And other issues

Active Publication Date: 2022-02-01
杭州国节能源技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, endoscopy does not meet the observation needs of doctors, such as figure 1 As shown: ①The image of the inner cavity is displayed on the monitor, and the doctor needs to constantly move his sight between the surgical site and the monitor, which affects the continuity of the doctor's operation and is prone to fatigue
② A single endoscope observes the local area. If the doctor needs to observe a large area, multiple endoscopes will intervene in the human body at the same time, which not only increases the burden on the patient but also increases the burden on the endoscope cable, transmitter / receiver, interventional sleeve, etc. The degree of complexity and cumbersomeness; ③Sometimes assistants are needed to assist in holding and moving multiple endoscopes to cooperate with the doctor's observation, which brings inconvenience to the doctor's operation
[0004]The above solutions are still in the trial stage, and there are still some things to improve: ①The current orientation tracking technology needs to wear a transmitter or a marker on the doctor's head, increasing the ②The image of the inner cavity is a two-dimensional image, which does not reflect the multi-view three-dimensional shape of the inner cavity; Corrects the projected image so that an undistorted image of the lumen is seen on the patient surface

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Lumen Image Preprocessing Method for Differentiating Specular Reflection Regions and Blood Vessels
  • A Lumen Image Preprocessing Method for Differentiating Specular Reflection Regions and Blood Vessels
  • A Lumen Image Preprocessing Method for Differentiating Specular Reflection Regions and Blood Vessels

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0048] This embodiment is an embodiment of the method for observing the inner cavity through virtual and transparent projection of the body surface in minimally invasive surgery.

[0049] In the minimally invasive surgery in this embodiment, the body surface projection virtual transparent observation method for the inner cavity, the corresponding body surface projection system is as follows: Figure 4 As shown, the technical roadmap of this method is as follows Figure 5 shown, including the following steps:

[0050] Step a, Kinect doctor's viewing angle tracking, used to determine the doctor's current head position and visual angle;

[0051] Step b, PTAM three-dimensional modeling of the inner cavity, PTAM is Parallel Tracking and Mapping, which is used to generate a three-dimensional model of the inner cavity that can rotate with the doctor's perspective described in step a;

[0052] Step c. Generating a sequence of projection images of the patient's body surface, and proj...

specific Embodiment 2

[0054]This embodiment is an embodiment of the Kinect doctor's perspective tracking method.

[0055] The Kinect doctor's angle of view tracking method of the present embodiment can exist independently, and specific embodiment one can be further limited again; The Kinect doctor's angle of view tracking method, such as Figure 6 shown, including the following steps:

[0056] Step a1, select the depth data of the pupil and the tip of the nose as key points, and establish a mathematical model of the doctor's perspective;

[0057] Step a2, use the Kalman filter to predict the doctor's perspective and correct the tracking data;

[0058] Step a3, analyzing the orientation relationship among the Kinect, the doctor's head, the patient's body surface, the patient's inner cavity, and the projector, unifying the coordinate system, and designing the parameters of the patient's body surface projection system.

specific Embodiment 3

[0060] This embodiment is a Kalman filter embodiment.

[0061] The Kalman filter of the present embodiment can exist alone, and can be further limited to the second embodiment; the Kalman filter is specifically:

[0062] In a frame of Kinect data at time t, define its Kalman filter state vector X t and the observation vector Z t for:

[0063] x t =(x(t),y(t),z(t),v x (t), v y (t), v z (t))

[0064] Z t =(x(t),y(t),z(t))

[0065] Among them, x(t), y(t) and z(t) are the three-dimensional coordinates of the nose tip center, v x (t), v y (t) and v z (t) is the velocity of the nose tip center;

[0066] Accordingly, the Kalman system equation is:

[0067] x t+1 =AX t +BU t +GW t

[0068] Z t+1 =HX t +V t

[0069] Among them, A is the state matrix, B is the control matrix, which is approximately 0 when the facial movement has no control amount, G is the driving matrix, H is the observation matrix, and U t is the control vector, W t is x t Kinect measurement e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A lumen image preprocessing method for distinguishing specular reflection areas and blood vessels according to the present invention belongs to the technical fields of medicine, three-dimensional imaging, digital image processing, etc.; the image preprocessing method first selects the green component in the RGB image, and then calculates the green component image Then use the Hessian matrix to calculate L pixel by pixel, and then calculate the two orthogonal eigenvalues ​​and two eigenvectors of the Hessian matrix, and finally distinguish background noise, microvessels, branch points or tiny features, blood droplets or mirror reflections area; the present invention can distinguish the specular reflection area and the blood vessel, and reduce the shadow of the specular reflection area on identifying the blood vessel; this technology is applied to the method of body surface projection virtual transparent observation of the inner cavity in minimally invasive surgery, as the core of the three-dimensional modeling method of the inner cavity In part, it will lay a solid theoretical foundation for obtaining a more realistic virtual abdominal cavity transparency effect, and satisfying the doctor's need for intracavity-assisted observation in ordinary minimally invasive surgery without affecting the doctor and the operating environment.

Description

technical field [0001] The invention discloses a lumen image preprocessing method for distinguishing specular reflection areas and blood vessels, which belongs to the technical fields of medicine, three-dimensional imaging, digital image processing, and the like. Background technique [0002] Compared with traditional open surgery, minimally invasive surgery has the advantages of small incision, less pain, and faster healing. It caters to the aesthetic concept of modern people, so it is increasingly popular and used in some abdominal and cranial cavity surgeries. At present, the main observation mode of minimally invasive surgery is endoscopy. The endoscope uses multiple pinhole cameras and a xenon lamp light source to capture images of the inflated lumen, which are displayed on the monitor for doctors to observe. At present, the most advanced endoscopes can obtain very high-quality images of the lumen, and then the positioning technology of surgical equipment can be derive...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): A61B34/20A61B34/10
CPCA61B34/20A61B34/10A61B2034/107A61B2034/105A61B2034/2065
Inventor 吴海滨代启鹏刘博王森隋宗桂吴茜
Owner 杭州国节能源技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com