Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method for generating patient body surface projection image sequences

A projection image and sequence generation technology, which is applied in the fields of medicine, digital image processing, and three-dimensional imaging, can solve the problems of not reflecting the multi-view three-dimensional shape of the inner cavity, affecting the continuity of doctors' surgical operations, and fatigue.

Active Publication Date: 2021-04-20
北京世维通光智能科技有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, endoscopy does not meet the observation needs of doctors, such as figure 1 As shown: ①The image of the inner cavity is presented on the monitor, and the doctor needs to constantly move his sight between the surgical site and the monitor, which affects the continuity of the doctor's operation and is prone to fatigue
② A single endoscope observes the local area. If the doctor needs to observe a large area, multiple endoscopes will intervene in the human body at the same time, which not only increases the burden on the patient but also increases the burden on the endoscope cable, transmitter / receiver, interventional sleeve, etc. The degree of complexity and cumbersomeness; ③Sometimes assistants are needed to assist in holding and moving multiple endoscopes to cooperate with the doctor's observation, which brings inconvenience to the doctor's operation
[0004]The above solutions are still in the trial stage, and there are still some things to improve: ①The current orientation tracking technology needs to wear a transmitter or a marker on the doctor's head, increasing the ②The image of the inner cavity is a two-dimensional image, which does not reflect the multi-view three-dimensional shape of the inner cavity; Corrects the projected image so that an undistorted image of the lumen is seen on the patient surface

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for generating patient body surface projection image sequences
  • A method for generating patient body surface projection image sequences
  • A method for generating patient body surface projection image sequences

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0044] This embodiment is an embodiment of the method for observing the inner cavity through virtual and transparent projection of the body surface in minimally invasive surgery.

[0045] In the minimally invasive surgery in this embodiment, the body surface projection virtual transparent observation method for the inner cavity, the corresponding body surface projection system is as follows: Figure 4 As shown, the technical roadmap of this method is as follows Figure 5 shown, including the following steps:

[0046] Step a, Kinect doctor's viewing angle tracking, used to determine the doctor's current head position and visual angle;

[0047] Step b, PTAM three-dimensional modeling of the inner cavity, PTAM is Parallel Tracking and Mapping, which is used to generate a three-dimensional model of the inner cavity that can rotate with the doctor's perspective described in step a;

[0048] Step c. Generating a sequence of projection images of the patient's body surface, and proj...

specific Embodiment 2

[0050] This embodiment is an embodiment of the Kinect doctor's perspective tracking method.

[0051] The Kinect doctor's angle of view tracking method of the present embodiment can exist independently, and specific embodiment one can be further limited again; The Kinect doctor's angle of view tracking method, such as Figure 6 shown, including the following steps:

[0052] Step a1, select the depth data of the pupil and the tip of the nose as key points, and establish a mathematical model of the doctor's perspective;

[0053] Step a2, use the Kalman filter to predict the doctor's perspective and correct the tracking data;

[0054] Step a3, analyzing the orientation relationship among the Kinect, the doctor's head, the patient's body surface, the patient's inner cavity, and the projector, unifying the coordinate system, and designing the parameters of the patient's body surface projection system.

specific Embodiment 3

[0056] This embodiment is a Kalman filter embodiment.

[0057] The Kalman filter of the present embodiment can exist alone, and can be further limited to the second embodiment; the Kalman filter is specifically:

[0058] In a frame of Kinect data at time t, define its Kalman filter state vector X t and the observation vector Z t for:

[0059] x t =(x(t),y(t),z(t),v x (t), v y (t), v z (t))

[0060] Z t =(x(t),y(t),z(t))

[0061] Among them, x(t), y(t) and z(t) are the three-dimensional coordinates of the nose tip center, v x (t), v y (t) and v z (t) is the velocity of the nose tip center;

[0062] Accordingly, the Kalman system equation is:

[0063] x t+1 =AX t +BU t +GW t

[0064] Z t+1 =HX t +V t

[0065] Among them, A is the state matrix, B is the control matrix, which is approximately 0 when the facial movement has no control amount, G is the driving matrix, H is the observation matrix, and U t is the control vector, W t is x t Kinect measurement e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for generating patient body surface projection image sequences according to the present invention belongs to the technical fields of medicine, three-dimensional imaging, digital image processing, etc.; the method firstly uses a typical camera imaging model to calculate what the doctor expects to see according to the doctor's perspective and the three-dimensional model of the inner cavity. According to the internal cavity image, the three-dimensional shape of the patient's body surface, the doctor's angle of view, and the orientation of the projector, the body surface projection image sequence is calculated; a method for generating a patient's body surface projection image sequence according to the unified doctor's head Coordinate system, inner cavity coordinate system, patient body surface coordinate system, projector coordinates, real-time calculation of the inner cavity image that the doctor expects to see, and then combine the inner cavity image with the patient's body surface projection image sequence, using point correspondence instead of surface fitting , the overlapping coverage area of ​​the doctor's field of view and the projector's field of view on the patient's body surface can accurately calculate the projected image, regardless of the complexity of the patient's body surface, so distortion correction can be achieved while projecting.

Description

technical field [0001] The invention relates to a method for generating a patient body surface projection image sequence, which belongs to the technical fields of medicine, three-dimensional imaging, digital image processing, and the like. Background technique [0002] Compared with traditional open surgery, minimally invasive surgery has the advantages of small incision, less pain, and faster healing. It caters to the aesthetic concept of modern people, so it is increasingly popular and used in some abdominal and cranial cavity surgeries. At present, the main observation mode of minimally invasive surgery is endoscopy. The endoscope uses multiple pinhole cameras and a xenon lamp light source to capture images of the inflated lumen, which are displayed on the monitor for doctors to observe. At present, the most advanced endoscopes can obtain very high-quality images of the lumen, and then the positioning technology of surgical equipment can be derived from the images of the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): A61B34/20A61B34/10
Inventor 吴海滨周思礼孙崐徐凯歌于晓洋徐清
Owner 北京世维通光智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com