A dual-image visual navigation method in the curved intestine of a dual-hemispherical capsule robot

A capsule robot and visual navigation technology, applied in image communication, television, esophagoscopy and other directions, can solve the problems of low inspection efficiency, high requirements for image parameters, complex algorithms, etc., to reduce the requirements of installation and processing accuracy, and to simplify the operation process. The effect of fast and convenient human-computer interaction

Inactive Publication Date: 2021-04-20
DALIAN UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Although the above-mentioned capsule endoscope technology is relatively mature, there are still many problems in terms of clinical application feedback: (1) Active control of capsule robots: since most of the existing clinical capsule endoscopes do not have active walking mechanisms, they all rely on gastric Intestinal peristalsis advances passively, so its movement in the gastrointestinal tract is random, and the capsule cannot return after missing the lesion, and doctors cannot observe the area of ​​interest in detail, so the missed detection rate is high and the inspection efficiency is low
(2) Capsule robot navigation problem: Since the real-time position and attitude (pose) of the existing capsule endoscope in the gastrointestinal tract cannot be determined, it cannot be navigated, so that effective control of the capsule robot cannot be achieved
At present, the common visual navigation uses a multi-eye vision system. However, the internal space of the dual hemispherical capsule robot is small, and the method of installing multiple cameras will be limited by the space of the dual hemispherical capsule robot. There are high requirements for the installation accuracy of the dual hemispherical capsule robot, which makes the internal structure of the double hemispherical capsule robot too complex, and the complex circuit will reduce the reliability of the system
Although the 3D reconstruction technology can calculate the position of the current dual hemispherical capsule robot, the algorithm is complex and requires high image parameters
[0013] At present, no one has proposed to use the uniformity of the universal rotating magnetic field and the follow-up of the dual-hemispherical capsule robot in the magnetic field, without installing any sensors or other devices in the dual-hemispherical capsule robot. The image is used to determine the attitude information of the dual hemispherical capsule robot camera relative to the fixed coordinate system and determine the navigation direction through coordinate transformation. The significant advantage of this method is that it does not need to install other devices in the dual hemispherical capsule robot. The multi-eye vision system and the use of complex three-dimensional image reconstruction technology of the intestinal tract rely on the monocular camera vision of the dual hemispherical capsule robot combined with the uniformity of the universal rotating magnetic field and the follow-up of the dual hemispherical capsule robot in the universal rotating magnetic field. Through coordinate transformation, the final navigation information of the dual hemispherical capsule robot is obtained

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A dual-image visual navigation method in the curved intestine of a dual-hemispherical capsule robot
  • A dual-image visual navigation method in the curved intestine of a dual-hemispherical capsule robot
  • A dual-image visual navigation method in the curved intestine of a dual-hemispherical capsule robot

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0090] (1) When the dual hemispherical capsule robot is at position A, such as image 3 As shown, take the first image, and extract the centroid pixel coordinates of the dark area as (520, 135), as shown in Figure 10(a), read the magnetic vector direction θ=50° and δ=75° from the magnetic field controller at this time °; Keep the pitch angle of the magnetic vector direction unchanged, only change the side swing angle, the dual hemispherical capsule robot is still again, take the second image, and extract the pixel coordinates of the center of mass in the dark area of ​​the image as (361, 476), as shown in Figure 10 As shown in (b), read the magnetic vector direction θ=30° and δ=75° from the magnetic field controller at this time. Calculate the rotation angle α*=65° of the camera around the axis of the dual-hemispherical capsule robot through formulas (1)-(3).

[0091] (2) Using the magnetic vector directions θ=50° and δ=75° when taking the first image, combined with the rotat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dual-image visual navigation method in the curved intestinal tract of a dual-hemispherical capsule robot, which belongs to the technical field of automation engineering. This method uses the coaxial follow-up characteristics of the axis of the dual hemispherical capsule robot and the axis of the universal rotating magnetic field in the attitude adjustment mode to determine the pitch angle of the side swing of the axis, through the same pitch angle and two different side swing Two consecutive images taken by the monocular camera under the corner determine the rotation angle of the camera frame around the axis of the dual-hemispherical capsule robot, and then determine the camera attitude; then use the uniformity of the universal rotating magnetic field and combine the attitude information to determine the position in the fixed coordinates through coordinate conversion. The center of mass of the dark area of ​​the image of the curved intestine in the system is relative to the direction vector of the dual-hemispherical capsule robot to realize the navigation of the dual-hemispherical capsule robot in the curved intestine by the universal rotating magnetic field. The present invention can realize the navigation of the dual hemispherical capsule robot in the intestinal tract without adding any sensor or device and avoiding the use of complicated three-dimensional reconstruction technology.

Description

technical field [0001] The invention belongs to the technical field of automation engineering, and relates to a dual-image visual navigation method for a dual-hemispherical capsule robot driven by a space-universal rotating magnetic field in a curved intestinal tract. Background technique [0002] The human gastrointestinal tract is prone to various fatal diseases, among which colorectal cancer is the most common disease. However, if most gastrointestinal diseases are detected and diagnosed early, the cure rate will be significantly improved. Therefore, gastrointestinal examination and diagnosis are very important in the medical field. The most commonly used instrument for examining gastrointestinal diseases is the traditional endoscope, which cannot inspect the entire intestinal tract due to the limitation of the length of the catheter that can be inserted. Moreover, during the insertion of the endoscopic catheter, it is easy to cause damage to the soft tissue of the gast...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): A61B1/04A61B1/31A61B1/273A61B1/05A61B5/07H04N5/225H04N5/232
Inventor 张永顺田丰王智博杨慧远刘旭杨振强
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products