Endoscope Tracking Device Using Bidirectional Mask Combination

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional image tracking methods, especially in endoscopic surgeries, face challenges with high accuracy due to accumulation of tracking errors over time, and are not suitable for region-based tracking as they disrupt the continuity of the tracking target.

Innovation Solution

A tracking device and method that performs both forward and backward tracking, generating a combined mask image by combining forward and backward mask images, which reduces tracking errors and maintains the continuity of the tracking target, allowing for accurate region-based tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If forward tracking is performed in consecutive frames, then tracking continuity is maintained, but tracking errors accumulate over time reducing accuracy

Engineering Contradiction:

Improvetracking continuityVSAvoidtracking accuracy

Core Design Contradiction:

Stability of the object's compositionVSMeasurement precision

Solution Approach 1:

The patent applies backward tracking from the end frame to the start frame, inverting the conventional forward-only tracking approach. This allows errors to accumulate in reverse direction, and by combining both forward and backward tracking results, the system cancels out accumulated errors and maintains high accuracy throughout the video sequence while preserving tracking continuity.

Inventive Principle:

Principle #13The other way round (Inversion)

2Speed

If conventional tracking methods are used, then processing speed is maintained, but accuracy deteriorates due to error accumulation

Engineering Contradiction:

Improveprocessing speedVSAvoidtracking accuracy

Core Design Contradiction:

SpeedVSMeasurement precision

Solution Approach 1:

The patent performs preliminary backward tracking from the end frame before final forward tracking. By pre-calculating the backward mask image and combining it with forward tracking results, the system establishes an error-corrected reference that maintains high accuracy throughout the tracking process without sacrificing processing speed.

Inventive Principle:

Principle #10Preliminary action

3Stability of the object's composition

If region-based tracking is implemented, then tracking target continuity is preserved, but tracking accuracy decreases due to error accumulation

Engineering Contradiction:

Improvetarget continuityVSAvoidregion tracking accuracy

Core Design Contradiction:

Stability of the object's compositionVSMeasurement precision

Solution Approach 1:

The patent merges forward mask image from forward tracking with backward mask image from backward tracking to create a combined mask image. This combination integrates results from both tracking directions, canceling accumulated errors while preserving the continuity of the tracking target region, thereby maintaining both accuracy and target integrity.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11790537B2Tracking device, endoscope system, and tracking method

Publication Date: 2023.10.17 OLYMPUS CORPORATION(JP)

AI summary

A tracking device includes a processor including hardware. The processor is configured to: set a start frame and an end frame in a video including multiple frames; perform forward tracking in frames subsequent to the start frame based on a region of a tracking target in the start frame; perform backward tracking in frames previous to the end frame based on a region of the tracking target in the end frame; and generate a combined mask image by combining a forward mask image based on the forward tracking with a backward mask image based on the backward tracking.