Endoscope Motion Pattern Detection for Intuitive AI Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Endoscope operators face difficulties in performing complex operations without confusing assigned functions due to limited input devices, especially when interacting with artificial intelligence for diagnosis, requiring them to stop examining and use external input methods like mice, which is burdensome.

Innovation Solution

An endoscope device with a motion pattern identification unit that associates specific movements of the scope head with operations, allowing operators to perform tasks using existing mechanisms and buttons without adding sensors, by identifying motion patterns through time-series images or sensor information, and executing corresponding operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the number of input devices such as buttons and angle knobs is increased to accommodate more operations, then the number of operations that can be assigned is improved, but the device complexity and ease of operation deteriorate due to adding more physical components

Engineering Contradiction:
Improvenumber of operations that can be assignedVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The operation unit is designed so that existing buttons and angle knobs can perform multiple different operations depending on the current operation mode. For example, a single button can serve as a capture button in one mode and a light source switching button in another mode, allowing one physical component to control multiple functions without increasing the number of physical inputs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically changes the function assigned to each input device based on the current operation mode. The operation mode itself can be switched by specific operations (such as half-pressing a button or rotating an angle knob in a particular way), creating a dynamic reconfiguration of the interface where the same physical device serves different purposes at different times.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If different operations are assigned to the same button for different operation modes, then the versatility is improved, but the ease of operation deteriorates due to operator confusion

Engineering Contradiction:
Improveoperation versatilityVSAvoidease of operation
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system provides visual feedback through the display unit to indicate the current operation mode and the function currently assigned to each input device. This allows the operator to understand which operation will be executed when pressing a button, eliminating confusion even though the same button serves multiple functions across different modes.

Inventive Principle:
Principle #23Feedback

3Reliability

If AI diagnosis functionality is added, then the diagnostic capability is improved, but the ease of operation deteriorates because the operator must stop examining and use external input devices like mice

Engineering Contradiction:
Improvediagnostic capabilityVSAvoidease of operation
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The AI diagnosis approval/disapproval functionality is merged with the existing endoscope operation unit. Instead of requiring a separate mouse or external input device, the system allows operators to approve or disapprove AI diagnosis results using the same buttons and angle knobs already present on the endoscope handle, combining multiple functions into a single integrated interface.

Inventive Principle:
Principle #5Merging (Combining)

4Device complexity

If the number of buttons and angle knobs is limited, then the device complexity is reduced, but the adaptability deteriorates due to limitation on the number of operations that can be assigned

Engineering Contradiction:
Improvedevice complexityVSAvoidadaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

Each button and angle knob on the operation unit is designed to serve multiple functions across different operation modes. The system dynamically reassigns functions to these limited physical inputs based on the current mode, allowing a small number of physical components to control a large number of different operations including examination functions, AI diagnosis approval/disapproval, and mode switching.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11324388B2Endoscope device, endoscope operation method, and program with motion pattern detection
Publication Date: 2022.05.10 FUJIFILM CORP
  • US11324388B2 patent drawing
  • US11324388B2 patent drawing
  • US11324388B2 patent drawing

AI summary

An endoscope device, an endoscope operation method, and a program are provided. An endoscope device includes a motion pattern identification unit that identifies a single or plurality of motion patterns indicating a specific movement of a scope head of a scope unit, an operation storage unit that stores a single or plurality of pieces of operation information for instructing an operation of the endoscope device, and the single or plurality of motion patterns of the scope head in association with each other, an operation information acquisition unit that acquires the operation information corresponding to the motion pattern from the operation storage unit on the basis of the motion pattern identified by the motion pattern identification unit, and an operation execution unit that executes an operation corresponding to the operation information acquired by the operation information acquisition unit.