Touchless Medical Image Processing via Voice and Gesture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Advanced medical imaging processing software is cumbersome and difficult to use, especially in sterile environments like operating rooms, requiring trained users and physical interaction, which is risky and time-consuming.

Innovation Solution

A touchless advanced image processing system that uses voice, motion, or gesture controls, along with sensors like cameras and microphones, to allow users to interact with medical images without physically touching the device, enabling automatic image processing based on identified parameters and anatomical landmarks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional medical imaging processing software is used in sterile environments, then image processing functions can be performed, but sterility is compromised and operation becomes cumbersome

Engineering Contradiction:
Improvesterility maintenanceVSAvoidoperation complexity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces mechanical contact-based interaction (mouse, keyboard, touchscreen) with voice recognition and gesture-based control systems. This allows physicians to operate imaging software without physical contact with devices, maintaining sterility while enabling intuitive control through natural voice commands and hand gestures captured by microphones and cameras.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces voice recognition software and gesture recognition software as intermediaries between the physician and the imaging processing system. These intermediaries translate voice commands and gestures into software operations, eliminating the need for direct physical contact with control devices while maintaining full functionality of the imaging processing software.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If traditional mouse-click based software tools are used, then precise image processing control is achieved, but time consumption increases and sterility is compromised

Engineering Contradiction:
Improveimage processing control precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical mouse-click interaction model with voice-based command execution. Physicians can issue multiple processing commands sequentially through voice without returning the mouse to the hand, eliminating repetitive hand-to-device movements and significantly reducing operation time while maintaining precise control over image processing parameters.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system allows physicians to pre-configure processing parameters and workflows that can be activated through simple voice commands. Complex multi-step processing sequences are prepared in advance and can be executed with a single voice instruction, reducing the time required for sophisticated image processing tasks.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If multiple software tools and processing steps are used, then comprehensive image analysis is achieved, but device complexity and training requirements increase

Engineering Contradiction:
Improveimage processing capabilityVSAvoidsoftware complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal control interface that handles multiple image processing functions through a single voice recognition system. The same voice interface can perform bone removal, vessel segmentation, tumor identification, and measurement tasks, consolidating what would otherwise require multiple specialized tools and interfaces into one unified system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system incorporates automatic image processing capabilities that execute complex algorithms without requiring detailed user intervention. The software automatically performs tasks such as anatomical landmark identification, vessel segmentation, and measurement calculations based on voice commands, reducing the need for users to understand complex processing parameters while maintaining comprehensive analysis capabilities.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10603134B2Touchless advanced image processing and visualization
Publication Date: 2020.03.31 TERARECON INC
  • US10603134B2 patent drawing
  • US10603134B2 patent drawing
  • US10603134B2 patent drawing

AI summary

A display device displays a first medical image to a user. Touchless sensor technology detects user actions. The touchless sensor technology includes at least one sensor that does not rely on physical touch to detect the user actions. An image processor that compares detected user actions with currently valid user action within a list of currently valid user actions for the first medical image to determine when a detected user action matches a currently valid user action from the currently valid user actions contained in the list. A medical image processing engine uses metadata identifying the first medical image and an action identifier for a currently valid user action that is matched by the detected user action to generate a second medical image based on the metadata and the action identifier. Thee display device displays the second medical image to the user.