Handheld Surgical Imaging With Beacon-Based Display Manipulation

Solution Overview

Problem

Existing medical imaging systems require practitioners to use multiple devices for capturing and manipulating images/videos, leading to delays and potential contamination, and lack precision in extracting information from medical video streams and annotating tissue samples.

Innovation Solution

A handheld device with integrated white and infrared sensors captures images/videos, using infrared beacons to determine its position/orientation relative to a display, allowing single-device capture and manipulation, and employs frame-synchronized object tracking for precise image analysis and annotation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If multiple devices are used for capturing and manipulating images/videos, then the functionality is comprehensive, but the operation becomes cumbersome and time-consuming

Engineering Contradiction:

Improveease of operationVSAvoiddevice complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent combines image capture functionality and image manipulation controls into a single handheld device. The device integrates an image sensor for capturing medical images/videos and a display screen showing the captured content with manipulation controls, eliminating the need to switch between separate capture and control devices during medical procedures

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The handheld device serves multiple functions: it captures images/videos via the image sensor, displays the captured content on its screen, and provides manipulation controls for processing the images/videos. This multi-functional design allows a single device to replace what previously required multiple separate devices

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Productivity

If multiple devices are used for capturing and manipulating images/videos, then the functionality is comprehensive, but delays occur during device switching

Engineering Contradiction:

ImproveproductivityVSAvoidloss of time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent combines image capture functionality and image manipulation controls into a single handheld device. The device integrates an image sensor for capturing medical images/videos and a display screen showing the captured content with manipulation controls, eliminating the need to switch between separate capture and control devices during medical procedures

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The handheld device enables continuous operation by allowing the practitioner to capture images/videos and immediately manipulate them on the device's display without interruption. The integrated design maintains continuous workflow by eliminating device switching, keeping the useful action of image capture and manipulation uninterrupted

Inventive Principle:

Principle #20Continuity of useful action

3Reliability

If multiple devices are used for capturing and manipulating images/videos, then the functionality is comprehensive, but contamination risk increases

Engineering Contradiction:

ImprovereliabilityVSAvoidcontamination risk

Core Design Contradiction:

ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent combines image capture functionality and image manipulation controls into a single handheld device. The device integrates an image sensor for capturing medical images/videos and a display screen showing the captured content with manipulation controls, eliminating the need to switch between separate capture and control devices during medical procedures

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent extracts the manipulation controls from separate external devices (mouse, keyboard, touch-screen) and integrates them directly into the handheld capture device's display. This extraction and integration eliminates the need for the practitioner to physically handle or switch to other devices that could introduce contamination

Inventive Principle:

Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless capture and manipulation of medical images/videos using a single device, reduces contamination risk, and enhances precision in selecting and tracking regions of interest within medical video streams.

Implementation Method 1

one or more image sensors configured to capture both white light video/images and infrared video/images

Methodology Applied

Scientific EffectInfrared radiation detection: Infrared Radiation

Implementation Method 2

the display assembly comprises one or more infrared beacons positioned proximate to the display assembly and configured to emit infrared light

Methodology Applied

Scientific EffectLight emission and detection: Light

Data Source

PatentUS12514675B2Systems and methods for capturing, displaying, and manipulating medical images and videos

Publication Date: 2026.01.06 STRYKER CORP

AI summary

A surgical image capture and display system includes a handheld image capture and pointing device and a display assembly. An image is captured by an image sensor of the handheld device and displayed on the display assembly. The image sensor detects light emitted by one or more beacons of the display assembly. The system determines, based on the light emitted by the one or more beacons, a position or orientation of the handheld device relative to the display assembly. The system updates display of a graphical user interface comprising the image on the display assembly in accordance with the determined position or orientation of the handheld device.