Robot Arm Projector for Distortion-Free Surgical Image Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In medical and other environments, surgeons and operators face challenges in accessing and interacting with visual information systems while performing tasks, requiring frequent gaze shifts between the operating table and display devices, which can hinder efficiency and safety.

Innovation Solution

A robot with a projector and camera integrated into its arm projects virtual input means onto an object's surface, allowing for image analysis of gestures and compensation for distortion caused by surface geometry, enabling hands-free operation and improved visual information access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If visual information is displayed on a separate screen, then information can be provided to the surgeon, but the surgeon must constantly shift gaze between the operating table and the screen

Engineering Contradiction:
Improvevisual information accessVSAvoidgaze shifting requirement
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces a camera as an intermediary device that captures the surgical field and transmits it to a display screen. This allows the surgeon to view surgical information on the screen without directly observing the surgical site, reducing the need for gaze shifting between the operating table and display devices

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent projects virtual input means and visual information onto a three-dimensional object (such as a model or the patient's body) in the surgical field. This transforms the traditional two-dimensional screen display into a three-dimensional spatial display that integrates with the surgical environment, allowing surgeons to access information without leaving the surgical field

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If virtual input means are projected onto a non-planar surface, then hands-free operation is enabled, but image distortion occurs due to surface geometry

Engineering Contradiction:
Improvehands-free operation capabilityVSAvoidimage projection accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent changes the projection parameters dynamically based on the detected surface geometry. The system adjusts projection angle, distance, and image content according to the three-dimensional characteristics of the target surface, thereby compensating for distortion and maintaining image accuracy on non-planar surfaces

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent employs a feedback mechanism where a camera or sensor detects the actual projection on the three-dimensional surface, analyzes the distortion, and sends correction signals back to the projection device. This closed-loop control enables real-time compensation for surface geometry-induced distortion

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Facilitates easier acquisition and interpretation of visual information, enhancing operational efficiency and safety by allowing surgeons to interact with virtual input means without gaze shifts, while compensating for image distortion for clearer projections.

Implementation Method 1

a device (18) for projecting an image onto a surface of an object

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

a device, in particular attached to or integrated into the robot arm, for capturing an image of the image projected onto the surface of the object

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Data Source

PatentEP2214872B1Robot and method for projecting an image onto the surface of an object
Publication Date: 2019.02.13 KUKA DEUT GMBH
  • EP2214872B1 patent drawingFigure 1
  • EP2214872B1 patent drawingFigure 2
  • EP2214872B1 patent drawingFigure 3~4

AI summary

The invention relates to a robot (R), a medical work station, and a method for projecting an image (20) onto the surface of an object (P). The robot (R) comprises a robot arm (A) and a device (18) for projecting the image (20) onto the surface of the object (P), said device (18) being mounted on or integrated into the robot arm (A).