Robotic Microscope Gesture Control With Redundant Detection Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manual control of microscopic imaging settings during surgical procedures introduces sterility issues and distracts surgeons from the operating field, while existing gesture control systems are limited by a narrow field of view and flexibility.
Innovation Solution
A robotic microscope system with multiple detection devices providing enhanced fields of view for detecting control gestures, allowing flexible and redundant control of imaging and display settings through gesture recognition, including position, orientation, and movement sequences, with adjustable detection areas and overlapping or separated fields of view to enhance accessibility and plausibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual control members are used to control imaging settings, then control functionality is provided, but sterility issues arise and surgeon attention is distracted
Solution Approach 1:
The patent replaces manual mechanical control members with gesture-based control using detection devices. The surgeon's hand gestures are detected by imaging devices to control imaging parameters, eliminating the need for physical contact with control members and thus resolving sterility issues while keeping the surgeon's attention on the operating field.
Solution Approach 2:
The patent introduces detection devices as intermediaries between the surgeon's control intentions and the imaging system. The detection devices capture hand gestures and convert them into control commands, allowing sterile operation without direct manual control while maintaining surgeon focus on the surgical site.
2Object-affected harmful factors
If gesture control with a single detection device is used, then sterility and attention are maintained, but flexibility and control options are limited
Solution Approach 1:
The patent divides the detection function into multiple separate detection devices, each with its own field of view. This segmentation allows detection of gestures from different body parts (hands, arms, head) and enables more diverse control commands while maintaining the sterile gesture-based interaction mode.
Solution Approach 2:
The patent makes the detection system universal by using multiple detection devices that can detect various body parts and gesture types. This multi-functionality allows a single gesture-based control system to handle diverse control needs (imaging parameters, robotic control, display settings) without compromising sterility or surgeon attention.
3Adaptability or versatility
If multiple detection devices with overlapping fields of view are used, then flexibility and redundancy are enhanced, but device complexity increases
Solution Approach 1:
The patent merges the outputs of multiple detection devices into a unified control system. The control unit integrates information from all detection devices to determine the surgeon's intent, providing redundant control options while managing complexity through centralized processing rather than requiring separate control paths for each device.
Data Source
AI summary
The present invention relates to a robotic microscope system (100, 100′) for imaging and displaying images of an operating field (6), comprising:a microscopic imaging system (10, 10′), comprising at least one microscopic imaging unit (1), the at least one microscopic imaging unit (1) comprises at least one imaging device (8) providing a field of view (9) for imaging the operating field (6),a robotic device (20), operatively connected to the microscopic imaging system (10, 10′) configured for a controlled movement of the microscopic imaging system (10, 10′) in at least one degree of freedom,at least one display device (30) operatively connected to the at least one microscopic imaging unit (1) and configured to display at least the images of the operating field (6) imaged by the at least one imaging device (8),at least a first detection device (3a) and a second detection device (3b), each of which providing a field of view (4a, 4b) for detecting at least one of a position, an orientation and a movement sequence of at least one control triggering object (5a, 5b) as at least one trigger characteristic, anda control device (1b) configured to control at least one of the at least one microscopic imaging unit (1), the robotic device (20) and the display device (30) in accordance with the at least one detected trigger characteristic detected by at least one of the first detection device (3a) and the second detection device (3b) within a predetermined portion of the respective field of view (4a, 4b) for detecting the at least one trigger characteristic to adapt images of the operating field (6) to be displayed.The present invention also relates to a method for controlling such robotic microscope system and a respective computer program product.