AR Glasses Marker Tracking for Surgical Instrument Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to easily recognize and track a portion where a real object acts on its surroundings in virtual or real worlds, especially when using familiar surgical instruments or tools.
Innovation Solution
An information processing device and method that includes a recognition unit to identify the relative position of an acting portion relative to a marker fixed to a target object, and a tracking unit to track this acting portion based on its relative position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a specifically-designed surgical instrument with a marker is used, then tracking of the surgical instrument end is enabled, but the system requires specially designed instruments instead of familiar surgical tools
Solution Approach 1:
A marker is introduced as an intermediary element that attaches to the surgical instrument. The marker serves as a mediator between the familiar surgical instrument and the tracking system, enabling optical recognition without modifying the instrument's fundamental design or requiring specially designed instruments.
Solution Approach 2:
Instead of tracking the complex three-dimensional surgical instrument directly, the system creates a two-dimensional projection or image of the marker on the instrument surface. This copied representation is then tracked through image processing, simplifying the tracking task while maintaining precision.
2Adaptability or versatility
If general surgical instruments are used without markers, then instrument compatibility is maintained, but recognition and tracking of the acting portion becomes difficult
Solution Approach 1:
The marker utilizes optical contrast (color or brightness differences) to become detectable by the imaging system. This visual distinction allows the tracking system to easily identify and differentiate the marker from the surrounding surgical field and instrument surfaces.
3Measurement precision
If a marker is attached to the surgical instrument, then acting portion recognition is enabled, but the system complexity increases due to marker attachment requirements
Solution Approach 1:
The system tracks a two-dimensional image or projection of the marker rather than the full three-dimensional instrument. This dimensional reduction simplifies the computational burden and processing requirements while maintaining sufficient information for accurate tracking.
Data Source
AI summary
The present technology relates to an information processing device and an information processing method that enable easy recognition and tracking of a portion where a real object acts on its surroundings.The information processing device includes a recognition unit that recognizes a relative position of an acting portion relative to a marker fixed to a target object, the acting portion corresponding to a portion of the target object used by a user to act on surroundings in a virtual world or a real world, and a tracking unit that tracks the acting portion on the basis of the relative position of the acting portion relative to the marker. The present technology is applicable to augmented reality (AR) glasses, for example.