Mirror Accessory for Camera-Based Touch Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current touch detection methods in mixed reality environments face challenges in accurately detecting touch events on real objects without integrated touch sensors, as cameras often provide insufficient image data for reliable detection.
Innovation Solution
A method utilizing a mirror accessory to capture first and second image data, where the second image is a reflection of the touching object and target surface, allowing for the determination of the pose of the mirror and the touching object, thereby estimating the touch status between the object and the surface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a camera is used for visual touch detection on real objects, then touch detection capability is provided, but the image data is insufficient for accurate touch detection
Solution Approach 1:
The patent introduces a mirror to capture reflected light from the touch interface, adding a new dimensional perspective (reflection dimension) to the image data. This allows the system to observe touch events from multiple angles simultaneously, providing sufficient image data for accurate touch detection without requiring physical contact with the surface.
Solution Approach 2:
The mirror acts as an intermediary element between the camera and the touch interface. It redirects light from the touch surface to the camera, enabling indirect observation of touch events. This intermediary approach allows the camera to capture adequate image data for touch detection without being physically close to or in direct contact with the touch surface.
2Measurement precision
If traditional touch sensors are integrated into real objects, then accurate touch detection is achieved, but the object complexity and manufacturing difficulty increase
Solution Approach 1:
The patent extracts the touch detection function from the physical object itself and relocates it to a separate camera-based system with mirror assistance. This eliminates the need to integrate touch sensors into the real object, maintaining object simplicity while achieving accurate touch detection through external imaging and analysis.
Solution Approach 2:
The patent replaces mechanical/electrical touch sensors with an optical-based detection system. Instead of using physical sensors embedded in the object, the system uses light reflection captured by a camera and processed through image analysis algorithms, substituting a complex mechanical sensing system with a simpler optical approach.
3Reliability
If a single viewpoint camera is used, then the system is simple, but occlusion and ambiguity reduce touch detection reliability
Solution Approach 1:
The mirror provides an additional dimensional viewpoint (reflected perspective) that complements the direct camera view. This multi-dimensional imaging approach reduces occlusion and ambiguity by capturing touch events from different angles simultaneously, improving detection reliability without requiring multiple physical cameras.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach improves the accuracy of touch detection by providing additional data perspectives, reducing occlusion and ambiguity, and enhancing the observability of touch events, even on surfaces without integrated sensors.
Implementation Method 1
Second image data is captured and includes the touching object and the target surface as a reflection in a mirror
Data Source
AI summary
Touch detection using a mirror accessory may include obtaining first image data comprising a touching object and a target surface, wherein the first image data captures a scene comprising the touching object and the target surface from the viewpoint of a camera, obtaining second image data comprising the touching object and the target surface, wherein the second image data captures the touching object and the target surface as a reflection in a mirror that is separate from the target surface, determining a pose of the mirror in the scene, determining a pose of the touching object in the scene based on the first image data, the second image data, and the pose of the mirror, and estimating a touch status between the touching object and the target surface based on the determined pose of the touching object and a pose of the target surface.