Remote Touch Detection via Peripheral Camera Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current techniques for interacting with virtual objects in computer-generated reality (CGR) environments are cumbersome and non-intuitive, particularly for remote touch detection.
Innovation Solution
A system comprising multiple devices, including a peripheral device placed on a physical surface, uses camera sensors from both devices to determine touch inputs, allowing users to interact with virtual objects by performing touches on a physical surface, with optional infrared light emission for enhanced detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If hardware buttons or touch-enabled hardware are used to interact with virtual objects, then interaction capability is provided, but the interaction becomes cumbersome and non-intuitive
Solution Approach 1:
The patent introduces a peripheral device as an intermediary between the user and the virtual objects. This peripheral device includes camera sensors that detect physical touches on a surface and translate them into interactions with virtual objects displayed on a head-mounted display. The intermediary device enables natural, intuitive touch interaction without requiring the user to manipulate hardware buttons or touch screens directly.
Solution Approach 2:
The patent replaces mechanical interaction systems (hardware buttons, touch screens) with an optical detection system. Camera sensors capture images of physical touches on a surface, and image processing algorithms determine touch characteristics such as location, pressure, and duration. This substitution eliminates the need for specialized input hardware and enables more natural interaction gestures.
2Measurement precision
If multiple camera sensors from different devices are used for touch detection, then detection accuracy is improved, but system complexity increases
Solution Approach 1:
The patent divides the detection system into separate functional components: the peripheral device containing camera sensors for capturing touch images, the head-mounted display for presenting virtual objects, and a processing system for analyzing images and determining touch inputs. This segmentation allows each component to be optimized independently while working together to achieve accurate touch detection.
Solution Approach 2:
The peripheral device serves multiple functions: it houses camera sensors for touch detection, may include infrared light sources for enhanced detection, and communicates with the head-mounted display system. This multi-functionality reduces overall system complexity by consolidating multiple capabilities into a single device rather than requiring separate specialized components.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and intuitive remote touch detection, improving interaction efficiency and accuracy in CGR environments by combining data from multiple camera sensors and potentially using infrared light for precise input recognition.
Implementation Method 1
with optional infrared light emission for enhanced detection
Implementation Method 2
obtaining first image data about an input, wherein the first image data is obtained using one or more camera sensors
Data Source
AI summary
The present disclosure relates generally to remote touch detection. In some examples, a first electronic device obtains first image data and second image data about an input, and performs an operation based on the input in accordance with a determination that a set of one or more criteria is met based on the first image data and the second image data. In some examples, a first electronic device causes emission of infrared light by an infrared source of a second electronic device, obtains image data about an input, and performs an operation based on the input in accordance with a determination that a set of one or more criteria is met based on the image data.