AR Mat with Light Sensors and IR Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems lack effective solutions for realistically representing virtual objects by accurately simulating real-world lighting and anchoring virtual objects to real-world locations, which affects the intuitive interaction with virtual images/objects and consistency in game and application spaces.
Innovation Solution
An assembly comprising a substrate with embedded or supported light sensors, a processor, and storage that outputs directional light information to render virtual objects with emulated illumination, along with a touch sensor array and IR reflective coating for user interaction and location tracking, allowing for accurate rendering of virtual objects in real-world lighting conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If light sensors and processing components are integrated into the mat assembly, then lighting measurement accuracy and virtual object rendering quality improve, but device complexity and manufacturing difficulty increase
Solution Approach 1:
The patent combines multiple functional components (light sensors, touch sensors, IR transmitters/receivers, processors) into a single integrated mat assembly. This merging approach enables comprehensive lighting measurement and virtual object rendering capabilities while managing complexity through unified system architecture rather than separate distributed components.
Solution Approach 2:
The mat assembly is designed as a multi-functional device that simultaneously performs lighting measurement, touch detection, IR tracking, and virtual object rendering. This universal approach allows a single device to replace multiple separate systems, improving measurement accuracy while consolidating complexity into one standardized platform.
2Manufacturing precision
If multiple sensor arrays and processing components are integrated into the mat, then virtual object rendering quality and interaction capability improve, but ease of manufacture deteriorates
Solution Approach 1:
The mat assembly is divided into distinct functional layers and modules: substrate layer, light sensor array, touch sensor array, IR reflective coating, and processing components. This segmentation allows each component to be manufactured and tested separately before integration, improving overall manufacturing precision while maintaining ease of assembly through modular construction.
Solution Approach 2:
Different regions of the mat are optimized for specific functions: certain areas have higher density light sensors for accurate lighting measurement, while other regions have enhanced touch sensor coverage for interaction. The IR reflective coating is applied selectively to specific zones for tracking purposes. This local optimization achieves high rendering quality without uniformly complicating the entire manufacturing process.
3Adaptability or versatility
If the system integrates multiple sensing and rendering components, then user interaction capability and AR realism improve, but system complexity increases
Solution Approach 1:
The mat assembly serves multiple functions simultaneously: it measures lighting conditions for realistic rendering, detects touch interactions for user input, tracks position via IR patterns, and renders virtual objects. This multi-functionality enhances adaptability and interaction capability while consolidating what would otherwise require multiple separate systems into one unified device.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables realistic rendering of virtual objects with accurate lighting and location anchoring, enhancing user interaction and consistency in AR environments by providing a standardized surface for AR simulations and games, ensuring correct lighting and interaction across different setups.
Implementation Method 1
The array is configured to output plural values together indicating a direction at which light from a light source impinges on the substrate
Implementation Method 2
a patterned infrared (IR) reflective coating juxtaposed with the substrate to reflect IR light from at least a first IR transmitter to at least a first IR receiver in a pattern provided to the processor as a location reference
Data Source
AI summary
A mat has an embedded array of light sensors under a micro-faceted lens array to provide an array of light intensity values for various incident angles of incident real world light. Virtual objects may be projected onto the mat and, using the information from the light sensors, virtually illuminated to match the real-world lighting environment. A touch sensor array may be embedded in the mat to allow users to interact with the virtual objects and provide other input. The surface of the micro-faceted lens array may be coated with a patterned infrared (IR) reflective coating, such that the mat passively reflects a specific band of IR wavelengths in a pattern to act as a fiducial marker.