AR Headset Camera Extracts Offline Sensor Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems struggle to effectively extract and utilize data from offline sensing devices, such as analog and digital sensors, for generating interactive AR content, as these devices are not typically connected to monitoring computer systems, limiting their integration and real-time monitoring capabilities.
Innovation Solution
A system and method that utilize a head-mounted device with a camera, display, and hardware processor, equipped with an AR application, to identify and extract visual data from sensing devices, generate AR content, and communicate this data to a server, effectively making offline devices 'online' for monitoring and integration into AR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR systems attempt to extract data from offline sensing devices, then integration capability and real-time monitoring are improved, but device complexity and data extraction difficulty increase
Solution Approach 1:
The patent introduces an intermediary system consisting of the AR device, camera, and image processing algorithms that mediates between offline sensing devices and the monitoring system. The camera captures images of sensor displays, and image processing extracts data without requiring direct connection to the sensing devices, thus maintaining integration capability while managing complexity through an intermediate layer
Solution Approach 2:
The system creates a visual copy of sensor data by capturing images of physical sensor displays with a camera. Instead of directly interfacing with the sensing devices, the system copies the visual representation of data from sensor displays, processes this copy through image recognition, and integrates it into the AR environment, thereby simplifying the integration process while maintaining data accessibility
2Productivity
If AR systems integrate offline sensing devices, then real-time monitoring capability is improved, but difficulty of detecting and measuring sensor data increases
Solution Approach 1:
The patent replaces traditional mechanical or electrical connection methods for data extraction with an optical system. Instead of using wires, connectors, or direct electronic interfaces to read sensor data, the system uses a camera to optically capture sensor display images and image processing algorithms to extract data, thereby enabling real-time monitoring while simplifying the detection process
Solution Approach 2:
The image processing system serves as an intermediary that translates visual information from sensor displays into usable data. This intermediary layer captures images of sensor displays, processes them through recognition algorithms, and outputs structured data for monitoring, thereby reducing the difficulty of detecting and measuring sensor data from offline devices
Data Source
AI summary
A system and method for extracting data for augmented reality content are described. A device identifies a sensing device using an image captured with at least one camera of the device. Visual data are extracted from the sensing device. The device generates an AR content based on the extracted visual data and maps and displays the AR content in the display to form a layer on the sensing device.


