AR Cross-Domain Security via Image Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality and virtual display technologies face challenges in processing and recognizing objects in physical environments, particularly in scenarios requiring sensitive information separation due to security, privacy, or classification concerns, where physical separation of computing systems is necessary to prevent data leakage.
Innovation Solution
A method and system that utilize a first computer to display primary data of a lower sensitivity level and a second computer, communicatively isolated from the first, to capture and process images of the primary data, executing a display recognition and characterization algorithm to augment the primary data with secondary information of a higher sensitivity level on a separate display, without sharing data between the computers, using image or video capture devices and wearable heads-up displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If physical separation of computing systems is used to prevent data leakage between sensitivity levels, then data security is improved, but the ability to augment display information across domains deteriorates
Solution Approach 1:
An image capture device serves as an intermediary between the first computer (lower sensitivity level) and the second computer (higher sensitivity level). The device captures images of the display screen without requiring direct data transmission or communication between the isolated computing systems, enabling information augmentation while maintaining physical security separation.
2Adaptability or versatility
If image capture devices are used to transfer information between isolated systems, then information augmentation capability is improved, but system complexity increases
Solution Approach 1:
The system creates visual copies of data from the first computer's display screen by capturing images with a camera device. These image copies are then processed by the second computer to extract and augment information, allowing data transfer without direct connection while using familiar display and camera components.
3Productivity
If display recognition algorithms are executed on isolated systems, then information processing capability is improved, but computational requirements increase
Solution Approach 1:
The display recognition and characterization algorithm extracts only the specific information needed from the captured images rather than processing or transmitting complete datasets. This partial action approach enables the second computer to obtain necessary augmented information while minimizing unnecessary computational energy consumption.
Data Source
AI summary
A method comprising the steps of: displaying primary data having a first sensitivity level on a first display screen that is operatively coupled to a first computer; capturing an image of the first display screen with an image capture device that is operatively coupled to a second computer that is communicatively isolated from the first computer such that no data is shared between the first and second computers; executing with the second computer a display recognition and characterization algorithm to recognize the primary data based only on the captured image of the first display screen; and augmenting the primary data by displaying secondary data on a second display, wherein the secondary data is related to, and has a higher sensitivity level than, the primary data.