Mixed Reality Device Simulation for Pre-Hardware Performance Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Developing mixed reality (MR) software applications without access to hardware for testing can result in unsatisfactory performance when the hardware becomes available, and waiting for hardware availability introduces undesirable delays.
Innovation Solution
An immersive feedback loop simulates MR device configurations using synthetic sensors to test and optimize MR applications, collecting and comparing key performance indicators (KPIs) across various configurations, enabling experience-driven hardware development.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If MR applications are developed prior to hardware availability, then development time is reduced, but application performance on actual hardware becomes uncertain
Solution Approach 1:
The patent creates virtual copies of MR devices with simulated sensor configurations that replicate the behavior and characteristics of physical hardware. These virtual device copies enable developers to test and optimize applications before actual hardware is available, maintaining development speed while ensuring performance reliability through accurate simulation of sensor data and device behavior.
Solution Approach 2:
The system performs preliminary testing and optimization of MR applications using simulated sensor data and virtual device configurations before the actual hardware becomes available. This preliminary action includes validating application behavior, identifying performance issues, and optimizing code against simulated hardware characteristics, ensuring the application is ready for deployment when physical devices are available.
2Productivity
If hardware designers speculate minimum hardware requirements, then development can proceed in parallel, but hardware specifications may be inaccurate
Solution Approach 1:
The patent implements a feedback mechanism where application performance metrics are collected during testing on virtual device configurations with simulated sensors. This feedback loop provides quantitative data about minimum hardware requirements, replacing speculative estimates with measured performance data. Developers can iteratively adjust hardware specifications based on actual performance feedback from the simulated environment.
Solution Approach 2:
The system varies sensor configuration parameters in the virtual device simulations to test different hardware specifications. By changing parameters such as sensor resolution, sampling rates, and sensor types in the simulated environment, the system identifies the minimum viable hardware requirements that maintain acceptable application performance, providing precise specifications rather than speculation.
3Reliability
If physical MR devices are used for testing, then application performance is accurately validated, but development delays occur due to hardware availability
Solution Approach 1:
The patent introduces a simulated sensor environment as an intermediary between the application code and the physical hardware. This intermediary layer provides realistic sensor data and device behavior simulation, enabling accurate performance validation without requiring physical device availability. The intermediary maintains fidelity to actual hardware behavior while decoupling the development timeline from hardware delivery schedules.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A feedback loop, for experience driven development of mixed reality (MR) devices, simulates application performance using various synthetic MR device configurations. Examples display, using an application, a virtual object on a first MR device, during a recording session; record, during the recording session, sensor data from the first MR device; simulate sensor data, based at least on the recorded sensor data, for the virtual object on simulated MR devices having various configurations of simulated sensors, during simulation sessions; and generate displays, using the application, of the virtual object on the simulated MR devices, during playback sessions. Some examples further collect recording key performance indicator (KPI) data during the recording session; collect simulation KPI data during the simulation sessions; compare the simulation KPI data with the recording KPI data to produce simulation KPI comparison data sets; and collect playback key performance indicator (KPI) data during the playback sessions.