Throwable Mixed Reality Sensor for Real-Time Scene Mapping

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current mixed reality systems face challenges in generating and maintaining accurate scene and mapping data in real-time, especially in environments where users need to assess danger before entering, such as in combat scenarios, where stale mapping data can lead to surprise attacks from undetected enemies.

Innovation Solution

A projectable device, such as a throwable grenade or drone, equipped with cameras and sensors, captures and transmits scene and mapping data to a mixed reality system, which can analyze the data to recognize people and their intent, and initiate detonation only when necessary, thereby providing real-time visualization of environments and reducing the waste of resources by not detonating in empty rooms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a projectable device continuously captures and transmits scene data in real-time, then the accuracy and freshness of mapping data is improved, but the energy consumption increases

Engineering Contradiction:

Improveaccuracy of mapping dataVSAvoidenergy consumption of projectable device

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The projectable device alternates between active mode (capturing and transmitting scene data) and low-power mode (conserving energy). The device is activated when threats are detected or when scene changes occur, and transitions to low-power mode when the environment is stable and safe, thereby reducing energy consumption while maintaining data accuracy when needed.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The system uses feedback from scene analysis (detecting threats, movement, or changes) to dynamically control the projectable device's operation. When threats are detected, the device activates to capture fresh scene data; when no threats are present, it enters low-power mode, optimizing the balance between data accuracy and energy consumption.

Inventive Principle:

Principle #23Feedback

2Speed

If the projectable device detonates immediately upon entering an environment, then the speed of neutralizing threats is improved, but the risk of friendly fire and resource waste increases

Engineering Contradiction:

Improvespeed of threat neutralizationVSAvoidfriendly fire risk

Core Design Contradiction:

SpeedVSObject-affected harmful factors

Solution Approach 1:

The projectable device performs preliminary scene capture and threat detection before detonation. It first captures scene data, analyzes it for threats using the mixed reality system, and only then detonates if threats are confirmed. This preliminary action ensures rapid response to genuine threats while avoiding friendly fire by verifying threat presence before detonation.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses real-time feedback from scene analysis to control detonation timing. The mixed reality system continuously analyzes captured scene data for threats, and the projectable device detonates only when threat detection feedback is received, ensuring both speed and safety.

Inventive Principle:

Principle #23Feedback

3Area of stationary object

If multiple projectable devices are deployed to cover large areas, then the coverage and detection capability are improved, but the quantity of resources consumed increases

Engineering Contradiction:

Improvecoverage areaVSAvoidnumber of grenades used

Core Design Contradiction:

Area of stationary objectVSQuantity of substance

Solution Approach 1:

Each projectable device is designed to be multi-functional, serving both as a scene capture platform and a threat neutralization device. By making each device universal in function, the system reduces the total number of devices needed, as each device can independently cover and neutralize threats in its area without requiring additional specialized devices.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The projectable devices operate autonomously, capturing scene data, transmitting it to the mixed reality system for analysis, and self-detonating when threats are detected. This self-service capability reduces the need for human intervention and allows devices to be deployed more efficiently, covering larger areas with fewer devices.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS11821723B2Projectable device for use with mixed reality system

Publication Date: 2023.11.21 CHOSEN REALITIES LLC

AI summary

A peripheral device that is used with a mixed reality system that is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.