Synthesized See-Through Viewpoints for Operator Occlusion Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Limited operator awareness of surrounding environments due to visual obstacles or distractions in settings like film production and theme parks, leading to potential collisions with objects or people.
Innovation Solution
A head-mounted display (HMD) system communicates with imaging devices to synthesize and render a field of view (FOV) that provides an unobstructed view of the environment, using omnidirectional cameras mounted on vehicles or costumes to capture image data and generate a see-through view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If imaging devices are mounted on vehicles or costumes to capture surrounding environment, then operator awareness of occluded areas is improved, but device complexity increases
Solution Approach 1:
The HMD system integrates multiple imaging devices (omnidirectional cameras) mounted on the vehicle or costume, nesting the imaging system within the operational platform. This allows the operator to wear the HMD and receive synthesized visual feedback from cameras positioned on the vehicle/costume, providing awareness of occluded areas without requiring separate external monitoring equipment.
Solution Approach 2:
The system introduces an intermediary processing system that captures images from multiple cameras, synthesizes the field of view, and renders it through the HMD display. This intermediary system bridges the gap between the physical cameras mounted on the vehicle/costume and the operator's visual perception, enabling see-through capability without direct line of sight.
2Area of stationary object
If multiple imaging devices are used to capture image data from different locations, then coverage of occluded areas is improved, but manufacturing precision requirements increase
Solution Approach 1:
The system divides the field of view coverage into multiple segments by deploying several imaging devices at different locations on the vehicle or costume. Each camera captures a specific portion of the surrounding environment, and the system synthesizes these segmented views into a complete panoramic or omnidirectional field of view, ensuring comprehensive coverage of occluded areas.
Solution Approach 2:
The system transitions from a single-point perspective to a multi-dimensional spatial arrangement by positioning cameras at various locations around the vehicle or costume. This spatial distribution across multiple dimensions allows comprehensive coverage of the surrounding environment, with the synthesis algorithm integrating these multi-dimensional views into a unified panoramic display.
Data Source
AI summary
The disclosure is directed a method including capturing image data of a real-world environment at a first location and a second location different than the first location. The image data includes a plurality of intersecting image data points captured at both the first location and the second location, and a representation of an area occluded by an obstacle from a point of view of a user and; generating a synthesized field of view (“FOV”) that includes the plurality of intersecting image data points such that the synthesized FOV includes an unobstructed view of the area occluded by the obstacle from the point of view of the user; and rendering the synthesized FOV as a visual display.