First-Person Reality Content Subsetting via Real Space Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing first-person perspective-mediated reality systems struggle to efficiently determine and render a subset of available mediated reality content without requiring users to change their location in the real space, limiting the user's interaction and immersion.

Innovation Solution

The system determines an available real space and a corresponding constrained virtual space, automatically selects a subset of mediated reality content based on user interaction, and renders this content to the user without changing their location, using a head-mounted display and tracking technology.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If the system renders all available mediated reality content, then the completeness of virtual space representation is improved, but the computational complexity and rendering time increase

Engineering Contradiction:
Improveamount of mediated reality contentVSAvoidrendering system complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The system extracts and renders only the relevant subset of mediated reality content that corresponds to the user's available real space, rather than rendering all available content. This is achieved by determining the boundary of available real space and mapping it to a constrained virtual space, then selectively rendering content within those boundaries.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies different rendering quality and content selection to different spatial regions. Content within the constrained virtual space (corresponding to available real space) is rendered with full detail, while content outside this region is excluded or rendered with lower priority, optimizing computational resources for the user's current field of view and interaction zone.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If the user moves to different locations in real space to view different content, then the variety of mediated reality content accessible is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improvecontent accessibilityVSAvoiduser interaction simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system creates a virtual representation (copy) of the available real space within the constrained virtual space, allowing users to view and interact with mediated reality content as if they were physically present at different locations, without actually moving. The mapping between real space coordinates and virtual space coordinates enables this virtual traversal.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system adds a virtual dimension layer over the physical space, allowing users to access content from different virtual locations while remaining stationary in physical space. The constrained virtual space is mapped to the available real space, creating a correspondence that enables virtual movement without physical movement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the system determines the boundary of available real space and maps it to constrained virtual space, then the precision of content rendering is improved, but the measurement and detection complexity increases

Engineering Contradiction:
Improvespace boundary determination accuracyVSAvoidboundary detection complexity
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The system uses a unified coordinate mapping framework that handles multiple functions: determining real space boundaries, defining constrained virtual space, calculating scale factors, and rendering content. This universal approach simplifies the overall process compared to implementing separate specialized systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically determines the boundary of available real space and creates the corresponding constrained virtual space mapping without requiring manual user input or configuration. The mapping parameters (location, scale factor) are calculated automatically based on the detected real space boundaries.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3654142B1First-person perspective-mediated reality
Publication Date: 2025.01.29 NOKIA TECHNOLOGIES OY
  • EP3654142B1 patent drawingFigure 1A~3B
  • EP3654142B1 patent drawingFigure 4A~6C
  • EP3654142B1 patent drawingFigure 7~8

AI summary

An apparatus method comprising means for: determining an available real space comprising a portion of a real space that comprises locations available to a user to control a corresponding virtual location of a virtual user, via first-person perspective-mediated reality, wherein first-person perspective-mediated reality creates a correspondence between a location and orientation of a user in real space to a virtual location and virtual orientation of a virtual user; determining a constrained virtual space comprising a portion of a virtual space that corresponds to the available real space; determining available mediated reality content which comprises multiple representations of the virtual space when observed from multiple virtual locations within the constrained virtual space; automatically determining a sub-set of the available mediated reality content without requiring the user to change location in the real space; and causing rendering of at least some of the determined sub-set of the available virtual reality content to the user.