Virtual Reality Content Selection and Real-World Object Replacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual and augmented reality techniques fail to effectively combine real-world and virtual content in a user-specific manner, often obstructing important real-world objects and not adequately accommodating individual needs and preferences.

Innovation Solution

The system allows users to select and combine real-world objects with virtual reality content by identifying and replacing non-selected real-world objects with virtual content, enabling a customizable and immersive user experience through head-mounted displays, using input methods like finger gestures and 3D modeling to create a composite environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual reality content is combined with real world objects in augmented reality, then the user experience becomes more immersive and informative, but the real world objects may be blocked or obstructed from view

Engineering Contradiction:
Improveuser experience customizationVSAvoidview obstruction
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system applies different treatments to different regions of the field of view. Selected real-world objects are preserved and enhanced with augmented content, while non-selected objects are obscured or replaced with virtual content. This local differentiation allows important objects to remain visible while still providing immersive virtual experiences in other areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The augmented reality system segments the real world environment into selected and non-selected objects. Users can designate specific objects as important through selection mechanisms, and the system processes these segments differently - preserving selected objects while modifying or replacing non-selected ones with virtual content.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If generic augmented reality content is added to the real world environment, then the user receives additional information, but the content does not account for individual user needs and preferences

Engineering Contradiction:
Improveinformation deliveryVSAvoiduser personalization
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The system incorporates user feedback through object selection mechanisms. Users actively select which real-world objects are important to them, and the system uses this feedback to customize the augmented reality experience. The feedback loop continues as users can modify their selections and the system adapts the content delivery accordingly.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The augmented reality content delivery is dynamic and adaptable rather than static and generic. The system continuously adjusts which objects receive augmented content based on user selections, allowing the experience to evolve and personalize to individual user needs and preferences in real-time.

Inventive Principle:
Principle #15Dynamics

3Ease of manufacture

If fixed location augmented content is displayed, then the implementation is simple, but the content may block important real world objects in certain circumstances

Engineering Contradiction:
Improvecontent implementation simplicityVSAvoidview blocking
Core Design Contradiction:
Ease of manufactureVSObject-affected harmful factors

Solution Approach 1:

Instead of placing augmented content only in fixed two-dimensional locations that may block views, the system uses spatial awareness and object selection to position content in three-dimensional space around selected objects. This allows content to be displayed in multiple dimensions and positions that avoid blocking important real-world objects while maintaining information delivery.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10474336B2Providing a user experience with virtual reality content and user-selected, real world objects
Publication Date: 2019.11.12 ADOBE INC
  • US10474336B2 patent drawing
  • US10474336B2 patent drawing
  • US10474336B2 patent drawing

AI summary

Techniques disclosed herein provide a user experience with virtual reality content and user-selected, real world objects. An exemplary technique involves receiving input selecting a subset of the real world objects in a selection view. The subset of the real world objects is selected for inclusion in the user experience. The technique further involves identifying virtual reality content for inclusion in the user experience. The technique provides the user experience by combining a live view of the user's real world environment with the virtual reality content. The real world objects in the live view that are in the subset selected by the user are visible in the user experience. The real world objects in the live view that are not in the subset selected by the user are replaced with virtual reality content.