Mixed Reality Virtual Object Rendering for Real-World Collision Avoidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mixed reality technologies fail to notify users of real objects in their vicinity, such as tables or walls, when using head-mounted displays, as they primarily focus on user proximity notifications without considering real-world objects.

Innovation Solution

An information processing apparatus that generates virtual objects with attributes for approach warnings, allowing users to be notified when approaching real objects by calculating distances and outputting alerts when threshold values are reached, while also managing virtual object positioning and rendering to avoid collisions with real objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a head-mounted display is used to provide immersive mixed reality, then user immersion in virtual objects is improved, but user awareness of real objects in the environment deteriorates

Engineering Contradiction:
Improvevisual immersionVSAvoidreal object awareness
Core Design Contradiction:
Illumination intensityVSLoss of information

Solution Approach 1:

The patent introduces virtual objects as intermediary elements that represent real-world objects in the virtual space. These virtual objects serve as mediators between the user and actual real objects, providing informational alerts when users approach real objects while maintaining immersion in the mixed reality environment. The virtual objects with alert functions act as a communication bridge without breaking the immersive experience.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If virtual objects are superimposed on real space to enhance immersion, then mixed reality experience is improved, but collision with real objects cannot be prevented

Engineering Contradiction:
Improvemixed reality experienceVSAvoidsafety
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements preliminary action by providing advance warning through informational alerts before users physically collide with real objects. The system calculates distances between users and real objects, and triggers alerts at predetermined thresholds, allowing users to take preventive action to avoid collisions before they occur, thus ensuring safety while maintaining the mixed reality experience.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If distance calculation and alert systems are added to notify users of real objects, then user safety is improved, but system complexity increases

Engineering Contradiction:
Improveuser safetyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by enabling virtual objects to serve multiple purposes: they maintain the mixed reality immersive experience while simultaneously providing safety functions through distance calculation and informational alerts. This universal approach allows a single system component to address both immersion and safety requirements without significantly increasing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9784972B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2017.10.10 CANON KK
  • US9784972B2 patent drawing
  • US9784972B2 patent drawing
  • US9784972B2 patent drawing

AI summary

A warning information output outputs warning information for a user, based on a position of the user and a position of a real object with which data is associated in a case where a first attribute indicates outputting of the warning information for the user. An image output outputs an image to be generated, in a case where a second attribute indicates drawing of a virtual object in accordance with the position of the real object and a position at which the virtual object to be viewed by the user is arranged, by not drawing the virtual object in a region in which the position of the real object with which the data is associated is closer to the position of the user than the position at which the virtual object is arranged.