XR CAVE Projection Control Using Pedestrian Movement Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing XR environments require users to wear Head-Mounted Displays (HMDs), which restrict the field of view and prevent users from seeing their own and others' physical bodies, reducing the sense of presence and immersion.

Innovation Solution

A method and system that projects XR content onto walls within an XR CAVE environment, using cameras and beam projectors to track pedestrian movement without HMDs, allowing users to see their own and others' bodies and adjust content projection based on average movement, enhancing immersion and presence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If users wear HMDs for XR content delivery, then XR content can be displayed with appropriate resolution, but the field of view is narrowed and users cannot see their own and others' physical bodies

Engineering Contradiction:
ImproveXR content resolutionVSAvoidfield of view
Core Design Contradiction:
Measurement precisionVSArea of moving object

Solution Approach 1:

The patent transitions from head-mounted display (personal viewpoint) to room-scale projection (environmental viewpoint), fundamentally changing the spatial dimension of XR content delivery. By projecting content onto walls and surfaces in the physical environment, the system provides a wide field of view while maintaining high resolution through multiple projectors working in coordination.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent employs a multi-functional system where cameras track multiple pedestrians simultaneously, beam projectors render content on various surfaces, and the system coordinates to provide both immersive XR content and real-world body visibility. This multi-functional approach allows the same system to serve multiple purposes: XR immersion, body visibility, and environmental interaction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If users wear HMDs for XR content delivery, then XR content can be displayed, but users cannot see their own and others' physical bodies, reducing sense of presence

Engineering Contradiction:
ImproveXR content deliveryVSAvoidsense of presence
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent merges XR content projection with real-world visual capture by using cameras to capture pedestrians and beam projectors to display content in the same physical space. This combination allows users to see both the XR content and the physical bodies of themselves and others simultaneously, enhancing the sense of presence through unified visual experience.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system introduces cameras and beam projectors as intermediary devices between the user and the XR content. These intermediaries enable the user to perceive both the virtual content and the physical environment simultaneously, with the cameras capturing real bodies and the projectors rendering XR content, thus mediating the visual experience to enhance presence.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the system tracks movement of multiple pedestrians in XR environments, then XR content can be adjusted to each user's position, but the system complexity increases

Engineering Contradiction:
Improveviewpoint adjustment for multiple usersVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses a multi-functional camera system that simultaneously tracks multiple pedestrians, captures their positions and orientations, and provides this data to the beam projector system. This universal tracking mechanism serves multiple purposes: determining user positions for content placement, calculating movement vectors for dynamic adjustment, and enabling multi-user interaction, thereby managing complexity through a unified approach.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements continuous feedback loops where cameras constantly monitor pedestrian positions and movements, the system processes this information to adjust XR content in real-time, and the adjusted content is projected back to the users. This feedback mechanism enables adaptive viewpoint adjustment for multiple users while managing system complexity through automated real-time processing.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12430862B2XR content control method and system in XR cave environment
Publication Date: 2025.09.30 NEWJAK CO LTD
  • US12430862B2 patent drawing
  • US12430862B2 patent drawing
  • US12430862B2 patent drawing

AI summary

A method for controlling XR content in an XR CAVE environment comprising projecting XR content into the XR CAVE, detecting a plurality of pedestrians and calculating the average movement speed and direction using a camera disposed within the XR CAVE, correcting the projection position and speed of the XR content based on the calculated average speed and direction, and projecting the corrected XR content onto the wall(s) of the XR CAVE.