Image Processing Device for Overlapping VR Fields of View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies for projection mapping struggle to provide an immersive virtual reality experience for multiple users sharing the same real environment, as they fail to account for overlapping fields of view, leading to disturbed VR experiences due to reflected images from other users.

Innovation Solution

An image processing device and method that classify objects into background and foreground groups based on user-specific fields of view, generating a common background image and individual foreground images with motion parallax effects for each user, and using shutter glasses to display these images in a time-division manner to prevent interference.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a single projection image is displayed for multiple users sharing the same real environment, then the system complexity is low, but the VR experience quality deteriorates due to overlapping fields of view causing interference

Engineering Contradiction:
ImproveVR experience qualityVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The projection image is segmented into multiple regions corresponding to each user's field of view. The image processing device divides the single projection image into first projection image regions and second projection image regions, allowing each user to see only their intended content without interference from other users' views.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the projection image based on real-time user positions and field of view information. By acquiring user information and determining overlapping areas, the system adaptively modifies the projection content to eliminate interference while maintaining immersive VR experience for each user.

Inventive Principle:
Principle #15Dynamics

2Reliability

If separate projection images are generated for each user to avoid interference, then the VR experience quality improves, but the processing time and system complexity increase

Engineering Contradiction:
ImproveVR experience qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary processing by pre-determining non-overlapping areas and overlapping areas based on user information before generating the final projection image. This advance preparation allows for efficient image generation without excessive processing time during actual projection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system merges the generation of multiple user-specific projection regions into a single integrated projection image. By combining first projection image regions and second projection image regions into one unified projection, the system avoids the time overhead of generating and managing completely separate projection streams for each user.

Inventive Principle:
Principle #5Merging (Combining)

3Object-affected harmful factors

If the projection image is divided into multiple regions for different users, then the interference between users is reduced, but the image processing complexity increases

Engineering Contradiction:
Improveinterference between usersVSAvoidimage processing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

Different regions of the projection image are assigned different qualities and characteristics based on local user requirements. The first projection image regions are optimized for users viewing from specific positions, while the second projection image regions are optimized for other users, allowing each region to have tailored properties that reduce interference.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The image processing device acts as an intermediary that automatically manages the division and coordination of multiple projection regions. By introducing this intelligent mediator that handles user information acquisition, overlapping area determination, and regional image generation, the system reduces the manual complexity burden while effectively eliminating user interference.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12052410B2Image processing device, image processing method, and image display system for generating common images and individual images for users with overlapping fields of view
Publication Date: 2024.07.30 SONY GROUP CORP
  • US12052410B2 patent drawing
  • US12052410B2 patent drawing
  • US12052410B2 patent drawing

AI summary

There is provided an image processing device that processes a projection image presented to a plurality of persons at the same time. The image processing device specifies an overlapping area in which fields of view of two or more users overlap based on information on each user, classifies objects included in the overlapping area into a first object group and a second object group, generates a common image common to all users, made up of the first object group, generates individual images different for each user, made up of the second object group, and determines an output protocol for displaying the individual images.