Virtual Camera Quality Measurement in Volumetric Immersive Media

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing solutions for generating virtual reality environments from sporting events are limited to static views, offering minimal user interaction and control, restricting the immersive experience.

Innovation Solution

A system and method for user-controlled virtual cameras that synchronize multiple panoramic camera heads through a time code generator, allowing users to interactively choose their viewing angle and control playback speed and direction across all video streams in a synchronous manner, enabling immersive volumetric video experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple panoramic camera heads are synchronized through a time code generator, then the system enables interactive user control and dynamic viewing angles, but the device complexity increases

Engineering Contradiction:
Improveuser control capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the volumetric video capture into multiple independent panoramic camera heads, each capturing data from a specific direction. This segmentation allows users to selectively view from different camera perspectives while maintaining manageable system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The time code generator serves as a universal synchronization mechanism that coordinates all panoramic camera heads simultaneously. This single device enables multi-functional operation across the entire camera array, allowing interactive user control without proportionally increasing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If users can interactively select vantage points and control playback, then the immersive experience is enhanced, but the ease of operation becomes more complex

Engineering Contradiction:
Improveinteractive controlVSAvoiduser control difficulty
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system creates virtual camera views that replicate and combine data from multiple physical panoramic camera heads. Users interact with these synthesized virtual views rather than directly controlling each physical camera, simplifying the user interface while maintaining comprehensive control capability.

Inventive Principle:
Principle #26Copying

3Measurement precision

If pixel-to-pixel correspondence is established between physical and virtual camera images, then measurement precision improves, but the processing time increases

Engineering Contradiction:
Improveimage alignment accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary synchronization by aligning all panoramic camera heads to a common time code before generating virtual camera views. This pre-alignment establishes pixel-to-pixel correspondence in advance, reducing the computational burden and processing time during actual view generation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11748870B2Video quality measurement for virtual cameras in volumetric immersive media
Publication Date: 2023.09.05 INTEL CORP
  • US11748870B2 patent drawing
  • US11748870B2 patent drawing
  • US11748870B2 patent drawing

AI summary

Apparatus and method for determining a quality score for virtual video cameras. For example, one embodiment comprises: a region of interest (ROI) detector to detect regions of interest within a first image generated from a first physical camera (PCAM) positioned at first coordinates; virtual camera circuitry and/or logic to generate a second image positioned at the first coordinates; image comparison circuitry and/or logic to establish pixel-to-pixel correspondence between the first image and the second image; an image quality evaluator to determine a quality value for the second image by evaluating the second image in view of the first image.