Imaging Device Position and Orientation Control for VR Panorama Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating high-quality 3D virtual reality data face challenges in controlling the position and orientation of imaging devices, which affects the quality of the panorama generated, especially in varying environments.

Innovation Solution

A method that determines a coordinate system for an imaging device, defines conditions for controlling its position and orientation using a spherical region and reference points, and adjusts parameters like pitch, yaw, and roll angles to ensure accurate image capture, allowing for the generation of high-quality panoramas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the position and orientation of the imaging device are controlled using sensors (accelerometer and gyroscope), then the control capability is improved, but the manufacturing precision of the panorama is still insufficient

Engineering Contradiction:
Improvecontrol capabilityVSAvoidpanorama quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent introduces a coordinate system as an intermediary framework that connects sensor data to panorama generation. By establishing a coordinate system with origin at the initial position and defining reference points, the system mediates between the raw sensor measurements and the final panorama quality, enabling more precise control of the imaging device's position and orientation relative to the scene being captured.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the imaging device is manually held and rotated 360 degrees to capture images, then the operation is simple, but the position and orientation control is imprecise

Engineering Contradiction:
Improveoperation simplicityVSAvoidposition and orientation accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements feedback by continuously monitoring the imaging device's position and orientation through sensors and comparing them against the established coordinate system and reference points. Prompt messages are generated to guide the user in adjusting the device position, creating a closed-loop control system that maintains measurement precision while preserving ease of operation.

Inventive Principle:
Principle #23Feedback

3Loss of information

If multiple images are captured to generate a panorama, then the information content is increased, but the alignment quality and void prevention become more difficult

Engineering Contradiction:
Improvescene informationVSAvoidpanorama alignment
Core Design Contradiction:
Loss of informationVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by establishing the coordinate system and defining reference points before capturing the multiple images. This pre-established framework guides the imaging process, ensuring that each captured image is properly positioned and oriented relative to the others, thereby facilitating accurate alignment and void prevention during panorama generation.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables precise control of the imaging device to capture images that can be combined into high-quality panoramas, preventing voids and improving alignment, thus enhancing the quality of the generated 3D virtual reality data.

Implementation Method 1

The accelerometer measures a non-gravitational axis-based linear acceleration of the movement

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

the gyroscope uses the gravity to measure a rotational velocity

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Data Source

PatentUS11645780B2Method and device for collecting images of a scene for generating virtual reality data
Publication Date: 2023.05.09 REALSEE (BEIJING) TECHNOLOGY CO LTD
  • US11645780B2 patent drawing
  • US11645780B2 patent drawing
  • US11645780B2 patent drawing

AI summary

A method for capturing an image of a scene using an imaging device is disclosed herein. The method includes determining a coordinate system with an origin based on an initial position of the imaging device, generating a first condition to control the position of the imaging device in the coordinated system with respect to the origin, generating a second condition to control the orientation of the imaging device, determining a position and an orientation of the imaging device, generating a first prompt message in response to the position of the imaging device satisfying the first condition, and generating a second prompt message in response to the orientation of the imaging device satisfying the second condition.