3D Object Reproduction in Virtual Reality Scenes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality technologies face challenges in displaying an object's real-time shape and displacement in 3D scenes, hindering seamless interaction between users and virtual worlds.

Innovation Solution

A system and method that acquire and process multiple channels of video stream data in real time to recognize object shapes and motion trajectories, projecting them into 3D images and superimposing them into 3D scenes using an object acquiring, recognizing, tracking, and projecting unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple video channels are processed to recognize object shapes in real time, then the accuracy of object reproduction is improved, but the computational complexity and processing time increase

Engineering Contradiction:
Improveobject shape recognition accuracyVSAvoidsystem processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the complex task of object recognition into separate processing channels, each handling specific video streams from different cameras. The object acquiring unit separates multiple video channels, and the object recognizing unit processes each channel independently to extract shape features, which are then integrated to achieve accurate 3D object reproduction without overwhelming computational complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from 2D video images to 3D object representation by processing multiple video channels from different angles simultaneously. The object projecting unit converts recognized 2D shape information into 3D spatial coordinates and projects them into the virtual reality scene, adding a dimensional transformation that enables realistic object reproduction

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Speed

If real-time object tracking and projection is implemented, then the responsiveness of the virtual reality system is improved, but the processing load and energy consumption increase

Engineering Contradiction:
Improveobject tracking speedVSAvoidsystem energy consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by pre-processing video streams through multiple channels before object recognition. The object acquiring unit prepares and organizes video data from multiple cameras in advance, and the object recognizing unit pre-extracts shape features, reducing the computational burden during real-time tracking and projection operations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous object tracking and projection operations without interruption. The object tracking unit continuously monitors object position and motion across video frames, and the object projecting unit continuously updates the 3D projection in the virtual reality scene, ensuring real-time responsiveness while distributing processing load over time

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS9842434B2System and method for reproducing objects in 3D scene
Publication Date: 2017.12.12 QINGDAO GOERTEK
  • US9842434B2 patent drawing
  • US9842434B2 patent drawing
  • US9842434B2 patent drawing

AI summary

The present disclosure discloses a system and a method for reproducing an object in a 3D scene. The system comprises an object acquiring unit configured to simultaneously acquire at least two channels of video stream data in real time at different angles for an object to be displayed; an object recognizing unit configured to recognize a shape of the object varying in real time from the at least two channels of video stream data; an object tracking unit configured to obtain corresponding object motion trajectory according to the shape of the object varying in real time; and an object projecting unit configured to process the shape of the object varying in real time and the corresponding object motion trajectory into a 3D image and superposition-project the 3D image into the 3D scene in real time. The technical solutions of the present disclosure can reproduce the object in the 3D scene, and achieve the purpose of displaying the real object in the 3D scene.