3D Model Generation via Multi-Camera Calibration and Cloud Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods of virtual reality (VR) content creation are time-consuming and expensive, making it inaccessible to casual users who are not computer-graphics experts, and the high cost of equipment and extensive time required for 3D model generation hinder widespread creation of VR content.

Innovation Solution

A system comprising a HoloPortal electronic system with multiple cameras for capturing and calibrating video data, a HoloCloud cloud computing platform for processing, and a 3D printer for generating physical replicas, enabling rapid and inexpensive creation of 3D models using consumer-level video recording devices and scalable GPUs, along with a platform for sharing and monetizing these models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional methods are used to create 3D models, then model quality and detail are improved, but production time and cost increase significantly

Engineering Contradiction:
Improve3D model qualityVSAvoidproduction time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical 3D modeling processes with automated computer vision and machine learning systems. The system uses multiple cameras to capture 360-degree images of objects, then automatically processes these images through computational algorithms to generate 3D models, eliminating the need for manual scanning and modeling operations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the fundamental parameters of object capture by using multiple standard cameras arranged in specific geometries to capture 360-degree images. This approach transforms the capture process from traditional single-camera or mechanical scanning methods to a multi-camera imaging system that can rapidly acquire complete object data.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If professional 3D modeling equipment is used, then model accuracy is improved, but accessibility for casual users deteriorates

Engineering Contradiction:
Improve3D model accuracyVSAvoiduser accessibility
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent makes professional 3D modeling capability universal by enabling any user with standard cameras and smartphones to create 3D models. The system provides automated calibration, capture, and model generation functions that work with consumer-grade devices, eliminating the need for specialized equipment while maintaining professional model quality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs self-service by automatically handling the complex tasks of calibration, image capture coordination, and 3D model generation without requiring user expertise. The automated pipeline processes captured images and generates accurate 3D models independently, making the technology accessible to casual users.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If 360-degree virtual reality video cameras are used, then capture capability is improved, but equipment cost increases significantly

Engineering Contradiction:
Improvecapture capabilityVSAvoidequipment cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent segments the capture system into multiple independent standard cameras or smartphones positioned around the object. Instead of using a single expensive 360-degree camera, the system divides the capture function across multiple affordable devices, achieving the same 360-degree coverage through distributed imaging.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses copies of standard camera technology (multiple smartphones or consumer cameras) to replicate the functionality of expensive specialized 360-degree cameras. By using multiple identical or similar consumer devices arranged in a circle, the system achieves professional capture capability at consumer prices.

Inventive Principle:
Principle #26Copying

4Productivity

If multiple cameras are positioned circularly around the target object, then 3D model generation speed is improved, but system complexity increases

Engineering Contradiction:
Improve3D model generation speedVSAvoidsystem configuration
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary calibration and setup before actual object capture. Users first calibrate the system by capturing images of a calibration object to establish the spatial relationships between cameras. This preliminary calibration step simplifies subsequent object capture operations and automates the complex task of determining camera positions and orientations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10516869B2Real-time 3D virtual or physical model generating apparatus for HoloPortal and HoloCloud system
Publication Date: 2019.12.24 DOUBLEME INC (OF KOREA)
  • US10516869B2 patent drawing
  • US10516869B2 patent drawing
  • US10516869B2 patent drawing

AI summary

A novel electronic system provides fast three-dimensional model generation, social content sharing of dynamic three-dimensional models, and monetization of the dynamic three-dimensional models created by casual consumers. In one embodiment, a casual consumer utilizes a dedicated real-time 3D model reconstruction studio with multiple camera angles, and then rapidly create dynamic 3D models with novel computational methods performed in scalable graphics processing units. In another embodiment, uncalibrated multiple sources of video recording of a targeted object are provided by a plurality of commonly-available consumer video recording devices (e.g. a smart phone, a camcorder, a digital camera, etc.) located at different angles, after which the uncalibrated multiple sources of video recording are transmitted to a novel cloud computing system for real-time temporal, spatial, and photometrical calibration and 3D model reconstruction. The dynamic 3D models can be uploaded, listed, and shared among content creators and viewers in an electronic sharing platform.