3D Model Generation Using Mobile Depth Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems for generating three-dimensional models require remote third-party involvement and are computationally intensive, limiting their accessibility and efficiency for untrained users.

Innovation Solution

A client-device-based system that enables untrained individuals to create 3D mesh models using a smartphone or tablet with attached cameras, allowing for local data processing and transmission, including components for depth map generation, object mesh fitting, and data review, with real-time guidance for optimal image capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional third-party systems are used for generating three-dimensional models, then model generation capability is provided, but system complexity and computational requirements increase significantly

Engineering Contradiction:
Improveease of use for untrained usersVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system enables users to perform 3D model generation themselves using their own mobile devices without requiring external third-party services. The mobile device captures images, processes depth maps, and generates 3D models locally, making the system self-sufficient and eliminating dependency on complex external infrastructure.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent extracts the 3D model generation capability from complex remote third-party systems and implements it directly on the user's mobile device. By taking out the essential functionality (image capture, depth map generation, mesh creation) and placing it on the client device, the system reduces overall system complexity while maintaining ease of use.

Inventive Principle:
Principle #2Taking out (Extraction)

2Manufacturing precision

If remote third-party systems perform computationally intensive operations, then three-dimensional models can be generated, but processing time and computational resources increase

Engineering Contradiction:
Improveaccuracy of 3D model generationVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing multiple images from different angles and pre-processing them to generate depth maps before final 3D model construction. This preliminary processing of image data and depth map generation prepares the information in advance, enabling faster and more accurate 3D model creation without requiring extensive post-processing computational resources.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If third-party systems are used for model generation, then modeling capability is provided, but user independence and accessibility decrease

Engineering Contradiction:
Improveintegration into various software applicationsVSAvoidindependence from external services
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The mobile device is designed to perform multiple functions: capturing images, generating depth maps, creating 3D models, and integrating with various software applications. This multi-functional approach makes the system universally applicable across different contexts and software platforms while maintaining user independence, as the device itself provides all necessary 3D modeling capabilities without requiring specialized external services.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11893689B2Automated three dimensional model generation
Publication Date: 2024.02.06 SNAP INC
  • US11893689B2 patent drawing
  • US11893689B2 patent drawing
  • US11893689B2 patent drawing

AI summary

In various example embodiments, a system and methods are presented for generation and manipulation of three dimensional (3D) models. The system and methods cause presentation of an interface frame encompassing a field of view of an image capture device. The systems and methods detect an object of interest within the interface frame, generate a movement instruction with respect to the object of interest, and detect a first change in position and a second change in position of the object of interest. The systems and methods generate a 3D model of the object of interest based on the first change in position and the second change in position.