Morphable 3D Human Model Generation from Low-Resolution Depth Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Consumer-level 3D capture devices produce low-resolution data, making it difficult to construct usable 3D human models, which are typically high in complexity and cost for professional devices.

Innovation Solution

A method that processes pose data from low-resolution 3D capture devices to generate a 3D model by selecting a morphable generic human model, adjusting its pose and appearance parameters, and applying these adjustments to produce a recognizable 3D model of an individual, using a system that includes a CPU, display processor, and 3D camera, optionally with an HD camera for enhanced detail.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If professional 3D capture devices are used, then model quality and resolution are improved, but device complexity and cost increase

Engineering Contradiction:
Improve3D model resolutionVSAvoidcapture device complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a morphable 3D generic human model as a template that can be adapted to match individual characteristics. Instead of capturing every detail directly, the system copies the generic model structure and modifies it based on captured data points, achieving high-quality results with simpler input devices

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system changes parameters of the generic 3D model (such as body proportions, facial features, clothing details) to match the captured individual characteristics. By adjusting these parameters rather than requiring complete high-resolution capture, the system achieves accurate 3D modeling with lower-resolution input data

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If professional 3D capture devices are used, then model quality is improved, but cost increases

Engineering Contradiction:
Improve3D model resolutionVSAvoiddevice cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent employs inexpensive consumer-grade 3D capture devices (such as depth cameras or structured light scanners) instead of expensive professional equipment. The system compensates for the lower hardware quality through sophisticated software processing and the morphable model approach, making 3D human modeling accessible at consumer price points

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Device complexity

If low-resolution data from consumer devices is used, then device complexity is reduced, but model usability deteriorates

Engineering Contradiction:
Improvecapture device simplicityVSAvoid3D model usability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system uses iterative feedback loops where the captured low-resolution data is compared against the morphable generic model, and adjustments are made to model parameters to minimize differences. This feedback process allows the system to extract accurate 3D information even from low-resolution input data, maintaining model usability

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent prepares a pre-parameterized morphable 3D generic human model before capture, with all possible anatomical variations already encoded. This preliminary preparation allows the system to quickly and reliably generate usable 3D models from minimal input data, as the heavy computational work has already been done in advance

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9348950B2Perceptually guided capture and stylization of 3D human figures
Publication Date: 2016.05.24 DISNEY ENTERPRISES INC
  • US9348950B2 patent drawing
  • US9348950B2 patent drawing
  • US9348950B2 patent drawing

AI summary

One embodiment of the present invention sets forth a technique for generating a three-dimensional (3D) model of an individual. The technique involves receiving pose data that includes image data associated with the individual being in a pose, selecting from a database a morphable 3D generic human model based on a gender of the individual, adjusting a pose of the morphable 3D generic model based on the image data, identifying, based on the image data, one or more 3D appearance parameter objects included in the database, and adjusting via one or more processors one or more properties of the morphable 3D generic model based on the image data as well as the one or more 3D appearance parameter objects to produce the 3D model of the individual.