Mobile Terminal 3D Object Animation via Camera Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional scanners are difficult for non-professionals to operate and have limited application scenarios, making it challenging for common users to utilize three-dimensional scanning technology effectively.

Innovation Solution

A mobile terminal equipped with a color camera and a depth camera, capable of performing panoramic scanning, obtaining 3D models, fusing skeletal models, and animating objects through integrated scanning, 3D reconstruction, skeletal rigging, and animation display, allowing users to easily create and animate 3D models of static objects without requiring professional devices or complex processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a three-dimensional scanner is used to obtain 3D information, then measurement precision is improved, but device complexity increases and ease of operation deteriorates

Engineering Contradiction:
Improve3D information accuracyVSAvoiduser accessibility
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent combines multiple camera systems (color camera, depth camera, infrared camera) and multiple functions (scanning, modeling, animation) into a single mobile terminal device. This integration allows common users to access 3D scanning capabilities without needing separate professional equipment, thereby improving ease of operation while maintaining measurement precision through the coordinated use of multiple sensors.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The mobile terminal is designed to perform multiple functions beyond traditional 3D scanning, including panoramic scanning, 3D model reconstruction, skeletal model fusion, and animation generation. This multi-functionality allows a single device to serve both professional and consumer needs, making 3D technology accessible to common users while preserving measurement accuracy through specialized camera systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If a three-dimensional scanner is used to create accurate 3D models, then manufacturing precision is improved, but device complexity increases

Engineering Contradiction:
Improve3D model accuracyVSAvoidsystem structure
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple camera systems (color camera for texture, depth camera for geometry, infrared camera for additional depth information) into a single mobile terminal. This consolidation achieves accurate 3D modeling through coordinated multi-sensor data fusion while reducing device complexity compared to using separate professional scanning equipment.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a skeletal model as an intermediary structure that simplifies the representation of complex 3D objects. By fusing the skeletal model with detailed 3D scan data, the system achieves manufacturing precision for both the overall structure and fine details, while the skeletal abstraction reduces computational complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If professional three-dimensional scanning equipment is used, then measurement precision is improved, but ease of operation deteriorates and adaptability decreases

Engineering Contradiction:
Improvescanning accuracyVSAvoidapplication scenarios
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The mobile terminal is designed to adapt to multiple application scenarios beyond traditional 3D scanning, including panoramic scanning, virtual try-on, augmented reality, and animation creation. The device maintains measurement precision through specialized camera systems while achieving versatility through software-based processing and multiple camera configurations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements dynamic scanning capabilities that can adapt to different object types and scanning scenarios. The system can switch between different camera combinations and processing modes based on the scanning target, enabling both high-precision scanning of static objects and dynamic tracking of moving objects, thereby improving adaptability while maintaining accuracy.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11436802B2Object modeling and movement method and apparatus, and device
Publication Date: 2022.09.06 HUAWEI TECH CO LTD
  • US11436802B2 patent drawing
  • US11436802B2 patent drawing
  • US11436802B2 patent drawing

AI summary

The present invention discloses an object modeling and movement method. The method is applied to a mobile terminal, and the mobile terminal includes a color camera and a depth camera. The method includes: performing panoramic scanning on a target object by using the color camera and the depth camera, to obtain a 3D model of the target object; obtaining a target skeletal model; fusing the target skeletal model and the 3D model of the target object; obtaining a target movement manner; and controlling the target skeletal model in the target movement manner, to animate the 3D model of the target object in the target movement manner. This can implement integration from scanning, 3D reconstruction, skeletal rigging, to preset animation display for an object on one terminal, thereby implementing dynamization of a static object, and increasing interest in using the mobile terminal by a user.