Mobile 3D Modeling via Virtual Point Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D modeling processes are cumbersome and time-consuming due to the need for extensive hardware equipment and manual editing of 3D model data, which can be costly and inefficient.

Innovation Solution

A system utilizing one or more processors and non-transitory computer-readable storage media to display a live video of a scene with a user interface overlay, allowing users to select virtual points on a target object to generate 3D polygonal data, enabling cooperative and simultaneous 3D modeling by multiple users through mobile devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional hardware devices (camera rigs, laser scanners, articulated arms) are used for 3D modeling, then measurement precision and manufacturing precision are improved, but device complexity and ease of operation deteriorate due to cumbersome equipment and manual editing requirements

Engineering Contradiction:
Improve3D model accuracyVSAvoidUser operation convenience
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent replaces complex mechanical 3D scanning hardware (camera rigs, laser scanners, articulated arms) with a mobile device-based system that uses camera imaging combined with virtual point selection and computational processing to generate 3D models. This substitution maintains acceptable modeling precision while dramatically improving ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates a digital copy of the physical object through photogrammetry techniques, capturing multiple 2D images and reconstructing a 3D model through computational algorithms. This copying approach eliminates the need for direct physical measurement hardware while achieving accurate 3D representations.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If traditional manual editing processes are used for 3D model data, then manufacturing precision is maintained through professional editing, but productivity and loss of time increase due to time-consuming manual editing for each model

Engineering Contradiction:
Improve3D model qualityVSAvoid3D modeling throughput
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system enables end users to directly create and edit 3D models themselves through intuitive virtual point selection on mobile device screens, eliminating the need for specialized 3D artists and manual editing processes. This self-service approach maintains sufficient model quality for various applications while dramatically increasing productivity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent employs accelerated computational processing and automated algorithms to rapidly process captured images and generate 3D models, significantly reducing the time required compared to traditional manual editing while maintaining acceptable quality standards.

Inventive Principle:
Principle #38Strong oxidants (Accelerated oxidation)

3Measurement precision

If extensive hardware equipment is used for 3D modeling, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improve3D data accuracyVSAvoidHardware equipment requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent utilizes a mobile device camera, which is a universal multi-functional device already present in most smartphones and tablets, to perform 3D scanning functions. This eliminates the need for specialized dedicated scanning hardware while achieving sufficient measurement precision for various applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system replaces expensive, complex, and fragile specialized scanning hardware with inexpensive, readily available mobile device cameras. This substitution reduces both equipment cost and complexity while maintaining acceptable measurement capabilities for many practical applications.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS11302074B2Mobile device 3-dimensional modeling
Publication Date: 2022.04.12 SONY GROUP CORP
  • US11302074B2 patent drawing
  • US11302074B2 patent drawing
  • US11302074B2 patent drawing

AI summary

Implementations generally relate to 3D modeling. In some implementations, a method includes displaying a live video of a scene on a device with a user interface overlay on top of the scene, wherein the user interface overlay includes one or more objects and includes one or more selectable controls. The method further includes receiving a selection of one or more new virtual points on a target object, wherein the target object is one object of the one or more objects in an image. The method further includes generating 3D polygonal data, wherein the 3D polygonal data is saved as a 3-dimensional (3D) model.