3D Object Scanning Using Coarse Models for Coverage Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing scanning systems lack effective methods to assess and provide feedback on sensor data quality during the scanning process for generating 3D models, leading to inefficiencies and potential gaps in data coverage.

Innovation Solution

Implementing a system that generates a coarse 3D model in real-time during scanning, assesses coverage values for sensor data, and provides feedback to users through visual and interactive indicators to ensure comprehensive data capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a detailed 3D model is generated in real-time during scanning, then the quality of the live feedback model is improved, but the processing time and computational complexity increase making real-time generation infeasible

Engineering Contradiction:
Improve3D model qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the 3D model representation into two distinct levels: a coarse voxel-based model for real-time live feedback during scanning, and a detailed model generated after scanning completes. This segmentation allows the system to provide immediate visual feedback with simplified geometry while the comprehensive detailed model is processed separately, resolving the contradiction between real-time performance and model quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs partial model generation during scanning by creating only a coarse voxel-based representation rather than a complete detailed model. This partial action provides sufficient feedback for guiding the scanning process without requiring the full computational resources needed for detailed model generation, thus enabling real-time operation.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If comprehensive sensor data is collected from all angles during scanning, then the coverage and quality of the final 3D model is improved, but the scanning time and number of required scans increases

Engineering Contradiction:
Improvedata coverage qualityVSAvoidscanning efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent implements a feedback mechanism where coverage values are calculated and displayed in real-time during the scanning process. This feedback guides the user on which areas need additional scanning, allowing them to efficiently capture comprehensive coverage without unnecessarily scanning already-sufficient areas multiple times, thus improving both coverage quality and scanning efficiency.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary assessment of coverage during the scanning process by calculating coverage values for each scanned area. This preliminary action allows the system to identify which areas have sufficient coverage and which need more scanning, enabling the user to stop scanning early in well-covered areas and focus efforts on under-scaned regions.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If coverage assessment is performed on every scanned portion in real-time, then the accuracy of feedback information is improved, but the computational load and processing time increases

Engineering Contradiction:
Improvecoverage assessment accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality assessment by calculating coverage values for specific discrete portions (voxels) of the scanned object rather than attempting to assess the entire object uniformly. Each voxel is independently evaluated based on the sensor data that covers it, allowing for accurate local coverage measurement while keeping individual computational tasks manageable and parallelizable.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12394145B2Feedback using coverage for object scanning
Publication Date: 2025.08.19 APPLE INC
  • US12394145B2 patent drawing
  • US12394145B2 patent drawing
  • US12394145B2 patent drawing

AI summary

Various implementations disclosed herein provide feedback to a user during object scanning based on how well sensor data of the scanned object has been captured. During object scanning a user may move an electronic device with sensors (e.g., cameras, depth sensors, etc.) around an object to capture sensor data for use in generating a final 3D model of the object. Live feedback during the scanning process is enabled by assessing how well the captured sensor data represents different portions of the object. In some implementations, a 3D model is generated, updated, and assessed based on the sensor data live during the scanning process. This live 3D model may be coarser (i.e., having fewer details) than the final 3D model.