AR-Guided Mobile Image Capture for Product 3D Modeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Businesses face challenges in obtaining high-quality images of products, especially for online retailers without physical locations, as images captured by customers often lack the necessary quality for accurate product representation and 3D modeling.

Innovation Solution

An augmented reality (AR) system on a mobile device guides users to capture images from multiple positions, ensuring desired quality by providing real-time guidance through an AR interface, performing quality control tests, and enabling image capture only when criteria are met, thus allowing non-expert users to achieve professional-grade image capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If customers capture images of products using their mobile devices without guidance, then the ease of operation is improved, but the manufacturing precision (image quality) deteriorates

Engineering Contradiction:
Improveease of image captureVSAvoidimage quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

An augmented reality interface acts as an intermediary between the customer and the image capture process. The AR interface provides real-time visual guidance overlays that show customers the optimal positioning and framing of product images, enabling them to capture high-quality images without professional training or equipment while maintaining ease of operation with their mobile devices

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms through the AR interface that provide real-time information to customers about their image capture quality. The interface displays guidance indicators that show whether the customer is positioned correctly and whether the product is properly framed, allowing immediate correction and ensuring manufacturing precision without complicating the operation

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If professional photographers and specialized equipment are used to capture product images, then the manufacturing precision (image quality) is improved, but the device complexity and cost increase

Engineering Contradiction:
Improveimage qualityVSAvoidcomplexity of photography equipment
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The AR interface copies the functionality of professional photography guidance systems into a mobile device application. By replicating the guidance and quality control capabilities that would otherwise require professional equipment and expertise, the system enables standard mobile devices to achieve professional-grade image quality without the complexity of specialized photography equipment

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system enables customers to perform their own product image capture with professional-quality results through self-service. The AR interface provides all necessary guidance and quality control automatically, eliminating the need for professional photographers or complex equipment while maintaining high manufacturing precision through automated feedback and guidance mechanisms

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11769308B2Systems and methods of augmented reality guided image capture
Publication Date: 2023.09.26 WAYFAIR LLC
  • US11769308B2 patent drawing
  • US11769308B2 patent drawing
  • US11769308B2 patent drawing

AI summary

Some embodiments provide a mobile device configured to guide a user, via an augmented reality (AR) interface generated by the mobile device, to capture images of the physical object using a camera of the mobile device. The mobile device may be configured to obtain boundary information indicative of a boundary enclosing the physical object (e.g., a box enclosing the physical object). The mobile device may be configured to use the boundary information to determine positions from which the user is to capture images of the physical object. The mobile device may be configured to guide the user to capture the images using the AR interface by guiding the user to each of the positions in the AR interface (e.g., by generating on or more GUI elements in the AR interface that indicate a position from which the user is to capture an image).