3D Reconstruction for Listing Image Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Online marketplaces face issues with inaccurate and incomplete data in user-provided images for accommodations, including low quality, incomplete coverage, outdated images, and the potential for fake images, which complicates user selection and listing management, especially in large platforms with millions of listings.

Innovation Solution

A dynamic image capture and processing system using a smartphone camera to quickly scan and generate 3D reconstructions of spaces, detect amenities, and request additional images, integrated with a server system for verification and listing purposes, allowing users to easily upload and manage images for listings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If professional photography services and equipment are used to improve image quality, then image quality and accuracy are improved, but cost and device complexity increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoidphotography equipment
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses photogrammetry to create 3D models and panoramic images by capturing multiple 2D photographs from different angles and processing them computationally. This copying approach allows standard camera equipment to produce professional-quality visual data without requiring specialized photography equipment, thereby resolving the contradiction between image quality and device complexity

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces manual professional photography processes with automated computational methods. The system automatically captures images, processes them through photogrammetry algorithms, and generates 3D models and panoramas without requiring professional photographers or complex mechanical photography equipment, thus improving image quality while reducing device complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If professional inspectors visit accommodations to verify images, then data accuracy and reliability are improved, but time consumption and operational complexity increase

Engineering Contradiction:
Improvedata accuracyVSAvoidinspection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent enables the accommodation listing system to automatically verify and process image data through computational photogrammetry methods. The system self-verifies the accuracy of spatial representations by algorithmically processing captured images into 3D models and panoramas, eliminating the need for manual inspector verification and thereby improving reliability while reducing time loss

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system provides automated feedback by generating visual representations (3D models, panoramas) that can be immediately reviewed and verified for accuracy. This automated feedback mechanism replaces manual inspection feedback loops, maintaining data reliability while significantly reducing the time required for verification

Inventive Principle:
Principle #23Feedback

3Loss of information

If comprehensive image coverage of all accommodation areas is captured, then completeness of information is improved, but the number of images and data processing requirements increase

Engineering Contradiction:
Improvecoverage completenessVSAvoidnumber of images
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent merges multiple 2D photographs into unified 3D models and panoramic images through photogrammetry processing. This combining approach consolidates comprehensive coverage information from numerous individual images into integrated visual representations, maintaining complete area coverage while reducing the effective quantity of images that need to be stored and processed

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from 2D image coverage to 3D spatial representation by creating three-dimensional models from captured photographs. This dimensional transformation allows comprehensive coverage of all accommodation areas to be achieved more efficiently, as the 3D model consolidates spatial information from multiple angles and perspectives into a single integrated representation, reducing the total number of images required

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Ease of operation

If users manually upload and manage images for listings, then ease of operation is improved, but data quality control and verification become more difficult

Engineering Contradiction:
Improveimage upload processVSAvoiddata quality
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces manual image quality assessment with automated computational photogrammetry processing. The system automatically processes uploaded images through algorithms that generate 3D models and panoramas, providing objective quality verification without requiring manual review. This maintains ease of operation for users while ensuring data quality through automated precision measurement

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides accurate, comprehensive, and up-to-date image data for listings, enhancing user selection and management processes while reducing costs associated with professional photography and inspections.

Implementation Method 1

a camera of the computing device to capture image data

Methodology Applied
Scientific EffectLight detection: Light

Data Source

PatentUS10937235B2Dynamic image capture system
Publication Date: 2021.03.02 AIRBNB INC
  • US10937235B2 patent drawing
  • US10937235B2 patent drawing
  • US10937235B2 patent drawing

AI summary

Systems and methods are provided for receiving image data via a camera of a computing device, the image data comprising a plurality of image frames; displaying a 3D reconstruction of the image data on a graphical user interface (GUI) displayed on a computing device as the image data is received and the 3D reconstruction of the image data is generated; detecting at least one object corresponding to one or more of a plurality of predefined object types in the image data; determining dimensions of the at least one object in 3D space based on the 3D reconstruction of the image data; and displaying in the GUI the at least one detected object.