3D Scene Modeling from Single Image Using Line Features

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D scene modeling methods face challenges in cost, time, flexibility, and accuracy, particularly in large-scale scene reconstruction, as they require significant resources, high-tech equipment, and struggle to efficiently update or extend existing models.

Innovation Solution

A method for modeling and registering 3D scene structure using a single image, which extracts and groups line features, calculates vanishing points, and uses user interaction to construct and optimize the scene, allowing for registration in a unified 3D space, enabling rapid and flexible modeling with a general camera.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If professional 3D modeling software is used, then modeling accuracy is improved, but cost and modeling period increase

Engineering Contradiction:
Improvemodeling accuracyVSAvoidmodeling period
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent replaces manual field measurement and professional 3D modeling operations with automatic image processing algorithms. The system automatically extracts line features, calculates vanishing points, and reconstructs 3D scene structure from images, eliminating the need for manual measurement and professional software operation, thus reducing both cost and modeling period while maintaining accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service 3D modeling by allowing users to automatically reconstruct 3D scenes from their own captured images without requiring professional modeling expertise. The automatic feature extraction and 3D reconstruction algorithms enable non-professionals to perform accurate 3D modeling independently

Inventive Principle:
Principle #25Self-service

2Productivity

If binocular imaging technology is used, then modeling period is shortened, but equipment requirements and technical complexity increase

Engineering Contradiction:
Improvemodeling periodVSAvoidequipment requirements
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces expensive binocular imaging equipment with ordinary cameras that are widely available and inexpensive. The system achieves 3D reconstruction using standard camera hardware combined with automatic image processing algorithms, eliminating the need for specialized expensive equipment while maintaining modeling efficiency

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent substitutes complex binocular imaging hardware with a simpler system based on ordinary cameras and computational algorithms. The 3D reconstruction is achieved through automatic extraction of line features and vanishing points from images, replacing the need for complex stereo vision hardware

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Area of stationary object

If aerial survey technology is used, then large scale scene modeling is enabled, but cost and data processing complexity increase

Engineering Contradiction:
Improvescene scaleVSAvoiddata processing complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent replaces complex aerial survey data processing with automatic image-based 3D reconstruction algorithms. The system processes ordinary camera images to extract line features and reconstruct 3D scenes, eliminating the need for complex point cloud processing and specialized algorithms required by aerial survey technology

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses ordinary camera images instead of expensive aerial survey data. The system achieves large-scale scene modeling using standard imaging equipment and automatic processing algorithms, avoiding the high costs and complex data processing requirements of aerial survey technology

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

4Manufacturing precision

If manual field measurement is used, then modeling accuracy is improved, but manpower requirements and cost increase

Engineering Contradiction:
Improvemodeling accuracyVSAvoidmanpower resources
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent replaces manual field measurement operations with automatic image processing algorithms. The system automatically extracts geometric features from images and reconstructs 3D scene structure without human intervention in the measurement process, eliminating the need for multiple personnel while maintaining high modeling accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-service 3D reconstruction by automatically processing images to extract line features, calculate vanishing points, and build 3D scene models. This eliminates the need for manual field measurement teams and reduces dependency on human resources while preserving modeling precision

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9942535B2Method for 3D scene structure modeling and camera registration from single image
Publication Date: 2018.04.10 BEIHANG UNIV
  • US9942535B2 patent drawing
  • US9942535B2 patent drawing
  • US9942535B2 patent drawing

AI summary

The present invention discloses a method for modeling and registering 3D scene structure based on single image, belonging to the field of virtual reality technology. The method includes calibrating camera through analyzing image line features; analyzing property of plane support relationship by using categorized lines to obtain a preliminary scene structure; optimizing scene structure via interoperation by a small number of users to complete modeling of scene structure for whole image; and finally registering 3D image scene structure, collected by different cameras through line features, into a unified 3D scene, allowing application into modeling of wide-range scene structure. According to the present invention, corresponding information of 3D scene structure can be rapidly obtained through interoperation by a small number of users. In the meantime, the present invention can guarantee modeling integrity of scene structure and effectively reducing 3D modeling cost, making 3D reconstruction of wide-range scene structure easier.