3D Reconstruction Using QR Code Calibration Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D reconstruction methods are cumbersome and complex due to the need for external parameter calibration, which involves cumbersome image acquisition processes, complex calibration object production, and limitations in overlapping field of view, restricting their application scenarios.

Innovation Solution

A 3D reconstruction method using multiple cameras with different viewing angles to image a symbol with markers, identifying marker IDs, computing external parameter matrices, and stitching point clouds together to unify them under a world coordinate system, facilitating faster and more accurate reconstruction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional calibration methods using calibration objects are used, then measurement accuracy is improved, but device complexity and ease of operation deteriorate due to cumbersome image acquisition processes and complex calibration object production

Engineering Contradiction:
Improvecamera calibration accuracyVSAvoidcalibration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a QR code as a disposable, easily produced calibration marker instead of complex calibration objects. The QR code can be printed on ordinary paper and discarded after use, eliminating the need for expensive, precision-manufactured calibration artifacts while maintaining calibration accuracy.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent replaces mechanical calibration objects with digital/image-based calibration markers (QR codes). Instead of using physical calibration artifacts that require precise manufacturing and handling, the system uses 2D barcodes that can be captured by the camera and processed algorithmically, simplifying the calibration process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If traditional calibration methods are used, then measurement precision is improved, but ease of operation worsens due to cumbersome image acquisition processes

Engineering Contradiction:
Improvecamera calibration accuracyVSAvoidcalibration operation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The QR code marker is a simple, disposable element that can be printed on standard paper. It eliminates the need for complex calibration object production and setup, making the calibration process accessible to users without specialized equipment or training.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent extracts the essential calibration function from complex mechanical calibration objects and condenses it into a simple 2D barcode pattern. This extracted representation contains all necessary calibration information in a compact, easily captured format that simplifies the operation.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If traditional calibration methods with overlapping field of view requirements are used, then measurement precision is improved, but adaptability worsens due to field of view limitations

Engineering Contradiction:
Improvecalibration accuracyVSAvoidapplication scenario flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The QR code calibration marker serves multiple functions: it provides calibration targets for multiple cameras simultaneously, works with various camera configurations (overlapping and non-overlapping fields of view), and can be used in diverse application scenarios. This universal marker design eliminates the need for different calibration objects for different scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The QR code acts as an intermediary object that bridges multiple camera coordinate systems. By placing the marker in the overlapping region of multiple cameras' fields of view, it enables coordinate transformation and calibration without requiring extensive overlap between camera views, thus expanding adaptability.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If complex calibration processes are used, then measurement precision is improved, but productivity worsens due to time-consuming procedures

Engineering Contradiction:
Improvereconstruction accuracyVSAvoidreconstruction speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The QR code marker is pre-designed with known geometric properties and encoding information. This preliminary design allows the calibration algorithm to start with prior knowledge about the marker's structure, reducing the computational search space and accelerating the calibration and reconstruction process while maintaining precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12020398B23D reconstruction method and apparatus
Publication Date: 2024.06.25 CHINA ELECTRONIC TECH GRP CORP NO 38 RES INST
  • US12020398B2 patent drawing
  • US12020398B2 patent drawing
  • US12020398B2 patent drawing

AI summary

Provided are a 3D reconstruction method and apparatus, an electronic device and a storage medium. The 3D reconstruction method comprises: using a plurality of cameras with different viewing angles to image a symbol to obtain a symbol image, a reference object for camera calibration being called the symbol, the symbol including a plurality of markers, and each of the markers having a corresponding ID number; identifying the ID number of the marker in the symbol image and searching for world coordinates corresponding to the marker according to the ID number; computing an external parameter matrix of the camera according to marker coordinates of a camera coordinate system and marker coordinates of a world coordinate system, and unifying point clouds under the world coordinate system to obtain a plurality of point clouds under different viewing angles; and stitching the plurality of point clouds together to obtain a 3D reconstructed image.