Camera Perspective Alignment via Augmented Reality Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating reproducible photographs of objects, such as motor vehicles, face challenges with perspective alignment and distortion due to mismatched 2D recording views and 3D model sections, leading to inconsistent image quality.

Innovation Solution

A method utilizing a computer vision module and augmented reality markers to guide the camera to specific perspectives by determining the starting location on a reference object, such as a license plate, and using acceleration and gyro sensors to ensure accurate alignment and orientation, ensuring consistent quality across different models and backgrounds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If 2D photographs are taken from predetermined directions using a 3D model alignment method, then the perspectives can be standardized, but distortions arise when the 2D recording does not match the section of the 3D model

Engineering Contradiction:
Improveperspective consistencyVSAvoidalignment accuracy
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent replaces the manual mechanical alignment process with an automated computer vision system. The camera's image sensor captures the reference view, and a computer vision module automatically identifies the starting location on the object and calculates the required camera positions and orientations, eliminating manual measurement errors and achieving precise alignment between 2D recordings and 3D model sections.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces augmented reality markers as an intermediary between the camera system and the object. These markers provide visual feedback to guide the camera operator to the correct positions and orientations, serving as a mediator that bridges the gap between the predetermined perspectives and the actual camera placement, thereby ensuring accurate alignment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If manual positioning is used for photographing objects, then flexibility in operation is maintained, but reproducible perspectives cannot be ensured independently of the operator

Engineering Contradiction:
Improveoperator flexibilityVSAvoidreproducibility
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements a feedback mechanism through augmented reality markers displayed on the camera's viewfinder or screen. The system provides real-time visual feedback to the operator, showing whether the camera is positioned at the correct location and orientation. This feedback loop enables operators to easily adjust their positioning while ensuring reproducible results across different operators and sessions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs self-positioning calculations automatically. The computer vision module processes the reference view image, identifies the starting location, and autonomously computes the coordinates and orientations for all required camera positions. This self-service capability eliminates the need for manual measurement and calculation, ensuring consistent results regardless of operator skill level.

Inventive Principle:
Principle #25Self-service

3Loss of information

If multiple 2D recordings are taken from different perspectives, then comprehensive object documentation is achieved, but time consumption increases due to manual positioning and alignment

Engineering Contradiction:
Improveobject documentation completenessVSAvoidphotography process duration
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by first capturing a reference view of the object and using the computer vision module to pre-calculate all necessary camera positions and orientations before actual photography begins. The system prepares the complete set of predetermined perspectives in advance, allowing operators to simply follow the guided positions without time-consuming manual alignment during the photography process itself.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces time-consuming manual positioning and alignment processes with automated computer vision and calculation systems. The system automatically determines camera positions, orientations, and distances based on the reference view, eliminating the need for operators to manually measure and calculate each position, thereby significantly reducing the time required to document objects from multiple perspectives.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11605182B2Method for generating reproducible perspectives of photographs of an object, and mobile device with an integrated camera
Publication Date: 2023.03.14 AUDI AG
  • US11605182B2 patent drawing
  • US11605182B2 patent drawing
  • US11605182B2 patent drawing

AI summary

A first 2D recording of a specified reference view of an object is captured by a camera and, starting from the first 2D recording, a user's starting location relative to the object is ascertained by a computer vision module. Starting from the origin of a coordinate system as the starting location of the camera, one or more specified and/or settable relative positions in the vicinity of the object and/or in the object are determined as one or more locations for the respective perspective of the camera for taking at least one second 2D recording. The respective location in an object view on a display of the camera is displayed by a respective first augmented reality marker on the ground and/or on the object. The alignment of the camera with regard to angle and rotation with the perspective corresponding to the respective location is performed in this case by second augmented reality markers as auxiliary elements.