3D Annotation via 2D Projection for Street View Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods lack efficient systems for creating and managing annotations for images, particularly for three-dimensional objects viewed through two-dimensional images, which limits the ability to associate user-input content with specific locations in a unified and retrievable manner.
Innovation Solution
The system projects a selecting object, such as a bounding box, onto a three-dimensional model created from multiple two-dimensional images, allowing users to input content that is then stored with location information to form annotations, enabling retrieval and display across corresponding images or maps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users create annotations by manually selecting objects in two-dimensional images, then annotation accuracy for three-dimensional objects is improved, but the complexity of the annotation system increases
Solution Approach 1:
The patent introduces a three-dimensional model as an intermediary between the two-dimensional image and the annotation system. This 3D model serves as a mediator that bridges the gap between 2D image coordinates and 3D object locations, enabling accurate annotations without directly increasing system complexity. The projection mechanism acts as an intermediary transformation layer.
Solution Approach 2:
The patent transforms the annotation problem from two-dimensional image space to three-dimensional model space by projecting selecting objects onto the 3D model. This dimensionality change allows annotations to be created in 2D while accurately representing 3D object locations, resolving the contradiction between accuracy and complexity.
2Measurement precision
If a three-dimensional model is created from multiple two-dimensional images to enable accurate annotation projection, then annotation precision is improved, but the time and computational resources required increase
Solution Approach 1:
The three-dimensional model is constructed in advance from multiple two-dimensional images before the annotation process begins. This preliminary action prepares the spatial framework beforehand, so that during actual annotation, only simple projection operations are needed rather than complex real-time computations.
Solution Approach 2:
The patent creates a three-dimensional copy or representation of the scene from 2D images. This 3D copy serves as a reusable reference model that can be projected onto multiple different 2D images without requiring repeated complex processing, thus reducing time loss for subsequent annotations.
3Adaptability or versatility
If selecting objects are projected onto three-dimensional models for annotation, then the ability to associate content with specific locations is improved, but the complexity of location determination increases
Solution Approach 1:
The patent uses projection from 3D model space to 2D image space to determine locations. By working in the simpler 2D projection space rather than complex 3D coordinate transformations, the system achieves versatile content-location association while keeping location determination relatively simple through the projection mechanism.
Data Source
AI summary
The present invention relates to annotating images. In an embodiment, the present invention enables users to create annotations corresponding to three-dimensional objects while viewing two-dimensional images. In one embodiment, this is achieved by projecting a selecting object onto a three-dimensional model created from a plurality of two-dimensional images. The selecting object is input by a user while viewing a first image corresponding to a portion of the three-dimensional model. A location corresponding to the projection on the three-dimensional model is determined, and content entered by the user while viewing the first image is associated with the location. The content is stored together with the location information to form an annotation. The annotation can be retrieved and displayed together with other images corresponding to the location.