Augmented Reality Labeling for Building Blocks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current navigation applications face challenges in presenting labeling information for building blocks, as it is often not visible when the preset superimposed position is outside the camera's viewing angle, and overlaps between multiple building blocks can obscure information, leading to unclear presentation.

Innovation Solution

A method and apparatus that acquire outline data of building blocks within the camera's viewing angle, generate reference information on projected line segments to determine occlusion, and superimpose labeling information on a target building block, ensuring visibility and avoiding overlaps by calculating optimal positions for labeling boxes based on occlusion correlations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If labeling information is preset at fixed superimposed positions on building blocks, then the presentation method is simple, but the labeling information cannot be displayed when the building block is only partially captured or when the preset position is outside the camera's viewing angle

Engineering Contradiction:
Improvepresentation method simplicityVSAvoidlabeling information visibility
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent applies dynamics by making the superimposed position of labeling information adaptive rather than fixed. The system dynamically calculates the superimposed position based on the building block's detection results, including its position, size, and orientation in the current image. This allows the labeling information to be correctly positioned even when the building block is captured at different angles or only partially visible, resolving the contradiction between simple presentation method and information visibility.

Inventive Principle:
Principle #15Dynamics

2Ease of manufacture

If multiple building blocks are labeled with preset superimposed positions, then the labeling process is straightforward, but overlaps between labeling information of different building blocks occur, making it unclear

Engineering Contradiction:
Improvelabeling process simplicityVSAvoidlabeling information clarity
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent applies local quality by making each building block's labeling information have unique local characteristics based on its specific position and orientation. The system calculates the superimposed position for each building block individually according to its detection results, ensuring that labeling information for different building blocks is distributed to appropriate locations without overlap, thus maintaining clarity while keeping the labeling process straightforward.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If the camera captures building blocks at various viewing angles or only partially captures them, then the navigation coverage is improved, but the preset superimposed position is not in the captured part, preventing labeling information from being presented

Engineering Contradiction:
Improvenavigation coverageVSAvoidlabeling information presentation
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system dynamically adjusts the superimposed position calculation based on the actual captured content and building block orientation. When the camera captures building blocks at various viewing angles or only partially, the system recalculates the appropriate superimposed position according to the detected building block parameters, ensuring labeling information remains visible and correctly positioned, thus maintaining both navigation coverage and information presentation.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3594907B1Method and apparatus for augmenting reality
Publication Date: 2021.04.28 BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
  • EP3594907B1 patent drawingFigure 1
  • EP3594907B1 patent drawingFigure 2
  • EP3594907B1 patent drawingFigure 3

AI summary

Embodiments of the present disclosure disclose a method and apparatus for augmenting reality. A specific embodiment of the method includes: acquiring outline data of a plurality of building blocks satisfying a preset selection condition, the outline data being used to describe an outline of a building block in three-dimensional space; generating reference information based on projected line segments of the plurality of building blocks; determining, based on the reference information, a target building block in the plurality of building blocks and a superimposed region in an image acquired by the terminal, labeling information of the target building block being superimposed on the superimposed region; and superimposing the labeling information of the target building block on the determined superimposed region, to obtain an augmented reality image.