AR Establishment Level Identification in Multi-Story Buildings

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems cannot easily identify the level of a building with multiple stories when displaying virtual information, making it difficult for users to determine which floor an establishment is located on.

Innovation Solution

An information processing apparatus and method that stores establishment information including level data, identifies establishments in captured images, and generates display information to superimpose identification details on the correct level of the building, allowing users to easily ascertain the level of establishments displayed in AR.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual display information is superimposed on a captured image of a building with multiple stories, then the user can see establishment information, but the user cannot easily ascertain which level the information corresponds to

Engineering Contradiction:
Improvelevel informationVSAvoiduser understanding
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent applies dimensionality change by transitioning from 2D image display to 3D spatial positioning. Virtual display information is positioned at specific 3D coordinates corresponding to the actual physical location of establishments in the building. This allows users to understand which level the information corresponds to by its spatial position in the augmented reality scene, resolving the ambiguity of flat 2D displays.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an intermediary mechanism - a recognition server that processes captured images, identifies buildings and establishments, determines their levels, and generates appropriately positioned virtual display information. This intermediary system bridges the gap between the captured image and the user's understanding of establishment locations by automatically performing the complex task of level identification and information positioning.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If establishment information is displayed without level positioning, then the display is simple, but the information is incomplete and ambiguous

Engineering Contradiction:
Improveestablishment location accuracyVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The recognition server performs multiple functions: it recognizes buildings, identifies establishments within buildings, determines the level of each establishment, and positions virtual display information accordingly. This multi-functional approach consolidates complex operations into a single system, making the overall system more manageable despite the increased capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs preliminary actions by pre-processing captured images to identify buildings and establishments before displaying information to the user. The recognition server analyzes the image, determines establishment levels, and prepares positioned virtual display information in advance, so that when information is presented to the user, it is already accurately positioned and ready for display.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10025985B2Information processing apparatus, information processing method, and non-transitory computer-readable storage medium storing program
Publication Date: 2018.07.17 GURUNAVI
  • US10025985B2 patent drawing
  • US10025985B2 patent drawing
  • US10025985B2 patent drawing

AI summary

An information processing apparatus includes: a storage that stores establishment information including identification information of an establishment, establishment position information indicating the position of the establishment, and level information indicating a level, on which the establishment is located, communication circuitry that receives, from a user terminal, a captured image captured, azimuth information, and terminal position information, and control circuitry that identifies at least one establishment existing in a building included in the received captured image based on the received terminal position information and azimuth information and the stored establishment position information, identifies the position of a level, on which the identified establishment exists, in the captured image based on the level information, and generates display information for displaying the identification information of the identified establishment on the position of the identified level of the captured image in a superimposed manner.