AR Off-Screen Object Guidance Using Viewing Frustum Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality technologies cannot display information on objects outside the visual field of a terminal, requiring users to change their location to view excluded objects and lack guidance for their location or direction.

Innovation Solution

A method and terminal that specify the visual field using location, displacement, and viewing angle information to search and display guiding information on objects outside the field, utilizing a viewing frustum to provide augmented reality-based information on existence, location, and direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional AR technology displays only objects within the visual field, then the screen size limitation is respected and interface simplicity is maintained, but users cannot access information on objects outside the visual field without changing their location

Engineering Contradiction:
ImproveUser convenience in accessing object informationVSAvoidInformation on objects outside visual field
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent extends the AR display from 2D screen space into 3D spatial information by calculating and displaying the relative position, direction, and distance of objects outside the visual field. This allows users to access information about objects in any direction without physically moving, effectively adding a dimensional layer of information access.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system introduces an intermediary computational layer that processes terminal location, displacement, and viewing angle data to generate guiding information about objects outside the visual field. This intermediary processing enables indirect access to off-screen objects through calculated spatial relationships.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If users change terminal displacement or geographic location to include excluded objects in the visual field, then complete object information becomes accessible, but users lose guidance on location and direction and experience operational inconvenience

Engineering Contradiction:
ImproveComplete object information accessVSAvoidUser convenience and guidance
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system performs preliminary calculations of object positions and directions relative to the terminal's current state before the user needs the information. By pre-computing the spatial relationships and displaying guiding information in advance, users are guided to objects without needing to trial-and-error their movement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides continuous feedback to the user by displaying guiding information that shows the relative position and direction of objects outside the visual field. This feedback loop allows users to understand where to move or look without losing orientation, as the system constantly updates the spatial relationship information.

Inventive Principle:
Principle #23Feedback

3Loss of information

If AR technology provides comprehensive information on all objects, then information completeness is improved, but the small screen size cannot accommodate the huge amount of information

Engineering Contradiction:
ImproveInformation completenessVSAvoidDisplay screen area
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The patent extracts only the essential spatial information (relative position, direction, and distance) of objects outside the visual field and displays it as compact guiding information. This extraction approach provides complete directional guidance while consuming minimal screen space, allowing the interface to remain clean while information remains complete.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8947457B2Method for providing information on object which is not included in visual field of terminal device, terminal device and computer readable recording medium
Publication Date: 2015.02.03 INTEL CORP
  • US8947457B2 patent drawing
  • US8947457B2 patent drawing
  • US8947457B2 patent drawing

AI summary

The present invention relates to a method for providing information on an object excluded in a visual field of a terminal in a form of augmented reality (AR) by using an image inputted to the terminal and information related thereto. The method includes the steps of: (a) specifying the visual field of the terminal corresponding to the inputted image by referring to at least one piece of information on a location, a displacement and a viewing angle of the terminal; (b) searching an object(s) excluded in the visual field of the terminal; and (c) displaying guiding information on the searched object(s) with the inputted image in a form of the augmented reality; wherein the visual field is specified by a viewing frustum whose vertex corresponds to the terminal.