Context-Aware AR Registration Information Display Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods struggle to dynamically display registration information on real-world points of interest (POIs) based on user behavior and context, such as physical activity or proximity to unseen facilities, without rigid control over text size, position, and animation.

Innovation Solution

An information processing apparatus and method that uses a data processing unit to input virtual object display control data, including positional information for real-world POIs in a three-dimensional spatial coordinate system, and updates the display based on predefined context changes, allowing flexible display of registration information and virtual objects on a user terminal.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional methods are used to superimpose registration information on shot images based on GPS and Geo information, then the information can be displayed following the positional relationship, but it is difficult to dynamically change the display based on user behavior and context

Engineering Contradiction:
Improvedisplay adaptabilityVSAvoidcontrol complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic display control by detecting user behavior context (such as walking, running, or stationary states) and automatically adjusting registration information display parameters including text size, position, and animation effects. The system transitions from static to dynamic display adaptation based on real-time user state detection, resolving the contradiction between display adaptability and control complexity.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the registration information is displayed with fixed size and position based on metadata, then the display is simple to control, but it cannot adapt to different user behaviors and contexts

Engineering Contradiction:
Improvecontext awarenessVSAvoiddisplay control ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system employs feedback mechanisms by continuously detecting user behavior context through sensors and camera data, then using this feedback to automatically adjust registration information display parameters. The closed-loop control system monitors user state and dynamically modifies text size, position, and animation without requiring manual intervention, thus achieving context awareness while maintaining ease of operation.

Inventive Principle:
Principle #23Feedback

3Productivity

If the information display is updated in real-time according to user motion, then the display becomes more engaging, but the processing load and system complexity increase

Engineering Contradiction:
Improveinformation presentation effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by pre-defining multiple display modes and parameter sets corresponding to different user behavior contexts. The system prepares various text sizes, positions, and animation configurations in advance, then simply selects the appropriate pre-configured set based on detected user state. This approach reduces real-time processing complexity while maintaining effective information presentation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10499002B2Information processing apparatus and information processing method
Publication Date: 2019.12.03 SONY GROUP CORP
  • US10499002B2 patent drawing
  • US10499002B2 patent drawing
  • US10499002B2 patent drawing

AI summary

The present disclosure is intended to display registration information on a real-world registration information setting point and update the display with detection of an event in accordance with a change in the context as a trigger. A control for displaying a virtual object including registration information on a real-world registration information setting point is performed. The data processing unit performs a process for displaying registration information described in control data and a process for updating the display in accordance with a change in predefined context. Further, the data processing unit displays the virtual object indicative of the registration information setting point in conjunction with the display of the registration information. The data processing unit calculates the positional relationship between an information processing apparatus and the registration information setting point on the basis of the position, direction, and the like of a reference image (anchor) detected from the shot image in a virtual three-dimensional space, and displays the virtual object indicative of the registration information setting point on the basis of the calculated positional relationship and a change in the context.