Live Scene Display With Feature-Docked Auxiliary Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mobile device applications do not provide augmented images that include additional information beyond the captured live scene, limiting user interaction and navigation experience.

Innovation Solution

Simultaneously display a live scene with an auxiliary object, such as a top-down map, docked to features in the image, and enhance it with augmented reality data, allowing real-time updates and user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a mobile device displays only the captured live scene, then the display remains simple and uncluttered, but the user lacks access to additional useful information that could enhance navigation and interaction

Engineering Contradiction:
Improveadditional informationVSAvoiddisplay complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces auxiliary objects that exist in a separate dimensional layer above the live scene. These objects (such as maps, information panels, or navigation elements) are docked to specific features in the live scene but rendered in an elevated dimensional space, allowing additional information to be displayed without cluttering the original scene view. This dimensional separation resolves the contradiction by providing extra information while maintaining the simplicity of the base live scene display.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If auxiliary objects are added to provide additional information, then user navigation and interaction are enhanced, but the display becomes more complex and may obscure the live scene

Engineering Contradiction:
Improveuser interaction capabilityVSAvoiddisplay clarity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent applies local quality by docking auxiliary objects to specific localized features within the live scene rather than uniformly distributing information. Each auxiliary object is positioned and anchored to a particular feature (such as a landmark, navigation point, or point of interest), providing enhanced interaction capability at that specific location while leaving other areas of the display clear and easy to operate. This localized approach allows versatility where needed without compromising overall display clarity.

Inventive Principle:
Principle #3Local quality

3Reliability

If the display updates in real-time as the mobile device moves, then the navigation information remains current and useful, but the processing requirements and energy consumption increase

Engineering Contradiction:
Improvenavigation accuracyVSAvoidenergy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by updating the auxiliary objects and their docking positions at discrete intervals or triggered by specific events (such as reaching certain geographic coordinates or detecting significant movement thresholds) rather than continuously updating at every frame. This approach maintains reliable navigation accuracy by providing updates when they are most needed while reducing energy consumption by avoiding unnecessary continuous processing during periods of minimal change.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentEP3688724B1Display of a live scene and auxiliary object
Publication Date: 2025.10.15 QUALCOMM INC
  • EP3688724B1 patent drawingFigure 1A
  • EP3688724B1 patent drawingFigure 1B
  • EP3688724B1 patent drawingFigure 1C

AI summary

A mobile device comprising one or more processors coupled to a camera configured to capture an image of a live scene, a display, and a memory can comprise the one or more processors configured to present an augmented image on the display. The augmented image can be based on the captured image and can include an image of an auxiliary object, such as a map, a browser, an additional camera view (local or remote), and/or an interface of a mobile application, docked to a feature comprising a physical object visible in the captured image. The feature can be a floor, corner, wall, ceiling, storefront, window, other physical or architectural object or feature, or an arbitrary system or user-defined area within the image. The one or more processors update the augmented image such that the auxiliary object remains docked to the feature as the augmented image is update.