Ambient Display Annotation Hierarchy via Temporal Grouping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for presenting annotations on ambient displays fail to effectively preserve the temporal context and relationships between annotations, leading to a loss of context due to overwriting, erasure, and lack of hierarchical organization.

Innovation Solution

Implementing an annotation tree structure to organize and store annotations, allowing for a hierarchical representation that displays annotations in a timeline with branches representing related comments, spatial proximity, and temporal context, using criteria like time intervals, spatial density, and text recognition to group and display annotations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If annotations are displayed in a flat linear sequence, then the display is simple and easy to implement, but the temporal context and relationships between annotations are lost

Engineering Contradiction:
Improvetemporal contextVSAvoidannotation organization structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments annotations into hierarchical groups based on temporal proximity and spatial proximity. Annotations are divided into annotation groups where each group contains annotations that are temporally close to each other or spatially close to the same location on the display. This segmentation preserves temporal context while maintaining manageable organization structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical dimension to the annotation display structure. Instead of a flat linear sequence, annotations are organized in multiple levels: individual annotations within annotation groups, which are themselves organized chronologically. This dimensional transformation allows preservation of temporal relationships without requiring excessive structural complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If all annotations are displayed simultaneously, then complete information is provided, but the display becomes cluttered and difficult to navigate

Engineering Contradiction:
Improveannotation completenessVSAvoidannotation navigation
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent implements dynamic display behavior where annotation groups are displayed based on user interaction. When a user selects an annotation group, the system dynamically adjusts the display to show detailed information about that specific group while allowing navigation to other groups. This dynamic approach maintains complete information availability while ensuring easy navigation through interactive selection and filtering.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent displays partial information initially by showing annotation groups as summary units rather than all individual annotations at once. Users can then expand or select specific groups to view complete details when needed. This partial display approach reduces clutter while maintaining access to complete information through on-demand expansion.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If annotations are organized by strict chronological order, then temporal sequence is preserved, but relationships between related annotations are obscured

Engineering Contradiction:
Improveannotation relationshipsVSAvoidorganization criteria
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges multiple organization criteria by combining chronological ordering with spatial proximity and thematic relationships. Annotations that are chronologically close or spatially close are merged into the same annotation group, preserving both temporal sequence and relational context. This merging approach maintains simple chronological structure while enriching it with additional organizational dimensions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal annotation group structure that can serve multiple organizational purposes simultaneously. Each annotation group functions as both a temporal container (grouping annotations by time) and a relational container (grouping annotations by spatial proximity or thematic connection). This multi-functionality allows the same structure to preserve both chronological order and annotation relationships without requiring separate complex systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8751921B2Presenting annotations in hierarchical manner
Publication Date: 2014.06.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8751921B2 patent drawing
  • US8751921B2 patent drawing
  • US8751921B2 patent drawing

AI summary

Ambient displays and electronic whiteboards are commonly used to present information during meeting or other appropriate settings. Many times graphical objects are displayed on ambient displays where users of the ambient display will create annotations to the graphical object to provide further comments, meaning, and/or context. Annotations on the ambient display may be recorded for later review. An effective way to present recorded annotations is through a hierarchical system that provides context to the annotations. Annotations may be defined as sets of annotations based upon a logical grouping (e.g. spatial density, temporal density, etc.). These sets can be displayed to users as annotation branches. One method for displaying annotations branches is with a timeline. Depending on where along the timeline a user is, different annotations and/or annotation branches are displayed in relation to one another (e.g. annotation branches that derive from another annotation branch are displayed in a hierarchical manner).