Gesture-Based Data Annotation System for Context-Aware Vocabulary Binding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in interpreting and utilizing data due to its structured and described nature, which varies across applications, leading to inefficient data discovery and usage, as existing systems fail to capture and share the meaning imparted by user interactions.

Innovation Solution

An architecture that facilitates annotating data based on gestures, using a tracking component to associate user interactions with data and an analysis component to determine global terms, stored in a look-up table, allowing for context-aware annotation and data interpretation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If data is structured and described based on specific applications, then data can be stored and accessed in organized formats, but new users must spend time and resources parsing the data to understand what it is and how to use it

Engineering Contradiction:
Improvedata organizationVSAvoiddata interpretation time
Core Design Contradiction:
Ease of manufactureVSLoss of time

Solution Approach 1:

The patent introduces an intermediary layer (data annotation system with global terms and vocabulary bindings) that sits between the raw data and the user. This intermediary translates application-specific data structures into universally understandable meanings, allowing users to grasp data purpose without parsing the underlying structure. The tracking component captures user interpretations, and the analysis component generates annotations that serve as this mediating layer.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary action by automatically generating data annotations and bindings before users need to interpret the data. The tracking component monitors user interactions in advance, and the analysis component proactively creates vocabulary bindings that pre-explain data meanings, so users encounter already-annotated data rather than raw unexplained data.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If data is structured differently depending on the source, then data can be collected from multiple sources, but searching for data results in under inclusive or over inclusive results

Engineering Contradiction:
Improvedata source compatibilityVSAvoiddata search accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent implements universality through global terms that serve multiple functions across different data sources. The vocabulary binding system creates a universal layer that maps various source-specific structures to common semantic meanings, allowing the same global term to represent equivalent concepts from different sources. This enables precise searching across heterogeneous data sources without being constrained by source-specific structures.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If users interpret and analyze data in different manners, then data can be used for multiple applications, but there does not exist a way to capture and share this acquired meaning

Engineering Contradiction:
Improvedata usage flexibilityVSAvoiduser interpretation meaning
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system implements feedback by having the tracking component continuously monitor user interactions with data and feed this information back to the analysis component. This feedback loop captures the actual meanings users derive from data, which are then converted into vocabulary bindings and annotations. These captured interpretations are stored and can be shared with other users, creating a cumulative knowledge base that preserves and propagates user-derived meanings across the system.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9746932B2Gesture inferred vocabulary bindings
Publication Date: 2017.08.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9746932B2 patent drawing
  • US9746932B2 patent drawing
  • US9746932B2 patent drawing

AI summary

The subject disclosure relates to annotating data based on gestures. Gestures include user interaction with a client device or client software. Gestures are tracked and associated with data. In an aspect, client context associated with a gesture is also tracked. The gestures are then employed to determine a global term to associate with the data. In an aspect, a look-up table comprising a pre-defined relationship between gestures and a global term can be employed. In another aspect, an inference component employ context information in conjunction with the tracked gestures to determine a global term to assign to data. After a global term is determined for data based on a gesture, an annotation file for the data can be created associating the data with the global term.