Linking Annotations to Continuous Data via Material Correlation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for linking annotations to continuous data, such as video and voice recordings, often result in irrelevant annotations being associated with non-relevant portions of the data due to reliance on pre-defined time information, reducing the usefulness of annotations during playback.

Innovation Solution

A user-data relating apparatus and method that allows users to input and relate annotations to specific positions within continuous data based on the relationship between materials used during recording, using image recognition and correlation analysis to accurately match annotations with corresponding data positions, enabling post-processing linking of annotations to relevant video data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If annotations are linked to continuous data using pre-defined time information, then the linking process is simplified, but the annotations become irrelevant to the actual data portions

Engineering Contradiction:

Improvelinking process simplicityVSAvoidannotation relevance

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent introduces material information (documents, images, slides) as an intermediary between annotations and continuous data. Annotations are first linked to materials, and materials are then correlated with specific portions of continuous data through image recognition and content analysis. This mediator resolves the contradiction by enabling accurate linking without direct time-based association.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical time-based linking system with an intelligent content-based system. Instead of using pre-defined time information to link annotations to video/audio data, the system uses image recognition, optical character recognition, and content analysis to automatically identify and link annotations to relevant data portions based on material content.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If annotations are made independently of data progression, then users can annotate materials of interest, but the annotations cannot be accurately associated with the correct data portions

Engineering Contradiction:

Improveannotation independenceVSAvoidannotation positioning accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent replaces time-based positioning with content-based positioning. Instead of relying on when an annotation is made during data playback, the system uses image recognition and content analysis to identify which specific portion of the continuous data the annotation refers to, based on the material content and its correlation with the data.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a copy of material information (images, text) from the continuous data and uses this copy for correlation analysis. By comparing the material copy with the annotated material, the system can accurately identify corresponding data portions even when annotations are made independently of data progression.

Inventive Principle:

Principle #26Copying

3Ease of manufacture

If time information is used to link annotations with continuous data, then the linking process is straightforward, but irrelevant annotations are associated with non-relevant data portions

Engineering Contradiction:

Improvelinking process efficiencyVSAvoidannotation-data correspondence

Core Design Contradiction:

Ease of manufactureVSLoss of information

Solution Approach 1:

The patent introduces material information as a mediator that preserves the correspondence between annotations and data portions. Instead of directly linking annotations to continuous data using time information, the system links annotations to materials and then correlates materials with data portions, thereby preventing loss of correspondence information.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent substitutes the time-based linking mechanism with a content-based verification mechanism. Image recognition and content analysis are used to verify that annotations are associated with the correct data portions, preventing irrelevant associations that would occur with simple time-based linking.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS7350140B2User-data relating apparatus with respect to continuous data

Publication Date: 2008.03.25 FUJIFILM BUSINESS INNOVATION CORP

AI summary

In a meeting held with employment of a plurality of materials, conditions of this meeting are recorded in the form of continuous data, and these materials are distributed to a user P who participates in this meeting by way of a printed matter and/or a screen output. Then, an analyzing unit analyzes the recorded continuous data so as to specify both a material and a place of the continuous data where this material was used. Also, an annotation/material relating unit specifies both an annotation which was added to a distributed material by the user in the meeting and this distributed material. A material matching unit judges a matching characteristic between these specified material and distributed materials. Then, are relating unit links the place of the continuous data where the material having the matching characteristic was employed with respect to the annotation of the distributed material.