Multi-Modal Time Series Annotation With Domain-Specific Refinement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for automatic time series annotation lack the ability to generate high-quality, domain-specific annotations efficiently, often resulting in mislabeling and failing to capture nuanced patterns, especially when precise domain-specific terminology is required.

Innovation Solution

A multi-agent system that includes a general annotation agent and a domain-specific annotation agent, leveraging large language models and reinforcement learning to extract common knowledge from multiple source domains and domain-specific terminology from a target domain, ensuring accurate and contextually appropriate annotations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing automatic annotation methods are used, then annotation speed is improved, but annotation quality and precision deteriorate

Engineering Contradiction:
Improveannotation speedVSAvoidannotation quality
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces domain experts as intermediaries between the automatic annotation system and the final annotations. Domain experts review and refine annotations generated by automated methods, ensuring both high speed and high quality. The system acts as an intermediary layer that combines automated efficiency with expert precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The annotation process is segmented into multiple stages: initial automatic annotation, domain-specific refinement, and expert verification. Each stage handles specific aspects of annotation quality, allowing the system to maintain high productivity while progressively improving precision through specialized processing at each level.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If manual annotation methods are used, then annotation quality is improved, but time consumption and cost increase

Engineering Contradiction:
Improveannotation qualityVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system creates and uses domain-specific annotation guides and templates that can be copied and applied consistently across different datasets. These standardized templates encode expert knowledge in reusable formats, maintaining high annotation quality while reducing the time experts need to spend on each individual annotation task.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

Domain-specific terminology and annotation criteria are pre-established and prepared before the actual annotation process. This preliminary preparation work, including creating domain vocabularies and annotation protocols, enables faster execution during the actual annotation phase while maintaining high quality standards.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If generic annotation approaches are used, then processing efficiency is improved, but domain-specific accuracy deteriorates

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddomain-specific accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system applies different annotation strategies to different domains and data types. Instead of using a single generic approach, it tailors annotation methods to specific domain requirements while maintaining overall system efficiency. Domain-specific configurations and parameters are applied locally to ensure accuracy without compromising global processing efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The annotation system dynamically adjusts parameters such as annotation granularity, terminology vocabulary, and validation criteria based on the specific domain being processed. This allows the system to maintain high processing efficiency by using optimized default parameters while adapting to domain-specific requirements when needed, thereby improving domain-specific accuracy.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260074074A1Cross-domain multi-modal time series annotation for medical decision making
Publication Date: 2026.03.12 NEC LABORATORIES AMERICA INC
  • US20260074074A1 patent drawing
  • US20260074074A1 patent drawing
  • US20260074074A1 patent drawing

AI summary

Methods and systems include generating general annotations for input time series data based on annotations from one or more source domains. Domain-specific annotations are generated for the input time series based on annotations from a target domain and based on the general annotations. An action is performed responsive to the domain-specific annotations and the general annotations.