Multi-Modality Email Classification Using Social Network Features

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Document classification in large corporate litigation cases is time-consuming and prone to errors due to the reliance on human annotators, with existing systems often focusing solely on textual content and lacking consistency, especially when only a small corpus of labeled documents is available.

Innovation Solution

A multi-modality classification method that extracts both text-based and social network features from electronic mail messages, using a semi-supervised approach to train classifiers, which combines representations from different modalities to improve classification accuracy and efficiency, even with limited labeled data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If human annotators review documents manually, then classification can be performed with full contextual understanding, but the process becomes time-consuming and costly

Engineering Contradiction:
Improveclassification accuracyVSAvoidreview time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent introduces an automated classification system as an intermediary between the documents and human reviewers. The system extracts features from both textual content and social network structures, trains classifiers on labeled data, and generates preliminary classifications that guide human review, thereby reducing the time burden while maintaining accuracy through the collaborative human-machine approach

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary classification actions before human review by automatically analyzing document features and social network patterns. This preliminary sorting and grouping of documents allows human annotators to focus only on borderline cases or high-priority items, significantly reducing overall review time while maintaining high classification accuracy

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If only textual content is used for classification, then the system remains simple to implement, but classification accuracy deteriorates when labeled data is limited

Engineering Contradiction:
Improvesystem complexityVSAvoidclassification accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent merges multiple data modalities including textual content features and social network structure features into a unified classification framework. By combining these complementary information sources, the system achieves higher classification accuracy with limited labeled data, as the social network features provide additional contextual signals that text alone cannot capture

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The classification system is designed to handle multiple types of features and data sources universally. The framework can process both traditional textual features and social network-derived features through a common machine learning pipeline, making the system multi-functional and adaptable to different data types without requiring separate specialized systems

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If multi-modality features are extracted and combined, then classification accuracy improves significantly, but the computational complexity and processing time increase

Engineering Contradiction:
Improveclassification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the classification process into distinct modular components: text feature extraction, social network feature extraction, data integration, and classification. Each module handles a specific aspect of the multi-modality processing independently, which manages computational complexity by breaking down the overall task into manageable segments that can be optimized separately

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If a large corpus of labeled documents is used for training, then classifier accuracy improves, but the cost and time for annotation increase significantly

Engineering Contradiction:
Improveclassifier accuracyVSAvoidlabeled data volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The social network structure acts as an intermediary that provides additional training signals. By leveraging the relational information between documents (co-authorship, citation networks, organizational hierarchies), the system can achieve better generalization with fewer labeled examples, as the social context provides implicit supervision that reduces the need for extensive manual labeling

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8386574B2Multi-modality classification for one-class classification in social networks
Publication Date: 2013.02.26 GENESEE VALLEY INNOVATIONS LLC
  • US8386574B2 patent drawing
  • US8386574B2 patent drawing
  • US8386574B2 patent drawing

AI summary

A classification apparatus, method, and computer program product for multi-modality classification are disclosed. For each of a plurality of modalities, the method includes extracting features from objects in a set of objects. The objects include electronic mail messages. A representation of each object for that modality is generated, based on its extracted features. At least one of the plurality of modalities is a social network modality in which social network features are extracted from a social network implicit in the set of electronic mail messages. A classifier system is trained based on class labels of a subset of the set of objects and on the representations generated for each of the modalities. With the trained classifier system, labels are predicted for unlabeled objects in the set of objects.