Email Filtering via Content Recognition and Social Group Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current email filtering systems are inadequate in effectively managing and filtering out spam emails, as they often rely on source-based blocking methods that can be easily circumvented by spammers changing their identities, and they lack efficient mechanisms for social group-based filtering.

Innovation Solution

A system that employs content recognition and social group-based filtering, where emails are flagged as spam based on their content and sender identity, and users can assign special treatments to emails from specific sources or with similar content, applying these treatments to their own and associated user groups, even if the spammer changes their identity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If source-based blocking methods are used to filter spam emails, then the filtering process is simple to implement, but spammers can easily circumvent the filtering by changing their identities

Engineering Contradiction:
Improveease of implementationVSAvoideffectiveness of spam filtering
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The system transitions from filtering based solely on sender address parameters to filtering based on content parameters. By analyzing email body text, subject lines, and metadata, the system creates content-based profiles that remain valid even when sender identities change. This parameter transformation allows the same spam content to be identified regardless of which email address it comes from.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system creates content profiles and fingerprints as copies of the essential characteristics of spam emails. These content-based representations are stored and used for matching future emails, allowing the system to identify spam without relying on the original sender address. The content profile acts as a reusable template that can detect variations of the same spam campaign.

Inventive Principle:
Principle #26Copying

2Ease of operation

If individual user filtering is implemented, then each user can control their own inbox, but the filtering effectiveness is limited to individual users and does not leverage collective user feedback

Engineering Contradiction:
Improveuser controlVSAvoidfiltering effectiveness
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system merges individual user filtering capabilities with collective user feedback by allowing users to share content profiles and blocking rules across the network. When one user identifies spam content, the content profile is made available to other users, creating a collaborative filtering system that combines the power of individual control with collective intelligence.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback loops where user actions (marking emails as spam, reporting phishing attempts) are processed to update content profiles and improve future filtering. User feedback directly influences the evolution of filtering rules, allowing the system to adapt and improve based on real-world user experiences with spam and phishing attempts.

Inventive Principle:
Principle #23Feedback

3Reliability

If content recognition and social group-based filtering are implemented, then spam filtering becomes more effective and adaptive, but the system complexity increases

Engineering Contradiction:
Improvespam filtering effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary analysis of email content during the receiving phase, creating content profiles and fingerprints before the user needs to take action. By pre-processing and categorizing email content, the system reduces the computational burden during filtering decisions and provides users with pre-organized information for making filtering choices.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces content profiles as intermediary representations between raw email content and filtering decisions. These profiles serve as a simplified intermediate layer that captures the essential characteristics of spam content without requiring the full complexity of the original email, making the filtering process more manageable and efficient.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If emails are filtered based on content similarity, then spam from varying sources can be identified, but the risk of false positives increases

Engineering Contradiction:
Improveability to identify spam from varying sourcesVSAvoidfalse positives
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system applies different filtering thresholds and matching criteria to different types of content and users. By localizing the filtering parameters to specific contexts, content types, and user preferences, the system can adjust its sensitivity to reduce false positives while maintaining high detection rates for actual spam. Different user groups can have customized tolerance levels for content similarity matching.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS8667069B1Filtering incoming mails
Publication Date: 2014.03.04 YAHOO ASSETS LLC
  • US8667069B1 patent drawing
  • US8667069B1 patent drawing
  • US8667069B1 patent drawing

AI summary

Techniques are described for determining how to handle inbound messages based on feedback from users. Feedback may relate to content of inbound messages and/or a source of inbound messages. In addition, feedback may be dynamically filtered based on groups and message recipients may become affiliated with one or groups causing feedback associated with the one or more groups to apply to inbound messages they receive. In displaying messages, an indication of feedback associated with the messages may be displayed to the message recipient.