Rule-Based Data Classification System for Automated File Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in efficiently identifying data files with common characteristics due to the vast amounts of data generated, requiring advanced machine-learning algorithms to locate and categorize relevant information without human intervention.

Innovation Solution

The development of systems and methods for generating a rule set using machine-learning algorithms that analyze labeled data files to identify features common to data files with specific characteristics, allowing for automatic classification and retrieval of relevant data without human intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If machine-learning algorithms are used to automatically classify data files, then productivity and automation are improved, but device complexity increases

Engineering Contradiction:
Improvedata classification efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the data classification task into multiple components: a rule generation engine that creates classification rules from training data, a rule set that stores and manages these rules, and a classification engine that applies rules to new data. This segmentation allows each component to be optimized independently and reduces overall system complexity by dividing the complex automation task into manageable parts.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The machine-learning algorithms enable the system to automatically generate classification rules from training data without requiring manual programming of classification logic. The rule generation engine self-learning from labeled data files creates and refines classification rules autonomously, improving productivity while the rule-based approach keeps the execution phase simple and maintainable.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If advanced machine-learning algorithms are applied to locate and categorize data, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedata categorization accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system replaces complex neural network inference with a rule-based classification mechanism. Machine-learning algorithms generate classification rules from training data, but the actual classification process uses simple rule matching and evaluation, substituting complex mechanical/algorithmic processing with more straightforward logical operations that are easier to implement and maintain while achieving high accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the representation of classification knowledge from raw training data to extracted rules with specific parameters (conditions and actions). This parameter transformation allows the system to achieve high measurement precision through rule-based decision making while reducing the complexity of the execution algorithms, as rules are simpler to process than raw machine-learning models.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If human intervention is reduced for data classification, then productivity is improved, but reliability may worsen due to lack of human oversight

Engineering Contradiction:
Improveautomatic classification speedVSAvoidclassification trustworthiness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system incorporates feedback mechanisms where classification results can be reviewed and corrected, and these corrections feed back into the rule generation process. This feedback loop allows the system to maintain high productivity through automation while improving reliability by learning from errors and refining classification rules based on actual performance and human corrections when needed.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary action by generating and pre-testing classification rules using training data before applying them to production data. This preliminary rule generation and validation process ensures that the automated classification system is thoroughly prepared and tested, improving reliability by catching potential issues before they affect production workflows.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9251465B2System and methods for interactive displays based on associations for machine-guided rule creation
Publication Date: 2016.02.02 SAS INSTITUTE INC
  • US9251465B2 patent drawing
  • US9251465B2 patent drawing
  • US9251465B2 patent drawing

AI summary

This disclosure provides a computer-program product, system, method and apparatus for accessing a representation of a category or item and accessing a set of multiple transactions. The transactions are processed to identify items found amongst the transactions, and the items are ordered based on an information-gain heuristic. A depth-first search for a group of best association rules is then conducted using a best-first heuristic and constraints that make the search efficient. The best rules found during the search can then be displayed to a user, along with accompanying statistics. The user can then select rules that appear to be most relevant, and further analytics can be applied to the selected rules to obtain further information about the information provided by these rules.