Content Quality Management Service Using Ensemble Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods and systems fail to comprehensively address the overall quality of content items in user communities, leading to the display of low-quality content that can confuse users, decrease engagement, and negatively impact the credibility and sales of products or services.

Innovation Solution

A method and system that utilize an ensemble model comprising trained models to generate quality scores for content items based on features such as sentiment, errors, and complexity, determining how to handle each item by deciding whether to display, hide, or remove it, ensuring high-quality content is promoted.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional methods and systems are used to manage content items, then the system is simple and easy to operate, but the quality of displayed content deteriorates leading to user confusion and decreased engagement

Engineering Contradiction:
Improvecontent qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The content quality assessment system is segmented into multiple specialized models, each evaluating specific aspects of content quality (e.g., spam detection, quality scoring, freshness assessment). These segmented models work together to provide comprehensive content evaluation without requiring a single complex system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An intermediary content quality management service is introduced between the content database and users. This service acts as a mediator that retrieves content items, evaluates their quality using multiple models, and selectively displays only high-quality content, thereby improving content quality without directly complicating the user interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If moderators are employed to fix or remove low quality content, then content quality improves, but the cost and resource consumption increase significantly

Engineering Contradiction:
Improvecontent qualityVSAvoidmoderator resource consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The system implements self-service content quality management through automated models that continuously evaluate and manage content quality without human intervention. The spam detection model, quality scoring model, and freshness model automatically identify and manage low-quality content, eliminating the need for manual moderator resources while maintaining high content quality standards.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Manual moderator operations are replaced with automated computational models. The mechanical process of human review and content management is substituted with algorithmic evaluation systems that can process and evaluate content at scale without consuming human resources, thereby maintaining content quality while eliminating moderator costs.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If traditional automated methods are used to address individual quality features, then specific errors are corrected, but overall content quality assessment fails

Engineering Contradiction:
Improvequality assessment comprehensivenessVSAvoidcontent processing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

Multiple specialized quality assessment models (spam detection, quality scoring, freshness assessment) are merged into a unified content quality management system. This combination enables comprehensive evaluation of overall content quality while maintaining the efficiency benefits of specialized individual models, addressing both comprehensiveness and productivity requirements.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The content quality management service performs multiple functions through a single integrated system: retrieving content items, evaluating spam, scoring quality, assessing freshness, and selectively displaying content. This multi-functional approach ensures comprehensive quality assessment while improving processing efficiency by consolidating operations into a single universal service.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11182448B1Content quality management service
Publication Date: 2021.11.23 INTUIT INC
  • US11182448B1 patent drawing
  • US11182448B1 patent drawing
  • US11182448B1 patent drawing

AI summary

Certain aspects of the present disclosure provide techniques for determining content quality of a set of content item based on generating a score for each content item. An example technique includes using a trained content quality model to generate the score for each content item component. In such example, the model is trained using a calculated set of features associated with text and metadata of a content item in a training data set as well as a quality label for the content item. The model is trained by associating the set of features with the quality label for each content item in the training data.