Automated Content Rating System Using Crowdsourced Player Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video game and user-generated content rating systems face challenges in efficiently managing the large volume of unrated content, particularly for children's content, due to the need for frequent re-rating and compliance with laws like COPPA, which can be labor-intensive and prone to errors.

Innovation Solution

A network-connected server-based system that crowdsources ratings from registered players by tracking their interactions and soliciting opinions through surveys, using data from player profiles and incentives to ensure accurate and timely age-appropriate content ratings, with the ability to automatically update ratings for new or altered content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If providers hire third parties to rate content manually, then rating accuracy can be maintained, but the time and cost required increases significantly

Engineering Contradiction:
Improverating accuracyVSAvoidrating time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables players to automatically rate content themselves through integrated surveys and feedback mechanisms. Players complete surveys after gameplay sessions, providing real-time ratings without requiring external reviewers. This self-service approach maintains accuracy while dramatically reducing the time and resources needed for rating.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements continuous feedback loops where player ratings and survey responses are collected, processed, and used to automatically update content ratings. The feedback mechanism includes post-game surveys, in-game feedback options, and automated analysis of player behavior data to generate and maintain accurate ratings efficiently.

Inventive Principle:
Principle #23Feedback

2Reliability

If manual review processes are used to ensure compliance with COPPA, then legal requirements can be met, but the complexity and resource requirements increase

Engineering Contradiction:
Improvecompliance reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system replaces manual mechanical review processes with automated computational methods. Algorithms automatically analyze content and player data to determine COPPA compliance, replacing the need for manual legal reviews. This substitution maintains compliance reliability while reducing system complexity and resource requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system automatically self-regulates compliance by integrating COPPA requirements into its rating algorithms. The system autonomously ensures compliance through automated age verification, parental consent management, and content appropriateness checks, eliminating the need for complex external compliance verification processes.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If frequent re-rating is performed to account for content updates, then rating accuracy is maintained, but the workload for providers increases significantly

Engineering Contradiction:
Improverating accuracyVSAvoidcontent review efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system implements continuous automated monitoring and re-rating of content as updates occur. Rather than periodic manual re-rating, the system continuously tracks content changes and automatically updates ratings in real-time. This continuous action maintains rating accuracy without increasing provider workload, as the automated system operates continuously without additional human resources.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system uses automated feedback mechanisms to detect content updates and trigger appropriate re-rating actions. Player feedback, survey responses, and system monitoring automatically identify when content has changed, triggering seamless re-rating processes that maintain accuracy without requiring manual intervention or increasing provider productivity burdens.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10743076B2Automated content rating system and network
Publication Date: 2020.08.11 ROBLOX CORP
  • US10743076B2 patent drawing
  • US10743076B2 patent drawing
  • US10743076B2 patent drawing

AI summary

A system for rating user-generated content (UGC), has a network-connected server hosted by an enterprise, enabling registered participants to select UGC from a network-connected repository, the content then presented to the selecting participants. A a data repository is coupled to the network-connected server, storing profile information regarding individual ones of the registered participants, and rating software executes on the network-connected server, providing functionality for creating age-appropriate rating for individual ones of the UGC.