Personalized Markov Chains for Content Recommendation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital content recommendation systems face inefficiencies in accurately recommending content due to the need for large data storage and processing power, especially when using metadata tags, and fail to account for individual user preferences, leading to sub-optimal recommendations.

Innovation Solution

The implementation of personalized Markov chains, where each user's title selection process is represented as a weighted mixture of prototypical Markov chains, allowing for tailored recommendations based on user interactions, independent of metadata or demographics, and optimizing computational resources by computing similarities for each Markov chain rather than per user.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If collaborative filtering techniques are used to determine digital media of interest based on preferences of similar users, then recommendation accuracy is improved, but data storage and processing requirements increase significantly

Engineering Contradiction:
Improverecommendation accuracyVSAvoiddata storage requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential transition probability information from user interaction data, representing user preferences through compact Markov chain models rather than storing complete user preference profiles. This extraction approach maintains recommendation accuracy while significantly reducing data storage requirements by focusing only on the probabilistic transition patterns between content items.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms user interaction data into parameterized Markov chain models with transition probabilities. By changing the representation from raw interaction data to parameterized probability matrices, the system achieves efficient storage while preserving the essential patterns needed for accurate recommendations.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If metadata tags are used to identify similar digital media, then recommendation capability is improved, but processing power and storage space requirements increase

Engineering Contradiction:
Improverecommendation capabilityVSAvoidprocessing power
Core Design Contradiction:
Adaptability or versatilityVSPower

Solution Approach 1:

The patent replaces the mechanical computation of metadata tag similarity with a probabilistic Markov chain model. Instead of computing similarity based on multiple metadata tags, the system uses transition probabilities derived from actual user behavior patterns, significantly reducing processing requirements while improving recommendation accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If personalized Markov chains are computed for each user, then recommendation personalization is improved, but computational intensity increases

Engineering Contradiction:
Improverecommendation personalizationVSAvoidcomputational intensity
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent segments the computational workload by pre-computing a shared Markov chain from aggregate user interaction data, then deriving individual user recommendations through efficient parameter adjustments rather than full re-computation. This segmentation maintains personalization while reducing computational intensity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary computation of the shared Markov chain model in advance, storing it for efficient retrieval and adaptation. By preparing the base model beforehand, the system avoids intensive real-time computation when generating personalized recommendations, significantly reducing energy consumption during operation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10360508B1Personalized Markov chains
Publication Date: 2019.07.23 NETFLIX INC
  • US10360508B1 patent drawing
  • US10360508B1 patent drawing
  • US10360508B1 patent drawing

AI summary

A data processing method comprises receiving title interaction data, wherein the title interaction data specifies, an order in which users interacted with a plurality of titles; generating a plurality of statistical models, each statistical model of the plurality of statistical models specifying a plurality of probabilities, wherein the plurality of probabilities represent, for each first title of the plurality of titles and each second title of the plurality of titles, a likelihood that a user will interact with the first title then next interact with the second title; refining the plurality of statistical models based on the title interaction data; determining a plurality of weight values corresponding to the plurality of statistical models for a particular user; identifying, for the particular user, one or more recommended titles of the plurality of titles based on the plurality of weight values and the plurality of statistical models.