Neural Autoregressive Video Recommendation Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video delivery services face challenges in generating real-time video recommendations that are both accurate and fast, as they require significant computing resources and time, which can lead to undesirable delays in a real-time online environment.

Innovation Solution

A neural autoregressive architecture for collaborative filtering tasks is employed, using user-specific models with shared parameters across multiple users, trained with neural networks to predict user preferences based on ratings, enabling quick and accurate recommendation generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional recommendation algorithms are used to generate accurate video recommendations, then recommendation accuracy is improved, but computing time and resource consumption increase

Engineering Contradiction:
Improverecommendation accuracyVSAvoidcomputing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-computes and stores user preference models and video feature representations during off-peak hours. When a user requests recommendations, the system only needs to query and combine pre-computed data, dramatically reducing real-time computing time while maintaining recommendation accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The recommendation system is divided into independent modules: user profile analysis, video feature extraction, preference modeling, and recommendation generation. Each module processes data independently and can be pre-computed or cached, reducing the computational burden during real-time recommendation generation.

Inventive Principle:
Principle #1Segmentation

2Reliability

If complex neural network models are trained to predict user preferences accurately, then recommendation relevance is improved, but device complexity and training resources increase

Engineering Contradiction:
Improverecommendation relevanceVSAvoidmodel complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Instead of deploying a single complex neural network model, the system creates multiple simplified user-specific models that are lighter copies tailored to individual user preferences. Each user model is a simplified version that can be quickly instantiated and used for personalized recommendations without requiring the full complexity of a universal model.

Inventive Principle:
Principle #26Copying

3Speed

If real-time recommendation generation is implemented to meet user expectations, then user experience is improved, but computing resource consumption increases

Engineering Contradiction:
Improverecommendation generation speedVSAvoidcomputing resource consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs heavy computational work in advance by pre-processing video metadata, pre-training general preference patterns, and pre-computing similarity matrices. During real-time operation, only lightweight queries and ranking operations are needed, achieving fast recommendation generation with minimal real-time resource consumption.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10515116B2Generation of video recommendations using connection networks
Publication Date: 2019.12.24 HULU LLC
  • US10515116B2 patent drawing
  • US10515116B2 patent drawing
  • US10515116B2 patent drawing

AI summary

A method receives ratings for videos from a first user that is using a video delivery service. A first model includes connection networks where each connection network corresponds to a rating. The method inputs each rating into a connection network in an order. Also, parameters for the ratings and ratings other than the rating received from the first user are modeled in a respective connection network. Values for the set of parameters are trained such that the plurality of connection networks predict conditional probabilities that the first user would provide the rating corresponding to the each connection network in the order. The conditional probabilities are based on the first user providing ratings that are previously located in the order. The parameters are then used to generate a list of videos to recommend to the first user using the first model.