Recommender System Rating Prediction Using Pre-Trained Review Representations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional online retail recommendation systems lack effectiveness in predicting user ratings for products without available reviews, as they rely solely on historical ratings and metadata, failing to leverage the predictive power of text-based reviews.

Innovation Solution

A recommender system that models users, products, and reviews as a multi-relational graph, generating user, product, and review representations to predict ratings, allowing for approximation of review representations at prediction time, even when reviews are not available, using a neural network-based approach that embeds entities into a latent space and learns regressor models for rating predictions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional recommendation systems use only historical ratings and metadata for predictions, then the system complexity remains low, but the prediction accuracy deteriorates when reviews are unavailable

Engineering Contradiction:
Improveprediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-training machine learning models on available review data before prediction time. Review representations are generated and stored in advance, allowing the system to quickly approximate ratings even when reviews are not available at prediction time, thus improving accuracy without proportionally increasing complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces review representations as an intermediary element that mediates between user-item interactions and rating predictions. These representations capture the predictive power of review text and serve as a bridge, allowing the system to make accurate predictions even when actual reviews are unavailable, resolving the contradiction between simplicity and accuracy

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the system leverages text-based reviews for rating predictions, then prediction accuracy improves, but the difficulty of processing and storing review data increases

Engineering Contradiction:
Improverating prediction accuracyVSAvoiddata processing difficulty
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The system extracts essential features from review text and condenses them into compact review representations. This extraction process separates the critical predictive information from the full text, making the data more manageable and easier to process while retaining the accuracy benefits of using review content

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms review data from its original text form into numerical representations through machine learning models. This parameter change converts unstructured text into structured numerical data that is easier to process, store, and integrate with other recommendation system components, reducing processing difficulty while maintaining predictive power

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the system generates user, product, and review representations for all possible pairs, then prediction accuracy improves, but the computational resources and time required increase

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary computation by pre-training models and generating review representations during offline processing. This allows the computationally intensive work to be done in advance, reducing online prediction time while maintaining high accuracy when making recommendations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements approximate nearest neighbor search and selective computation, performing partial actions only when necessary. The system approximates review representations at prediction time rather than computing exact values for all possible pairs, achieving sufficient accuracy with reduced computational overhead and time

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10963941B2Method and system for combining user, item and review representations for recommender systems
Publication Date: 2021.03.30 NEC CORP
  • US10963941B2 patent drawing
  • US10963941B2 patent drawing
  • US10963941B2 patent drawing

AI summary

A method for providing recommendations to users includes obtaining stored data structure triples and actual ratings associated with the data structure triples; training a machine learning model using the stored data structure triples and associated actual ratings, wherein training the machine learning model includes generating user, product, and review representations based on the stored data structure triples and their associated ratings; predicting, by the machine learning model, ratings using the generated user, product, and review representations; and making recommendations based on the predicted ratings.