Pre-trained ML Model for Ecommerce Title Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing ecommerce marketplaces face inefficiencies in conversational transactions due to lengthy product titles, leading to user frustration and increased resource consumption in compressing titles, with existing methods being costly and resource-intensive.

Innovation Solution

A method and apparatus using pre-trained machine learning models with multiple layers, including embedding, encoder, and classification layers, trained on replaced-token detection tasks, to compress product titles efficiently, reducing parameter usage and processing time, allowing for accurate and cost-effective title compression.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If existing systems use database repositories of product titles with lengthy descriptions, then complete product information is provided to users, but interaction time increases and user satisfaction decreases

Engineering Contradiction:
Improveproduct information completenessVSAvoidinteraction time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system pre-generates compressed versions of product titles and stores them alongside the original lengthy titles in the database. This preliminary compression allows the system to quickly retrieve and display shortened product names during user interactions, eliminating the need to process and compress titles in real-time while maintaining information availability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The product title information is segmented into two representations: the original complete title for information accuracy and a compressed version for quick display. This segmentation allows the system to use different representations for different purposes - the compressed form for rapid interaction and the original form when detailed information is needed.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If existing systems compress product titles using traditional methods, then title length is reduced for better user experience, but computational resources and processing time increase significantly

Engineering Contradiction:
Improveuser experienceVSAvoidcomputational resources
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

Title compression is performed in advance during data processing or offline batches, not during user interactions. The compressed titles are pre-computed and stored, so when users interact with the system, the compression task has already been completed, eliminating real-time computational overhead.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of performing complex compression algorithms during user interactions, the system creates simplified copies of product titles that are stored in the database. These copied compressed versions are then directly used during interactions, avoiding repeated computational expensive operations.

Inventive Principle:
Principle #26Copying

3Productivity

If existing systems use resource-intensive compression methods, then compressed titles can be generated, but implementation cost and complexity increase

Engineering Contradiction:
Improvetitle compression efficiencyVSAvoidsystem implementation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system uses simple, lightweight compression rules and heuristics that are computationally inexpensive and easy to implement. Rather than deploying complex machine learning models or sophisticated algorithms, the system uses straightforward text processing rules that are easy to maintain and update, sacrificing some compression optimality for significant gains in simplicity and low cost.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS11804214B2Methods and apparatuses for discriminative pre-training for low resource title compression
Publication Date: 2023.10.31 WALMART APOLLO LLC
  • US11804214B2 patent drawing
  • US11804214B2 patent drawing
  • US11804214B2 patent drawing

AI summary

A system for generating compressed product titles that can be used in conversational transactions includes a computing device configured to obtain product title data characterizing descriptive product titles of products available on an ecommerce marketplace and to determine compressed product titles based on the product title data using a machine learning model that is pre-trained using a replaced-token detection task. The computing device also stores the compressed product titles for use during conversational transactions.