LLM Comment-to-Feature Linking for Accurate Feature Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques for processing large volumes of user comments in software development are inefficient, requiring significant manual effort due to keyword-based searches that yield numerous documents, leading to potential errors in feature prioritization and resource allocation.
Innovation Solution
An online system uses a machine learning-based language model to automatically link user comments with features, generating vector representations and determining feature priorities based on comment analysis, enabling efficient and accurate feature management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If keyword-based search is used to process user comments, then search coverage is improved, but manual review effort increases significantly
Solution Approach 1:
The patent introduces an automated classification system as an intermediary between keyword search and manual review. This system uses machine learning models to automatically categorize and prioritize search results, filtering out clearly irrelevant comments and flagging only those requiring human attention, thereby reducing manual review effort while maintaining comprehensive search coverage
Solution Approach 2:
The patent replaces the mechanical manual review process with an automated computational system. Machine learning models analyze comment content, extract features, and automatically classify comments, substituting human manual sorting and filtering with algorithmic processing that operates at scale without proportional increases in effort
2Measurement precision
If manual review is used to process search results, then accuracy is improved, but processing speed decreases
Solution Approach 1:
The patent segments the processing workflow into distinct automated and manual stages. Automated machine learning models handle initial classification, filtering, and prioritization of the majority of comments, while human reviewers focus only on edge cases or high-priority items. This segmentation allows most processing to occur at high speed automatically while maintaining accuracy through targeted human review
Solution Approach 2:
The patent implements self-service through automated classification systems that independently process and prioritize comments without human intervention. The machine learning models autonomously analyze comment content, determine relevance to specific features, and organize results, enabling the system to serve itself in the initial processing stages and reserve human expertise for cases requiring judgment
3Adaptability or versatility
If more features are tracked, then system functionality is improved, but data management complexity increases
Solution Approach 1:
The patent implements a universal automated classification framework that handles multiple features and comment types through a single system architecture. The machine learning models are designed to process diverse feature descriptions and comment content using common techniques, allowing the system to manage many features without proportionally increasing complexity through standardized multi-functional processing
Data Source
AI summary
A system, for example, an online system uses a machine learning based language model, for example, a large language model (LLM) to rank features of items. The system receives comments from users. Each comment represents user feedback received via a channel of the online system, for example, via email, via a chat interface, and so on. The system links comments with features using a machine learning based language model. The system stores a link representing an association between a feature and a comment and determines aggregate information describing links for each feature. The system determines a priority for a feature based on the aggregate information describing links for the feature and sends information describing the priority of the feature.