Mobile Device QoS Evaluation via Normalized User Ratings
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Evaluating and comparing the quality of service of mobile communication devices in varying radio environments is challenging due to differing design characteristics and environmental conditions, making it difficult to objectively determine performance across different devices, locations, and user experiences.
Innovation Solution
A system and method that uses reference and test content items to evaluate the quality of service of mobile devices, where users provide ratings for content items of varying quality, and these ratings are normalized to enable objective comparisons across different devices, locations, and times, capturing network and location information to ensure meaningful comparisons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If mobile devices are tested in live networks under varying radio environments, then the evaluation reflects real-world performance, but the results become difficult to compare objectively across different devices, locations, and times
Solution Approach 1:
The patent transforms subjective quality ratings into normalized objective metrics by changing the parameter representation. User ratings are converted through normalization processes that adjust for environmental variations, location differences, and temporal changes, enabling consistent comparison across diverse testing conditions while maintaining the benefits of real-world live network testing
Solution Approach 2:
The patent introduces normalization algorithms and statistical processing as intermediary layers between raw user ratings and final quality metrics. These intermediaries process the subjective ratings to eliminate biases from different users, locations, and times, producing standardized comparable metrics that reflect true device performance differences
2Adaptability or versatility
If multiple different mobile device designs are tested, then comprehensive performance comparison is achieved, but the varying design characteristics make it difficult to isolate and evaluate specific performance factors
Solution Approach 1:
The patent segments the quality evaluation into distinct measurable components by collecting multiple ratings for the same content across different devices and conditions. This segmentation allows statistical analysis to isolate device-specific performance factors from environmental variations, enabling comprehensive comparison while identifying specific performance contributors
3Ease of operation
If users provide subjective quality ratings, then real user experience is captured, but the ratings vary due to individual user preferences and making objective comparison difficult
Solution Approach 1:
The patent implements a feedback mechanism where user ratings are collected and processed through normalization algorithms that use statistical feedback from multiple ratings to establish consistent baseline expectations. This feedback loop transforms individual subjective ratings into standardized metrics that preserve user experience insights while enabling objective device comparison
Solution Approach 2:
The patent changes the parameter state of user ratings from raw subjective scores to normalized objective metrics. By applying normalization transformations, the system converts varying user preferences into consistent performance indicators that maintain the authenticity of user experience data while eliminating individual rating biases
Data Source
AI summary
A system and method for determining the quality of service in wireless data network by a plurality of mobile devices is provided. In one embodiment, the method includes presenting to a user a plurality of reference content items, for each content item, receiving a reference content item rating indicative of a quality rating provided by the user, wirelessly transmitting a test content item to the mobile device, presenting the transmitted test content item to the user; receiving a test content item rating provided by the user, wherein at least some of the plurality of reference content items comprise content items of known and differing quality, normalizing the test content item rating based on the reference content rating received to provide a normalized test content item rating; and outputting a quality of service performance metric based on the normalized test content item rating.