Workflow Verification via Real-World Session Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Online service providers face challenges in verifying the accurate rendering of online content across diverse device and account configurations, as simulation-based verification methods are incomplete and performance-intensive, failing to account for all possible combinations and causing additional traffic to production servers.
Innovation Solution
A workflow verification system that records and analyzes real-world user interaction sessions across various device and account configurations to ensure accurate rendering of user interface software workflows, using real-world data to detect anomalies and maintain server performance by avoiding additional traffic.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If simulation-based verification methods are used to verify online content rendering, then verification can be performed, but the verification is incomplete and performance-intensive, failing to account for all possible combinations of devices and configurations
Solution Approach 1:
The patent uses real-world user sessions as copies of actual user interactions to verify rendering. Instead of creating complex simulations of all possible device configurations, the system records and analyzes actual user sessions that naturally occur in production, using these real-world copies to infer rendering behavior across different configurations without needing to simulate each one explicitly.
Solution Approach 2:
The verification system leverages existing real-world user traffic and sessions to perform verification. The system records data from actual user interactions and analyzes this self-generated data to detect rendering anomalies, eliminating the need for separate verification traffic or complex simulation infrastructure.
2Reliability
If simulation-based verification methods are used to verify online content rendering, then verification can be performed, but additional traffic is generated causing performance impact on production servers
Solution Approach 1:
The verification system uses existing real-world user traffic to perform verification. By recording and analyzing actual user sessions that occur during normal production operations, the system leverages the self-service of existing traffic patterns to detect rendering anomalies without generating additional verification traffic that would impact server performance.
Solution Approach 2:
The system introduces a recording and analysis layer that acts as an intermediary between production traffic and verification needs. This intermediary captures rendering data from real user sessions and performs verification analysis separately, decoupling verification operations from production server workload and avoiding direct performance impact.
3Measurement precision
If comprehensive verification across all device and account configurations is performed, then rendering accuracy can be ensured, but the verification process becomes time-consuming and inefficient
Solution Approach 1:
The patent uses real-world user sessions as representative copies of actual user interactions across various device and configuration combinations. By analyzing these real sessions, the system obtains precise rendering verification data without needing to systematically test every possible configuration combination, thereby reducing verification time while maintaining accuracy.
Solution Approach 2:
The system continuously records and analyzes real user session data, providing feedback about rendering anomalies as they occur in production. This ongoing feedback mechanism enables comprehensive verification through natural user traffic patterns rather than requiring dedicated time-consuming test cycles, efficiently detecting issues as they arise in the real-world environment.
Data Source
AI summary
Methods and systems are presented for automatically verifying online content for different device configurations and/or account configurations. A request for verifying a user interface software workflow is received from a device. The request can specify particular parameters and content to see if that content appeared correctly when presented to users. Session data associated with one or more real-world user interaction sessions between user devices and a service provider server is obtained. The session data is used to generate data representing how one or more user interface elements are rendered on one or more user devices during the one or more real-world user interaction sessions. The data is comparable against benchmark data to determine if content was correctly presented. Reporting data can be made available that indicates if the user interface workflows are operating correctly.