Mobile Behavior Capture via Accessibility API Injection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional methods for capturing consumer behavior on mobile devices are becoming obsolete due to the shift from desktop to mobile usage, encryption, and platform changes, leading to scalability issues, privacy concerns, and concentration of user data among fewer entities, making it difficult for independent third-party measurement.
Innovation Solution
A system and method that utilizes the accessibility services on mobile devices to monitor and analyze user interface changes, specifically identifying and tracking navigation events in web browsers without relying on network traffic or privileged positions, by using the AccessibilityService interface to detect patterns indicative of web browser address bars and user interactions, thereby capturing user behavior data at the point of display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If VPN or proxy-based solutions are used to intercept and log remote communications, then user behavior data can be collected, but deployment costs increase, device and network performance is disrupted, and scalability is limited
Solution Approach 1:
The patent extracts the data collection function from network-level interception (VPN/proxy) and relocates it to the application layer by injecting a library directly into the target application process. This allows behavior data to be captured at the source without requiring external network infrastructure, thereby reducing deployment complexity and improving scalability.
Solution Approach 2:
The patent introduces a data collection library as an intermediary component that is injected into the target application. This library acts as a mediator between the application's internal operations and the external data collection system, enabling seamless data capture without requiring VPN or proxy infrastructure.
2Loss of information
If VPN or proxy-based solutions are used to intercept communications, then user behavior data can be collected, but privacy concerns increase and regulatory issues arise
Solution Approach 1:
The patent extracts data collection from external network interception methods (which raise privacy concerns) and moves it to an internal application-level implementation. By collecting data within the application's own process space rather than intercepting network traffic externally, the solution reduces privacy concerns and regulatory issues while maintaining effective data collection.
3Reliability
If certificate-pinning and platform restrictions are implemented to protect user privacy, then communication security is improved, but independent third-party measurement capability is reduced
Solution Approach 1:
The patent inverts the traditional approach by not trying to intercept encrypted communications from the outside (which certificate-pinning blocks), but instead injecting the data collection library directly into the application process from the inside. This allows measurement capability to be maintained while respecting the communication security measures implemented by the platform.
4Quantity of substance
If mobile devices are used as primary portals for content consumption, then user reach and data relevance are improved, but independent measurement becomes more difficult due to encryption and platform restrictions
Solution Approach 1:
The patent performs preliminary action by injecting the data collection library into the application process before the application executes its main functionality. This early injection ensures that data collection capabilities are established upfront, allowing the system to capture user behavior data on mobile devices despite encryption and platform restrictions that would prevent later external interception.
Data Source
AI summary
Provided is a process to detect a web-browser address bar in a UI layout based on communications with an accessibility application program interface (API) of an operating system and detect navigation events in the same via the accessibility API.