Tamper-proof Interaction Data Verification via Screenshot Attestation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Programmatic clicks can lead to the widespread distribution of false information, deteriorating users' online experience and wasting computing resources.
Innovation Solution
Generating non-falsifiable attestation tokens to verify human interaction with content while protecting user privacy, by capturing screenshots, verifying visual appearances, and processing interactions based on declared locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If programmatic clicks are used to interact with digital components, then interaction speed and automation are improved, but information authenticity and resource efficiency deteriorate
Solution Approach 1:
The patent introduces an intermediary verification system that acts as a mediator between automated interactions and digital components. This system captures screenshots, verifies visual appearances against declared appearances, and generates attestation tokens to confirm legitimate interactions. The intermediary layer prevents programmatic clicks from directly manipulating component states without verification, thus maintaining information authenticity while allowing automated interactions to proceed.
2Extent of automation
If programmatic clicks are used to interact with digital components, then automation capability is improved, but computing resource consumption deteriorates
Solution Approach 1:
The patent implements preliminary action by requiring digital components to declare their appearances and interaction requirements before actual interactions occur. The system pre-verifies visual appearances by comparing captured screenshots against declared appearances and generates attestation tokens in advance. This preliminary verification prevents wasted computing resources on invalid or malicious interactions, while still allowing legitimate automated interactions to proceed efficiently.
3Reliability
If visual verification of rendered elements is implemented, then interaction authenticity is improved, but system complexity deteriorates
Solution Approach 1:
The patent uses copying by creating visual copies (screenshots) of rendered elements and comparing them against declared appearance templates. Instead of implementing complex visual analysis algorithms, the system captures bitmaps of the actual rendered elements and compares these copies against pre-declared appearance data. This copying approach simplifies the verification process while maintaining high authentication reliability, as it directly compares visual representations rather than analyzing complex visual features.
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for validating interactions with false rendered elements. In one aspect, a method includes receiving a rendering notification and a declaration of a rendered element defined in an active window on a client device, detecting interaction with the rendered element at the client device, determining whether the interaction occurred at a declared location of the rendered element within the active window, and processing the interaction including: in response to determining that the interaction occurred: capturing a screenshot of the active window on the client device; verifying a visual appearance of the rendered element in the screenshot with a declared appearance of the rendered element, and generating an interaction attestation, thereby validating the interaction. In response to determining that the interaction did not occur, refraining from generating the interaction attestation.