User Interaction Recording with Pre-Click Signal Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In safety-critical systems, conventional methods fail to accurately reconstruct user interactions, particularly the position of a pointer at the time of a click, due to unpredictable data processing by the operating system and insufficient screen content recording, which is essential for analyzing human error or misconduct.
Innovation Solution
A method and device that record user interactions by storing pointer signals and display signals at predetermined intervals, replacing the display signal immediately before or after a click with the current signal, ensuring regular recording intervals and effective detection of double clicks, thereby improving interaction recording and reducing storage requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If screen content is recorded at low rate (e.g., one image per second), then storage requirements are reduced, but the position of the pointer at the time of clicking cannot be reconstructed with certainty
Solution Approach 1:
The system performs preliminary actions by recording the display signal immediately before a click event occurs, and also records the current display signal at the click moment. This preliminary recording ensures that the pointer position information is captured before it might be lost or changed, allowing accurate reconstruction without requiring continuous high-rate recording of all screen content.
Solution Approach 2:
Instead of uniformly recording all screen content at high resolution and frequency, the system applies local quality enhancement by specifically capturing and storing the display signal at click events. This selective high-quality recording of critical moments (clicks) combined with lower-rate general recording optimizes the balance between storage efficiency and measurement precision.
2Measurement precision
If display signals are recorded at every click event, then pointer position reconstruction is improved, but recording interval regularity is disrupted
Solution Approach 1:
The system dynamically adjusts the recording strategy based on event type. For periodic recording, it maintains regular intervals. For click events, it triggers additional recordings. This dynamic approach allows the system to maintain overall interval regularity while capturing critical interaction moments, resolving the conflict between precision and regularity.
Solution Approach 2:
The system records the display signal immediately before the click and replaces the subsequently recorded signal with this pre-click signal. This preliminary action ensures accurate pointer position capture without creating permanent disruptions to the recording schedule, as the replacement maintains the expected recording timeline.
3Loss of substance
If the display signal recorded before click is replaced with current signal, then storage space is reduced, but pointer position at click moment may be lost
Solution Approach 1:
The system performs a preliminary recording of the display signal immediately before the click event occurs. This pre-recorded signal is then used to replace the subsequently recorded signal, ensuring that the pointer position information at the critical click moment is preserved in storage, while still achieving storage optimization by avoiding duplicate recordings.
Solution Approach 2:
The system creates a copy of the display signal at the click moment and uses this copy to replace the subsequently recorded signal. This copying mechanism ensures that the critical pointer position information is preserved in the storage location, while the replacement strategy maintains storage efficiency by avoiding redundant data.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The method has a computer system (1) with an indicating unit and a display unit. A display signal is included by existing of click, where the display signal is momentarily adjacent to the computer unit. The included display signal is discarded directly before or after the click, where the discarded display signal is replaced by the existence display signal at the computer unit. Independent claims are also included for the following: (1) a device for recording the user interaction; (2) a data carrier with electronically selectable control signals; (3) computer program with program code unit for the execution of recording method; and (4) a computer program product with program code.