Operating System Triggers for Reduced-Data Graphical Captures

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for capturing user activity on computing devices result in excessive resource consumption and storage usage, degrading performance and user experience, while also compromising privacy due to detailed local recordkeeping.

Innovation Solution

Implementing operating system-level triggers to capture reduced data graphical captures based on user interactions, using AI embeddings and threshold analysis to identify moments of interest, minimizing storage and preserving privacy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If constant screen recording is used to capture user activity, then measurement precision of user activity recollection is improved, but use of energy and storage space increase

Engineering Contradiction:
Improveaccuracy of user activity recollectionVSAvoidresource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary analysis of onscreen content changes and user input events before capturing graphical captures. By pre-processing and filtering events based on predefined criteria (such as detecting significant content changes or meaningful user interactions), the system prepares and selects only the most relevant moments for capture, avoiding unnecessary recording of routine activities and thereby reducing energy and storage consumption while maintaining recollection accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of continuously recording all user activity, the system captures only partial selections of user activity that meet specific criteria. By using triggers based on onscreen content changes and user input events, the system records only the most significant moments (such as when a user opens a new application, views important content, or performs meaningful interactions), thereby reducing the volume of stored data while preserving the accuracy of important activity recollections.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If constant screen recording is used to capture user activity, then measurement precision of user activity recollection is improved, but device performance degrades

Engineering Contradiction:
Improveaccuracy of user activity recollectionVSAvoidcomputing device performance
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary analysis of onscreen content changes and user input events before capturing graphical captures. By pre-processing and filtering events based on predefined criteria (such as detecting significant content changes or meaningful user interactions), the system prepares and selects only the most relevant moments for capture, avoiding unnecessary recording of routine activities and thereby reducing energy and storage consumption while maintaining recollection accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of continuously recording all user activity, the system captures only partial selections of user activity that meet specific criteria. By using triggers based on onscreen content changes and user input events, the system records only the most significant moments (such as when a user opens a new application, views important content, or performs meaningful interactions), thereby reducing the volume of stored data while preserving the accuracy of important activity recollections.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If detailed records of user activity are stored locally, then measurement precision of user activity recollection is improved, but storage space consumption increases

Engineering Contradiction:
Improveaccuracy of user activity recollectionVSAvoidstorage space consumption
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The system performs preliminary analysis of onscreen content changes and user input events before capturing graphical captures. By pre-processing and filtering events based on predefined criteria (such as detecting significant content changes or meaningful user interactions), the system prepares and selects only the most relevant moments for capture, avoiding unnecessary recording of routine activities and thereby reducing energy and storage consumption while maintaining recollection accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of continuously recording all user activity, the system captures only partial selections of user activity that meet specific criteria. By using triggers based on onscreen content changes and user input events, the system records only the most significant moments (such as when a user opens a new application, views important content, or performs meaningful interactions), thereby reducing the volume of stored data while preserving the accuracy of important activity recollections.

Inventive Principle:
Principle #16Partial or excessive action

4Measurement precision

If detailed records of user activity are stored locally, then measurement precision of user activity recollection is improved, but user privacy is compromised

Engineering Contradiction:
Improveaccuracy of user activity recollectionVSAvoiduser privacy
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

Instead of continuously recording all user activity, the system captures only partial selections of user activity that meet specific criteria. By using triggers based on onscreen content changes and user input events, the system records only the most significant moments (such as when a user opens a new application, views important content, or performs meaningful interactions), thereby reducing the volume of stored data while preserving the accuracy of important activity recollections.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20250335217A1Trigger mechanism for generating graphical captures enabling downstream user experiences
Publication Date: 2025.10.30 MICROSOFT TECHNOLOGY LICENSING LLC
  • US20250335217A1 patent drawing
  • US20250335217A1 patent drawing
  • US20250335217A1 patent drawing

AI summary

The techniques described herein provide systems for generating a record of user activity that enable downstream user experiences. Due to the significant portion of daily life that occurs via personal computing devices (e.g., laptops, personal computers, smartphones, tablets), service providers (e.g., operating system providers) may wish to enhance productivity and/or engagement through helpful user experiences. Moreover, such user experiences can be customized to a user's current context, preferences, and tendencies. Accordingly, the present system can, with the consent of the user, collect graphical captures recording a current state of a desktop environment at certain moments of interest. This is accomplished through a trigger mechanism utilizing operating system signals to intelligently collect graphical captures. In this way, the system captures the minimum or reduced amount of data to enable an accurate recollection of moments of interest in past user activity enabling efficient user experiences while respecting user privacy.