Context-Aware Screen Capture for Cross-Device Application State Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices lack the capability to effectively capture and share both the screen content and its contextual information during a screen capture, limiting the ability to reproduce the exact state of applications across different devices.
Innovation Solution
An electronic device is equipped with processors that capture a screen image, identify running applications, gather location and contextual information, and store this data together, enabling the reproduction of the screen and context on other devices through communication protocols.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If only screen image is captured and shared, then sharing simplicity is maintained, but application context and state information are lost
Solution Approach 1:
The patent combines screen image capture with application context information capture into a unified screen capture system. The processor captures both the screen image and contextual information (application ID, location, execution state) simultaneously, storing them together in memory. This merging resolves the contradiction by adding valuable context information without requiring separate capture systems.
Solution Approach 2:
The screen capture function is enhanced to serve multiple purposes: capturing visual screen content, identifying running applications, determining execution context, and enabling precise reproduction of application states. This multi-functional approach allows a single system to provide comprehensive screen sharing capabilities while maintaining system integration.
2Loss of information
If comprehensive screen and context information is captured, then information completeness is improved, but data storage requirements increase
Solution Approach 1:
The patent extracts only the necessary contextual information elements (application identification information, location information, execution context) rather than capturing all possible data. This selective extraction approach ensures comprehensive enough information for reproduction while minimizing unnecessary data storage requirements.
Solution Approach 2:
The system preliminarily captures and stores contextual information along with the screen image at the time of capture. This preliminary action ensures that all necessary information is available for subsequent reproduction without requiring additional data collection, thereby optimizing the balance between information completeness and storage efficiency.
3Reliability
If screen capture is used for sharing, then screen content can be transmitted, but exact reproduction of application state is not achieved
Solution Approach 1:
The patent implements feedback by capturing execution context information that describes the application state at the time of capture. This feedback information (application ID, location, execution state) is stored with the screen image and used during reproduction to accurately restore the application state, ensuring reliability while maintaining ease of use through automated state restoration.
Solution Approach 2:
The system creates a comprehensive copy that includes both the visual screen content and the execution context information. This dual-component copy enables exact reproduction of application state on another device while maintaining simple sharing operation, as the entire context package is automatically transferred and restored without manual intervention.
Data Source
AI summary
An electronic device is provided. The electronic device includes a display, memory storing one or more computer programs, and one or more processors communicatively coupled to the display and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to receive a first user input for capturing a screen being displayed on the display, in response to the receiving of the first user input, acquire an image obtained by capturing the screen, based on the acquiring of the image, acquire identification information of at least one application running on the electronic device at the time the image is acquired, location information indicating a location where an execution screen of the at least one application is displayed, and contextual information regarding the execution context of the at least one application, and store the image, the identification information, the location information, and the contextual information together.