Screen Recording via Graphical Command Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing screen capturing methods for recording audio/visual content are processor, memory, and power intensive, and result in low quality images due to data encoding and fixed resolution limitations, making them inefficient for recording and sharing across different screen sizes.
Innovation Solution
A system that records and transmits graphical commands instead of processed display data, allowing devices to recreate the visual content at a later time with reduced resource consumption, using a circular buffer to store commands and pointers for efficient video generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If screen capturing is used to record audio/visual content, then the content can be recorded for later playback, but the method is processor, memory, and power intensive
Solution Approach 1:
The patent extracts only the essential graphical commands from the display rendering process, storing only these commands rather than the entire processed display data. This extraction approach captures the core information needed for recreation while eliminating redundant data, thereby reducing memory usage and power consumption while maintaining reliable recording capability
Solution Approach 2:
The system performs preliminary action by capturing graphical commands at the source before they are processed into final display data. By recording commands early in the rendering pipeline, the system avoids the need to process and store large amounts of final display data during playback, reducing both memory requirements and power consumption
2Reliability
If screen capturing is used to record audio/visual content, then the content can be recorded, but the method results in low quality images due to data encoding and fixed resolution limitations
Solution Approach 1:
The patent applies preliminary action by capturing graphical commands before they undergo processing that degrades quality. By recording the original commands rather than processed display data, the system preserves the ability to recreate high-quality images at any resolution during playback, avoiding the fixed resolution limitations and encoding losses of traditional screen capturing
Solution Approach 2:
The system changes the parameter being recorded from processed display data to graphical commands. This parameter change enables flexible resolution scaling and high-quality reconstruction because commands can be re-rendered at different resolutions without the quality degradation that occurs when capturing already-processed pixel data
3Reliability
If processed display data is captured and encoded, then recording can be achieved, but processor and memory resources are heavily consumed
Solution Approach 1:
The patent extracts only the graphical commands from the display system, storing these minimal essential elements rather than the full processed display data. This extraction dramatically reduces memory requirements and simplifies the recording system while maintaining the ability to reliably recreate the visual content
Solution Approach 2:
By capturing graphical commands early in the rendering pipeline before extensive processing occurs, the system avoids the need to store and process large amounts of final display data. This preliminary capture of commands simplifies the overall system complexity and reduces both processor and memory resource requirements
Data Source
AI summary
Devices, systems and methods are disclosed for capturing a display by storing graphical commands and generating video data using the graphical commands at a later point in time. For example, a device may store graphical commands while generating display data associated with the graphical commands. The device may modify the graphical commands to replace data included in the graphical commands with pointers to the data. Optionally, the device may transmit the graphical commands to a server. The device and/or server may identify the data referenced by the pointers, execute the graphical commands to generate display data and encode the display data to generate a video of the original display.