Screen Recording Virtual Device Image Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional screen recording methods only capture changes on the screen, making it difficult for users to understand operations outside the screen and resulting in a lack of intuitive and informative video content.
Innovation Solution
A method and apparatus that obtain operation data and response data from an electronic device, associate them with a virtual device image using a pre-determined processing strategy to generate a video that includes both the screen changes and external operations, enhancing the content and usability of the recording.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional screen recording methods are used to capture only screen changes, then the recording process is simple, but the video content is not informative and users cannot understand operations outside the screen
Solution Approach 1:
The patent segments the recording system into multiple data acquisition channels: screen content acquisition, operation data acquisition (keyboard, mouse, touch), and audio acquisition. Each channel independently captures specific types of data, which are then integrated into a unified video output. This segmentation allows comprehensive information capture while maintaining manageable system complexity through modular design.
Solution Approach 2:
The patent merges multiple data sources (screen recordings, operation logs, audio streams) into a single integrated video file. The processing module combines these disparate data types with temporal synchronization, creating a unified output that presents multi-dimensional information in a cohesive manner, thereby reducing information loss without proportionally increasing final system complexity.
2Loss of information
If only screen changes are recorded, then the recording process is simple, but the video content lacks detail and intuitiveness
Solution Approach 1:
The patent implements preliminary action by pre-defining processing strategies that automatically determine how operation data should be integrated with screen recordings. The system pre-configures mapping relationships between operation types and their corresponding visual representations, so that during recording, data is automatically processed according to these predetermined rules, reducing real-time processing complexity while capturing detailed operation information.
Solution Approach 2:
The patent introduces a processing module as an intermediary between raw data acquisition and final video output. This intermediary component handles the complex task of synchronizing multiple data streams, mapping operation data to visual elements, and applying processing strategies. By isolating this complex processing logic in a dedicated intermediary module, the system manages data processing complexity while comprehensively capturing operation details.
3Loss of information
If comprehensive operation data is captured and integrated with screen recordings, then the video becomes more informative, but the processing complexity increases
Solution Approach 1:
The patent applies parameter changes by implementing configurable processing strategies that can adjust the level of detail and integration methods based on recording needs. The system allows dynamic adjustment of parameters such as synchronization precision, data sampling rates, and integration depth, enabling the video generation system to optimize between information completeness and processing complexity depending on specific requirements.
Data Source
AI summary
A screen recording method includes obtaining operation data of an electronic device and response data generated by the electronic device based on the operation data; obtaining a virtual device image matching the electronic device; and associating the operation data and the response data with the virtual device image according to a pre-determined processing strategy to generate a first video.

