Screen Recording Virtual Device Image Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional screen recording methods only capture changes on the screen, making it difficult for users to understand operations outside the screen and resulting in a lack of intuitive and informative video content.

Innovation Solution

A method and apparatus that obtain operation data and response data from an electronic device, associate them with a virtual device image using a pre-determined processing strategy to generate a video that includes both the screen changes and external operations, enhancing the content and usability of the recording.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional screen recording methods are used to capture only screen changes, then the recording process is simple, but the video content is not informative and users cannot understand operations outside the screen

Engineering Contradiction:
Improveoperation informationVSAvoidrecording system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the recording system into multiple data acquisition channels: screen content acquisition, operation data acquisition (keyboard, mouse, touch), and audio acquisition. Each channel independently captures specific types of data, which are then integrated into a unified video output. This segmentation allows comprehensive information capture while maintaining manageable system complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges multiple data sources (screen recordings, operation logs, audio streams) into a single integrated video file. The processing module combines these disparate data types with temporal synchronization, creating a unified output that presents multi-dimensional information in a cohesive manner, thereby reducing information loss without proportionally increasing final system complexity.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If only screen changes are recorded, then the recording process is simple, but the video content lacks detail and intuitiveness

Engineering Contradiction:
Improveoperation detail informationVSAvoiddata processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by pre-defining processing strategies that automatically determine how operation data should be integrated with screen recordings. The system pre-configures mapping relationships between operation types and their corresponding visual representations, so that during recording, data is automatically processed according to these predetermined rules, reducing real-time processing complexity while capturing detailed operation information.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a processing module as an intermediary between raw data acquisition and final video output. This intermediary component handles the complex task of synchronizing multiple data streams, mapping operation data to visual elements, and applying processing strategies. By isolating this complex processing logic in a dedicated intermediary module, the system manages data processing complexity while comprehensively capturing operation details.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If comprehensive operation data is captured and integrated with screen recordings, then the video becomes more informative, but the processing complexity increases

Engineering Contradiction:
Improveoperation context informationVSAvoidvideo generation system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by implementing configurable processing strategies that can adjust the level of detail and integration methods based on recording needs. The system allows dynamic adjustment of parameters such as synchronization precision, data sampling rates, and integration depth, enabling the video generation system to optimize between information completeness and processing complexity depending on specific requirements.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11818498B2Screen recording method and apparatus, and electronic device
Publication Date: 2023.11.14 LENOVO (BEIJING) LTD
  • US11818498B2 patent drawing
  • US11818498B2 patent drawing

AI summary

A screen recording method includes obtaining operation data of an electronic device and response data generated by the electronic device based on the operation data; obtaining a virtual device image matching the electronic device; and associating the operation data and the response data with the virtual device image according to a pre-determined processing strategy to generate a first video.