Simulator Data Processing System for High-Resolution Video Blending
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing simulator debrief systems face challenges in efficiently capturing, recording, and playing back high-quality video and audio data from multiple simulators, particularly at higher resolutions and framerates, due to the limitations of hardware encoders and media players, which restrict dynamic configuration and video blending capabilities.
Innovation Solution
A simulator data processing system utilizing native hardware encoders and decoders on graphics cards to generate and render video streams at higher resolutions and framerates, enabling dynamic switching and blending of video streams, and providing flexible capture and streaming parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If hardware encoders are used to capture video signals, then video capture capability is provided, but the system is limited in resolution and framerate and cannot dynamically change streams without adding new hardware
Solution Approach 1:
The patent uses software-based video capture that creates virtual copies of hardware encoder functionality through virtualization technologies. The software simulator captures video streams from multiple sources and processes them through virtual hardware interfaces, eliminating the need for physical hardware encoders at each capture point while maintaining compatibility with existing hardware decoder workflows.
Solution Approach 2:
The software-based capture system provides universal functionality that can handle multiple video streams with different resolutions and framerates simultaneously. A single software module can adapt to various stream configurations and dynamically adjust capture parameters without requiring dedicated hardware for each configuration, thus achieving multi-functionality with reduced hardware complexity.
2Manufacturing precision
If high-quality video data is captured at high resolutions and framerates, then video quality is improved, but the volume of video data becomes large making efficient transfer and display problematic
Solution Approach 1:
The patent segments high-resolution video streams into multiple lower-resolution sub-streams that can be processed and transmitted more efficiently. The software capture system divides the large video data into manageable chunks or frames that can be handled by standard playback hardware, maintaining overall video quality while improving transfer efficiency through parallel processing of segmented data.
Solution Approach 2:
The system dynamically adjusts video capture parameters such as resolution, framerate, and bitrate based on the capabilities of the playback system and network conditions. The software encoder can modify these parameters in real-time to optimize the balance between video quality and data transfer efficiency, allowing high-quality capture when needed while maintaining efficient transfer under normal conditions.
3Ease of operation
If media players render video data in real-time with buffering, then continuous playback is achieved, but dynamic configuration of display parameters and video blending is not possible
Solution Approach 1:
The patent implements dynamic configuration capabilities in the software playback system that allow display parameters such as resolution, framerate, and stream selection to be changed during playback without restarting the video. The software renderer can adjust these parameters in real-time based on user input or system conditions, providing operational flexibility while maintaining continuous playback through intelligent buffer management.
Solution Approach 2:
The software video renderer acts as an intermediary layer between the captured video data and the display hardware. This intermediary can perform real-time video processing, blending, and parameter adjustment before sending data to the display, enabling dynamic configuration capabilities while minimizing rendering delays through optimized processing pipelines and hardware acceleration when available.
Data Source
AI summary
At least one encoder processor of a simulator data processing system receives simulator data from a plurality of simulators comprising a plurality of video data, including first and second data having different frame rates, and non-audio/visual data, and outputs a respective plurality of compressed video streams. A scheduler of the at least one encoder processor uses frames of the video data to generate scheduled items, specifies a frame rate for capturing the frames, and generates encoded data based on the compressed video streams and the non-audio/visual simulator data. At least one further processor receives, decodes, and processes the encoded data. The at least one further processor executes a media player/renderer application that processes the compressed video streams and displays on the display a plurality of the decoded video data are simultaneously displayed on a display at the specified frame rate, together with information based on the non-audio/visual simulator data.