Parallel Engine for High-Resolution Image Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video production systems face inefficiencies due to serial processing of file-based high-resolution images, leading to poor scalability and time-consuming final processing stages.
Innovation Solution
A high-speed parallel engine is used to generate and process transfer units of images, optimizing their size based on specified resolution, image count, and system resources, allowing for parallel processing across multiple compute nodes in a render farm.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If serial processing is used for file-based high-resolution images, then system simplicity is maintained, but processing time increases and scalability deteriorates
Solution Approach 1:
The patent divides the image processing workload into discrete transfer units, each containing a specific number of frames (e.g., 10-100 frames per unit). This segmentation enables parallel processing across multiple compute nodes while maintaining manageable unit sizes for efficient transfer and processing, directly resolving the contradiction between processing speed and system complexity
Solution Approach 2:
The patent introduces a transfer unit as an intermediate dimension between individual images and the final video output. This transfer unit dimension enables batched parallel processing, allowing multiple images to be processed simultaneously across different compute nodes while maintaining coordination through the file engine, thus improving productivity without proportionally increasing complexity
2Loss of time
If multiple transfer units are processed in parallel, then processing time is reduced, but network bandwidth requirements increase
Solution Approach 1:
The patent implements dynamic transfer unit size adjustment based on system conditions. The file engine can modify the number of frames per transfer unit according to available network bandwidth, compute node capacity, and job requirements. This dynamic adaptation allows the system to optimize between processing time and network bandwidth consumption in real-time
Solution Approach 2:
The patent changes the parameter of transfer unit size (number of frames per unit) to optimize performance. By adjusting this parameter based on network conditions and hardware capabilities, the system achieves efficient parallel processing without overwhelming network bandwidth, resolving the contradiction between processing time reduction and bandwidth requirements
3Productivity
If transfer unit size is optimized for resolution, then processing efficiency improves, but flexibility for different resolutions decreases
Solution Approach 1:
The patent designs transfer units with universal applicability across different video resolutions and frame rates. The file engine can dynamically configure transfer unit sizes and compositions to work with various resolution requirements (e.g., 1080p, 4K, 8K) without requiring resolution-specific processing pipelines, thus achieving both processing efficiency and resolution adaptability
Data Source
AI summary
Techniques are provided for receiving a request to generate a video of a specified resolution based on a plurality of images, and generating, via a file engine, a plurality of transfer units comprising the plurality of images, wherein each of the plurality of transfer units has a size based on the specified resolution and at least one of: (i) a count of the plurality of images or (ii) a size of the plurality of images. The file engine then assigns the plurality of transfer units for parallel processing by a plurality of image processing applications.