Video Frame Processing with Dynamic Seam-Line Blending
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
When blending a plurality of video data in a predetermined region including a seam line, objects may appear double or be missing, spoiling the viewing experience.
Innovation Solution
A processing apparatus that acquires and specifies a blend region including a seam line by adjusting luminance differences and prohibited regions to ensure seamless blending of video data, using a specification unit to connect frame data with appropriate pixel values.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If blending is performed in a fixed predetermined region including the seam line, then the blending process is simple, but objects may appear double or be missing, degrading image quality
Solution Approach 1:
The patent applies dynamics by making the blend region variable rather than fixed. The specification unit dynamically determines the blend region width based on luminance differences between adjacent frame data. When luminance differences are large (indicating object boundaries), the blend region is narrowed or excluded to prevent double/missing objects. When luminance differences are small (indicating smooth transitions), the blend region is widened for better blending. This dynamic adjustment resolves the contradiction between simple fixed-region blending and high-quality variable-region blending.
2Stability of the object's composition
If the blend region is widened to improve blending smoothness, then the transition between frames is smoother, but objects may appear double or missing, degrading image quality
Solution Approach 1:
The patent applies local quality by making the blend region width vary locally across different spatial positions and frame positions. Instead of using a uniform blend region width throughout, the specification unit calculates luminance differences for each position and adjusts the blend region width accordingly. This allows smooth blending in regions with small luminance differences while preventing object duplication/loss in regions with large luminance differences, thus resolving the contradiction between blending smoothness and image quality.
3Manufacturing precision
If the blend region is narrowed to prevent double or missing objects, then image quality is maintained, but blending smoothness is reduced
Solution Approach 1:
The patent uses dynamic adjustment of blend region width based on local luminance characteristics. In regions where object boundaries are detected (large luminance differences), the blend region is narrowed to maintain image quality. In regions where smooth transitions are needed (small luminance differences), the blend region is widened to improve blending smoothness. This dynamic, location-dependent approach resolves the contradiction between preventing object artifacts and maintaining blending smoothness.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A processing apparatus 1 includes: an acquisition unit 21 that acquires a plurality of pieces of frame data captured simultaneously from a plurality of pieces of video data captured while parts of capturing regions are superimposed; a specification unit 22 that specifies a blend region which includes a pixel forming a seam line connecting the plurality of pieces of frame data and is provided in a direction in which the plurality of pieces of frame data overlap; and an output unit that outputs connected frame data F0 in which each pixel of the blend region has a pixel value obtained by blending pixel values of the plurality of pieces of frame data, and the plurality of pieces of frame data are connected by the seam line. The specification unit 22 specifies, as the blend region, consecutive pixels that include a pixel forming a seam line and in which a luminance difference between corresponding pixels of the plurality of pieces of frame data is within a predetermined value.