Multiview Video Encoding Reference Priority Optimization

The patent segments the reference image selection process into distinct layers: base layer and enhancement layer. The segmentation allows the decoder to process references in a hierarchical manner, first establishing base layer references and then building enhancement layer references upon them. This reduces the complexity of simultaneously managing all inter-layer and inter-view references, thereby improving decoding efficiency while maintaining the combined encoding functionality.

The patent applies preliminary action by pre-determining the priority order of reference images before decoding begins. The encoder establishes a reference priority structure where base layer references are processed first, followed by enhancement layer references. This preliminary organization of reference priorities allows the decoder to systematically process references in the correct order without needing to evaluate all possible references simultaneously, reducing processing load and improving decoding efficiency.

The patent segments the reference management into base layer and enhancement layer components. By dividing the reference structure into these segments, the system maintains high encoding quality through both inter-layer and inter-view references while reducing processing complexity. Each segment handles a specific aspect of reference management, preventing the need to simultaneously process all references in a monolithic structure.

The patent applies local quality by assigning different priority levels to different reference images based on their layer and view characteristics. Base layer references receive higher priority than enhancement layer references, and this priority differentiation is applied locally to each reference image. This allows the system to maintain high encoding quality by utilizing all references while managing complexity through localized priority assignments rather than uniform processing.

The patent applies preliminary action by pre-establishing the priority order of multiple reference images before decoding begins. The encoder communicates the reference priority information to the decoder, allowing the decoder to process references in a predetermined optimal order. This preliminary organization enables the decoder to maintain high decoding accuracy by considering multiple references while minimizing processing time through systematic prioritization rather than exhaustive evaluation.

The patent ensures continuity of useful action by organizing reference processing into a continuous hierarchical flow. Base layer references are processed first and continuously available, followed by enhancement layer references that build upon them. This continuous processing approach allows the decoder to maintain high decoding accuracy through multiple references while avoiding interruptions or backtracking, thereby reducing overall processing time compared to non-hierarchical approaches.