Parallel Image Transformation Pipelines for Field Sequential Color Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Field sequential color (FSC) display devices face challenges in reducing visual latency and energy consumption due to the need for separate full rendering of each color field, which increases processing time and power consumption, and existing post-rendering transformation methods are not well-suited for FSC devices that receive color data in successive fields.

Innovation Solution

A post-rendering image transformation module with multiple image transformation pipelines applies 2D transformations to generate transformed pixel color data for each color component, allowing for sequential generation and output of color component fields, reducing processing overhead and energy demands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If separate full rendering is performed for each color field using CPU or GPU, then color field processing can be completed, but power consumption and latency increase

Engineering Contradiction:
Improvecolor field processing throughputVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent segments the image transformation process into multiple parallel pipelines, where each pipeline processes a different color component (red, green, blue) independently. This allows the system to process all color fields simultaneously rather than sequentially, maintaining productivity while reducing power consumption by avoiding repeated full renderings

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary rendering of the complete image once, then applies post-rendering transformations to generate individual color fields. This preliminary action eliminates the need for separate full renderings for each color field, significantly reducing power consumption while maintaining processing throughput

Inventive Principle:
Principle #10Preliminary action

2Productivity

If separate full rendering is performed for each color field using CPU or GPU, then color field processing can be completed, but processing time (latency) increases

Engineering Contradiction:
Improvecolor field processing throughputVSAvoidvisual latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent divides the transformation process into segmented parallel pipelines that operate simultaneously on different color components. This segmentation enables concurrent processing of red, green, and blue fields, reducing the total time required compared to sequential processing while maintaining high productivity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements continuous transformation processing where multiple pipelines operate continuously and in parallel on different color fields. This continuous action eliminates idle time between processing steps and maintains steady throughput while reducing overall latency

Inventive Principle:
Principle #20Continuity of useful action

3Adaptability or versatility

If buffering a full RGB field for output as successive red, green, and blue fields is done, then FSC display compatibility is achieved, but output buffer size increases latency and/or power consumption

Engineering Contradiction:
ImproveFSC display compatibilityVSAvoidlatency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the transformation output into separate color component fields that are generated on-demand and processed in parallel. This segmentation allows the system to output successive red, green, and blue fields without buffering the entire RGB field, thereby maintaining FSC compatibility while reducing latency

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary transformation of color fields in parallel as they are generated, rather than buffering complete RGB fields for later processing. This preliminary action eliminates the need for large output buffers and reduces both latency and power consumption while maintaining FSC display compatibility

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If buffering a full RGB field for output as successive red, green, and blue fields is done, then FSC display compatibility is achieved, but power consumption increases

Engineering Contradiction:
ImproveFSC display compatibilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent segments the processing into parallel color component pipelines that operate independently and simultaneously. This segmentation eliminates the need to buffer full RGB fields, reducing memory bandwidth requirements and power consumption while maintaining FSC display compatibility through efficient color field generation

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements continuous parallel processing of color fields as they are generated and transformed. This continuous action eliminates idle buffering periods and maintains steady processing throughput, reducing overall power consumption while ensuring FSC display compatibility through efficient color field output

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10360832B2Post-rendering image transformation using parallel image transformation pipelines
Publication Date: 2019.07.23 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10360832B2 patent drawing
  • US10360832B2 patent drawing
  • US10360832B2 patent drawing

AI summary

Techniques for post-rendering image transformation including outputting an image frame including a plurality of first pixels by sequentially generating and outputting multiple color component fields including a first color component field and a second color component field by applying one or more two-dimensional (2D) image transformations to at least one portion of the plurality of source pixels by first, second, and third image transformation pipelines, to generate transformed pixel color data for the first color component field and the second color component field.