Real-Time Image Processing Rendering Engine Pixel Rearrangement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern display technologies, such as VR and AR, require real-time image processing to achieve higher image resolution, but existing methods struggle to efficiently process and display images with rearranged pixel arrangements without causing abnormalities in the displayed image.

Innovation Solution

A method and apparatus for real-time image processing using a rendering engine that involves sampling data in a first pixel arrangement, mapping it to two models, processing with specific shaders, and superimposing the results to achieve a higher display resolution in a second pixel arrangement, allowing for improved image resolution without altering the driver IC.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If real-time image processing is implemented to achieve higher image resolution, then image resolution is improved, but processing complexity and computational load increase

Engineering Contradiction:
Improveimage resolutionVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The pixel arrangement is segmented into multiple sub-pixel groups (e.g., RGB sub-pixels) that are processed independently through separate shader programs. Each sub-pixel type has its own mapping and processing pipeline, allowing parallel processing that reduces overall computational complexity while achieving higher effective resolution through the combined output of all segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the 2D pixel arrangement problem into a multi-dimensional processing space by introducing sub-pixel level processing dimensions. Instead of processing entire pixels as single units, the system processes individual sub-pixels (R, G, B components) as separate dimensions, enabling higher resolution output through dimensional expansion of the processing architecture.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If pixel arrangement is rearranged to achieve higher display resolution, then display resolution is improved, but image abnormalities occur

Engineering Contradiction:
Improvedisplay resolutionVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

Different shader programs are applied to different sub-pixel types (R, G, B) with customized mapping rules specific to each sub-pixel's characteristics. Each sub-pixel group undergoes localized processing tailored to its specific properties, ensuring that the rearrangement maintains proper color relationships and prevents image abnormalities while achieving higher resolution.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically changes processing parameters including mapping coordinates, interpolation factors, and shader execution settings based on the detected sub-pixel arrangement pattern. By adjusting these parameters according to the specific pixel rearrangement configuration, the system maintains image fidelity and prevents abnormalities even when achieving higher display resolution through non-standard pixel arrangements.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If multiple processing models and shaders are used to process pixel data, then image resolution and quality are improved, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements continuous processing pipelines where sub-pixel data flows through multiple shader stages without interruption or buffering between stages. The processing of R, G, and B sub-pixels occurs in a continuous streamlined manner, eliminating idle time and ensuring that all processing operations work in unison to produce the final high-resolution output, thereby reducing total processing time despite multiple processing steps.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system pre-calculates and pre-configures shader programs and mapping parameters based on the detected pixel arrangement pattern before actual image processing begins. By preparing processing templates, mapping tables, and shader configurations in advance, the system eliminates runtime computation overhead and enables real-time processing of high-resolution images without excessive processing time delays.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11263805B2Method of real-time image processing based on rendering engine and a display apparatus
Publication Date: 2022.03.01 BEIJING BOE OPTOELECTRONCIS TECH CO LTD
  • US11263805B2 patent drawing
  • US11263805B2 patent drawing
  • US11263805B2 patent drawing

AI summary

The present application discloses method for real-time processing image data based on a rendering engine. The method includes sampling a first set of data in a first pixel arrangement to be displayed as an image in a display screen with pixels in a second pixel arrangement. The method further includes creating a first model mapped with the first set of data to generate a second set of data and a second model mapped with the first set of data to generate a third set of data. Additionally, the method further includes rendering the second set of data using a first shader to output a fourth set of data and rendering the third set of data using a second shader to output a fifth set of data. Furthermore, the method includes superimposing the fourth set of data over the fifth set of data to display a sixth set of data.