Layered Image Compression via Flattened Base and Delta Layers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The transmission of layered images for parallax-capable GUI elements is inefficient, leading to GUI rendering delays due to high processing and network resource consumption, exacerbated by increasing GUI resolutions.

Innovation Solution

Pre-processing layered images by generating a flattened image and delta layer images, which are then compressed using Lempel-Ziv-Welch (LZW)-based compressors, to reduce redundant pixel information and enhance compression ratios, allowing for efficient transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If layered images are transmitted to enable parallax-capable GUI elements, then user interaction experience is improved, but network bandwidth consumption and processing resources increase

Engineering Contradiction:
Improveuser interaction experienceVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The layered image is segmented into a base image and multiple layer images with different transparency levels. Only the essential base image and selective layer images are transmitted, rather than transmitting all layers at full quality. This segmentation allows the system to maintain parallax interaction capabilities while reducing the total data volume transmitted over the network.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the layered image are processed with different quality levels. Areas with high transparency or low visual importance are compressed more aggressively or represented with fewer data points, while regions with high visual importance maintain higher quality. This local quality adjustment reduces overall network bandwidth consumption while preserving the essential visual experience for user interaction.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If layered images are transmitted with high resolution to maintain visual quality, then GUI rendering quality is improved, but transmission time and network bandwidth consumption increase

Engineering Contradiction:
ImproveGUI rendering qualityVSAvoidtransmission time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Instead of transmitting all layer images at full resolution, the system transmits a base image at full resolution and only essential layer images at reduced resolution or with selective detail. This partial action approach maintains sufficient visual quality for effective GUI rendering while significantly reducing transmission time and network bandwidth consumption.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system dynamically adjusts image parameters such as resolution, compression level, and bit depth based on network conditions and device capabilities. By changing these parameters, the system can optimize the balance between GUI rendering quality and transmission time, delivering high-quality visuals when bandwidth permits and accepting lower quality when transmission time is critical.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If all layer images are transmitted to preserve transparency information, then image fidelity is improved, but compression ratio deteriorates

Engineering Contradiction:
Improveimage fidelityVSAvoidcompression ratio
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system extracts and transmits only the essential transparency information needed for effective rendering, rather than transmitting complete layer images with all transparency data. By taking out only the critical alpha channel information and discarding redundant transparency data, the system maintains sufficient image fidelity for parallax effects while achieving significantly better compression ratios.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system discards redundant or less important transparency information during transmission, and recovers or reconstructs essential transparency effects at the rendering side using the base image and selective layer images. This approach preserves the visual perception of transparency and parallax effects while dramatically improving compression ratio and reducing transmitted data volume.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentUS10809869B2Layered image compression
Publication Date: 2020.10.20 APPLE INC
  • US10809869B2 patent drawing
  • US10809869B2 patent drawing
  • US10809869B2 patent drawing

AI summary

Disclosed are techniques for pre-processing layered images prior to compression and distribution. According to some embodiments, a technique can include accessing at least two images of a layered image: (i) a background image, and (ii) one or more layer images. Next, a flattened image is generated based on the at least two images. Next, respective one or more delta layer images are generated for the one or more layer images by: for at least one pixel of each layer image having (i) an alpha sub-pixel set to fully opaque, and (ii) a first color property equivalent to a second color property of a corresponding pixel within the flattened image: setting bits of the first color property of the pixel to the same value (e.g., zero (0) or one (1)). Finally, the one or more delta layer images are compressed and provided to a destination computing device.