Visual Layout Tree Generation for Multi-Display Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in efficiently rendering complex and sophisticated content on low computational power devices and large displays, as they require significant resources and often cannot handle content that spans multiple display areas or includes complex animations.

Innovation Solution

A layout engine generates a visual layout tree from a visual description tree, allowing for efficient rendering of content across multiple display areas by traversing the tree, caching nodes, and using positioning pointers to animate movements, thereby optimizing resource usage and supporting complex layouts and animations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If complex and sophisticated content is presented using current technologies, then the content quality and sophistication are improved, but the computational resources required increase significantly

Engineering Contradiction:
Improvecontent complexityVSAvoidcomputational resources
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent segments complex content into a hierarchical structure consisting of a visual description tree (VDT) and visual layout tree (VLT). The VDT separates content semantics from layout rendering, allowing independent processing. This segmentation enables low-power devices to render only visible portions while maintaining support for sophisticated content structures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical dimension by creating two separate tree structures (VDT and VLT) instead of a single flat rendering system. The VDT represents content in a logical hierarchy while the VLT represents physical layout, adding an organizational dimension that decouples content complexity from rendering complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If content spans multiple display areas or includes complex animations, then the versatility of content presentation is improved, but the computational power required increases

Engineering Contradiction:
Improvecontent presentation capabilityVSAvoidcomputational power
Core Design Contradiction:
Adaptability or versatilityVSPower

Solution Approach 1:

The patent performs preliminary actions by pre-processing content into the VDT structure and pre-calculating layout information in the VLT before rendering. Layout interruption records are generated in advance to guide resumption of layout processing, eliminating the need for complex real-time computations during animation and multi-display operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces layout interruption records as an intermediary data structure that mediates between the VDT and VLT during layout processing. These records capture the state of layout computation at interruption points, enabling efficient resumption without re-computing entire layouts, thus reducing computational power requirements for complex presentations.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Area of stationary object

If content is rendered on large displays with tens of millions of pixels, then the display area is improved, but the efficiency of content presentation decreases

Engineering Contradiction:
Improvedisplay areaVSAvoidcontent presentation efficiency
Core Design Contradiction:
Area of stationary objectVSProductivity

Solution Approach 1:

The patent segments the large display area into multiple manageable regions represented in the VLT, each corresponding to portions of the VDT. This segmentation allows the rendering system to process and render only relevant content segments for each display region, maintaining efficiency even when the total display area spans tens of millions of pixels.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10353991B2Generating a visual description tree based on a layout interruption record
Publication Date: 2019.07.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10353991B2 patent drawing
  • US10353991B2 patent drawing
  • US10353991B2 patent drawing

AI summary

A layout engine generates a visual layout tree for a visual description tree of a document whose content is to be rendered in one or more display areas. A visual description tree describes the content of a document along with formatting and logical arrangement the content. Visual description nodes of a visual description tree represent the organization of the constituent elements a document hierarchically. A visual layout tree defines the layout of a document within one or more display areas. Visual layout nodes of a visual layout tree represent the layout of the content of a document hierarchically. The layout engine receives as input a visual description tree and generates the corresponding visual layout tree. A rendering engine then inputs the visual layout tree and generates a graphics buffer containing the pixels representing the layout of the document as defined by the visual layout tree.