Parallel Renderers and Compositor for Concurrent XR Content

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Electronic devices face challenges in efficiently managing and integrating multiple applications' content for display, particularly in extended reality environments, where concurrent rendering and interaction with both system and application-generated content is complex and resource-intensive.

Innovation Solution

Implementing parallel renderers and a compositor to manage and integrate system and application-generated content, allowing concurrent display and interaction with user input modalities, such as gaze and gestures, to optimize rendering and user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple applications generate content concurrently for display, then content variety and user interaction options increase, but system complexity and resource consumption increase

Engineering Contradiction:

Improvecontent varietyVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the rendering workload into separate application renderers for different applications and a system renderer for system content. Each renderer operates independently to generate content for its specific application or system function, reducing the complexity of managing multiple applications simultaneously while maintaining content variety.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

A compositor is introduced as an intermediary component that receives rendered content from multiple application renderers and the system renderer, then integrates and displays the combined output. This mediator manages the complexity of concurrent content generation and integration, allowing multiple applications to coexist without directly interfering with each other's rendering processes.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If multiple renderers operate concurrently to display different application content, then display capability and user interaction improve, but resource utilization and processing overhead increase

Engineering Contradiction:

Improvedisplay capabilityVSAvoidresource utilization

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The rendering system is segmented into multiple independent renderers (application renderers and system renderer) that can operate concurrently without interfering with each other. Each renderer processes only its designated content, improving overall display capability while managing resource utilization through specialized division of labor.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The compositor serves as a universal component that handles integration of content from any number of application renderers and the system renderer. This multi-functional component manages the combined output efficiently, allowing the system to scale display capability without proportionally increasing processing overhead for each additional application.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12482191B2Parallel renderers for electronic devices

Publication Date: 2025.11.25 APPLE INC

AI summary

Aspects of the subject technology relate to electronic devices having multiple renderers. The multiple renderers may include a system renderer that renders system content and application content generated by some applications at the electronic device, and one or more application renderers that render application content generated by one or more other corresponding applications. The electronic device may include a compositor that receives rendered content from the system renderer and one or more application renderers, and generates a composite display environment that concurrently includes the rendered content from the system renderer and one or more application renderers.