Adaptive User Interface Rendering for Remote Input Devices

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

There is a need for efficient user interfaces in electronic devices that receive inputs from remote input devices, particularly to enhance gaming experiences and reduce cognitive burden and battery power consumption.

Innovation Solution

Electronic devices display tailored user interfaces based on detected input devices, including showing game interfaces, reducing interfaces when a cover is applied, and directing inputs based on input device modes, utilizing display generation components and projection devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the device displays a full user interface, then the user can access all functions and information, but the processor and battery must work harder consuming more power

Engineering Contradiction:

ImproveUser interface accessibilityVSAvoidBattery power consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system displays only the necessary portion of the user interface based on the detected input device type. When a remote input device is detected, the system selectively displays game-related interface elements while hiding non-essential elements, performing partial interface rendering instead of full interface display to reduce processor and battery power consumption.

Inventive Principle:

Principle #16Partial or excessive action

2Adaptability or versatility

If the device displays game-specific user interface, then the gaming experience is enhanced, but the interface must be tailored which increases processing requirements

Engineering Contradiction:

ImproveInterface adaptation to input deviceVSAvoidProcessing requirements

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary detection of the input device type before displaying the user interface. By detecting the remote input device and determining the appropriate game mode in advance, the system can pre-configure the interface elements to display, avoiding complex real-time processing decisions and reducing overall processing requirements.

Inventive Principle:

Principle #10Preliminary action

3Loss of energy

If the device reduces the user interface, then battery power consumption is reduced, but the user may miss important information

Engineering Contradiction:

ImproveBattery power savingsVSAvoidUser interface information

Core Design Contradiction:

Loss of energyVSLoss of information

Solution Approach 1:

The system applies local quality by selectively rendering specific portions of the user interface based on the detected input device. Game-related interface elements are displayed with full quality and detail, while non-essential elements are hidden or reduced, ensuring that important gaming information is preserved while achieving power savings.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS20240333829A1User interfaces associated with remote input devices

Publication Date: 2024.10.03 APPLE INC

AI summary

In some embodiments, an electronic device displays user interfaces associated with games in response to detecting input devices having been connected to the electronic device. In some embodiments, an electronic device displays a reduced user interface in response to detecting that a cover has covered a portion of the display of the electronic device. In some embodiments, an electronic device displays a user interface via a display generation component of an input device. In some embodiments, an electronic device projects a user interface via a projection device of an input device. In some embodiments, an electronic device directs inputs from an input device to different user interfaces depending on the mode in which the input device is operating.