Compositing Device for Remote User Interface Session Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote user interface (RUI) technologies, such as browser-based implementations and RVU, face limitations in processing power and network resource usage, particularly when handling high-definition rendering and multiple renderers, leading to performance issues and incompatibility with cost-sensitive consumer electronics.

Innovation Solution

A compositing device processes multiple RUI sessions into a single composite session, reducing the rendering and processing load on rendering devices by handling session processing and switching, and selecting the appropriate session based on network and device information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a browser-based RUI implementation is used, then the RUI can be displayed on various devices, but the memory and processing requirements become too high for cost-sensitive consumer electronics devices

Engineering Contradiction:
Improvedevice compatibilityVSAvoidmemory requirements
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent introduces a gateway device as an intermediary between the RUI source and renderers. The gateway performs RUI processing, session management, and rendering operations that would otherwise burden the renderer devices. This mediator approach allows lightweight renderers (including cost-sensitive devices) to display RUIs without requiring them to have sufficient local processing power or memory, as the gateway handles the computationally intensive tasks.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If a browser-based RUI implementation is used, then the RUI can be displayed on various devices, but the processing speed is insufficient for a responsive experience

Engineering Contradiction:
Improvedevice compatibilityVSAvoidprocessing speed
Core Design Contradiction:
Adaptability or versatilityVSSpeed

Solution Approach 1:

The gateway device serves as a powerful intermediary that centralizes processing operations. By moving RUI composition, session management, and rendering to the gateway (which has superior processing capabilities compared to typical consumer electronics devices), the system achieves fast, responsive performance while maintaining compatibility with a wide range of renderer devices including those with limited processing power.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If the browser interface is used for RUI, then it works well with mouse and keyboard control, but it is not ideal for limited button remote control

Engineering Contradiction:
Improvemouse and keyboard controlVSAvoidremote control compatibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The gateway device provides a universal interface layer that adapts the RUI presentation and interaction model to suit different remote control types. It can transform complex RUI interactions into simplified remote-control-friendly interfaces, supporting both traditional mouse/keyboard operations and limited-button remote controls through a single multi-functional system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Productivity

If multiple RUI sessions are handled by individual rendering devices, then each device can process sessions independently, but the rendering and processing load becomes too high

Engineering Contradiction:
Improvesession processing independenceVSAvoidprocessing load
Core Design Contradiction:
ProductivityVSPower

Solution Approach 1:

The patent segments the RUI processing architecture into distinct functional components: RUI source devices, gateway devices for processing and session management, and renderer devices for display. This segmentation allows the system to distribute workload appropriately, with the gateway handling the processing-intensive session management tasks while renderers focus solely on display operations, thereby reducing the processing load on individual devices.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The gateway acts as an intermediary that centralizes session processing for multiple RUI sessions. Instead of each renderer independently managing multiple sessions (which would create high processing loads), the gateway manages all sessions centrally and distributes appropriate content to renderers, significantly reducing the processing burden on individual renderer devices while maintaining efficient session handling.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9444640B2Method to create a composite RUI from multiple RUIs
Publication Date: 2016.09.13 SONY GROUP CORP
  • US9444640B2 patent drawing
  • US9444640B2 patent drawing
  • US9444640B2 patent drawing

AI summary

A compositing device lessens a rendering/processing load for rendering devices by processing one or more sessions instead of requiring the rendering devices to do so. The compositing device is able to receive one or more sessions from one or more source devices and process the sessions either together or separately. Then, either a composited session or a selected session is sent to be displayed by a rendering device.