Companion Device Control Interface for Background Media Applications

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing television interfaces for interactive content, such as game consoles and digital video recorders, require complex navigation and often necessitate scrolling and textual input, which can be cumbersome for users.

Innovation Solution

A control application running on a companion device is used to control media applications on a primary device, allowing users to interact with media applications through a contextual interface with virtual controls, enabling control of background applications without disrupting foreground applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a television interface displays interactive content with complex navigation, then the functionality and media selection capabilities are improved, but the ease of operation deteriorates due to required scrolling and textual input

Engineering Contradiction:

Improvemedia selection capabilitiesVSAvoiduser interaction complexity

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a camera as an intermediary device to capture images of media selections (e.g., movie posters) and transmit them to the television. This mediator handles the complex navigation and selection process automatically, eliminating the need for users to manually scroll through interfaces or input text, thus resolving the contradiction between enhanced media selection capabilities and ease of operation

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical interaction system (remote control buttons, scrolling, textual input) with an optical system (camera capture and image recognition). Instead of manually navigating through interface elements, the camera captures visual information and the system automatically processes media selections, substituting physical manipulation with optical recognition to simplify user interaction

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If multiple media applications run simultaneously on the primary device, then the productivity and functionality are improved, but the device complexity increases

Engineering Contradiction:

Improvemedia application processingVSAvoidsystem management complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The camera system acts as an external intermediary that handles media selection and application control tasks outside the primary device's interface management system. By capturing media selections and transmitting control signals, the camera offloads the complexity of managing multiple simultaneous media applications from the television system, allowing enhanced productivity without proportionally increasing system complexity

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10187448B2Remote application control interface

Publication Date: 2019.01.22 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Embodiments of the present invention provide an active-application interface on a companion device that allows a user to control an application running on a primary device. The active-application interface may describe state information for a plurality of applications running on the primary device and allow the user to manipulate the application through one or more contextual controls. The active-application interface may be used to control applications running out-of-control focus on the primary device, including applications that do not presently have a visible viewport.