Contextual Remote Control Interface for Gamepad Emulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing entertainment systems face challenges in providing an intuitive and efficient way for users to navigate and control complex interactive content on primary devices, such as game consoles and web browsers, especially when requiring complex navigation and textual input.

Innovation Solution

A contextual remote control interface on a companion device allows users to control primary devices by detecting user interactions and outputting tailored virtual play controls, enabling communication of control commands to the primary device, effectively mimicking gamepad functions through touch screen interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a contextual remote control interface with tailored virtual play controls is implemented, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent creates virtual copies of physical gamepad controls (buttons, d-pads, triggers) as software-based virtual play controls displayed on the touch screen. These virtual controls replicate the functionality and layout of physical controllers, allowing users to interact with the primary device through a simplified graphical interface that mimics familiar physical control schemes without requiring actual gamepad hardware

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The contextual remote control interface serves multiple functions: it provides navigation controls, media playback controls, and input methods across different applications and content types. The system automatically adapts the virtual controls to match the current context (game, video, music, browsing), making a single interface solution work for diverse entertainment scenarios without requiring separate control mechanisms for each application

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If tailored virtual play controls are generated based on media engagement status, then adaptability is improved, but processing time increases

Engineering Contradiction:
ImproveadaptabilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system pre-generates templates for different types of virtual play controls corresponding to common media engagement states (playing, paused, stopped, buffering). When the media engagement status changes, the system quickly switches between pre-prepared control templates rather than creating custom controls from scratch, significantly reducing processing time while maintaining contextual adaptability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously monitors media engagement status (playing, paused, buffered, error states) and automatically adjusts the virtual play controls displayed to the user. This real-time feedback loop ensures the controls remain appropriate for the current media state without requiring manual user configuration, achieving adaptability through automated context-aware adjustments

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10104419B2Contextual remote control interface
Publication Date: 2018.10.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10104419B2 patent drawing
  • US10104419B2 patent drawing
  • US10104419B2 patent drawing

AI summary

Embodiments of the present invention provide a contextual remote control interface, which is a companion application that allows a user to use a companion device to control experiences generated by an application running on a primary device. Web browsers, games, and streaming media applications are examples of applications running on a primary device that may be controlled using the companion device. Interfaces associated with each of the media applications on the primary device may be displayed on a television or other device coupled to the primary device. A unique set of virtual controls are included in the remote control interface for each application and may be tailored to the current state of the application.