Second-Screen Controller Layouts for Adaptive Video Game Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video games are limited by the rigid layout and functionality of physical controllers, and mobile gaming often compromises display area and usability due to digital controls being displayed on the same screen as game graphics.
Innovation Solution
A system converts a second screen device, such as a smartphone, into a video game controller that dynamically adapts custom-built layouts in response to trigger events, providing unique interactions and hidden information gameplay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If controls are displayed on the same mobile display as game graphics, then the control layout is integrated with the game, but the controls block game graphics and reduce usability and immersiveness
Solution Approach 1:
The system divides the control interface from the game display by using a separate second screen device (mobile device) for controls while the first screen device (TV/monitor) displays the game graphics. This segmentation eliminates the blocking issue while maintaining control integration through wireless communication between devices.
Solution Approach 2:
The control interface is moved from the two-dimensional game display plane to a separate physical device (mobile device), creating a spatial separation that allows full game graphics visibility on the main display while maintaining control functionality on the secondary device.
2Reliability
If a physical controller with dedicated buttons and joysticks is used, then the controller layout is fixed and reliable, but the layout cannot be customized for different games or situations
Solution Approach 1:
The control layout transitions from a static physical arrangement to a dynamic software-based interface that can be reconfigured in real-time. The system detects trigger events during gameplay and automatically switches between different control layouts (standard, custom-built, full-screen) to adapt to different game situations while maintaining reliable control functionality.
Solution Approach 2:
The system changes the parameter of control layout configuration from fixed to variable by allowing dynamic switching between multiple layout modes (standard emulated controller layout, custom-built layouts with rich interactions, and full-screen layouts) based on game context and user needs.
3Reliability
If a standard emulated controller layout is used on the second screen device, then the controller functionality is consistent and reliable, but unique second screen device functionality cannot be utilized
Solution Approach 1:
The second screen device serves multiple functions: it can operate with a standard emulated controller layout for familiar reliable control, or switch to custom-built layouts that leverage unique mobile device capabilities such as touchscreen gestures (swipe, zoom, drag-and-drop, pan), gyroscopic interactions, and microphone interactions, providing both consistency and device-specific functionality.
Data Source
AI summary
The disclosed computer-implemented methods and systems cause a second screen device to display custom-built layouts once the second screen device has been converted to a video game controller. For example, the disclosed methods and system convert the second screen device to a video game controller for a video game being supported by a digital content system and displayed on a separate first screen device. In response to detecting a trigger event, the disclosed methods and systems replace a standard layout on the second screen device with a custom-built layout. Where the standard layout is limited to standard video game controls at standard positions, the custom-built layout includes any type combination of customized video game controls, colors, graphics, animations, and so forth. Various other methods, systems, and computer-readable media are also disclosed.