Dynamic Game Interface Layout for Picture-in-Picture Overlays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Picture-in-picture displays in games can reduce game operability by overlaying secondary screens on the main game screen, hindering player interaction.

Innovation Solution

An information processing system that detects the screen frame of a secondary screen and adjusts the position and dimension of the game's operation interface within the main screen to prevent overlay, ensuring optimal gameplay operability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If picture-in-picture is used to display a second screen within the first game screen, then the player can view additional information while playing the game, but the operability of the game is reduced due to overlaying screens

Engineering Contradiction:
Improveinformation accessibilityVSAvoidgame operability
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The operation interface elements are dynamically repositioned or resized based on the presence and position of the picture-in-picture second screen. The system automatically adjusts the layout of buttons, menus, and interactive elements to avoid overlaying the PiP window, maintaining accessibility while preserving game operability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The first screen is segmented into multiple display regions, with the picture-in-picture second screen occupying a specific portion. The operation interface elements are distributed across different segments of the first screen, ensuring that critical interactive elements remain accessible and are not obscured by the overlaying second screen.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If the second screen is displayed overlaying part of the first screen, then multiple information sources can be viewed simultaneously, but the area available for game interaction is reduced

Engineering Contradiction:
Improveinformation display capabilityVSAvoidinteractive screen area
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The system utilizes the spatial dimension by positioning the picture-in-picture second screen in a corner or edge region of the first screen, allowing the majority of the central and peripheral areas to remain dedicated to game interaction. This dimensional arrangement enables simultaneous display of multiple information sources while preserving sufficient interactive area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Device complexity

If the operation interface elements are fixed in position on the first screen, then the interface layout is simple and consistent, but the elements may be overlaid by the second screen reducing usability

Engineering Contradiction:
Improveinterface layout complexityVSAvoidinterface usability
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The operation interface elements transition from fixed to dynamic positioning based on the detection of the picture-in-picture second screen. When PiP is active, the system automatically adjusts the position and/or size of interface elements to avoid overlay, creating a context-aware adaptive layout that maintains simplicity while improving usability.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11964203B2Information processing system for displaying a screen and automatically adjusting the screen
Publication Date: 2024.04.23 AKATSUKI INC
  • US11964203B2 patent drawing
  • US11964203B2 patent drawing
  • US11964203B2 patent drawing

AI summary

An information processing system, an information processing apparatus, a program, and an information processing method are less likely to reduce the operability of a game. Within a first screen on which information processing associated with a game is to be performed, a second screen on which predetermined information processing is to be performed is displayed. A screen frame of the second screen is detected based on screen frame data received from a player. The screen frame data specifies the screen frame of the second screen to be displayed. The information processing associated with the game to be performed on the first screen is adjusted based on a position and a dimension of the second screen within the first screen. The position and the dimension of the second screen are detected using the detected screen frame of the second screen.