Recording-Aware UI Layout for Stream Visibility and Audio Clarity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing screen recorders, such as gaming recorders, fail to capture all desired information during recording sessions, including textual content, stream chat, and audio volume, leading to viewer experience loss.

Innovation Solution

A system and method that modifies the user interface of applications in real-time using machine learning to adjust elements like size, location, duration, and audio, ensuring desired information is recorded and broadcasted.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the user interface displays textual content underneath an icon to save space, then the interface remains compact and organized, but viewers cannot see the textual content clearly during recording

Engineering Contradiction:
Improvetextual content visibilityVSAvoiduser interface space utilization
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The user interface elements dynamically change their properties based on recording state. When recording is detected, textual content moves from underneath the icon to next to it, and font sizes adjust to optimize visibility for viewers while maintaining compact layout

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes parameters of user interface elements such as position, font size, and layout configuration based on the recording state. Textual content position parameter changes from 'underneath' to 'next to' icon, and font size parameter increases to enhance viewer readability

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If the stream chat is displayed in small font size along the border of the screen, then the interface maintains a clean and organized appearance, but the chat becomes unreadable for viewers

Engineering Contradiction:
Improvestream chat readabilityVSAvoidinterface aesthetics
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The stream chat element dynamically adjusts its font size based on the recording state. During recording, the font size increases from a small size suitable for compact display to a larger size that ensures readability for viewers, while maintaining its position along the border

Inventive Principle:
Principle #15Dynamics

3Loss of information

If user interface elements are positioned along the side of the screen to provide information, then the interface maintains a clean layout, but viewers cannot see the information clearly in the center of the screen

Engineering Contradiction:
Improvegaming opponent information visibilityVSAvoidscreen real estate distribution
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

User interface elements displaying gaming opponent information dynamically reposition themselves from the side of the screen to the center of the screen when recording is detected. This ensures maximum visibility for viewers while maintaining clean layout during normal operation

Inventive Principle:
Principle #15Dynamics

4Loss of information

If the audio volume is set to a quiet level during recording, then the recording captures accurate audio levels, but viewers miss important advances indicated by sounds

Engineering Contradiction:
Improveaudio information accessibilityVSAvoidaudio volume accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The audio volume dynamically adjusts based on the recording state. When recording is detected, the audio volume increases from a quiet level to a louder level that ensures viewers can hear important advances, while maintaining accurate audio capture during normal operation

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12472441B2Modifying user interface of application during recording session
Publication Date: 2025.11.18 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12472441B2 patent drawing
  • US12472441B2 patent drawing
  • US12472441B2 patent drawing

AI summary

A computer-implemented method, system and computer program product for recording information in a user interface of an application more desired to be seen and heard by viewers. A user interface of an application (e.g., gaming application) is displayed. Upon detecting an initiation of recording the user interface of the application, the user interface of the application is modified to ensure that the information desired to be viewed and heard by the viewers is recorded, such as by adjusting a size of a user interface element, adjusting an audio element of the user interface, etc. After such modifications, the modified user interface of the application is recorded and broadcasted to viewers via a video live streaming service. In this manner, viewers are able to see and hear information desired to be viewed and heard that may have been previously lost during the recording of the user interface prior to such modifications.