Runtime Interface Modification Without Source Code Changes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in modifying software behavior, particularly in run-time environments, especially when source code is unavailable or compiled executables cannot be changed, making it difficult to adapt applications for different environments and maintain user experience in cloud-based systems.

Innovation Solution

A computer system that modifies user interfaces and application behaviors in real-time by analyzing image information, using processors and memory to execute application and modification programs, allowing for dynamic changes without altering the source code or compiled executables, and supporting multiple users and virtual environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If video games are executed on cloud-based computer systems, then maintenance efficiency and cost reduction are improved, but adaptability to different environments and support for additional features deteriorate

Engineering Contradiction:
Improvemaintenance efficiencyVSAvoidenvironmental adaptability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent introduces an image information modification program as an intermediary layer between the application program and the display device. This mediator captures the original user interface through image information, modifies it by adding or removing elements, and presents the altered interface to the user. This allows the cloud-based system to maintain the original application unchanged while adapting the user interface to different environments and requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a copy of the user interface through image information capture. Instead of modifying the original application code, the system captures the rendered interface as image data, applies modifications to this copy, and displays the modified version. This copying approach enables environmental adaptation without altering the core application or requiring code changes.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If source code modification is performed to add features, then functionality is improved, but system complexity and modification difficulty increase

Engineering Contradiction:
Improvefeature functionalityVSAvoidmodification complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The image information modification program serves as an intermediary that adds functionality without modifying the original source code. By operating at the presentation layer rather than the code layer, it simplifies the modification process while still enabling additional features and environmental adaptations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent separates the application program from its user interface presentation. The modification program operates independently on the image information layer, allowing feature additions and adaptations without entangling modifications with the core application code. This segmentation reduces overall system complexity.

Inventive Principle:
Principle #1Segmentation

3Productivity

If real-time network interaction is implemented for cloud-based systems, then user service capability is improved, but network bandwidth consumption and latency increase

Engineering Contradiction:
Improveuser service capabilityVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system performs image information capture and modification locally at the display device rather than requiring continuous real-time communication with the cloud server. This preliminary local processing reduces the need for high-bandwidth real-time network interaction while maintaining user service capability.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10884723B2Modification of software behavior in run time
Publication Date: 2021.01.05 META PLATFORMS INC
  • US10884723B2 patent drawing
  • US10884723B2 patent drawing
  • US10884723B2 patent drawing

AI summary

When executed by one or more processors in a computer system, an application program may provide, to an electronic device, image information that specifies a user interface for display on the electronic device, and may receive, from the electronic device, information that specifies user-interface activity of the user. Furthermore, when executed by the one or more processors, the modification program may identify a state of the application program. Then, the modification program may selectively modify the image information based on the identified state to change the user interface without changing source code for the application program or a compiled executable of the application program, and may provide the modified image information to the electronic device for display. Subsequently, based on information that specifies a user-interface activity of the user that is associated with the modified user interface, the modification program may selectively perform an operation.