Cloud Overlay System for Video Frame Pixel Data Modification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video game execution and rendering models lack the ability to seamlessly integrate overlay content into video frames without affecting the native application's output, limiting the enhancement of user experiences in online gaming environments.

Innovation Solution

A system and method for cloud processing of applications that intercept and modify pixel data sets of video frames to overlay content, such as universal achievement status, by detecting key graphical images and replacing or inserting overlay images, allowing for enhanced gaming experiences without modifying the underlying game logic.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If overlay content is integrated into video frames through pixel manipulation, then user experience enhancement is achieved, but the native application's output integrity is compromised

Engineering Contradiction:
Improveuser experience enhancementVSAvoidapplication output integrity
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an intermediary overlay system that operates between the native application and the user interface. This overlay capability allows content to be integrated without modifying the underlying application code, thus maintaining application integrity while enhancing user experience through additional interface elements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the user interface into distinct layers: the native application layer and the overlay layer. This segmentation allows the overlay content to be independently managed and rendered on top of the application output, preventing corruption of the original application functionality while enabling enhanced user experience.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If pixel data sets are intercepted and modified to overlay content, then new gaming experiences are enabled, but processing complexity increases

Engineering Contradiction:
Improvegaming experience customizationVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates overlay representations of game content rather than modifying the original pixel data sets. By working with separate overlay layers that reference game state information, the system enables customized gaming experiences without the computational burden of deep pixel manipulation.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary actions by establishing overlay layers and rendering rules before the actual game rendering occurs. This preliminary setup allows the overlay system to efficiently integrate with the rendering pipeline without adding significant processing complexity during real-time game execution.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If overlay content is integrated without modifying game code, then application compatibility is maintained, but integration depth is limited

Engineering Contradiction:
Improveapplication compatibilityVSAvoidintegration capability
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal overlay system that can be applied to multiple different applications without requiring application-specific modifications. The overlay capability serves multiple functions including displaying additional information, providing enhanced controls, and creating customized user experiences across different game titles.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9707485B2Systems and methods for cloud processing and overlaying of content on streaming video frames of remotely processed applications
Publication Date: 2017.07.18 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9707485B2 patent drawing
  • US9707485B2 patent drawing
  • US9707485B2 patent drawing

AI summary

A first application executes on one or more computing systems to generate a series of original frame pixel data sets for rendering of graphical images associated with the first application execution. A second application executes on one or more computing systems to detect one or more key graphical images present in the series of original frame pixel data sets. Upon detection of the one or more key graphical images, the second application directs replacement of a portion of pixel data in the series of original frame pixel data sets with substitute pixel data so as to generate a series of modified frame pixel data sets for encoding in lieu of the series of original frame pixel data sets.