Split Client Video Game Streaming for Low-Latency Spectating

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing online video game services are costly and complex, particularly when hosting multi-player, fast-action games or providing spectating services, and often require changes or upgrades to user client devices for modifications in the look-and-feel of the gaming service.

Innovation Solution

A video game service architecture that logically splits client devices into input and output types, utilizing specialized media application hosts for video streams and incorporating a gateway device for secure communication, with each client type having its own instance of game service, allowing for efficient and secure gameplay, spectating, and picture-in-picture compositing without the need for complex client device upgrades.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a large number of components and complex hosting service systems are used to host multi-player and spectating services, then the service functionality is improved, but the device complexity and cost increase

Engineering Contradiction:
Improveservice functionalityVSAvoidhosting service system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the client device into two separate logical entities: an input client that handles user input and a output client that handles video rendering and display. This segmentation allows the system to optimize each client's function independently, reducing the complexity of the overall hosting service system while maintaining full service functionality for both gameplay and spectating.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The output client is designed to serve multiple purposes: it can display gameplay video streams when the user is playing, and simultaneously display spectated game streams when another user is being watched. This multi-functionality eliminates the need for separate components for gameplay and spectating, thereby reducing device complexity while maintaining service versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If changes are made to the look-and-feel of an online gaming service, then the user experience is improved, but changes or upgrades to the user client device are required

Engineering Contradiction:
Improveuser experienceVSAvoidclient device maintenance
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent extracts the video rendering and display functionality into a separate output client that operates independently from the input client. This extraction allows service providers to update the output client's look-and-feel, interface, and display capabilities without requiring changes to the input client or the core game execution environment, thereby improving user experience while simplifying client device maintenance.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The output client acts as an intermediary between the hosting service and the user's display device. It receives video streams from the server and handles all rendering, compositing, and display operations. This intermediary role allows the service provider to modify the output client's appearance and functionality without affecting the core game logic or requiring updates to other system components.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If a unified client device handles both input and output functions, then the device structure is simplified, but real-time responsiveness and security are reduced

Engineering Contradiction:
Improveclient device structureVSAvoidreal-time responsiveness
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

By dividing the client into separate input and output components, the patent enables independent optimization of each segment. The input client can be minimized to handle only control signals with minimal processing delay, while the output client can be optimized for high-speed video rendering and display. This segmentation improves real-time responsiveness without significantly increasing overall device complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The gateway acts as an intermediary that coordinates communication between the input client, output client, and hosting service. It manages data flow, synchronizes operations, and ensures secure transmission. This intermediary structure maintains system security and real-time responsiveness while allowing the client devices to have a simplified overall architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Productivity

If the client device processes both game input and video rendering, then the processing load is concentrated, but latency and security exposure increase

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidlatency and security
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the processing functions into distinct components: the input client handles user input with minimal processing, the gateway manages communication and security protocols, and the output client handles video rendering and display. This distribution of processing load across specialized components reduces latency by eliminating unnecessary processing steps in each segment while maintaining overall processing efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The gateway serves as a secure intermediary that mediates all communication between the input client, output client, and hosting service. It implements security protocols, validates data transmission, and isolates the clients from potential malware exposure. This intermediary structure enhances security without significantly impacting processing efficiency, as the gateway operates at the communication layer rather than interfering with core processing functions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12623156B2Online video game service with split clients
Publication Date: 2026.05.12 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12623156B2 patent drawing
  • US12623156B2 patent drawing
  • US12623156B2 patent drawing

AI summary

A method for an online video game or application service system includes running a video game or application on an application host server at a data center, an uncompressed video stream being produced therefrom. The uncompressed video stream is encoded into compressed video stream, which is then transmitted over the Internet to an output client device of a user. The output client device decompresses the compressed video stream and displays live video on a screen. User control input transmitted from an input client device is delivered to the application host server. The user control input includes game or application commands. The input client device is associated with the user and is separate from the output client device. Responsive to receiving the game or application commands, the application host server generates a new uncompressed video stream.