Game Stream Image Overlay Using Separate Compression and Area Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing game systems struggle with efficiently integrating captured images from cameras into game environments without causing a feeling of strangeness or distortion, particularly when handling different data types and compression methods.

Innovation Solution

The system distributes first data including game image data and second data including captured image data with separate compression methods, allowing for the superimposition of the captured image data onto the game environment, using lossless compression for area data and lossy compression for image data, and adhering to the H.264 standard for efficient data streaming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If captured image data and game image data are distributed using the same compression method, then processing is simplified, but image quality deteriorates and a feeling of strangeness occurs

Engineering Contradiction:
Improveprocessing simplicityVSAvoidimage quality
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent divides the distribution data into two separate streams: first data for game image and second data for captured image. Each stream uses compression methods optimized for its specific requirements, allowing lossless compression for captured images and lossy compression for game images, thereby resolving the contradiction between processing simplicity and image quality

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If lossless compression is used for captured image data, then image quality is maintained, but data amount increases

Engineering Contradiction:
Improveimage qualityVSAvoiddata amount
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies different compression qualities to different data types: lossless compression is applied specifically to captured image data where quality is critical, while lossy compression is applied to game image data where some quality degradation is acceptable. This localized quality approach maintains image quality where needed while managing overall data amount

Inventive Principle:
Principle #3Local quality

3Ease of manufacture

If captured image data and area data are distributed separately, then processing is simplified, but time lag between image and area data increases

Engineering Contradiction:
Improveprocessing simplicityVSAvoidtime lag
Core Design Contradiction:
Ease of manufactureVSLoss of time

Solution Approach 1:

The patent combines captured image data and area data into a single second data stream using H.264 compression. This merging ensures that both data types are transmitted together, eliminating time lag between them while maintaining processing simplicity through unified stream handling

Inventive Principle:
Principle #5Merging (Combining)

4Adaptability or versatility

If first data and second data are distributed independently, then processing complexity increases, but flexibility at distribution destination improves

Engineering Contradiction:
ImproveflexibilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a dynamic system where the reception terminal can flexibly choose how to process the distributed data. The system supports multiple display modes (superimposing captured image on game image, displaying separately, or other configurations) allowing adaptability at the destination while the distribution terminal maintains a relatively simple unified distribution structure

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4678254A1Information processing method, information processing apparatus, and computer program
Publication Date: 2026.01.14 NINTENDO CO LTD
  • EP4678254A1 patent drawingFigure 1
  • EP4678254A1 patent drawingFigure 2
  • EP4678254A1 patent drawingFigure 3

AI summary

An information processing method includes distributing, at a distribution terminal, first data including image data of a game being executed and second data including captured image data obtained from a camera and area data indicating an area of a person included in the captured image data, receiving, at a reception terminal, the first data and the second data from the distribution terminal, and generating based on the area data, at the reception terminal, a distributed display image in which the area of the person in the captured image data is shown superimposed on an image of the game being executed in the distribution terminal.