Image Processing for Physical Surface Compositing in Remote Board Games

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Networked multiplayer board games lack human interaction due to users feeling disconnected while moving virtual elements and waiting for opponents to update the display image.

Innovation Solution

A data processing apparatus that captures images of physical game surfaces using image sensors, generates a composite image by overlaying these images, and outputs it for display, allowing users to interact with their own physical pieces while viewing a combined image of both surfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users interact with virtual elements in a networked board game, then the game can be played remotely, but users feel disconnected and lack human interaction

Engineering Contradiction:
Improveremote gaming capabilityVSAvoiduser interaction quality
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent merges the virtual game interface with a live video feed of the opponent's physical environment. The video overlay is composited onto the game display, combining digital and real-world elements into a unified interface that maintains remote play functionality while restoring human connection through visual presence

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The video overlay acts as an intermediary between the virtual game elements and the opponent's physical presence. Instead of direct interaction with cold virtual elements, users interact with a mediated representation that includes the opponent's real-world context, thereby preserving social connection in remote gameplay

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If users wait for opponents to update the display image, then the game state can be synchronized, but interaction feels delayed and less engaging

Engineering Contradiction:
Improvegame state synchronizationVSAvoidresponse delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary capture and buffering of video footage from the opponent's environment. By pre-capturing the video stream and preparing it for overlay, the system reduces the perceived delay when game states are updated, as the video context is already available when synchronization occurs

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The video overlay provides continuous visual feedback of the opponent's environment throughout the game, rather than only updating at discrete game state changes. This continuous stream maintains engagement and reduces the perception of waiting, as users consistently see the opponent's real-time context even during synchronization delays

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP4252872B1Image processing apparatus, system and method
Publication Date: 2025.08.20 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP4252872B1 patent drawingFigure 1
  • EP4252872B1 patent drawingFigure 2~3
  • EP4252872B1 patent drawingFigure 4a~4b

AI summary

A data processing apparatus comprises at least one image sensor to capture one or more first images including a first physical surface for use in a board game, receiving circuitry to receive, via a network, one or more second images including a second physical surface for use in a same type of board game as the first physical surface, image processing circuitry to generate a composite image for display based on at least a portion of a first image and at least a portion of a second image to include, in the composite image, an image of a surface formed of the first physical surface and the second physical surface, and output circuitry to output the composite image for display.