Composite Board Game Imaging for Remote Physical Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Networked multiplayer board games lack human interaction due to users feeling disconnected while moving virtual elements and waiting for opponents to update the display image.

Innovation Solution

A system and method for generating a composite image by overlaying images from two physical surfaces using image processing, allowing users to view and interact with their own physical game surfaces in a composite image, enhancing interaction and immersion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users move virtual elements in a display image using a pointing device, then the game can be played remotely over a network, but users feel a lack of interaction with the opposing player and a lack of human interaction

Engineering Contradiction:
Improveremote gameplay capabilityVSAvoiduser interaction quality
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent merges the virtual display image with the user's physical environment by overlaying the virtual game board and elements onto the real-world view captured by the camera. This combination allows users to physically interact with their environment while playing, maintaining natural hand gestures and physical movements, thereby preserving human interaction quality while enabling remote gameplay

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses the camera and augmented reality display as intermediaries to bridge the physical and virtual worlds. The camera captures the user's physical environment and hands, while the AR display overlays virtual game elements, creating a mediator that maintains natural physical interaction while enabling remote networked gameplay

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If a composite image overlays the first image and the second image, then user interaction and immersion are enhanced, but the device complexity increases

Engineering Contradiction:
Improveuser interaction qualityVSAvoidimage processing system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system creates a composite image by copying and overlaying the second user's physical surface image onto the first user's view. This copying approach allows the system to present both users' physical environments in a single composite view without requiring complex real-time rendering or simulation, thereby enhancing interaction while managing device complexity through efficient image replication and composition

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12608764B2Image processing apparatus, system and method
Publication Date: 2026.04.21 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12608764B2 patent drawing
  • US12608764B2 patent drawing
  • US12608764B2 patent drawing

AI summary

A data processing apparatus includes at least one image sensor to capture one or more first images including a first physical surface for use in a board game, receiving circuitry to receive, via a network, one or more second images including a second physical surface for use in a same type of board game as the first physical surface, image processing circuitry to generate a composite image for display based on at least a portion of a first image and at least a portion of a second image to include, in the composite image, an image of a surface formed of the first physical surface and the second physical surface, and output circuitry to output the composite image for display.