Covert Player Communication via Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to facilitate secret communication between players during gameplay, particularly in competitive video games, where team coordination is crucial but traditional methods may reveal strategies to opposing teams.

Innovation Solution

A system that uses image data from cameras to identify gestures made by players and trains an AI model to predict responses, allowing for covert communication through audio or haptic feedback without alerting third-party players, ensuring strategies remain secret.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If players use traditional communication methods during gameplay, then team coordination is improved, but strategic secrecy is compromised

Engineering Contradiction:
Improveteam coordinationVSAvoidstrategic secrecy
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent introduces an intermediary communication system that translates gestures into coded signals. The system uses a camera to detect player gestures and converts them into encrypted communication signals that can only be decoded by teammates, preventing opposing teams from understanding the communication content while maintaining coordination effectiveness

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs visual coding through gesture variations, where different gestures, hand positions, or movement patterns represent different communication signals. This allows multiple layers of information to be conveyed through visual gestures that appear innocuous to outsiders but carry specific meaning to teammates who understand the coding system

Inventive Principle:
Principle #32Color changes

2Ease of operation

If players communicate openly during gameplay, then team coordination is enhanced, but detection by opposing teams increases

Engineering Contradiction:
Improveteam coordinationVSAvoiddetection by opposing teams
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The system acts as an intermediary that takes natural gestures and transforms them into coded communication signals. The camera captures the gestures, the system processes and encodes them, and transmits only the encoded signals to teammates, making the communication undetectable to opposing teams while preserving coordination

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a copy of the gesture communication system that operates on a different spectral or visual plane. The gesture recognition system creates a digital representation of the physical gesture and translates it into a coded signal, separating the visible gesture from the communicative information to prevent detection

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If a gesture recognition system is implemented, then secret communication capability is provided, but system complexity increases

Engineering Contradiction:
Improvesecret communication capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the camera and processing system multi-functional by using them for both gesture recognition and communication signal generation. The same hardware components serve multiple purposes: capturing gestures, recognizing patterns, encoding messages, and transmitting signals, thereby reducing the need for separate dedicated devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system is designed to be self-contained with integrated components where the camera automatically captures gestures, the processing unit autonomously recognizes and encodes communication signals, and the transmission system automatically delivers messages. This self-service architecture reduces the need for external complex infrastructure

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12029972B2Systems and methods for facilitating communication between players during game play
Publication Date: 2024.07.09 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12029972B2 patent drawing
  • US12029972B2 patent drawing
  • US12029972B2 patent drawing

AI summary

Systems and methods for facilitating secret communication between players are described. One of the methods includes receiving image data of a first player to identify one or more gestures and receiving input data indicating a response of a second player to the one or more gestures. The method further includes training a model using the image data and the input data to generate an inference of communication between the first user and the second user. The method also includes generating additional inferences of communication between the first user and the second user. The method includes generating a recommendation to the second user based on the inference of communication and the additional inferences of communication.