Video Call Object Recognition for Real-Time Game Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video call technologies do not provide an integrated gaming experience that allows users to engage in real-time games while maintaining a call, lacking the ability to utilize object recognition for interactive elements.

Innovation Solution

Implementing a method to recognize objects and gestures within a video call image using VoIP technology, allowing for the control of game elements and sharing of game progress, enabling real-time gaming between users through a video call environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If video call service is provided using existing technology, then users can communicate face-to-face, but the system lacks integrated gaming functionality and interactive elements

Engineering Contradiction:
Improvegaming functionalityVSAvoidsystem integration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges video call functionality with gaming functionality into a single integrated system. The server combines VoIP communication with object recognition and game control capabilities, allowing users to simultaneously engage in video calling and interactive games without requiring separate systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The video call system is enhanced to perform multiple functions: traditional video communication, real-time object recognition, gesture detection, and game control. This multi-functionality allows a single system to serve both communication and entertainment purposes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If object recognition is implemented in video call images, then interactive game control is enabled, but processing complexity and computational requirements increase

Engineering Contradiction:
Improveinteractive controlVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a server as an intermediary that handles the computationally intensive object recognition and gesture detection tasks. Instead of requiring complex processing in each client device, the server performs image analysis and returns simplified control signals, distributing the computational burden.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces manual game control mechanisms with automated object recognition technology. Instead of requiring users to manually control game elements, the system automatically detects objects and gestures in video images and translates them into game control actions, simplifying user interaction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If real-time game control based on object recognition is implemented, then gaming experience is enhanced, but system response time and processing speed requirements increase

Engineering Contradiction:
Improvegame responsivenessVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary processing by continuously analyzing video frames during the call to pre-identify objects and gestures before game actions are required. This allows the system to be ready to respond immediately when game control is needed, reducing actual response time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The object recognition process operates continuously throughout the video call rather than being triggered only when needed. This continuous analysis maintains readiness and ensures that game control responses are immediate, as the system is already processing and identifying objects in real-time.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11465044B2Method and system for providing game based on video call and object recognition
Publication Date: 2022.10.11 LY CORP
  • US11465044B2 patent drawing
  • US11465044B2 patent drawing
  • US11465044B2 patent drawing

AI summary

Provided are methods and systems for providing a game based on a video call and object recognition. A game providing method of an electronic device configured as a computer including displaying game content on a video call screen in response to a video call being established between a user of the electronic device and a counterpart through a voice over Internet protocol (VoIP) channel, recognizing an object in a call image as motion data with respect to the game content, and controlling a game element corresponding to the game content using a result of the recognizing may be provided.