Passive Object Pose Detection for Video Game Input Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high cost and technical complexity of traditional video game peripherals, such as motion controllers, limit accessibility to various game features and multiplayer experiences, as they often require charging and may not be usable at all times due to battery issues.
Innovation Solution
A system and method utilizing non-luminous passive objects, like bananas or oranges, as controllers, where images of these objects are detected using a video camera, and their pose is analyzed to generate user inputs for video games, eliminating the need for expensive tracking devices and batteries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional motion controllers with light sources or motion sensors are used, then tracking precision and control reliability are improved, but device cost and technical complexity increase
Solution Approach 1:
The patent uses a video camera to capture images of passive objects (like bananas or oranges) that users hold, creating a visual copy of the object's position and orientation. This optical copy is then processed to generate control inputs, replacing the need for active sensors in the controller itself.
Solution Approach 2:
The patent replaces mechanical/electronic sensing systems (accelerometers, gyroscopes, light sources) with an optical detection system using a video camera. The camera captures visual information about the passive object's pose, substituting complex mechanical sensing with simpler optical field detection.
2Ease of operation
If motion controllers with batteries are used, then control functionality is improved, but ease of operation deteriorates due to charging requirements
Solution Approach 1:
The passive objects used as controllers do not require any energy input or self-service. They are ordinary objects that users already possess, requiring no charging, battery replacement, or maintenance. The system serves itself by using the object's natural visual properties for tracking.
Solution Approach 2:
The patent employs inexpensive, readily available passive objects (such as fruits or everyday items) as controllers. These objects have essentially zero cost and require no energy input, making them infinitely more economical and easier to operate than battery-powered commercial controllers.
3Adaptability or versatility
If multiple peripherals are purchased to access all game features, then adaptability is improved, but device complexity and cost increase
Solution Approach 1:
The patent creates a universal control system where any passive object can serve as a controller. The video camera detects the object's position, orientation, and movements, enabling a single system to replace multiple specialized peripherals. Users can access various game features using the same basic setup with different objects.
4Ease of operation
If passive non-luminous objects are used as controllers, then cost and ease of operation are improved, but measurement precision may deteriorate
Solution Approach 1:
The patent introduces image processing algorithms and computer vision techniques as intermediaries between the passive object and the control system. These intermediaries extract precise positional and orientational information from video images, maintaining measurement accuracy despite using simple passive objects without active markers or sensors.
Data Source
AI summary
A system for generating video game inputs is provided. The system comprises an input unit operable to obtain images of a passive non-luminous object being held by a user as a video games controller. The system also comprises an object detector and object pose detector for detecting the object and its respective pose in the obtained images. The pose detector is configured to detect the pose of the object based on at least one of a (i) contour detection operation and (ii) the output of a machine learning model that has been trained to detect the poses of passive non-luminous objects in images. A user input generator is configured to generate user inputs based on the detected changes in pose of the passive non-luminous object and to transmit these to a video game unit at which a video game is being executed. A corresponding method is also provided.