Controller Detection Using Tilt Angle and Live Image
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computer entertainment systems lack the ability to effectively detect and track the three-dimensional movements of a hand-held controller, limiting the range of user inputs and interactions in video games and simulations.
Innovation Solution
A system that captures live images of the controller using a camera and combines this with tilt angle information from sensors to rotate reference images, allowing for the detection and tracking of the controller's movements and gestures, which are then mapped onto a two-dimensional image plane for input commands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If only two-dimensional image capture is used, then device complexity is reduced, but measurement precision of three-dimensional movements is insufficient
Solution Approach 1:
The patent combines data from multiple sensors (accelerometers, gyroscopes, magnetometers) with image capture device data to create a comprehensive three-dimensional movement detection system. This merging of multiple data sources enables accurate 3D tracking while distributing the complexity across separate components rather than requiring a single complex system.
Solution Approach 2:
The patent introduces a processor-based system that acts as an intermediary, receiving and integrating data from both the image capture device and the sensors. This intermediary processes the combined information to determine controller movements, simplifying the overall system architecture by centralizing the integration logic.
2Adaptability or versatility
If three-dimensional movement detection is implemented, then user input capabilities are enhanced, but device complexity increases
Solution Approach 1:
The patent makes the controller multi-functional by enabling it to detect and respond to various types of movements (translation, rotation, orientation changes) in three-dimensional space. The same sensor suite and processing system handle multiple input modalities, allowing the controller to serve diverse gaming functions without requiring separate devices for each input type.
Solution Approach 2:
The patent implements dynamic movement detection by continuously tracking controller position, orientation, and movement vectors in real-time. The system adapts to different movement types and speeds, providing versatile user input capabilities through dynamic rather than static detection methods.
3Measurement precision
If sensors are integrated into the controller, then measurement precision improves, but manufacturing precision requirements increase
Solution Approach 1:
The patent employs feedback mechanisms where the processor continuously receives sensor data and adjusts interpretations based on known controller orientation and movement patterns. This feedback loop compensates for minor manufacturing variations in sensor placement, maintaining high measurement precision without requiring extremely tight manufacturing tolerances.
Solution Approach 2:
The patent changes the parameters used for movement detection by utilizing multiple sensor types (accelerometers, gyroscopes, magnetometers) that measure different physical quantities. This multi-parameter approach provides redundant measurement pathways that compensate for individual sensor manufacturing variations, reducing the impact of precision requirements on any single component.
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
A method for use in obtaining input data from an object includes capturing a live image of the object with an image capture device (1402), receiving information related to a tilt angle of the object from one or more sensors other than the image capture device (1404), using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object (1406), comparing the live image of the object with the rotated reference image of the object (1408), and generating an indication in response to the live image matching the rotated reference image (1410). An apparatus and a storage medium storing a computer program executable by a processor based system are also disclosed.