Remote Controller Camera Coordinate Calculation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional interactive systems using pointing devices cannot calculate the position of a camera itself, limiting the types of games that can be applied, as they only determine the coordinate position of the screen aimed at by the user without tracking the user's hand motion.
Innovation Solution
An interactive system and remote controller that utilize face recognition technology to detect the user image region and background image region within an operating frame, allowing the calculation of the remote controller's coordinates based on these regions, and include a camera, storage element, and processor to generate estimated image frames and determine the current location information by comparing them with the initial operating frame.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional pointing devices detect location of specific objects in images, then the coordinate position of the screen aimed at can be calculated, but the position of the camera itself cannot be calculated
Solution Approach 1:
The patent introduces a reference light source as an intermediary object that emits light to form a reference light pattern on the display device. The camera captures this reference light pattern along with the operating frame, enabling the system to calculate both the aimed coordinate position and the camera's own position through the relative positional relationship between the reference light and the operating frame. This intermediary element bridges the gap between object detection and self-position calculation.
2Ease of operation
If the system only calculates coordinate position of the screen aimed at, then the pointing function is achieved, but the user's hand motion track cannot be obtained
Solution Approach 1:
The system continuously captures operating frames and reference light patterns, calculates the relative positional relationship between them, and determines the camera's position and motion track in real-time. This feedback mechanism provides continuous information about the user's hand motion while maintaining accurate pointing functionality, enabling both pointing operations and motion track acquisition simultaneously.
3Measurement precision
If face recognition technology is used to detect user image region and background image region, then the calculation of remote controller coordinates can be improved, but the system complexity increases
Solution Approach 1:
The system utilizes the camera's existing imaging capability to capture both the operating frame and the reference light pattern simultaneously. By processing the relative positional relationship between these two elements within the same image frame, the system achieves accurate coordinate calculation without requiring additional dedicated sensors or complex external equipment. The camera serves multiple functions: capturing the operating frame, capturing the reference light pattern, and providing the data for position calculation.
Data Source
AI summary
There is provided an interactive system, which includes a remote controller. The remote controller is equipped with a camera to capture an operating frame having a user image and a background image therein; and a processing unit to analyze the operating frame to identify a user image section and a background image section within the operating frame corresponding to the user image and the background image respectively, wherein the processing unit generates a movement information of the remote controller according to intensity distributions of the user image section and the background image section.