Remote Controller Pointer Alignment via Camera Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional pointing devices using relative pointing methods often result in a mismatch between the remote controller's pointing direction and the pointer position on the display, requiring users to reset the standard direction, which decreases usage convenience and natural interaction.

Innovation Solution

An image display apparatus that automatically adjusts the pointing direction of a remote controller to match the pointer position on the screen by using a camera to detect the remote controller's direction and posture, allowing the standard direction to be aligned with the screen center without user intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a relative pointing method is used to calculate pointer position based on posture angle variation, then the remote controller can operate without complex calibration, but the pointer position on the display becomes mismatched with the remote controller's pointing direction

Engineering Contradiction:
Improveoperation convenienceVSAvoidpointing accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system uses a camera to capture images of the remote controller and provides feedback on its actual position and orientation. This feedback is used to calculate the relationship between the remote controller's physical position and the pointer position on the display, enabling automatic standard direction adjustment to maintain accurate pointing.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces the mechanical sensor-based pointing method with an optical system using a camera and image processing. Instead of relying on motion sensors to track remote controller movement, the system uses visual recognition to determine the remote controller's position and orientation, then maps this to the appropriate pointer position on the display.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If the standard direction is fixed to match the screen center, then the pointer positioning is simple, but the pointing direction mismatches when the remote controller position changes

Engineering Contradiction:
Improvesystem complexityVSAvoidnatural usage feeling
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system dynamically adjusts the standard direction based on the remote controller's actual position and orientation detected by the camera. Instead of maintaining a fixed standard direction, the system adapts the reference direction to match the remote controller's current state, ensuring the pointer always aligns with the intended pointing direction regardless of remote controller position.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If automatic standard direction adjustment is implemented using camera detection, then the pointing accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvepointer placement accuracyVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The camera serves multiple functions: it detects the remote controller's position, determines its orientation, and enables the calculation of the relationship between physical position and display coordinates. This multi-functional use of a single component achieves high pointing accuracy without requiring separate sensors for each measurement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3054693B1Image display apparatus and pointing method for same
Publication Date: 2019.12.25 SAMSUNG ELECTRONICS CO LTD
  • EP3054693B1 patent drawingFigure 1
  • EP3054693B1 patent drawingFigure 2
  • EP3054693B1 patent drawingFigure 3

AI summary

An image display apparatus that automatically adjust a pointing direction of a remote controller to almost match with a position of a pointer on a screen, and a pointing method performed by the image display apparatus are provided. The image display apparatus includes a reference angle detector configured to detect a reference angle formed by the pointing direction of the remote controller with respect to a reference direction set for a display; a remote control direction detector configured to detect a remote control direction which is a direction in which the remote controller is viewed, from a reference point set on the display; and a standard direction adjuster configured to adjust a standard direction set in the remote controller so that the standard direction reaches the reference point on the display as viewed from the remote controller, based on the reference angle and the remote control direction.