Multimedia Controller Position Tracking via Sensor Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of multimedia apparatuses face challenges in determining and re-entering the recognizable range of the camera's field of view, leading to difficulties in controlling the device when outside the angle-of-view range, as they cannot visually ascertain their position and may struggle to move back within the range effectively.

Innovation Solution

A method and apparatus that utilize sensor information from a controller to estimate its location when outside the recognizable range and provide guidance information to the user through a multimedia system, including a camera, image processor, control unit, and display unit, to help them re-enter the viewing range by acquiring sensor data and outputting directional cues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If vision-based recognition methods are used to control electronic systems, then the system can recognize user movement, but the user cannot determine their position relative to the camera's angle-of-view range

Engineering Contradiction:
Improveuser position detectionVSAvoiduser awareness of position
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system provides visual feedback by displaying the camera's angle-of-view range on the screen and showing the user's detected position within that range. When the user moves outside the recognizable range, the system displays guidance information indicating the direction to move back into range, enabling the user to understand and adjust their position relative to the camera.

Inventive Principle:
Principle #23Feedback

2Reliability

If the user moves outside the angle-of-view range, then the system cannot recognize the user's movement, but the user has no guidance on how to move back within the range

Engineering Contradiction:
Improvemovement recognitionVSAvoiduser guidance
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system displays real-time feedback showing whether the user is within the angle-of-view range and provides directional guidance when outside the range, enabling the user to move back into the recognizable area and restore reliable movement recognition.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If direct input through a specific input unit is used, then the control is precise, but the user interface lacks versatility for different control methods

Engineering Contradiction:
Improveinput methodVSAvoidcontrol accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system implements multiple input methods including vision-based recognition for gesture control and traditional direct input through input units. This multi-functional approach allows users to choose different control methods based on their needs, enhancing versatility while maintaining control accuracy through the precision of direct input when required.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2708982B1Method for guiding the user of a controller of a multimedia apparatus to move within recognizable range of the multimedia apparatus, the multimedia apparatus, and target tracking apparatus thereof
Publication Date: 2019.09.11 SAMSUNG ELECTRONICS CO LTD
  • EP2708982B1 patent drawingFigure 1~2
  • EP2708982B1 patent drawingFigure 3
  • EP2708982B1 patent drawingFigure 4A

AI summary

Methods, systems, and devices for guiding a subject back within the recognizable visual range of a multimedia system are described. According to one of the described methods, when it is determined that the target has left the recognizable range of the multimedia system, sensor information is acquired from a portable electronic device (or controller) the user has been using to control the multimedia system, and the acquired sensor information is used to determine where the user is, relative to the recognizable range. In one example, the user is asked to make a gesture with the portable electronic device, and the sensor information concerning that gesture is used to determine the user's relative location. In another example, the sensor information recorded at the time the user left the recognizable range is used to determine the user's relative location.