Input Device Tilt Notification for Marker Detection Failure

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing input devices, such as those using CCD cameras, fail to notify users when the pointing position is outside the screen, especially when the image of markers cannot be captured, leading to incomplete user feedback and potential errors in game or interactive applications.

Innovation Solution

An information processing apparatus and program that utilizes an image capturing device and a motion detecting means, like an acceleration sensor, to calculate the tilt of the input device, allowing for user notification of pointing position deviations even when the marker image is not captured, by executing tilt calculating, determination, and notification steps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the image capturing device is used to calculate pointing position, then the pointing position can be determined, but when the marker image is not captured, the determination cannot be executed and user notification is unavailable

Engineering Contradiction:
Improvepointing position determinationVSAvoiduser feedback availability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces tilt calculation as an intermediary method to bridge the gap between image capturing failure and user notification. When the image capturing device fails to capture marker images, the tilt calculation unit uses acceleration sensor data to compute tilt values, which serve as a substitute for direct pointing position determination, enabling continuous user feedback even without visual marker detection

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary tilt calculation using acceleration sensor data before relying on image capturing. By having the tilt calculation mechanism ready and using acceleration data that is continuously available, the system prepares alternative determination methods in advance, ensuring that user notification can proceed without interruption even when marker images are not captured

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If only marker image capture is used for pointing position calculation, then the system structure remains simple, but the system cannot provide feedback when markers are not detected

Engineering Contradiction:
Improvesystem structureVSAvoidpointing position feedback
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The input device is designed with multi-functionality by integrating both image capturing means and motion detecting means. The same input device structure serves dual purposes: capturing marker images for precise pointing position determination and detecting device tilt for alternative positioning when images are unavailable. This universal design ensures continuous feedback capability without significantly increasing structural complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces the purely optical/image-based pointing determination with a hybrid approach that incorporates mechanical sensing through acceleration sensors. When image capturing fails, the mechanical tilt detection system substitutes for the optical system, providing pointing position feedback through physical sensor data rather than visual marker recognition

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables user notification of pointing position deviations from the screen, improving user interaction by providing feedback on correct orientation, even when markers are not detected, thus enhancing operational accuracy and user experience.

Implementation Method 1

a motion detecting means (acceleration sensor 37) for detecting a motion of the input device... calculates a tilt value (t) indicating a tilt of the input device using a result (acceleration data 62) of detection by the motion detecting means

Methodology Applied
Scientific EffectGravitation: Gravitation

Data Source

PatentEP1946806B1Information processing apparatus and storage medium storing information processing program
Publication Date: 2019.10.02 NINTENDO CO LTD
  • EP1946806B1 patent drawingFigure 1
  • EP1946806B1 patent drawingFigure 2
  • EP1946806B1 patent drawingFigure 3~4

AI summary

An information processing apparatus can communicate with an input device comprising an image capturing means for capturing an image of a target object, and calculates a pointing position on a screen of a display device based on the image captured by the image capturing means. The input device comprises a motion detecting means for detecting a motion of the input device. The information processing apparatus calculates a tilt value indicating a tilt of the input device using a result of detection by the motion detecting means. It is determined whether or not the pointing position can be calculated based on the image captured by the image capturing means. When it is determined that the pointing position cannot be calculated, the calculated tilt value is compared with a predetermined reference value. The user is notified of information about the tilt of the input device, depending on a result of the comparison.