Optical Input Detection for Mobile Accessories

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing accessory devices for mobile devices are complex due to the need for circuits to communicate and process information, leading to a need for a simpler structure that can still facilitate user input and processing.

Innovation Solution

An information processing system with an extended input device that uses an image capturing unit and transmission section to transmit data based on user inputs, eliminating the need for electric components to detect user operations, and employing infrared LEDs for accurate input recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional accessory devices use circuits for communication and information processing, then user input and processing functions are achieved, but device structure becomes complex

Engineering Contradiction:
Improveuser input processing capabilityVSAvoidcircuit structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces the conventional electronic circuit-based input detection system with an optical imaging system. Instead of using circuits to detect user inputs, the system uses an image capturing unit to capture images of the input device surface, and a processing unit analyzes these images to detect user inputs. This substitution of mechanical/optical systems for electronic circuits directly resolves the technical contradiction by maintaining input processing functionality while eliminating complex circuit structures from the accessory device.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent employs optical imaging to create a visual copy (image) of the input device surface and user interactions. Instead of directly sensing electrical signals from circuits, the system captures optical information about the surface state and user actions, then processes this copied information to detect inputs. This copying approach allows the system to achieve input detection without requiring complex sensing circuits in the accessory device.

Inventive Principle:
Principle #26Copying

2Measurement precision

If image data is transmitted from the data transmission device to the information processing apparatus, then user input detection is achieved, but data transmission amount increases

Engineering Contradiction:
Improveuser input detection accuracyVSAvoiddata transmission volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential information needed for input detection from the captured image data. Instead of transmitting the complete raw image data, the system processes the images locally to extract feature information such as position, pressure, and contact state, then transmits only this extracted information to the information processing apparatus. This extraction approach maintains detection accuracy while significantly reducing the quantity of data that needs to be transmitted over the communication interface.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs image processing and feature extraction as a preliminary action before data transmission. The data transmission device captures images and pre-processes them to extract relevant input information, so that when data is transmitted to the information processing apparatus, it already contains only the necessary extracted features rather than raw image data. This preliminary processing reduces transmission volume while preserving measurement precision.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system simplifies the structure of the extended input device by using image capture and processing to execute user inputs, reducing data transmission and allowing for various input types without new data formats, while minimizing recognition errors from external light.

Implementation Method 1

an image capturing unit, and a transmission section. The transmission section transmits, to the information processing apparatus, at least data generated based on an image captured by the image capturing unit

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

The light emitting unit is located such that an image thereof is allowed to be captured by the image capturing unit, and emits light, an image of which is allowed to be captured by the image capturing unit in accordance with the user input to, and/or the user operation on, the operation input portion

Methodology Applied
Scientific EffectLight emission: Light Emitting Diode

Data Source

PatentUS10709971B2Information processing system, extended input device, and information processing method
Publication Date: 2020.07.14 NINTENDO CO LTD
  • US10709971B2 patent drawing
  • US10709971B2 patent drawing
  • US10709971B2 patent drawing

AI summary

In a state where an extended input device is secured to a data transmission device, an image capturing unit of the data transmission device captures an image of a light emitting unit that emits light, an image of which is allowed to be captured by the image capturing unit in accordance with a user input and/or a user operation, and data generated based on at least the captured image is transmitted to an information processing apparatus. The information processing apparatus executes an information process based on the transmitted data.