Optical Gesture Joystick Control Without Mechanical Fatigue

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional mechanical joysticks suffer from mechanical fatigue due to limited operation gestures, leading to user discomfort during long-term use, as they are designed for specific directional movements and do not effectively read various gestures.

Innovation Solution

A joystick with a deformable bottom surface equipped with an image sensor that captures patterns of dots, allowing for the generation of control signals based on user gestures, including pinching and other motions, thereby eliminating mechanical fatigue and enabling more versatile user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a conventional mechanical joystick uses a solid handle and lever arm mechanism, then it can provide directional control, but it results in mechanical fatigue due to limited gestures and long-term usage

Engineering Contradiction:
Improvegesture varietyVSAvoidmechanical fatigue
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces the mechanical lever arm and trackball system with an optical sensing system. A deformable bottom surface with a pattern replaces the mechanical components, and an image sensor captures pattern deformation to determine gestures. This substitution eliminates mechanical fatigue while enabling diverse gesture recognition including pinching, twisting, and pressing motions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If a mechanical joystick is designed for designated directional movements, then it provides stable control, but it limits the variety of gestures that can be recognized

Engineering Contradiction:
Improvegesture recognitionVSAvoidoperation flexibility
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent employs a deformable bottom surface that can dynamically change shape in response to various user gestures. The pattern on this surface deforms accordingly, allowing the system to capture and distinguish between multiple gesture types such as pinching, twisting, pressing, and sliding motions, thereby providing both adaptability and operational flexibility.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If an image sensor is disposed inside the inner space of the hollow sunken structure, then the pattern can be effectively monitored, but the device complexity increases

Engineering Contradiction:
Improvepattern detectionVSAvoidstructural complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent nests the image sensor within the hollow sunken structure of the body, utilizing the existing internal space. The deformable bottom surface with the pattern is positioned above the image sensor, creating a compact nested arrangement that enables effective pattern monitoring while minimizing additional structural complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution allows for a wide range of gestures to be recognized, enhancing user experience by reducing mechanical fatigue and providing a more intuitive control method without the limitations of traditional joysticks.

Implementation Method 1

identifying characteristics of a plurality of dots on the deformable bottom surface from the received frame, and generating a displayed object control signal for determining whether the joystick is pinched or operated by other gestures according to characteristics of the plurality of dots within the frame

Methodology Applied
Scientific EffectDeformation: Deformation

Data Source

PatentUS11144084B2Control method applied to a joystick
Publication Date: 2021.10.12 PIXART IMAGING INC
  • US11144084B2 patent drawing
  • US11144084B2 patent drawing
  • US11144084B2 patent drawing

AI summary

A joystick has a related control method to provide displayed object control function. The joystick includes a body, an image sensor and a processor. The body has a deformable bottom surface whereon a pattern is disposed. The image sensor is disposed under the body and adapted to capture a frame about the pattern. The processor is electrically connected with the image sensor and adapted to generate a displayed object control signal according to pattern variation within the frame.