Trackball Orientation Detection Using Image Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in manipulating 3D models on screens using multiple input devices, especially in virtual reality environments where they cannot easily access multiple controllers or devices, leading to inconvenience and discomfort, particularly when handling 3D CAD programs.

Innovation Solution

A sphere-based 3D model controller with latitudinal and longitudinal data tracks on its surface encodes orientation information, using an inertial measurement unit and image sensors to determine absolute orientation, allowing for intuitive manipulation of 3D models with a single device, reducing the need for multiple controllers and minimizing drift issues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple input devices are used to control 3D models, then the control capability is improved, but the device complexity and ease of operation deteriorate

Engineering Contradiction:
Improvecontrol capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple input device functionalities into a single trackball device. The trackball incorporates both rotational movement detection (for positioning) and pressing action detection (for selection), merging the capabilities of multiple devices into one unified controller that can perform both positioning and selection tasks.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The trackball is designed as a universal input device that can perform multiple functions: rotational movement for positioning objects, pressing actions for selecting objects, and potential combination modes. This multi-functional design eliminates the need for separate devices while maintaining comprehensive control capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple input devices are used to control 3D models, then the control capability is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improvecontrol capabilityVSAvoidease of operation
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent combines multiple input device functionalities into a single trackball device. The trackball incorporates both rotational movement detection (for positioning) and pressing action detection (for selection), merging the capabilities of multiple devices into one unified controller that can perform both positioning and selection tasks.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system automatically determines the user's intended action (positioning vs. selection) based on the detected movement pattern without requiring manual mode switching or calibration. The controller adapts to the user's intentions automatically, making operation easier while maintaining full control capability.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If traditional sensors are used for trackball orientation detection, then the measurement capability is improved, but the device complexity and cost increase

Engineering Contradiction:
Improveorientation detection precisionVSAvoidsensor quantity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the orientation detection function from complex traditional sensor systems and implements it using a simpler image sensor-based approach. By capturing images of the trackball's position and analyzing the data tracks, the system achieves orientation detection without requiring multiple complex sensors.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces mechanical or complex electronic sensor systems with an optical imaging system. The image sensor captures visual information of the trackball's position and orientation, and image processing algorithms extract the orientation data, substituting a simpler optical system for complex mechanical sensing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Device complexity

If relative motion detection is used, then the device complexity is reduced, but the reliability deteriorates due to drift issues

Engineering Contradiction:
Improvesensor configurationVSAvoidorientation accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system pre-establishes a coordinate system and references the trackball's absolute position and orientation relative to the base unit. By having a predetermined reference frame and using image-based absolute positioning, the system eliminates drift accumulation that occurs in relative motion detection systems.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously captures images of the trackball and compares its position against the established coordinate system, providing continuous feedback to maintain accurate orientation detection. This closed-loop approach prevents drift by constantly referencing the absolute position rather than accumulating relative movements.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables comfortable and intuitive manipulation of 3D models in CAD software and virtual reality environments by providing a single device that maps sphere orientation directly to model orientation, reducing user fatigue and eliminating the need for calibration, while being cost-effective with fewer required sensors.

Implementation Method 1

the base unit includes a first image sensor adjacent to the trackball to capture images of the data tracks, wherein the captured images of the data tracks include orientation information to determine an absolute orientation of the trackball

Methodology Applied
Scientific EffectInertial measurement: Accelerometer

Implementation Method 2

the base unit includes a first image sensor adjacent to the trackball to capture images of the data tracks

Methodology Applied
Scientific EffectImage capture: Photography

Data Source

PatentUS11099658B2Determining orientation of a trackball
Publication Date: 2021.08.24 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US11099658B2 patent drawing
  • US11099658B2 patent drawing
  • US11099658B2 patent drawing

AI summary

A model controller includes a trackball having a spherical surface with one of latitudinal or longitudinal data tracks formed thereon. The model controller includes a base unit including a first image sensor adjacent to the trackball to capture images of the data tracks, wherein the captured images of the data tracks include orientation information to determine an absolute orientation of the trackball.