Headset Computer Control via Voice, Gesture, and Head Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional small, portable electronic devices face limitations in replicating the visual experience of high-resolution, large format displays due to physical size constraints, and existing headset computers lack effective control methods beyond traditional interfaces.

Innovation Solution

A headset computer that incorporates a microdisplay, head tracking accelerometers or cameras, and audio processing circuits to detect voice, head motion, and hand gesture inputs, allowing users to navigate and control a 3-D virtual space, and optionally control remote devices or vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a large format display is used to provide high-resolution visual experience, then display quality is improved, but device portability and wearability deteriorate

Engineering Contradiction:
Improvedisplay resolutionVSAvoiddevice size
Core Design Contradiction:
Measurement precisionVSVolume of moving object

Solution Approach 1:

The patent transitions from a traditional 2D flat display to a 3D volumetric display space. The system creates a three-dimensional virtual environment where graphical objects can be positioned and viewed from multiple angles, effectively adding a depth dimension to the display. This allows high-resolution visualization without requiring a physically large display surface, as the 3D space provides additional viewing real estate.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a head-mounted display device as an intermediary between the user and the large format display content. The HMD captures and processes visual information, then presents it to the user in a compact form factor. This intermediary device bridges the gap between the desire for large format high-resolution displays and the need for portability, allowing users to access large display content while wearing a compact device.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If traditional control interfaces are used in headset computers, then device complexity is reduced, but ease of operation deteriorates due to limited control methods

Engineering Contradiction:
Improvecontrol convenienceVSAvoidcontrol system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a multi-functional control system that integrates multiple input modalities into a single unified interface. The system can process voice commands, hand gestures, and head movements simultaneously, allowing the same device to perform diverse control functions without requiring separate specialized interfaces. This universal control approach enhances ease of operation while managing complexity through integrated processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The control system utilizes the user's natural body movements and voice as self-service input mechanisms. Instead of requiring the user to learn and operate external control devices, the system directly captures and interprets the user's natural gestures, head movements, and speech patterns. This self-service approach simplifies the interaction model, making the system more intuitive and easier to operate without adding significant complexity.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If multiple input devices are added to detect voice, head motion, and hand gestures, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveinput method versatilityVSAvoidsensor system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing functions into an integrated sensor system within the head-mounted display. Rather than implementing separate independent systems for voice recognition, head tracking, and gesture detection, the patent merges these functions into a unified sensor platform that processes multiple input types through a common architecture. This merging approach reduces overall system complexity while maintaining input versatility.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The control system utilizes the user's natural body movements and voice as self-service input mechanisms. Instead of requiring the user to learn and operate external control devices, the system directly captures and interprets the user's natural gestures, head movements, and speech patterns. This self-service approach simplifies the interaction model, making the system more intuitive and easier to operate without adding significant complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables hands-free navigation and control of large format 3-D spaces and remote devices, providing synthetic vision capabilities and efficient control of remote vehicles through voice, head motion, and hand gesture inputs, enhancing usability and functionality in various environments.

Implementation Method 1

head tracking accelerometer to detect movements such as head movements

Methodology Applied
Scientific EffectAcceleration: Accelerometer

Implementation Method 2

camera to detect movements such as head movements, hand motions and/or gestures

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS11237594B2Headset computer that uses motion and voice commands to control information display and remote devices
Publication Date: 2022.02.01 KOPIN CORP
  • US11237594B2 patent drawing
  • US11237594B2 patent drawing
  • US11237594B2 patent drawing

AI summary

A wireless hands-free portable headset computer with a micro display arranged near but below a wearer's eye in a peripheral vision area not blocking the wearer's main line of sight. The headset computer can display an image or portions of an image, wherein the portions can be enlarged. The headset computer also can be equipped with peripheral devices, such as light sources and cameras that can emit and detect, respectively, visible light and invisible radiation, such as infrared radiation and ultraviolet radiation. The peripheral devices are controllable by the wearer by voice command or by gesture. The headset computer also can be broken down into component parts that are attachable to another article worn by an individual, such as a helmet or respirator mask.