Direction Detector for Hands-Free User Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current human-machine interfaces for video recording and television systems, such as remote controllers, are inefficient for users who cannot operate them with their hands or are not directly viewing the screen, leading to difficulties in searching, recording, and interacting with content, especially when multitasking or in situations where hands are occupied.

Innovation Solution

An interactive apparatus that includes a speech recognition unit, a response determining unit, and a direction detector to assess the user's viewing direction and distance, adjusting the response output to include both visual and auditory cues based on the user's watching degree, ensuring natural interaction even when hands are busy or the user is not directly viewing the screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a remote controller is used for operating the system, then the interface is simple and easy to manufacture, but the ease of operation deteriorates when hands are occupied or the user cannot directly view the screen

Engineering Contradiction:
Improveinterface simplicityVSAvoidoperation accessibility
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The patent replaces the mechanical remote controller with a speech recognition system. Instead of requiring physical button presses, users can operate the system through voice commands, eliminating the need for hand operation while maintaining interface simplicity through automated speech processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces speech recognition as an intermediary between the user and the system. The speech recognition unit acts as a mediator that converts verbal commands into system instructions, enabling operation without direct physical interaction with the interface

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If speech input is used for operation, then the ease of operation improves for users with occupied hands, but the device complexity increases due to speech recognition and processing requirements

Engineering Contradiction:
Improvehands-free operation capabilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent integrates multiple functions into the interactive apparatus: speech recognition, viewing direction detection, distance detection, and automated response generation. This multi-functionality consolidates what would otherwise require separate devices into a single system, managing complexity through functional integration

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs self-service through automated speech processing and response generation. The speech recognition unit automatically processes user commands, and the response determination unit automatically selects appropriate responses, reducing the need for complex manual interface interactions

Inventive Principle:
Principle #25Self-service

3Loss of information

If the system provides detailed visual responses on the screen, then the information completeness improves, but the usability deteriorates when the user is not directly viewing the screen

Engineering Contradiction:
Improveresponse information completenessVSAvoidusability for non-viewing users
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent adds a temporal dimension to information delivery by providing spoken responses that occur in real-time during the user's viewing period. This complements the visual dimension, ensuring information is delivered whether the user is viewing the screen or not

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system dynamically adjusts its response mode based on detected user behavior. When the user is not viewing the screen, the system prioritizes speech output; when viewing, visual display is emphasized. This dynamic adaptation optimizes usability across different viewing scenarios

Inventive Principle:
Principle #15Dynamics

4Measurement precision

If the system waits for user input to provide responses, then the response accuracy improves, but the loss of time increases during busy periods when the user cannot provide input

Engineering Contradiction:
Improveresponse accuracyVSAvoidresponse time during busy periods
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously monitoring user viewing direction and distance, preparing appropriate responses in advance. This allows the system to respond immediately when the user needs information, without waiting for explicit commands, thereby reducing response time during busy periods

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8738371B2User interactive apparatus and method, and computer program utilizing a direction detector with an electromagnetic transmitter for detecting viewing direction of a user wearing the transmitter
Publication Date: 2014.05.27 TOSHIBA DIGITAL SOLUTIONS CORP
  • US8738371B2 patent drawing
  • US8738371B2 patent drawing
  • US8738371B2 patent drawing

AI summary

A response storage unit stores a response, a watching degree relative to a display unit, and an output form of the response to a speaker and the display unit. An extracting unit extracts a request from a speech recognition result. A response determining unit determines a response based on the extracted request. A direction detector detects a viewing direction based on sensing information received from a transmitter mounted on a user. A watching-degree determining unit determines a watching degree based on the viewing direction. An output controller obtains an output form corresponding to the response and the determined watching degree from the response storage unit, and outputs the response to the speaker and the display unit according to the obtained output form.