3D Menu System Using Hexahedral Manual Tools

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional two-dimensional menu systems are inadequate for three-dimensional environments due to spatial limitations, and existing three-dimensional menu systems face challenges with expensive equipment, limited display numbers, and one-dimensional input methods, making them unsuitable for complex systems.

Innovation Solution

A three-dimensional menu system utilizing hexahedral manual operation tools with magnets and buttons, equipped with a tracking unit, menu organizing unit, and rendering unit, which acquires images, tracks tool positions, organizes menu items, and outputs them to a display device, allowing for efficient hierarchical menu control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional two-dimensional menu systems are used, then implementation is simple and cost-effective, but they are inadequate for three-dimensional environments due to spatial limitations

Engineering Contradiction:
Improveadaptability to three-dimensional environmentVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional menu interfaces to three-dimensional menu systems by placing menu items in spatial positions around the user in virtual space. The system uses head-tracking technology to dynamically position menu items relative to the user's head orientation, enabling natural three-dimensional interaction without requiring complex specialized input devices.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If existing three-dimensional menu systems use expensive equipment like pinch gloves, then menu selection functionality is achieved, but commercialization for end users becomes difficult

Engineering Contradiction:
Improvemenu selection capabilityVSAvoidcommercialization feasibility
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

Instead of requiring expensive specialized input devices like pinch gloves, the system uses a standard game controller as a substitute. The game controller's directional pad and buttons are mapped to three-dimensional menu navigation functions, providing equivalent functionality while using mass-market, affordable hardware that is already familiar to users.

Inventive Principle:
Principle #26Copying

3Ease of operation

If hierarchical three-dimensional menu systems use limited displays and one-dimensional input methods, then rotational input control is achieved, but the number of displays is limited and input method is restricted

Engineering Contradiction:
Improverotational input controlVSAvoidinput method flexibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system makes the single game controller serve multiple functions by mapping different input mechanisms to various menu navigation tasks. The directional pad handles horizontal and vertical menu traversal, while the buttons execute selections and confirmations. This multi-functional design eliminates the need for multiple specialized input devices while maintaining versatile control capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Difficulty of detecting and measuring

If one marker corresponds to one function in augmented-reality menu systems, then marker-based interaction is achieved, but application to complicated systems becomes difficult

Engineering Contradiction:
Improvemarker-based interactionVSAvoidapplicability to complicated systems
Core Design Contradiction:
Difficulty of detecting and measuringVSAdaptability or versatility

Solution Approach 1:

Instead of using a single marker to represent one function, the system segments the interface by placing multiple distinct menu items in different spatial positions around the user. Each menu item is visually distinct and positioned according to the user's head orientation, allowing complex systems to be broken down into manageable, spatially-separated functional categories that can be browsed and selected independently.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables effective control of three-dimensional menus using hexahedral manual operation tools, providing a cost-effective and intuitive method for navigating complex systems by adding menu items around the tools in a three-dimensional space.

Implementation Method 1

an image acquisition device configured to acquire images from the manual operation tools

Methodology Applied
Scientific EffectImage acquisition: Photography

Implementation Method 2

A marker may be provided on each surface of the hexahedral manual operation tools, and the tracking unit may track the marker in the acquired images so as to track the manual operation tools

Methodology Applied
Scientific EffectMarker tracking: Photogrammetry

Implementation Method 3

The manual operation tools may include at least two hall sensors between two neighboring auxiliary magnets of the auxiliary magnets. A hall sensor detecting unit may be disposed in the manual operation tools to detect outputs of the hall sensors.

Methodology Applied
Scientific EffectHall effect: Hall Effect

Data Source

PatentUS9218062B2Three-dimensional menu system using manual operation tools
Publication Date: 2015.12.22 INTELLECTUAL DISCOVERY CO LTD
  • US9218062B2 patent drawing
  • US9218062B2 patent drawing
  • US9218062B2 patent drawing

AI summary

Disclosed is an augmented reality-based three-dimensional menu system using manual operation tools. According to the present invention, the three-dimensional menu system comprises: a display device; at least one pair of manual operation tools which are manually operated by the user, and are in a hexahedral shape; an image acquisition device which acquires images for the manual operation tools; and a menu augmentation unit which tracks the manual operation tools from the acquired images, and augments menu items in the vicinity of the manual operation tools of the acquired images, thereby outputting the augmented menu items to the display device.