Head-Mountable Display Gesture Navigation and Cropping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current head-mounted displays (HMDs) lack intuitive navigation and editing capabilities, particularly in three-dimensional spaces, making it difficult for users to efficiently interact with and manipulate objects within a Z-axis oriented display (ZAOD) environment.

Innovation Solution

A head-mountable device (HMD) configured with a hand-movement input device that receives head-movement and hand-movement data to pan and zoom objects on a display, allowing users to activate a cropping mode and generate a cropped image of viewable objects for further operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional navigation methods are used on HMDs, then the display can show information, but the ease of operation deteriorates due to lack of intuitive interaction in 3D space

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical input devices (buttons, knobs, joysticks) with natural body movements (head gestures, hand gestures) to control the display. Head movements control panning and zooming, while hand gestures enable object selection and navigation in 3D space, making the interface more intuitive and easier to operate.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent extends the traditional 2D display interface to a 3D interactive environment. Users can navigate through depth (Z-axis), rotate objects in 3D space, and interact with virtual objects positioned at different distances, adding a third dimension to the user interaction model.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If detailed object manipulation is enabled, then the functionality improves, but the device complexity increases due to multiple navigation and editing modes

Engineering Contradiction:
ImprovefunctionalityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal gesture-based control system where a single hand gesture input device can perform multiple functions including panning, zooming, object selection, navigation, and editing operations. This multi-functional approach reduces the need for separate controls for each function while maintaining high versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adapts its behavior based on the current view and user actions. The interface automatically adjusts navigation options, display parameters, and interaction modes according to the user's position in 3D space and the object being viewed, providing appropriate functionality without requiring manual mode switching.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If cropping mode is added for image manipulation, then the versatility improves, but the ease of operation may worsen due to additional interface requirements

Engineering Contradiction:
ImproveversatilityVSAvoidease of operation
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent merges the cropping function with the existing gesture-based navigation system. Users perform cropping operations using the same hand gestures already familiar from navigation, combining multiple functions (navigation and cropping) into a unified interaction paradigm rather than adding separate controls.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system provides automated cropping based on user gestures. When users perform zooming or panning gestures, the system automatically identifies the region of interest and prepares cropped images, reducing the need for manual cropping operations and simplifying the user interface.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9811154B2Methods to pan, zoom, crop, and proportionally move on a head mountable display
Publication Date: 2017.11.07 GOOGLE LLC
  • US9811154B2 patent drawing
  • US9811154B2 patent drawing
  • US9811154B2 patent drawing

AI summary

Methods, apparatus, and computer-readable media are described herein related to displaying and cropping viewable objects. A viewable object can be displayed on a display of a head-mountable device (HMD) configured with a hand-movement input device. The HMD can receive both head-movement data corresponding to head movements and hand-movement data from the hand-movement input device. The viewable object can be panned on the display based on the head-movement data. The viewable object can be zoomed on the display based on the hand-movement data. The HMD can receive an indication that navigation of the viewable object is complete. The HMD can determine whether a cropping mode is activated. After determining that the cropping mode is activated, the HMD can generate a cropped image of the viewable object on the display when navigation is complete.