Spreadsheet Gesture Recognition for Touch Interface Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current spreadsheet applications on touch or motion-sensing devices do not effectively utilize natural gestures for interaction, limiting productivity and efficiency in data manipulation and organizational tasks.

Innovation Solution

Implementing a variety of touch-based gestures such as pull-apart, touch-and-slide, drag-and-drop, and pinch-and-turn to enable users to interact with spreadsheet documents for structural and display changes, including inserting, deleting, and navigating columns and rows, as well as extending functionalities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch-based gestures are implemented for spreadsheet interaction, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically detects and interprets touch gestures without requiring explicit command selection. The gesture recognition system self-services by converting natural touch movements directly into spreadsheet operations, eliminating the need for users to navigate complex menus or learn specialized input techniques.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces traditional mechanical input methods (mouse clicks, keyboard shortcuts) with touch-based gesture recognition. This substitution allows users to interact with the spreadsheet using natural finger movements on the touchscreen surface, improving ease of operation while the software handles the complexity of gesture interpretation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If natural gestures are added for data manipulation, then productivity is improved, but device complexity increases

Engineering Contradiction:
ImproveproductivityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The gesture recognition system serves multiple functions: navigation, selection, data manipulation, and formatting. A single gesture interface replaces what would otherwise require multiple separate tools and commands, improving productivity by allowing users to perform diverse spreadsheet operations through natural gestures without adding proportional complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple spreadsheet operations into unified gesture sequences. For example, a continuous drag gesture can simultaneously select multiple cells, apply formatting, and trigger calculations, merging several discrete operations into a single intuitive action that enhances productivity while managing system complexity.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If gesture-based navigation is implemented, then ease of operation is improved, but loss of time occurs during gesture recognition processing

Engineering Contradiction:
Improveease of operationVSAvoidloss of time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary gesture recognition and validation as users begin their touch movements, providing real-time feedback about intended actions. This preliminary processing allows the system to prepare execution commands in advance, reducing the time loss between gesture completion and action execution while maintaining ease of operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The gesture recognition system uses threshold-based detection that allows users to complete gestures quickly without requiring precise, slow movements. The system skips detailed analysis for obvious, clear gestures and only performs deeper processing when ambiguity exists, reducing overall processing time while maintaining accuracy for common operations.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentUS11699031B2Natural quick function gestures
Publication Date: 2023.07.11 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11699031B2 patent drawing
  • US11699031B2 patent drawing
  • US11699031B2 patent drawing

AI summary

Natural gestures for interacting with spreadsheet documents are provided. A user may interact with a spreadsheet document using a variety of touch-based gestures. Gestures applied to a spreadsheet document may be used for making structural and display changes to the document. For example, gestures may be used on the spreadsheet document for inserting new columns and rows; for revealing hidden columns and rows; for deleting columns and rows; for extending functionalities across columns and rows; for moving objects displayed in a spreadsheet document; and for navigating various parts of a spreadsheet document.