Touch-and-Stylus Gesture Mapping for Digital Painting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional digital painting interfaces require users to constantly switch between focusing on their art and managing UI widgets for tasks like cleaning, refilling, and drying brushes, leading to distraction and increased cognitive load, especially as art canvases exceed monitor sizes.

Innovation Solution

Implementing a system that uses realistic brush and tablet stylus gestures to mimic real-world painting actions, allowing users to perform digital painting and image editing tasks with a natural, gesture-based approach, reducing the need for UI widgets by mapping stylus gestures to painting actions such as cleaning, refilling, and drying brushes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional UI widgets are used to control painting functions, then painting functionality is provided, but user cognitive load increases and focus shifts from artwork to interface elements

Engineering Contradiction:
Improveease of painting operationVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the painting canvas and control interface into a single unified workspace. UI widgets for brush control, palette selection, and painting parameters are integrated directly onto the canvas area, allowing users to access all painting functions without switching between separate interface panels and artwork view.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The canvas surface serves multiple functions simultaneously: it acts as both the painting area and the control interface. The same canvas space that displays artwork also contains interactive widgets for brush control, color selection, and parameter adjustment, eliminating the need for separate control panels.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Area of stationary object

If art canvases exceed monitor sizes, then creative freedom increases, but UI widgets often exist off-screen requiring panel manipulation

Engineering Contradiction:
Improvecanvas areaVSAvoidease of interface access
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent transitions from traditional 2D interface panels to a 3D spatial organization where widgets are distributed across the canvas surface. Users can access controls at different locations on the canvas without scrolling or switching panels, effectively utilizing the extended canvas area as a multi-dimensional control space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The interface widgets are merged directly onto the canvas surface rather than being separated into off-screen panels. This integration ensures that all controls remain within the visible canvas area, allowing users to access painting functions without navigating away from their artwork.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If multiple UI panels are provided for brush control, then painting functionality is comprehensive, but user distraction from artwork increases

Engineering Contradiction:
Improvepainting functionalityVSAvoidtime spent managing interface
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

Multiple brush control functions are merged into a single integrated canvas interface. Instead of requiring separate panels for brush selection, color picking, and parameter adjustment, all these controls are combined and distributed across the canvas area, allowing comprehensive painting functionality to be accessed in one unified space.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent extracts the essential painting controls from traditional menu bars and side panels, placing them directly on the canvas where they are most needed. This extraction of key functions from peripheral interfaces to the central workspace reduces the time users spend navigating between separate control areas.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9710097B2Methods and apparatus for natural media painting using touch-and-stylus combination gestures
Publication Date: 2017.07.18 ADOBE INC
  • US9710097B2 patent drawing
  • US9710097B2 patent drawing
  • US9710097B2 patent drawing

AI summary

Systems and methods for providing a natural media painting application may receive user inputs through tablet stylus gestures, including gestures that are proximity-based and/or context sensitive. The system may also receive user inputs through the touch of a stylus and/or a user touch on a tablet device. Various digital painting and image editing tasks may be invoked and/or controlled using such inputs in response to detecting and recognizing the stylus gestures. Various gestures defined by a combination of touch and stylus manipulation may be mapped to functions or modes of the application. A touch-and-stylus gesture may be used to invoke a change in the work mode, such as an automatic zoom mode, automatic panning mode, steady detail work mode, or snap to grid mode. A touch-and-stylus gesture may trigger adaptation of one or more parameters of the application to assist a user in performing a detected painting operation in progress.