Touch Gesture Mirroring with Semi-Transparent Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for demonstrating touch gestures on touch screens are inadequate for larger audiences, as they often obscure the interaction area and require expensive video cameras, which are impractical for virtual conferences and fail to clearly show the interaction with display elements.

Innovation Solution

A system that detects touch gestures on a touch screen and overlays an animation of semi-transparent fingers performing the gestures onto a mirrored display, allowing viewers to see both the gesture and the screen elements interactively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a document camera is used to demonstrate touch gestures, then the gestures can be shown to a larger audience, but the demonstrator's hand blocks the display elements and the equipment is large and expensive

Engineering Contradiction:
Improveaudience sizeVSAvoiddisplay element visibility
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The system creates a digital copy of the demonstrator's hand gesture and overlays it on the mirrored display. This virtual hand copy allows the audience to see both the gesture and the display elements simultaneously, eliminating the blocking problem while maintaining scalability for large audiences.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The solution transitions from a physical 3D hand blocking the 2D display to a 2D digital overlay of the hand on top of the mirrored display. This dimensional transformation allows the gesture visualization to exist in a different layer, preventing obstruction of underlying display elements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If a document camera is used to demonstrate touch gestures, then the gestures can be shown to a larger audience, but expensive equipment is required

Engineering Contradiction:
Improveaudience sizeVSAvoidequipment cost
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The system replaces the mechanical document camera system with a software-based solution that uses the device's existing display mirroring capabilities. This substitution eliminates the need for expensive external hardware while achieving the same goal of displaying gestures to a larger audience.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The solution utilizes the existing multi-functional capabilities of modern devices (touch screen, display mirroring, animation rendering) to achieve gesture demonstration without requiring specialized equipment. This universal approach works across multiple device types and platforms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Area of stationary object

If conventional mirroring software is used, then the display can be shown on a larger screen, but the touch gestures are not visible

Engineering Contradiction:
Improvedisplay areaVSAvoidgesture visibility
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The system merges the mirrored display content with the gesture animation into a single composite view. By combining these two elements that were previously separate (mirrored screen and gesture demonstration), the solution simultaneously provides both large display area and visible gestures.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The gesture animation is placed in a different visual layer above the mirrored display content. This dimensional separation allows both the full display area and the gesture information to be visible simultaneously without either obscuring the other.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10782787B2Mirroring touch gestures
Publication Date: 2020.09.22 ADOBE INC
  • US10782787B2 patent drawing
  • US10782787B2 patent drawing
  • US10782787B2 patent drawing

AI summary

The present disclosure is directed toward systems and methods that mirror a display on a touch screen as well as touch gestures being performed on the touch screen. For example, systems and methods described herein involve detecting a touch gesture being performed on a touch screen and providing a semi-transparent animation of the touch gesture on a mirrored display. The semi-transparent animation can allow users to view both the mirrored display and the touch gesture animation.