Gesture Translation Layer for Image Filter Input Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Complex image processing routines on portable electronic devices, such as graphically intensive image filters, pose challenges for client software applications in interpreting and processing user interactions and device inputs due to the complexity of inputs and logical considerations.

Innovation Solution

Implementing a programmatic interface that maps user interactions, such as gestures, to input parameters of image processing routines through a gesture translation layer, allowing client applications to pass relevant information without needing to handle logical operations, and using device inputs like orientation and sensors to apply image filters in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If complex image processing routines are implemented on portable electronic devices, then image processing capabilities are improved, but client software applications become difficult to interpret and process user interactions correctly

Engineering Contradiction:
Improveimage processing capabilitiesVSAvoidcomplexity of inputs and logical considerations
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a gesture translation layer as an intermediary component between the client software application and the image processing routines. This layer receives gestures from the user interface, translates them into appropriate input parameters for image processing routines, and handles the complexity of coordinate transformations and device orientation adjustments. The client application only needs to pass gestures to this layer without needing to understand the complex mapping logic, thus resolving the contradiction between enhanced image processing capabilities and software interpretation difficulty.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the number of image processing functions is increased, then device functionality is improved, but user interface design becomes more challenging

Engineering Contradiction:
Improvedevice functionalityVSAvoiduser interface design
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The gesture translation layer serves as a universal interface that handles multiple image processing functions through a common mechanism. Whether the user wants to apply filters, adjust exposure, or perform focus operations, the same gesture translation infrastructure is used to map user interactions to the appropriate input parameters. This multi-functional approach allows the device to offer numerous image processing capabilities while maintaining a consistent and simple user interface design paradigm.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Speed

If real-time image filtering is implemented, then processing speed is improved, but computational requirements increase

Engineering Contradiction:
Improvereal-time processingVSAvoidcomputational requirements
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by pre-translating gestures into input parameters before the actual image processing occurs. The gesture translation layer prepares the parameter mappings in advance based on the selected image processing routine and current device state, so that when real-time filtering is needed, the computational work has already been partially done. This preliminary parameter preparation reduces the computational burden during real-time execution while maintaining processing speed.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11481096B2Gesture mapping for image filter input parameters
Publication Date: 2022.10.25 APPLE INC
  • US11481096B2 patent drawing
  • US11481096B2 patent drawing
  • US11481096B2 patent drawing

AI summary

This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.