Touchless Mobile Workflows Using Context-Aware Audio Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional mobile devices face inefficiencies in user input due to small screen size and limitations in speech recognition, particularly in processing audio input for specific tasks beyond basic functionalities and context-dependent applications.
Innovation Solution
Integration of audio input capabilities with natural language processing (NLP) technology into mobile applications to facilitate context-dependent processing and business workflows, allowing for touchless input and output operations without relying on tactile feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If speech recognition technology is used for audio input, then input convenience is improved, but accuracy deteriorates due to inability to process context-dependent applications
Solution Approach 1:
The patent introduces an intermediary processing layer between audio input and application execution. The mobile device captures audio input, processes it through context-aware algorithms that analyze the current application state and user intent, and then executes appropriate commands. This intermediary layer resolves the contradiction by maintaining speech recognition convenience while improving accuracy through contextual understanding.
Solution Approach 2:
The system dynamically changes processing parameters based on context. When audio input is received, the device adjusts sensitivity thresholds, activation keywords, and command interpretation rules according to the current application context. This allows the same speech recognition technology to achieve high accuracy across different applications by adapting its parameters rather than requiring different technologies for each context.
2Measurement precision
If tactile input methods are used, then input accuracy is improved, but input time increases due to small screen size
Solution Approach 1:
The patent replaces the mechanical tactile input system (touching small screen keys) with an acoustic input system (speaking commands). This substitution eliminates the time penalty associated with navigating small touchscreen interfaces while maintaining or improving input accuracy through context-aware speech processing. The mechanical interaction is replaced by voice-based interaction that can be processed more quickly.
Solution Approach 2:
The system transitions from two-dimensional touchscreen interaction to three-dimensional spatial audio processing. By incorporating directional microphone arrays and spatial audio analysis, the device can distinguish between different speakers and directions, adding dimensional context that improves input accuracy without requiring more screen space or time.
3Adaptability or versatility
If context-dependent processing is implemented, then application versatility is improved, but device complexity increases
Solution Approach 1:
The patent implements a universal context-processing engine that can handle multiple applications and contexts through a single integrated system. Rather than requiring separate context-processing modules for each application, the device uses a unified framework that adapts to different applications by analyzing their specific context requirements. This universal approach achieves high versatility while minimizing the increase in device complexity through code reuse and standardized processing pipelines.
Data Source
AI summary
Computer program products for performing workflows using a mobile device, without requiring tactile input from the user. The workflow is thus “touchless” and may utilize input preferably including optical data and/or audio data. Tactile input may be optionally provided in some embodiments, but the workflow is configured to be performed without any tactile input. Accordingly, in one embodiment, a computer program product includes a computer readable medium having computer readable and/or executable program instructions embodied therewith, the program instructions being configured to cause a processor to: invoke a mobile application using a mobile device; receive auditory input via the mobile device; and perform a business workflow via the mobile application based on the auditory input. Corresponding systems and computer program product embodiments configured for touchless mobile workflows are also described.