Automated Haptic Event Generation from Audio Signals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for converting music files into haptic effects require human intervention, which is a constrained resource and inefficient, as they rely on manual analysis and design to select features for haptic effects generation.
Innovation Solution
A method for automatically converting audio files into haptic effects by calculating event scores, designating haptic events, and outputting them to actuators, using structured representation sequences and actuator limitations to ensure synchronized and pleasing haptic experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual conversion methods are used, then haptic effects can be designed with human judgment and creativity, but the process is time-consuming and inefficient
Solution Approach 1:
The system enables self-service by automatically analyzing audio files and generating haptic effect sequences without requiring human designers. The automated algorithm processes audio data, identifies musical events, and synthesizes corresponding haptic patterns, allowing the system to serve itself rather than requiring human intervention for each conversion task.
Solution Approach 2:
The patent replaces the mechanical human-based conversion process with an automated computational system. Instead of human designers manually analyzing audio and creating haptic effects, the system uses digital signal processing, pattern recognition algorithms, and computer-generated music theory analysis to automatically produce haptic sequences from audio files.
2Productivity
If automated conversion is implemented, then efficiency is improved, but the complexity of the system increases
Solution Approach 1:
The system segments the complex conversion process into distinct manageable modules: audio file processing, musical event detection, haptic pattern generation, and actuator control. Each module handles a specific aspect of the conversion, making the overall complex system more manageable and easier to implement through standardized processing stages.
Solution Approach 2:
The patent employs parameter changes by transforming audio parameters (frequency, amplitude, timing) into corresponding haptic parameters (vibration frequency, intensity, duration). The system maps musical parameters to tactile sensations through configurable transformation rules, allowing flexible conversion between audio and haptic domains without requiring complex custom algorithms for each parameter type.
3Adaptability or versatility
If human designers manually select audio features, then haptic effects can be tailored to specific musical interpretations, but the process is resource-constrained
Solution Approach 1:
The system introduces dynamics by allowing flexible, adaptive haptic effect generation that responds to different audio inputs in real-time. Rather than static manual design, the automated system dynamically analyzes the audio file's structure, rhythm, and musical events, then generates corresponding haptic patterns that adapt to the specific characteristics of each audio file, maintaining customization capability while eliminating design time constraints.
Data Source
AI summary
In an embodiment, a system and method for automatically converting a plurality of events in a plurality of channels in a structured representation sequence into haptic events. The method comprises calculating an event score for each event of the sequence in one or more channels. The method also comprises calculating a cumulative score based on the event scores in the one or more channels. The method includes selectively designating haptic events to the events based on the event scores in one or more selected channels, wherein the haptic events are output by a haptic actuator.