Portable Terminal Music Performance Using Touch Stroke and Infrared Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional portable terminals do not provide a realistic musical instrument playing experience, as they only allow users to press keys to produce music, lacking the tactile and auditory feedback of playing a real instrument.
Innovation Solution
A portable terminal equipped with a touch screen, infrared sensor, microphone, and audio processing unit, allowing users to select and play musical instruments by detecting touch and stroke inputs, which are analyzed to produce corresponding audio signals, mimicking the experience of playing string and brass instruments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional portable terminals use simple key pressing to produce music, then the device complexity is reduced and ease of operation is improved, but the realism of musical instrument playing experience deteriorates
Solution Approach 1:
The patent replaces the mechanical key-pressing system with a touch screen interface that detects touch position and stroke motion. The touch screen captures finger movements across the display area, and the controller analyzes these movements to generate corresponding musical notes, substituting physical mechanical interaction with optical and computational detection methods.
Solution Approach 2:
The patent introduces a controller as an intermediary that processes touch screen input signals and maps them to musical instrument responses. The controller analyzes touch position, stroke motion, and timing to generate appropriate audio output, acting as a mediator between the user's physical gestures and the digital music production.
2Reliability
If portable terminals add multiple sensing units (infrared sensor, microphone, audio processing unit) to enhance music performance function, then the realism of musical instrument playing experience is improved, but the device complexity increases
Solution Approach 1:
The patent makes the touch screen serve multiple functions: it acts as both the display interface and the musical instrument input interface. The same touch screen hardware detects both graphical user interactions and musical performance gestures, eliminating the need for separate specialized input devices and reducing overall system complexity despite enhanced functionality.
Solution Approach 2:
The patent combines multiple sensing capabilities (touch detection, infrared sensing, microphone input, audio processing) into a unified music performance system. The controller integrates signals from all these sources and coordinates them to produce realistic instrument responses, merging what would otherwise be separate subsystems into a cohesive multi-functional platform.
3Reliability
If portable terminals analyze touch position and stroke motion to produce realistic instrument responses, then the realism of musical instrument playing experience is improved, but the measurement precision requirements increase
Solution Approach 1:
The patent implements dynamic response characteristics by analyzing the velocity, acceleration, and timing of touch gestures. The system adjusts musical instrument responses based on the speed and force of strokes, creating realistic articulation and dynamics that mirror actual instrument playing techniques, thereby enhancing realism without requiring ultra-precise static measurements.
Solution Approach 2:
The system provides immediate audio feedback that correlates with the user's touch gestures, creating a closed-loop interaction. The controller continuously monitors touch position and stroke motion and adjusts the musical output in real-time, allowing the user to refine their technique based on the auditory response, which enhances the realism of the playing experience.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to play musical instruments virtually with a realistic feel, allowing for concert-like performances using multiple portable terminals, enhancing the musical experience and providing a more immersive interaction with digital instruments.
Implementation Method 1
a sensing unit for detection of a user's stroke motion by an infrared sensor
Implementation Method 2
an audio processing unit for detection of a user's audio signal input to a microphone
Data Source
AI summary
Disclosed are a portable terminal with a music performance function and a method for playing a variety of musical instruments. The method includes: selecting a particular piece of music and a particular musical instrument from the portable terminal, according to a user request, and executing a music performance mode corresponding to the selected musical instrument; detecting a first input signal input to a screen according to the selected musical instrument in the musical performance mode; determining, if the first input signal is detected, whether a second input signal for executing audio source data is detected; analyzing the first and second input signals, in association with each other; and outputting audio source data of the selected music, according to the analyzed result, via audio signals.