Signal Processing Device with Extracted Action Timing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Performing actions in ensemble performances, such as playing a musical instrument, is challenging due to difficulties in synchronizing actions with appropriate timings without knowing the exact timing of these actions.
Innovation Solution
A signal processing device and system that includes an electronic controller to receive and generate time-series data, synchronizing sound and video signals to match human action timings, allowing users to perform actions in sync with desired timings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If time-series sound data is transmitted for ensemble performance, then users can participate in remote performances, but users cannot determine the appropriate timing for their actions
Solution Approach 1:
The patent introduces an intermediary system (signal processing device) that extracts action timing information from sound data and generates separate timing data. This intermediary process separates the timing information from the raw sound data, allowing users to receive both the sound data and the extracted timing data to synchronize their actions appropriately.
Solution Approach 2:
The patent extracts the essential timing information from the complete sound data stream. The signal processing device analyzes the sound data to identify and extract action timing points, then outputs this extracted timing information as separate data, allowing users to focus on timing without processing the entire sound stream.
2Loss of information
If complete sound data is transmitted to indicate timing, then users can know action timings, but communication data volume and delays increase
Solution Approach 1:
The patent extracts only the essential timing information from the complete sound data. Instead of transmitting or processing entire sound segments to convey timing, the system extracts specific timing data points that indicate when actions should occur, dramatically reducing the data volume while preserving timing accuracy.
Solution Approach 2:
The patent transforms the sound data from its original continuous waveform form into discrete timing parameter data. By converting the continuous sound signal into specific timing parameters (when actions occur), the system reduces data volume while maintaining the essential timing information needed for synchronized performance.
Data Source
AI summary
A signal processing device includes an electronic controller including at least one processor. The electronic controller is configured to execute a reception unit, a generation unit, and a processing unit. The reception unit is configured to receive first time-series data that include sound data, and second time-series data that are generated based on the first time-series data and that include at least data indicating a timing of a human action. The generation unit is configured to generate, based on the second time-series data, third time-series data notifying of the timing of the human action. The processing unit is configured to synchronize and output an output signal based on the first time-series data and an output signal based on the third time-series data, such that the timing of the human action for the first time-series data and the timing of the human action for the third time-series data match.