Composite Audio Visualization Merging Spectrogram and Waveform

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio data visualization methods require users to switch between different visual representations, such as frequency spectrograms and amplitude waveforms, to analyze and edit audio data, leading to inefficiencies in identifying editing parameters and effects, and wasting display space.

Innovation Solution

A system and method that combines a frequency spectrogram and an amplitude waveform into a composite image, allowing both representations to be displayed simultaneously, with the amplitude waveform represented as an outline or fully visible, sharing a common time axis, enabling users to view and edit audio data more effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple visual representations are displayed separately, then each representation can be clearly viewed, but display space is wasted and users must switch between displays

Engineering Contradiction:
Improvevisibility of audio data featuresVSAvoiddisplay space
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The patent combines multiple visual representations (frequency spectrogram and amplitude waveform) into a single composite display area. The frequency spectrogram and amplitude waveform are rendered simultaneously in the same spatial region, allowing users to view both representations without switching between separate displays, thereby maximizing display space utilization while maintaining visibility of all audio data features.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses layered overlay in the visual dimension to display multiple representations. By rendering the amplitude waveform as a transparent or semi-transparent overlay on top of the frequency spectrogram (or vice versa), the system effectively utilizes the z-dimension (depth/transparency) to accommodate multiple visual representations in the same two-dimensional display space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If users switch between different visual representations, then they can analyze different features, but time is lost and editing efficiency decreases

Engineering Contradiction:
Improveaccess to audio data featuresVSAvoidtime to switch displays
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

By merging multiple visual representations into a single composite display, the patent eliminates the need for users to switch between separate displays or views. Both the frequency spectrogram and amplitude waveform are continuously visible simultaneously, allowing immediate access to different audio data features without any time loss associated with switching operations.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of manufacture

If separate displays are used for different representations, then each can be optimized independently, but editing accuracy decreases due to wasted display space

Engineering Contradiction:
Improveindependent display optimizationVSAvoidediting accuracy
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent merges multiple visual representations into a unified composite display that maximizes the use of available display space. This unified approach allows for precise identification of editing points and effects by presenting all relevant visual information within the same optimized display area, eliminating the wasted space that occurs when multiple separate displays are used.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9241229B2Visual representation of audio data
Publication Date: 2016.01.19 ADOBE INC
  • US9241229B2 patent drawing
  • US9241229B2 patent drawing
  • US9241229B2 patent drawing

AI summary

Systems, methods, and computer program products for displaying audio data are provided. In some implementations, a computer-implemented method is provided. The method includes receiving audio data and displaying a composite image representing the audio data. The composite image combines a first representation and a distinct second representation of the audio data. Each representation is visible in the composite image and the representations appear in the composite image as if laid one over the other.