Coordinated Audio Video Filter Pairs for Mobile Devices

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current mobile devices lack integrated solutions for applying coordinated audio and video filters that enhance the artistic and emotional content of audiovisual performances, limiting their ability to provide immersive and engaging social networking experiences.

Innovation Solution

A system and method for portable computing devices that allow users to select and apply coordinated audio and video filter pairs, which include digital signal processing techniques for real-time audio and video processing, enabling the enhancement of audiovisual content with effects such as vintage styles, seasonal themes, and music creation technologies like LaDiDa and Songify/AutoRap, allowing for local or remote rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If separate audio and video filters are applied independently, then flexibility in filter selection is improved, but coordination between audio and video effects deteriorates

Engineering Contradiction:

Improvefilter selection flexibilityVSAvoidaudio-video coordination

Core Design Contradiction:

Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent combines separate audio and video filter selections into unified filter pairs where each filter pair contains coordinated audio and video effects that are applied together. This merging ensures that audio and video filters work harmoniously rather than independently, resolving the contradiction between flexibility and coordination.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary layer (the filter pair structure) that mediates between individual filter selections and final application. This intermediary ensures coordinated application of audio and video effects while maintaining the ability to select from multiple different filter pairs, thus preserving both flexibility and coordination.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple filter pairs are provided for user selection, then artistic and emotional content enhancement is improved, but device complexity increases

Engineering Contradiction:

Improveartistic content enhancementVSAvoidfilter system complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the filter system into discrete filter pairs, where each filter pair is a self-contained unit with coordinated audio and video effects. This segmentation allows the system to offer multiple artistic styles without creating a complex interconnected filter system, as each filter pair can be independently selected and applied.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates composite filter units (filter pairs) that combine audio and video effects into unified packages. These composite filter pairs simplify the overall system architecture by pre-coordinating multiple effects, reducing the complexity of managing individual filter interactions while providing rich artistic enhancement capabilities.

Inventive Principle:

Principle #40Composite materials

3Ease of operation

If real-time audio and video processing is implemented, then user interaction responsiveness is improved, but computational power requirements increase

Engineering Contradiction:

Improveuser interaction responsivenessVSAvoidcomputational power requirement

Core Design Contradiction:

Ease of operationVSPower

Solution Approach 1:

The patent applies filters during the capture and processing stages rather than as post-processing operations. This preliminary application of filters allows real-time processing with optimized computational performance, as the filters are integrated into the existing audio-video pipeline rather than requiring separate heavy processing passes.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11264058B2Audiovisual capture and sharing framework with coordinated, user-selectable audio and video effects filters

Publication Date: 2022.03.01 SMULE INC

AI summary

Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.