Wireless Handheld Audio Capture Platform for Vocal Performance Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mobile device platforms face challenges in capturing and coordinating audiovisual performances, particularly vocal music, due to computational and network limitations, which hinder the creation of compelling user experiences and efficient audiovisual content management.

Innovation Solution

A method involving touchscreen-enabled portable computing devices paired with display device-coupled computing platforms over a wireless network to capture and transmit vocal audio and video, with features like pitch correction, audio effects, and user interface controls, enabling coordinated audiovisual rendering and social interaction through karaoke-style media applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If mobile devices are used to capture and coordinate audiovisual performances over wireless networks, then user accessibility and social interaction are improved, but computational resource consumption and network bandwidth requirements increase

Engineering Contradiction:
Improveuser accessibilityVSAvoidcomputational resource consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system divides computational tasks between mobile devices (audio/video capture and encoding) and server infrastructure (pitch correction, harmonization, and coordination). This segmentation allows mobile devices to maintain low resource consumption while still providing sophisticated audiovisual processing through cloud-based services.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A server infrastructure acts as an intermediary between multiple mobile devices, coordinating their audiovisual streams and performing computationally intensive processing. This mediator approach enables sophisticated processing without burdening individual mobile devices with high computational requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If real-time pitch correction and harmonization are applied to vocal performances, then audio quality is improved, but processing time and computational load increase

Engineering Contradiction:
Improveaudio qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary encoding and preparation of audio signals on mobile devices before transmission, and executes real-time pitch correction and harmonization on the server side. This preliminary action approach ensures high audio quality processing without adding significant latency to the user experience.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If multiple geographically distributed users participate in coordinated performances, then social interaction and content variety are improved, but network transmission latency and synchronization complexity increase

Engineering Contradiction:
Improvesocial interactionVSAvoidsynchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The server infrastructure serves as a central intermediary that receives, coordinates, and synchronizes audiovisual streams from multiple geographically distributed users. This mediator architecture manages synchronization complexity centrally, allowing users to interact socially without each device needing to independently handle complex synchronization protocols.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10565972B2Audiovisual media application platform with wireless handheld audiovisual input
Publication Date: 2020.02.18 SMULE INC
  • US10565972B2 patent drawing
  • US10565972B2 patent drawing
  • US10565972B2 patent drawing

AI summary

Embodiments described herein relate generally to systems comprising a display device, a display device-coupled computing platform, a mobile device in communication with the computing platform, and a content server in which methods and techniques of capture and/or processing of audiovisual performances are described and, in particular, description of techniques suitable for use in connection with display device connected computing platforms for rendering vocal performance captured by a handheld computing device.