Multimedia Stream Metadata Generation for Consumer Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current streaming technologies lack efficient methods to identify and capture items of interest in multimedia streams, leading to unnecessary processing and resource consumption for stream consumers, as they often lack the resources to perform real-time analysis of audio and video content.

Innovation Solution

A computer-implemented method that analyzes multimedia streams to identify items of interest and generates metadata, which is then provided to stream consumers, allowing them to tailor their processing and reduce unnecessary resource usage, while also receiving feedback to update the metadata dynamically.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If stream consumers perform real-time analysis of audio and video content, then they can identify items of interest, but they consume excessive processing resources and energy

Engineering Contradiction:
Improveitem identification accuracyVSAvoidprocessing energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts the computationally intensive task of analyzing multimedia content and identifying items of interest from the stream consumer device and relocates it to the stream producer device. The stream producer performs the analysis and generates metadata describing identified items, which is then transmitted to stream consumers. This extraction eliminates the need for stream consumers to perform resource-intensive real-time analysis while maintaining accurate item identification capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces metadata as an intermediary that carries information about identified items of interest from the stream producer to stream consumers. This metadata intermediary contains descriptions and location information of items without requiring stream consumers to perform the analysis themselves, thus reducing their processing energy consumption while preserving the ability to identify and process relevant content.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If stream consumers process the entire multimedia stream, then they ensure complete content delivery, but they waste resources on unnecessary processing

Engineering Contradiction:
Improvecontent delivery completenessVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The stream producer performs preliminary analysis of the multimedia stream before it reaches stream consumers, identifying items of interest in advance and generating metadata that describes these items. This preliminary action allows stream consumers to receive prepared information about what content is relevant, enabling them to focus processing only on necessary portions rather than analyzing the entire stream, thus improving processing efficiency while maintaining content delivery completeness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a feedback mechanism where stream consumers provide information about their processing needs and the stream producer adjusts the metadata accordingly. This feedback loop ensures that stream consumers receive accurate and relevant metadata that matches their processing requirements, allowing them to efficiently process only the necessary content portions without wasting resources on irrelevant material.

Inventive Principle:
Principle #23Feedback

3Loss of information

If the system provides detailed metadata about all items, then stream consumers have complete information, but the system complexity increases

Engineering Contradiction:
Improveinformation completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies local quality by providing metadata with varying levels of detail tailored to different items of interest. Rather than uniformly providing the same level of information for all content, the system generates metadata descriptions that are appropriately detailed for each specific item based on its importance and characteristics. This approach maintains information completeness for relevant items while avoiding unnecessary complexity in the metadata structure for less important content.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11991425B2Multimedia stream enhancement and tailored processing
Publication Date: 2024.05.21 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11991425B2 patent drawing
  • US11991425B2 patent drawing
  • US11991425B2 patent drawing

AI summary

Multimedia stream enhancement includes automatically analyzing a multimedia stream and identifying items of interest therein, building metadata, about the stream, that describes the identified items of interest and includes indications of each item of interest and a respective location of that item of interest, providing, by a stream producer device, the stream and the metadata to stream consumer devices, receiving feedback from at least one stream consumer device as the stream producer device provides the stream to the at least one stream consumer device, and using the feedback to generate updated metadata about the stream for provision to one or more stream consumer devices of the stream consumer devices.