Intelligent Media Data Explorer for Automated Content Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in efficiently navigating and focusing on relevant content in audio and video recordings, as existing systems require manual searching and lack automated segmentation and relevance-based selection, leading to wasted time and missed important information.

Innovation Solution

An intelligent media data service that identifies and annotates sections of media data based on user profiles, using media classification, topic detection, speaker detection, and noise detection, allowing for automated selection and bypassing of irrelevant content, with a machine learning model that learns user preferences and improves accuracy over time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If manual searching is used to navigate media content, then users can find relevant information, but it consumes excessive time and effort

Engineering Contradiction:
Improvetime spent searching for relevant contentVSAvoidmanual searching effort
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The system performs preliminary analysis of media content by detecting topics, speakers, and noise patterns before user interaction. Metadata is extracted and stored in advance, enabling rapid retrieval and filtering without requiring users to manually search through entire recordings.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Manual searching and content analysis are replaced with automated machine learning models. The system uses topic detection, speaker detection, and noise detection algorithms to automatically identify and categorize relevant sections, substituting human cognitive effort with computational processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated segmentation and relevance-based selection is implemented, then time efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvemedia consumption efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The media content is segmented into distinct sections based on detected topics, speakers, and noise patterns. Each segment is tagged with metadata indicating its characteristics, allowing the system to selectively present relevant portions to users while filtering out irrelevant content such as noise or unrelated topics.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A machine learning model acts as an intermediary between the raw media content and the user. The model processes the audio data, extracts meaningful features, and generates structured metadata that bridges the gap between unprocessed recordings and user-friendly presentations.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If multiple detection algorithms are used for media analysis, then accuracy of relevant content identification is improved, but processing time and computational resources increase

Engineering Contradiction:
Improverelevance detection accuracyVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Multiple detection algorithms (topic detection, speaker detection, noise detection) are merged into an integrated analysis system. The models work together to comprehensively characterize media sections, with their results combined to determine overall relevance and prioritize content for user presentation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11914632B2Intelligent media data explorer
Publication Date: 2024.02.27 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11914632B2 patent drawing
  • US11914632B2 patent drawing
  • US11914632B2 patent drawing

AI summary

Embodiments for providing an intelligent media data service in a computing environment by a processor. One or more sections of media data are identified and annotated (e.g., tagged) for a user based on a degree of relevancy between a user profile and the media data, wherein the media data include media classification, topic detection, speaker detection and noise detection. The one or more sections of media data are selected for the user based on the tagging of the or more sections.