Crowdsourced Multimedia Data Association and Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems lack a generalized method to associate and synchronize arbitrary data with multimedia files, and to enhance search and filter operations using this associated data, leading to cumbersome and time-intensive processes for managing large numbers of multimedia files.

Innovation Solution

The described techniques enable the association of arbitrary data with multimedia files, allowing for retrieval, filtering, and statistics capture based on information from this data, including text-based search, hyper-linking, and real-time data aggregation and rendering, using various hardware and software architectures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Difficulty of detecting and measuring

If meta-tags are used to enable text search on multi-media files, then search capability is improved, but the associated data does not add or supplement the content of the multi-media file

Engineering Contradiction:
Improvesearch capabilityVSAvoidcontent augmentation
Core Design Contradiction:
Difficulty of detecting and measuringVSLoss of information

Solution Approach 1:

The patent separates multi-media content into discrete segments (video clips, images, audio segments) and associates arbitrary data with specific timecodes or positions. This segmentation allows search and retrieval based on associated data while maintaining the ability to render only relevant portions, thus improving search capability without requiring full content augmentation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary indexing system that stores associations between multi-media file identifiers, timecodes, and arbitrary data. This intermediary layer enables text search and filtering operations on associated data without requiring the associated data to be embedded or rendered within the multi-media file itself, resolving the contradiction between search capability and content augmentation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If arbitrary data is associated with multi-media files to enable enhanced search and filtering, then retrieval efficiency is improved, but system complexity increases

Engineering Contradiction:
Improveretrieval efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent creates a universal association system that can handle multiple types of arbitrary data (text, images, video, audio) and multiple retrieval operations (search, filter, sort) through a single standardized interface. The indexing structure uses general-purpose fields (file identifier, timecode, associated data, relationship type) that can accommodate diverse data types and query requirements, improving retrieval efficiency across different scenarios without proportionally increasing system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent performs preliminary indexing and association of arbitrary data with multi-media files during the ingestion or processing phase. By pre-computing and storing the relationships between files, timecodes, and associated data in an optimized indexing structure, the system enables fast retrieval operations without incurring complex computation during actual search and filtering operations.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If large numbers of multi-media files are managed without rendering, then time-intensive operations are reduced, but search and sorting become cumbersome

Engineering Contradiction:
Improvefile management timeVSAvoidsearch and sorting ease
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The patent extracts the search and sorting functionality from the multi-media content itself and relocates it to the associated data layer. By indexing arbitrary data (descriptions, tags, metadata) separately from the actual multi-media files, the system enables text-based search, filtering, and sorting operations on the extracted data without requiring access to or rendering of the large binary multi-media files, thus reducing file management time while maintaining operational ease.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9477667B2Crowdsourced multi-media data relationships
Publication Date: 2016.10.25 MOBDUB LLC
  • US9477667B2 patent drawing
  • US9477667B2 patent drawing
  • US9477667B2 patent drawing

AI summary

The present disclosure describes a data association and retrieval facility. Attribute resources, such as metadata tags, that are not to be rendered along with a file, and content resources, such as annotations and commentary, which are to be rendered along with a file are associated with files, in particular multi-media files. The attribute and content resources may be searched and filtered against, and statistics on of file and resource accesses are tracked. Attribute and content resources may also be aggregated and redistributed. Altogether, these facilities constitute a platform to develop crowd-sourced applications and content packages. Finally, various user interfaces supporting particular applications are disclosed.