Media Data Organization via Viewing Environment Context Signals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Managing and retrieving large collections of media data files such as photos, videos, and audio across multiple storage systems and transmission channels is difficult due to the lack of effective organization, retrieval, and annotation beyond metadata, leading to time-consuming processes and limited user interaction.

Innovation Solution

A computer system that automatically organizes, retrieves, and annotates media data files using context derived from real-time signals in a viewing environment, incorporating audio and image processing to identify entities, preferences, and reactions, allowing for dynamic selection and presentation of media content without explicit user intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If media data files are stored across multiple storage systems and transmission channels, then the quantity and accessibility of media data increases, but the difficulty of management and retrieval increases

Engineering Contradiction:
Improvequantity of media data filesVSAvoidease of management and retrieval
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent segments media data management by creating distinct functional modules: signal capture components, context extraction modules, metadata generation systems, and retrieval interfaces. Each module handles specific aspects of media file organization, making the overall system manageable despite handling large quantities of files across multiple storage systems

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces context information as an intermediary layer between users and media data files. Sensors capture environmental signals (audio, visual, contextual data) that serve as mediators to automatically generate metadata and organize files, eliminating the need for manual management while handling large volumes of media across distributed storage systems

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If manual indexing and metadata generation are used, then organization of media data is achieved, but time consumption increases

Engineering Contradiction:
Improveorganization capabilityVSAvoidtime consumption for management
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system enables self-service organization by automatically capturing environmental signals through sensors, processing these signals to extract context, and generating metadata without human intervention. The media management system serves itself by autonomously organizing files based on captured contextual information, eliminating time-consuming manual indexing while maintaining effective organization

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements preliminary action by continuously capturing and processing environmental signals in advance of actual media file organization needs. Context information is extracted and metadata is generated proactively based on captured signals, so that when retrieval is needed, the organization work is already completed, significantly reducing time consumption

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If context extraction from environmental signals is implemented, then annotation capability is enhanced, but device complexity increases

Engineering Contradiction:
Improveannotation richnessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies universality by using a multi-functional sensor system that captures multiple types of environmental signals (audio, visual, contextual data) through a single integrated framework. The same sensor array and processing pipeline handle diverse annotation tasks, reducing overall system complexity while enhancing annotation capability through multi-purpose components

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements nesting by organizing context extraction in hierarchical layers: sensors capture raw signals, processing modules extract contextual information, and higher-level systems generate metadata. Each layer is nested within the framework of the previous layer, allowing complex annotation capabilities to be built from simpler, modular components that can be independently managed and maintained

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS11188586B2Organization, retrieval, annotation and presentation of media data files using signals captured from a viewing environment
Publication Date: 2021.11.30 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11188586B2 patent drawing
  • US11188586B2 patent drawing
  • US11188586B2 patent drawing

AI summary

A computer system automatically organizes, retrieves, annotates and/or presents media data files as collections of media data files associated with one or more entities, such as individuals, groups of individuals or other objects, using context captured in real time from a viewing environment. The computer system presents media data from selected media data files on presentation devices in the viewing environment and receives and processes signals from sensors in that viewing environment. The processed signals provide context, which can be used to select and retrieve media data files, and can be used to further annotate the media data files and/or other data structures representing collections of media data files and/or entities. In some implementations, the computer system can be configured to be continually processing signals from sensors in the viewing environment to continuously identify and use the context from the viewing environment.