Peer-to-Peer Content Retrieval via Segment Hashes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wide area network links in enterprise environments suffer from low bandwidth and high latency, leading to poor application performance and increased user frustration, and existing server caching mechanisms have limitations such as security concerns and protocol restrictions.

Innovation Solution

A peer-to-peer content retrieval system that uses hash information to identify and locate content blocks within a local area network, reducing the need for WAN usage by allowing clients to retrieve content from peers rather than a central server, utilizing segment hashes and Merkle trees for efficient content identification and validation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If content is retrieved from a central server over WAN, then content availability is ensured, but bandwidth usage increases and latency increases

Engineering Contradiction:
Improvecontent availabilityVSAvoidbandwidth usage
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent segments content into blocks and uses hash values to identify them. Instead of retrieving entire files or pages, the system retrieves only specific content blocks needed by the user, significantly reducing bandwidth consumption while maintaining content availability through distributed peer-to-peer delivery.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces hash value metadata as an intermediary between the user and content blocks. The hash information acts as a mediator that enables precise identification and location of content blocks across the distributed network, allowing efficient retrieval without requiring users to download entire files or pages.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If content is retrieved from a central server over WAN, then content availability is ensured, but application responsiveness deteriorates

Engineering Contradiction:
Improvecontent availabilityVSAvoidapplication responsiveness
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

By segmenting content into smaller blocks, the system enables parallel retrieval of multiple blocks from different peers simultaneously, reducing overall wait time and improving application responsiveness while ensuring complete content availability through distributed storage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary actions by pre-computing and distributing hash values and content blocks across the peer network before they are needed. When a user requests content, the system can quickly locate and retrieve blocks using pre-existing hash information, eliminating the need for users to wait for entire files to be downloaded from a central server.

Inventive Principle:
Principle #10Preliminary action

3Loss of energy

If server caching mechanisms are used, then WAN usage is reduced, but security concerns and protocol restrictions arise

Engineering Contradiction:
ImproveWAN usageVSAvoidsecurity and protocol flexibility
Core Design Contradiction:
Loss of energyVSAdaptability or versatility

Solution Approach 1:

The patent enables peers to serve content to each other autonomously using standardized protocols. Each peer independently verifies content integrity using hash values and can serve blocks to other peers without requiring centralized cache management, eliminating security concerns associated with traditional server caching while maintaining WAN usage reduction benefits.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent creates a universal peer-to-peer content retrieval mechanism that works across different protocols and applications. The hash-based identification and verification system provides a protocol-agnostic framework that can be applied to various content types and delivery scenarios, offering both WAN usage reduction and broad adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8112477B2Content identification for peer-to-peer content retrieval
Publication Date: 2012.02.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8112477B2 patent drawing
  • US8112477B2 patent drawing
  • US8112477B2 patent drawing

AI summary

Described is a technology in which client content requests to a server over a wide area network (WAN) are responded to with hash information by which the client may locate the content among one or more peer sources coupled to the client via a local area network (LAN). The hash information may be in the form of a segment hash that identifies multiple blocks of content, whereby the server can reference multiple content blocks with a single hash value. Segment boundaries may be adaptive by determining them according to criteria, by dividing streamed content into segments, and/or by processing the content based on the content data (e.g., via RDC or content/application type) to determine split points. Also described is content validation using the hash information, including by generating and walking a Merkle tree to determine higher-level segment hashes in order to match a server-provided hash value.