Parallel File Upload via Hostname Aliases

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current browsers limit the number of simultaneous HTTP requests to a single hostname, restricting the maximum achievable upload speed for large files, resulting in prolonged wait times before processing can begin on the server side.

Innovation Solution

The file is divided into chunks and uploaded in a distributed manner by generating multiple aliases to the same hostname or different hostnames, allowing parallel uploads across these aliases, thereby increasing bandwidth utilization and enabling processing to start before the file is fully uploaded.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple chunks are uploaded in parallel to increase bandwidth utilization, then upload speed is improved, but the number of simultaneous HTTP requests to a single hostname is limited to six by browsers

Engineering Contradiction:

Improveupload speedVSAvoidnumber of simultaneous requests

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The file is divided into multiple chunks that can be uploaded in parallel. Each chunk is uploaded as a separate HTTP request, allowing the system to bypass the browser's limit of six simultaneous requests to a single hostname by distributing requests across multiple segments of the same file.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism (chunking and request management system) that sits between the file upload process and the HTTP protocol limitations. This intermediary divides the upload into manageable chunks and manages the distribution of requests across available aliases, effectively working around the six-request limit.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If the entire file is uploaded before processing begins, then data integrity is ensured, but wait time before processing is extremely long for large files

Engineering Contradiction:

Improvedata integrityVSAvoidwait time before processing

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by uploading file chunks in parallel before the complete file is available. Processing can begin on already-uploaded chunks while the remainder of the file continues to upload, eliminating the need to wait for complete file upload before starting processing.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The upload and processing operations run continuously and concurrently rather than sequentially. While chunks are being uploaded in parallel, the server begins processing those chunks immediately upon receipt, maintaining continuous useful action throughout the transfer process rather than idle waiting.

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS10375144B2Uploading over parallel requests

Publication Date: 2019.08.06 SONY GROUP CORP

AI summary

Uploading a file in a distributed manner to a server, including: dividing the file into a plurality of chunks; generating a plurality of aliases to a hostname corresponding to the server; and uploading the plurality of chunks to the plurality of aliases corresponding to the server. Key words include distributed uploading and aliases.