Distributed Searchable Index for Stress Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional data storage solutions lack flexibility in retrieving data objects based on attributes other than file paths, leading to inefficiencies and increased costs as data stores grow, requiring extensive administrative management and hardware additions.

Innovation Solution

A searchable data service system provides a searchable index and interface that allows client applications to retrieve data objects from a backend data store based on attributes, implemented as a distributed system with automated stress management, using a Web service interface and gossip/anti-entropy protocols for scalability and reliability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional data storage solutions are used, then data objects can be stored and retrieved by file path, but the system lacks flexibility to retrieve data objects based on other attributes like category, company, or type

Engineering Contradiction:
Improveflexibility in data retrievalVSAvoiddata storage system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a searchable index as an intermediary layer between the data store and client applications. This index enables flexible attribute-based queries without modifying the underlying data storage structure, allowing clients to retrieve data objects by attributes such as category, company, or type while maintaining the simplicity of the storage system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If data store grows in size, then more data can be stored, but administrative management and hardware additions become more difficult and costly

Engineering Contradiction:
Improvedata storage capacityVSAvoidadministrative management ease
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent segments the data storage system into a data store component and a searchable index component. This segmentation allows the system to handle large volumes of data by distributing the indexing and querying functions, reducing the administrative burden on operators as the data store grows in size.

Inventive Principle:
Principle #1Segmentation

3Productivity

If conventional data storage solutions are used, then data can be stored, but query optimizations and monitoring require extensive system administrator intervention

Engineering Contradiction:
Improvedata retrieval efficiencyVSAvoidautomated query optimization
Core Design Contradiction:
ProductivityVSExtent of automation

Solution Approach 1:

The searchable index enables the system to perform query optimizations automatically without requiring extensive system administrator intervention. The index structure itself facilitates efficient attribute-based queries, allowing the system to self-optimize performance as data grows without manual intervention.

Inventive Principle:
Principle #25Self-service

4Adaptability or versatility

If table schemas are changed to support new attributes, then new query capabilities can be added, but system complexity and downtime increase

Engineering Contradiction:
Improvenew attribute query capabilityVSAvoidsystem availability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements a dynamic searchable index that can accommodate new attributes without requiring changes to the underlying data store schema. This allows the system to adapt to new query requirements by updating the index structure dynamically, maintaining system availability and avoiding downtime associated with schema changes.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11580109B2Method and apparatus for stress management in a searchable data service
Publication Date: 2023.02.14 AMAZON TECH INC
  • US11580109B2 patent drawing
  • US11580109B2 patent drawing
  • US11580109B2 patent drawing

AI summary

Method and apparatus for stress management in a searchable data service. The searchable data service may provide a searchable index to a backend data store, and an interface to build and query the searchable index, that enables client applications to search for and retrieve locators for stored entities in the backend data store. Embodiments of the searchable data service may implement a distributed stress management mechanism that may provide functionality including, but not limited to, the automated monitoring of critical resources, analysis of resource usage, and decisions on and performance of actions to keep resource usage within comfort zones. In one embodiment, in response to usage of a particular resource being detected as out of the comfort zone on a node, an action may be performed to transfer at least part of the resource usage for the local resource to another node that provides a similar resource.