Serverless Pipe Component for Event Data Transformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In cloud-based computing environments, incompatibilities between services due to differences in code, interfaces, or protocols lead to issues like latency and message failures when trying to process data across services with different APIs or data formats, making it difficult for services to communicate effectively without manual code integration.

Innovation Solution

The implementation of a 'pipe' as a virtual communication channel that allows configuring event transmissions between services, enabling filtering, transformation, batching, and buffering of events without requiring human-provided code, thereby facilitating communication between services with different event structures and processing capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If services use different APIs, data formats, or protocols, then service diversity and functionality are improved, but communication reliability and compatibility deteriorate due to latency and message failures

Engineering Contradiction:
Improveservice diversityVSAvoidcommunication reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements an intermediary service that acts as a mediator between services with different APIs and data formats. This intermediary translates and adapts data between incompatible formats, enabling reliable communication without requiring direct integration between disparate services. The intermediary handles format conversion, protocol adaptation, and data transformation to ensure message delivery reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs parameter changes by dynamically adjusting data format parameters, API interface parameters, and protocol parameters based on the communicating services. The system modifies data structure parameters, encoding formats, and transmission protocols to match the capabilities of both sending and receiving services, thereby maintaining communication reliability across diverse service types.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If manual code integration is provided to mitigate differences between services, then communication compatibility is improved, but device complexity and implementation difficulty increase

Engineering Contradiction:
Improvecommunication compatibilityVSAvoidimplementation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements self-service by enabling services to automatically discover and adapt to each other's interfaces through the intermediary. Instead of requiring manual code integration, the system allows services to self-configure their communication parameters, automatically register their capabilities, and dynamically adjust their data formats based on the receiving service's requirements, thereby reducing implementation complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent creates a universal intermediary service that handles multiple communication protocols, data formats, and API styles through a single unified interface. This multi-functional intermediary eliminates the need for separate integration code for each service pair, providing universal compatibility across diverse services while simplifying implementation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Speed

If direct service-to-service communication is implemented, then response speed is improved, but system complexity and integration difficulty increase

Engineering Contradiction:
Improveresponse speedVSAvoidintegration complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent uses an intermediary that enables direct service-to-service communication without complex point-to-point integrations. The intermediary handles all translation and adaptation logic centrally, allowing services to communicate directly through standardized interfaces while the intermediary manages the complexity of format conversion and protocol adaptation in real-time, maintaining response speed.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Ease of manufacture

If services are integrated without an intermediary, then deployment simplicity is improved, but adaptability to different service types deteriorates

Engineering Contradiction:
Improvedeployment simplicityVSAvoidservice interoperability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent implements a universal intermediary that provides standardized communication interfaces for all services. This allows services to be deployed independently with simple configurations, while the intermediary handles the complexity of adapting between different service types, protocols, and data formats, thereby maintaining both deployment simplicity and service interoperability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11941385B1Transforming data between cloud entities in an event architecture
Publication Date: 2024.03.26 AMAZON TECH INC
  • US11941385B1 patent drawing
  • US11941385B1 patent drawing
  • US11941385B1 patent drawing

AI summary

Techniques for a service provider network to communicatively couple services and/or applications in a serverless computing environment. A pipe component can configure a pipe to integrate two services by transmitting data between services and/or applications using the pipe. The pipe may also be configured to transform how a service processes an event, control timing of event transmissions using the pipe, define an event structure for an event, and/or batch events. Pipes enable an application or service to exchange data with a variety of services provided by the service provider network while controlling what type of data is generated, stored, or transmitted.