Server-Side Prompt Program for Generative AI API Sequencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing generative AI systems require multiple network calls to process and respond to a sequence of prompts, leading to delays and resource consumption.
Innovation Solution
Implementing a server-side prompt program that executes on the generative AI system, allowing a single API call to submit a sequence of prompts, with the program presenting prompts, processing intermediate results, and returning a final result.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple sequential API calls are used to process a sequence of prompts, then each prompt can be processed independently, but the number of network calls increases leading to delays and resource consumption
Solution Approach 1:
The patent combines multiple sequential API calls into a single API call by executing a prompt program on the server side. The prompt program handles the sequence of prompts locally on the server, eliminating the need for multiple network round trips between the client and the generative AI system. This merging approach reduces delay while maintaining processing capability.
Solution Approach 2:
The patent introduces a server-side prompt program as an intermediary between the client and the generative AI system. This intermediary executes the prompt sequence on the server, acting as a mediator that handles the complexity of sequential prompt processing without requiring multiple client-side network calls. The intermediary approach reduces the number of network calls while maintaining functional independence.
2Productivity
If multiple sequential API calls are used to process a sequence of prompts, then each prompt can be processed independently, but network resource consumption increases
Solution Approach 1:
The patent merges multiple network calls into a single network call by executing the prompt program on the server side. This consolidation reduces the total number of network transactions, thereby decreasing network resource consumption while maintaining the ability to process sequences of prompts efficiently.
Solution Approach 2:
The server-side prompt program serves as an intermediary that handles prompt processing locally on the server, reducing the burden on network resources. By processing prompts on the server side rather than requiring multiple client-side network calls, the system achieves better resource efficiency while preserving processing capability.
3Adaptability or versatility
If code is included to make successive API calls to handle complex tasks, then the application can process complex prompt sequences, but the implementation complexity increases
Solution Approach 1:
The patent introduces a server-side prompt program as an intermediary layer that handles complex prompt sequences. This intermediary abstracts the complexity from the client-side application, allowing complex tasks to be processed without increasing implementation complexity in the client code. The server-side program manages the sequence coordination and dependency resolution.
Solution Approach 2:
The server-side prompt program performs self-service by automatically managing the execution of prompt sequences, handling dependencies between prompts, and coordinating the generative AI calls. This self-service approach eliminates the need for complex client-side code to manage sequential processing, reducing implementation complexity while maintaining adaptability to complex tasks.
Data Source
AI summary
Generative artificial intelligence (AI) using a server-side prompt program is disclosed. In various embodiments, an API call comprising a request is received from a remote system. A server-side prompt program comprising or otherwise associated with one or both of the API call and the request is executed, including by sending two or more prompts to a generative AI service. A final result obtained by sending the two or more prompts to the generative AI service is received and returned to the remote system in response to the API call.