291 results about "Orchestration (computing)" patented technology

A scalable platform for orchestrating networks of specialized AI multi-agent networks that enables secure collaboration through token-based protocols and real-time result streaming with advanced dynamic chain-of-thought pruning. The central orchestration engine manages domain-specific agents, implementing sophisticated multi-branch reasoning with contribution-estimation layers that evaluate each agent's utility using Shapley value-inspired metrics. The system employs information-theoretic and gradient-based surprise metric to guide memory updates and dynamic reasoning expansion, preventing local minima stagnation while preserving valuable insights through adaptive forgetting mechanisms. The platform unifies Monte Carlo tree search with contribution-aware estimation to detect high-synergy expert combinations while maintaining privacy through partial data approaches. It scales across distributed computing environments, enabling complex collaborative tasks like materials discovery, product engineering and manufacturing process design, biomedical research, and drug development. The system supports multi-party economic rewards through systematic contribution effort, cost and importance tracking, while standardized interfaces manage security, privacy, and policy constraints across heterogeneous agents.

A federated distributed AI reasoning and action platform utilizing decentralized, partially observable hierarchical computing for neuro-symbolic reasoning. It features a federated Distributed Computational Graph (DCG) system integrating core components like pipeline orchestration, transformers, and marketplaces. The platform enables privacy-preserving dynamic resource allocation, intelligent task scheduling, and variable information sharing across diverse computing environments. By coordinating with an AI-based operating system and analyzing performance metrics, environmental conditions, and resource availability, the system optimizes efficiency across AI workloads and decision-making processes. This results in an adaptive, power-efficient, and scalable AI-enabled data processing system capable of handling complex tasks while maintaining peak performance under various operating conditions.

A scalable platform for orchestrating networks of collaborative AI agents utilizing modular hybrid computing architecture. The platform integrates classical, quantum, and neuromorphic computing paradigms through hardware-accelerated translation layers and cross-paradigm coordination mechanisms. A central orchestration engine manages interactions between domain-specific AI agents, dynamically distributing workloads across heterogeneous computing cores based on task complexity, computational requirements, and resource availability. The platform employs hardware-accelerated translation between paradigms, enabling efficient cross-paradigm information exchange while maintaining semantic consistency and computation integrity across different architectures. Specialized monitoring and optimization systems continuously adjust resource allocation and fine-tune performance across computing paradigms. Advanced cache management and fault tolerance mechanisms ensure reliable operation, while privacy-preservation techniques enable secure collaboration. The platform's modular architecture supports integration of different computational approaches, enabling complex multi-domain problem solving that leverages the unique advantages of each paradigm while maintaining system-wide efficiency, scalability, and coherence.

An artificial intelligence driven system of systems may include a layered architecture for providing transaction support to various types of enterprises. A governance layer implements automated governance and policy enforcement through specialized governance modules utilizing generative AI technology. An enterprise layer supports enterprise functions by integrating management and control platforms with digital infrastructure. An offering layer creates and manages system offerings via content generation, personalization, and smart product modules. A transactions layer enables automated transaction orchestration through API integration, execution, and fulfillment modules. An operations layer manages AI systems through generation, training, verification and orchestration modules. A network layer provides adaptive networking capabilities through routing, protocol selection and communication modules. A data layer processes fused data from multiple sources using machine learning and AI systems. A resource layer manages computing, storage, and other resources through specialized resource modules.

A platform for coordinating networks of specialized AI agents that enables secure collaboration through token-based communication and real-time result streaming. The system features a central orchestration engine managing interactions between domain-specific expert agents, with memory management and optional encryption for secure data handling. The platform uses efficient communication protocols for knowledge compression and faster reasoning, while a standardized agent interface system handles security, privacy, and policy requirements. It scales across distributed computing environments to enable complex collaborative tasks like personalized content creation, materials discovery, and drug development while optimizing resource usage and maintaining data privacy.

The present application relates to the field of information collaborative processing. Provided are a task collaborative scheduling method and apparatus, a device and a medium. The task collaborative scheduling method is applied to a collaborative computing system comprising a plurality of nodes, and the method comprises: first, on the basis of original task description information of a target task, performing splitting and orchestration on the target task to obtain a plurality of sub-tasks and a task logic topological relationship between the sub-tasks; then allocating, on the basis of node information of the nodes, from the collaborative computing system a corresponding execution node for each sub-task, and generating sub-task description information; and finally, issuing the sub-task description information to the execution nodes, such that all the execution nodes can complete all the sub-tasks according to the orchestrated logic topological relationship, thereby obtaining an output result of the target task. The present application can cover diversified task collaborative scheduling scenarios and enables compatibility with access and scheduling of devices having different capabilities, thereby meeting the collaborative processing requirements for diverse service types and scales.

An AI orchestration system dynamically manages multiple artificial intelligence (AI) agents within a cloud computing environment to efficiently process user requests. A model orchestration subsystem determines whether a request is handled locally using a domain-specific database or by invoking one or more AI agents. The system maintains AI agents in active and inactive states, provisioning computing resources for inactive agents as needed. Real-time model metrics guide the selection of target AI agents, and if a degrading performance trend is detected, the system preemptively spins up additional AI instances. The system provisions processor cycles, memory, and network bandwidth through a cloud-based resource manager, instantiates containerized execution environments or virtual machines, and performs automated load balancing among AI instances.

The invention discloses a self-adaptive cloud management platform system based on intelligent resource scheduling and container arrangement, and relates to the field of computer information management. The system comprises a refined resource scheduling and adaptive optimization module, a containerized application life cycle management and dynamic container arrangement module, a high-precision operation and maintenance monitoring and self-healing mechanism module based on big data analysis, and a dynamic resource allocation and elastic scaling strategy module of an intelligent scheduling engine. The system takes a containerization technology as a core, realizes centralized management and monitoring of cloud computing resources, can realize dynamic intelligent resource scheduling and optimization, accelerates application deployment, improves system flexibility, strengthens operation and maintenance monitoring and platform safety guarantee, and comprehensively improves resource optimization and cost effectiveness. The resource scheduling efficiency is improved, the application deployment is simplified, the operation and maintenance monitoring is enhanced, and efficient resource management is realized through an adaptive optimization technology.

The invention relates to the technical field of cloud computing, in particular to an intelligent capacity planning method and system in a hybrid cloud environment. According to the method and the system for intelligent capacity planning in the hybrid cloud environment, heterogeneous resources in a hybrid cloud are modeled by using a declarative description language, a dependency relationship among the resources is identified, and a directed acyclic graph (DAG) is constructed; the resource operation tasks are divided in batches, and the tasks without the dependency relationship are executed in parallel; synchronizing the running state of each resource in real time, and performing state consistency verification and abnormity marking; triggering a retry mechanism when an exception occurs; and after the resource arrangement process is completed, summarizing data in the whole process, and performing performance evaluation and strategy optimization on resource operation. According to the method and the system for intelligent capacity planning in the hybrid cloud environment, the use condition of resources can be monitored and analyzed in real time, the resource demand can be accurately predicted, a reasonable resource scheduling strategy can be generated, manual intervention is reduced, and elastic expansion and optimal configuration of cloud resources are realized.

A federated distributed AI reasoning and action platform utilizing decentralized, partially observable hierarchical computing for neuro-symbolic reasoning. It features a federated Distributed Computational Graph (DCG) system integrating core components like pipeline orchestration, transformers, and marketplaces. The platform enables privacy-preserving dynamic resource allocation, intelligent task scheduling, and variable information sharing across diverse computing environments. By coordinating with an AI-based operating system and analyzing performance metrics, environmental conditions, and resource availability, the system optimizes efficiency across AI workloads and decision-making processes. This results in an adaptive, power-efficient, and scalable AI-enabled data processing system capable of handling complex tasks while maintaining peak performance under various operating conditions.

Systems and methods are disclosed for optimization, management, and merging of processes. This system integrates a multifaceted technological framework, including generative artificial intelligence, quantum computing simulations, and blockchain technology. It features a user interface for inputting diverse workflow requirements, a generative AI module for processing these inputs, and a quantum computing module for simulating and optimizing workflows. The system utilizes blockchain for secure workflow deployment and a suite of specialized engines for prompt management, data extraction, analysis, optimization, deployment orchestration, and continuous monitoring. These components ensure the system's adaptability to user-specific needs, scalability across various industries, and capability for integration with existing enterprise systems. This invention revolutionizes BPM by streamlining processes, enhancing efficiency, and maintaining high security and customization standards.

A computing services environment may include a database system storing a plurality of database records for a plurality of client organizations accessing computing services including a conversational chat assistant. The computing services environment may also include an application server may receive user input for the conversational chat assistant, a generative language model interface, an orchestration and planning service configured to identify one or more actions based on the user input, to execute the one or more actions to determine a natural language response message, and to determine a recommended action for selection via a conversational chat interface. The computing services environment may also include a communication interface configured to transmit the natural language response message and a user interface generation instruction executable by the client machine to provide a selection affordance for selecting the recommended action.

Systems and methods for decentralized orchestration of event records within decentralized computing environments. A processing system including decentralized execution nodes dynamically allocates microservice instances based upon real-time node performance metrics. Transaction requests including transaction data digitally associated with decentralized identifiers (DIDs) are processed by allocated microservice instances. The processing includes verifying transactions, generating cryptographically-linked immutable memorialization records associated with respective DIDs, and distributing these records to a tamper-evident distributed ledger configured to enforce immutability through consensus nodes. The processing system dynamically reallocates microservice instances among decentralized execution nodes based upon monitored utilization metrics and predefined scaling thresholds. Each memorialization record is cryptographically secured and linked permanently to the DID for data immutability, enhanced security, and dynamic scalability for event data processing in distributed infrastructures.

The invention discloses a service-based calculation task dynamic abstraction method and system, and relates to the technical field of calculation task scheduling. The service-based calculation task dynamic abstraction method comprises the following steps: receiving and analyzing a to-be-executed task, and dividing the to-be-executed task into a plurality of independent service units; constructing a directed acyclic graph representing the dependency relationship between the service units, and executing topological sorting based on the directed acyclic graph to determine an execution sequence; and according to the resource demand of each service unit and the current system equipment state. According to the method, the technical problems that a traditional task scheduling method comprises but is not limited to the following technical problems that resource allocation is rigid, a heterogeneous computing environment cannot be dynamically adapted, and the hardware utilization rate is low; parallel arrangement is low in efficiency, depends on manual definition of an execution sequence, lacks an automatic arrangement capability and is difficult to deal with a complex task process; the real-time performance is insufficient, the task execution process is solidified, and the resource allocation and execution path cannot be dynamically adjusted according to the runtime state.

The invention relates to the technical field of cloud computing, in particular to a resource arrangement and automatic execution method and system based on a hybrid cloud architecture. The resource arrangement and automatic execution method based on the hybrid cloud architecture comprises the steps of pulling or receiving monitoring data, performing streaming and batch cleaning, and generating input required by training and reasoning in a feature processing pipeline; the model is deployed, a prediction result is sent to a decision module in real time, and the decision module triggers automatic execution to carry out capacity expansion and shrinkage on resources; and finally, comparing an execution effect with a prediction result to realize continuous optimization. According to the resource orchestration and automatic execution method and system based on the hybrid cloud architecture, cross-cloud resource dependence analysis and task-driven orchestration execution are realized, strategy-driven dynamic deployment and elastic capacity expansion and contraction are also realized, intelligent execution optimization and exception handling can be performed in combination with artificial intelligence or a rule engine, and the resource orchestration and automatic execution method and system based on the hybrid cloud architecture are high in practicability. The resource utilization rate and the operation and maintenance efficiency of the hybrid cloud environment are improved, and the risk of manual operation is reduced.

Systems and methods for managing a computing task are provided. The system includes a controller configured to receive the computing task, present to a client a set of factors defining desired conditions related to executing the computing task, receive a demand computing strategy associated with the computing task indicating one or more factors selected by the client and a constraint and a weight related to each factor from the one or more selected factors, receive a plurality of supply computing strategies from a plurality of datacenters, each supply computing strategy corresponding to a datacenter from the plurality of datacenters, calculate a task scheduling strategy based at least on the demand computing strategy and a supply computing strategy, select a candidate datacenter from the plurality of datacenters according to a predetermined rule, and schedule the computing task for execution on the candidate datacenter according to the task scheduling strategy.

The invention provides a stream computing resource scheduling method and system based on a dynamic time window, and relates to the field of stream computing resource scheduling, and the method comprises the following steps: constructing a master-slave event time monitoring network to obtain a task feature vector, and establishing an adaptive time window scheduling mechanism to dynamically adjust the window size; and constructing a multi-level task priority queue, carrying out state transition by adopting a remote direct memory access mechanism of incremental transmission, and finally coordinating computing nodes through a distributed task arrangement protocol to complete resource switching. According to the method, computing resource competition can be effectively reduced, the flow computing task processing efficiency is improved, dynamic optimal configuration of resources is realized, and the system throughput is enhanced.

A computing services environment may include a database system may store database records for client organizations accessing computing services including a conversational chat assistant. The computing services environment may also include an application server receiving natural language user input for the conversational chat assistant and a generative language model interface providing access to one or more generative language models. The computing services environment may also include an orchestration and planning service configured to analyze the natural language user input via a generative language model of the one or more generative language models to identify a plurality of actions to execute via the computing services environment to fulfill an intent expressed in the natural language user input. The computing services environment may be configured to execute the plurality of actions to determine a natural language response message.

An autonomous job scheduling system for distributed ledger technology is disclosed, leveraging photonic quantum computing and generative artificial intelligence (AI). The system collects transactional and operational data from various nodes within a distributed ledger network, focusing on transaction types, sizes, and priorities. This data is filtered for urgency and resource intensity, analyzed against real-time network conditions and business rules to ascertain job execution parameters. A photonic quantum computing system processes these parameters to optimize job scheduling strategies, including quantum annealing and simulations. The AI engine generates dynamic smart contracts deployed to distributed ledgers by a job orchestration engine. The system monitors job execution, gathering performance data and providing feedback for real-time adjustments. The job orchestration engine updates job scheduling in response to these adjustments, enhancing the efficiency and responsiveness of the blockchain network.

A computing services environment may include a database system storing database records for client organizations accessing computing services including a conversational chat interface, an application server providing access to the conversational chat interface, a metadata repository storing metadata entries characterizing a actions capable of being performed via the computing services environment, and an orchestration service configured to execute an orchestration process based on a natural language request message received via the conversational chat interface. An input prompt including the natural language request message and descriptions of actions selected from the metadata entries may be determined and transmitted to a generative language model. A prompt completion including a plan that includes a subset of the actions and a natural language description of the plan may be received from the generative language model and sent to a client machine via the conversational chat interface.

Methods and systems for managing service deployment are disclosed. To deploy services, dependencies and other characteristics (such as context data, capability data, placement rules, and workflow data) of services and the infrastructure boundaries in which the services are running may be dynamically collected, analyzed and updated. By dynamically analyzing dependencies and other characteristics (such as context data, capability data, placement rules, and workflow data) of services and the infrastructure boundaries, efficiency of use of computing resources may be improved by recycling existing workflow; statically defined operations and hard-coded conditional logic of services may also be avoided each time an environment in which the services are running has changed.

The invention relates to the field of data processing, and discloses a cloud computing-based data processing method, which comprises the following steps of: constructing a reference count management micro-service cluster at a cloud end, receiving a reference count request carrying a count type through an API (Application Program Interface) gateway, and analyzing the reference count request into a structured operation instruction; reading a first state identifier of the referenced object and a second state identifier of the reference object from the distributed cache system according to the metadata snapshot; according to the method, through dynamic scheduling of a reference counting management micro-service cluster and a container arrangement engine, efficient allocation and scheduling of computing resources can be realized, maximization of resource utilization is ensured, resource waste is avoided, and high-speed query capability of a distributed cache system and a memory database is utilized; the state identification of the object can be retrieved at a millisecond level, the system response speed is improved, and the performance requirement under a high-concurrency scene is met.

Systems and methods of the present disclosure may receive, from a user computing device, a user-provided data record query including a natural language request for information associated with one or more data sources. User persona attributes of the user may be determined, such as a user role or security parameters or both. Based on the user persona attributes a context query may be generated to obtain context attributes associated with the user-provided query. The natural language request and the context attributes are input into the model orchestration large language model (LLM) to output instructions to machine learning (ML) agents based on the context attributes. The ML agents output responses associated with the user-provided data record query based on the instructions, and the responses are input into the model orchestration LLM to output to the user computing device a natural language response based on the context attributes.

The invention relates to the field of artificial intelligence cloud computing, in particular to a cloud native application intention driven intelligent arrangement system based on a large language model. The intention analysis module is used for receiving input data and carrying out feature extraction and vectorization decomposition; outputting an intention vector representation; the strategy planning module is used for receiving the intention vector representation, generating a decision strategy through a multi-objective optimization algorithm and outputting an arrangement strategy; the arrangement execution module is used for receiving the arrangement strategy, analyzing the arrangement strategy through a feature mapping network, converting the arrangement strategy into an instruction set and outputting execution result data; the model training module is used for receiving execution result data and input data and generating a weight updating event when parameters change; and the autonomous learning module is used for receiving the weight updating event, carrying out neural network processing, generating an improved arrangement strategy and forming an adaptive learning mechanism. According to the method, the natural language intention is analyzed through the large language model, and the accuracy and robustness of large-scale arrangement are improved in combination with the data-driven decision.

A computing services environment may include a database system storing a plurality of database records for a plurality of client organizations accessing computing services including a conversational chat assistant, an application server receiving user input for the conversational chat assistant, a generative language model interface providing access to one or more generative language models, an orchestration and planning service configured to identify a plurality of actions based on the user input and to execute the plurality of actions to determine a natural language response message, and / or a metadata framework. The metadata framework may specify information related to the conversational chat assistant. The metadata framework may include a definition associated with an action of the plurality of actions. The definition may include one or more inputs, one or more outputs, and one or more operations performed via the computing services environment.

The invention provides a multi-LoRA large language model deployment system based on a cloud computing platform. A cloud computing AI platform layer trains a LoRA adapter matched with a basic large language model for a reasoning process; the multi-LoRA dynamic loading layer dynamically switches LoRA adapters needing to be mounted according to the request parameters, GPU optimization configuration is carried out according to service priorities in the request parameters, a basic large language model is loaded, and a plurality of LoRA adapters stacked in a sparse matrix form are mounted; and the resource scheduling optimization layer responds to the resource scheduling application, and outputs the request parameters subjected to priority management and hardware sensing optimization to the LoRA dynamic loading layer based on the container arrangement platform. According to the method, LoRA and container arrangement are deeply fused, and an automatic assembly line of training and reasoning is achieved. A video memory sharing mechanism enables a plurality of service scenes to share the same basic large language model, a LoRA adapter is loaded as required, and video memory occupation is greatly reduced. Full-life-cycle management from data preparation to model service is supported, and the large model deployment cost is remarkably reduced.

In some aspects, a cloud-based computer system includes: a quantum computing system comprising a quantum processing unit; a container management and execution system configured to receive a container and execute a program within the container; and a communication channel between the container management and execution system and the quantum computing system for providing program instructions to the quantum computing system. The container management and execution system and the quantum computer system may be co-located in a data center or located in different data centers. The latency of the communication channel may be selected to optimize cost for a required computer performance.

The invention discloses a micro-service application management method and device and computer equipment, and belongs to the technical field of cloud native computing. The method comprises the following steps: creating a corresponding self-defined resource object for each micro-service function node; reading operation state information in the custom resource object to detect the operation state of each micro-service function node; based on the operation state and the function description information, identifying a plurality of target micro-service function nodes which can be combined at present, and combining to form a target service chain; reading communication parameters of each target micro-service function node to establish a DDS communication relationship; and controlling each target micro-service function node to execute functions and performing data transmission through the DDS communication relationship so as to cooperatively execute the target task process. The invention provides a method for supporting a micro-service application based on a DDS communication model to realize unified registration, automatic operation, centralized management and flexible combination and arrangement on a Kubernetes cloud native platform, so as to solve the problem of insufficient support of an existing micro-service framework for DDS type communication middleware.

The invention discloses an airborne environment-oriented cloud native resource scheduling deployment control system and method, and belongs to the field of implementation and technical development of a cloud native architecture in an airborne environment. Comprising a heterogeneous resource definition template, a heterogeneous resource module management component, a heterogeneous resource agent component, a heterogeneous resource controller component, a heterogeneous resource scheduler component and an interface server. Performing selected type heterogeneous resource definition by adopting a heterogeneous resource definition template; creating a resource instance in the interface server; the heterogeneous resource controller component performs resource control tuning; creating a function application instance in the interface server; the heterogeneous resource scheduler component makes a scheduling decision; the heterogeneous resource agent component reads the function deployment information and issues the function deployment information to the heterogeneous resource module management component; and the heterogeneous resource module management component performs program loading and unloading operation and information updating and reporting. According to the invention, the adaptability and operation efficiency of the container scheduling engine in the airborne heterogeneous computing resource environment can be improved.

A technique manages computing resources on a container orchestration platform. Such a technique involves establishing a pool of computing resources on the container orchestration platform. Such a technique further involves, after the pool of computing resources is established, receiving graphics processing unit (GPU) provisioning requests (GPRs) which identify workspaces. Such a technique further involves allocating computing resources from the pool to the workspaces identified by the GPRs based on a set of GPR prioritization policies.