Elastic UAV Cooperative Inference for Node Failure Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cooperative inference architectures for UAVs are inflexible and unable to adapt to dynamic changes in computing and memory capabilities, leading to potential crashes when nodes become unavailable, limiting the processing of large-scale models and real-time performance.
Innovation Solution
An elastic cooperative inference architecture that dynamically adjusts task allocation based on UAV performance and network changes, allowing for adaptive task reassignment and use of lightweight models when necessary, ensuring continuous operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If a single UAV node performs inference, then the inference can be completed, but the scale of the model is limited due to limited onboard resources
Solution Approach 1:
The patent divides the large-scale model inference task into multiple segments that can be distributed across multiple UAV nodes. Each UAV node processes a portion of the inference task, enabling the cluster to handle models that exceed the capabilities of individual nodes while leveraging the collective computing resources of the entire UAV cluster.
2Adaptability or versatility
If a fixed scheduling strategy is used, then the system is simple to implement, but it cannot adapt to dynamic changes in computing and memory capabilities of UAV nodes
Solution Approach 1:
The patent implements a dynamic scheduling strategy that continuously monitors the computing and memory capabilities of UAV nodes and adjusts task allocation in real-time. This dynamic approach allows the system to adapt to changing node capabilities, ensuring optimal resource utilization and task completion even as node performance varies during operation.
Solution Approach 2:
The system incorporates feedback mechanisms where UAV nodes report their status and performance metrics to the coordination server, which then adjusts the scheduling strategy accordingly. This feedback loop enables the system to respond to dynamic changes in node capabilities, balancing adaptability with manageable complexity through automated decision-making based on real-time data.
3Power
If the UAV transmits data to cloud data center, then powerful computing resources can be used, but large delay and network fluctuation occur
Solution Approach 1:
The patent transitions from a single centralized cloud computing dimension to a distributed edge computing dimension by utilizing multiple UAV nodes as intermediate computing resources. This dimensional shift enables the system to leverage powerful computing capabilities closer to the data source, reducing transmission delays and network dependency while maintaining high processing power through collective UAV resources.
4Reliability
If some UAV nodes become unavailable, then the system must handle node failure, but the whole application will crash in traditional architecture
Solution Approach 1:
The patent implements fault tolerance mechanisms that prepare for node failures in advance by distributing tasks across multiple redundant UAV nodes. When a node becomes unavailable, the system has pre-established alternative routing and task redistribution capabilities that prevent application crashes, ensuring continuous operation through proactive failure preparation and elastic resource allocation.
Data Source
AI summary
An elastic cooperative inference architecture and method for UAV cluster can dynamically update the scheduling policy according to the status of each node, and can deal with the failure of some nodes. In addition, the elastic cooperative inference architecture and method can process larger scale complex models on the embedded devices with limited performance carried by UAVs by means of cooperative inference, so as to improve the accuracy of intelligent applications. At the same time, the elastic cooperative inference architecture and method can adaptively update the allocation strategy when some nodes are unavailable or recovered, and improve the survivability of UAV cluster through elastic coordination.