28 results about "Queue stability" patented technology

The invention relates to a vehicle queue cooperative control method fusing deep reinforcement learning communication time delay compensation, and belongs to the technical field of intelligent vehicle control. For the problems of control error accumulation and queue instability caused by communication time delay in the vehicle-road cloud cooperative system, a solution integrating deep reinforcement learning prediction and preset performance control is provided. According to the technical scheme, the method comprises the following steps: constructing a vehicle state prediction model based on a DDPG algorithm, and generating a time delay compensation amount in real time; establishing a vehicle dynamics model containing communication time delay, and designing a sliding mode controller based on a barrier function; and dynamically adjusting the control constraint in combination with an adaptive error boundary mechanism. According to the method, through closed-loop fusion of prediction compensation and dynamic constraint, under the scene of burst communication delay (100-400 ms), the queue spacing error is reduced by 62%, the speed tracking error is still kept to be smaller than 0.3 m / s, and the queue stability and the anti-jamming capability are remarkably improved.

The invention provides an integral shopping mall order rolling processing optimization method and system based on big data, and the method comprises the steps: employing a dynamic priority adjustment mechanism for a conflict order list, and adjusting the order processing priority based on the user behavior track data, including historical exchange preference, and obtaining a resource distribution scheme; integrating the order sequence through a queue reordering mechanism, reordering based on the resource allocation scheme to obtain a final processing sequence, preferentially executing the high-priority request, and maintaining the queue stability at the same time; if residual conflicts exist in the final processing sequence, supplementary resources are extracted from a preset standby inventory through a standby resource set scheduling mechanism, a complete execution plan is obtained, and the plan covers all order processing paths; and on the basis of the complete execution plan, monitoring the order processing progress, and obtaining a stable operation order flow through progress tracking and anomaly detection, real-time state feedback and iterative adjustment.

The invention discloses a heterogeneous vehicle queue control method for cooperative communication and energy consumption optimization. A three-order heterogeneous multi-vehicle queue model, a dynamic event trigger mechanism module, a network update law evaluation module and an optimal queue controller module are included. Defining a local consistency error through heterogeneous vehicle formation information, and constructing a dynamic event triggering mechanism according to the local consistency error; according to the local consistency error and an error value output by the optimal queue controller module, designing an evaluation network weight updating law; and deriving the local consistency error to obtain the state of the local consistency error, and learning an optimal cost function and an optimization controller online in combination with an integral reinforcement learning algorithm and the evaluation network weight update law, so as to construct an optimal queue controller module. According to the method, the number of communication times between vehicles is reduced through a dynamic event triggering mechanism, and communication resources are saved. And meanwhile, the queue stability is realized in the optimal queue controller module, and the problem of minimization of energy consumption is solved.

The invention discloses a multi-base-station cooperative wireless resource allocation method based on queue sensing, relates to the technical field of electronic communication, and provides a low-complexity distributed resource optimization solution aiming at the problem of random arrival of URLLC service in a multi-cell cellular system. The resource management problem of dynamic URLLC task multi-time-slot downloading under dense cellular network deployment is researched, and the defect that queue stability is neglected in an existing scheme is overcome; a multi-dimensional time coupling amount is decoupled by converting an original problem into a series of online sub-problems with the maximum rate, and then a distributed algorithm with multiple parallel base stations is provided to decompose global calculation tasks to the respective base stations, so that the calculation complexity is reduced; the method can effectively adjust the compromise between the throughput and the queue cache, and has obvious advantages in the aspect of improving the long-term performance of the system.

The invention provides an on-line resource management system and method oriented to a requirement of integration of communication, inductance and calculation, and the method comprises the steps: carrying out the correlation scheduling constraint between a sensing target and edge intelligent equipment under the constraint of transmitting power resources, the constraint of calculation resources of a base station end, the constraint of long-term queue backlog and the constraint of average power; constructing a non-convex optimization problem of the common inductance calculation integrated system under a long-term optimization framework; and solving the non-convex optimization problem to obtain an optimal perception scheduling decision, an optimal transmitting beam forming vector of perception and communication, an optimal receiving beam forming variable of perception echoes and calculation resource allocation of a base station end. The online resource management strategy provided by the invention aims to maximize the long-term weighted average rate, meet the requirements of queue stability, average power constraint and quality of service (QoS) at the same time, and explore the cooperative gain of the communication, inductance and calculation integrated system from a long-term perspective.

The invention provides a service demand-oriented 5G network slice dynamic arrangement method, which belongs to the technical field of 5G communication, and comprises the following steps of: establishing a network optimization model comprising a differential transmission rate model, a system utility model and a queue delay model; in combination with the network optimization model, proposing a random optimization problem of meeting a queue stability condition, a bandwidth allocation scheme, a time delay maximum threshold value and a minimum total cost in a multi-service coexistence scene of the power internet of things; and solving a stochastic optimization problem, decomposing the randomness of the problem into joint optimization of a queue drift amount and a cost penalty term, and carrying out collaborative optimization on time delay and throughput based on a dual-time scale mechanism dynamic decision. The method has the advantages that efficient collaborative management of network resources in a multi-service scene is realized; through dynamic weight adjustment and real-time resource allocation, the time-varying characteristics of the service priority and the channel state are considered, and a solution which is high in adaptability and stable is provided for network slice management.

The application provides a virtual power plant dynamic feasible region solving method and system based on coupling constraint decoupling, belongs to the technical field of power plant resource allocation management, establishes a virtual power plant model considering distributed energy and flexible load resources, and determines a virtual power plant feasible region solving model based on a vertex search method; through Lyapunov optimization, virtual queues of energy storage, heating ventilation air conditioning and electric vehicles and other flexible loads are respectively established, and the time coupling constraint of the flexible load is decoupled into a virtual queue stability problem; a virtual time queue is constructed to integrate the decoupled optimization problem into the virtual power plant dynamic feasible region solving of day-ahead and day-ahead, so that the day-ahead and day-ahead feasible region solving algorithm is obtained. Based on the Lyapunov optimization theory, the time coupling constraint is decoupled, a weight coefficient is introduced, and a mathematical model taking the vertex search and queue stability as targets is provided, and finally the virtual power plant dynamic feasible region solving of day-ahead and day-ahead is realized.

Aspects of this disclosure relate to methods of cross layer rate selection and related controllers and systems. A media access control scheduler can select a rate for transmitting data for a wireless terminal based on a queue stability metric and a predicted transmission rate associated with the wireless terminal. Information identifying the rate can be sent to an application server. The rate can then be used by application server to send data for the wireless terminal to an access point via an access point controller, in which the access point can wirelessly serve the wireless terminal.

The application discloses a low-altitude unmanned aerial vehicle communication and perception integrated beamforming method based on queue stability, which comprises the following steps: establishing a system model under a low-altitude unmanned aerial vehicle communication and perception integrated scene; the system model comprises a communication and perception signal propagation model between an unmanned aerial vehicle and a ground user and a data transmission queue model at the unmanned aerial vehicle end; establishing a long time slot optimization problem of the low-altitude unmanned aerial vehicle communication and perception integrated beamforming, converting the long time slot optimization problem into a short time slot optimization problem based on a current time slot state; solving the short time slot optimization problem to obtain a beamforming weight vector meeting the communication performance, the perception performance and the queue stability requirements. The application can effectively balance the transmission power consumption and the data transmission stability of the unmanned aerial vehicle system while guaranteeing the communication and perception performances, and realizes minimization of long-term average power consumption.

The invention discloses an EdgeManager framework and AIoT system resource management method and detection method based on Lyapunov optimization, the method comprises the first step of EdgeManager system model construction and the second step of dynamic resource management, and the dynamic resource management method comprises task dynamic allocation, communication and computing resource allocation, a HyDRL-MO hybrid optimization algorithm and Lyapunov optimization. And the Lyapunov optimization comprises queue stability processing based on the Lyapunov optimization and deep learning online resource management based on an EdgeManager framework. Through the EdgeManager framework provided by the invention, the resource management efficiency and reasoning performance in an edge intelligent environment can be remarkably improved, and effective support is provided for industrial automation, large-scale video monitoring and other application scenes with high QoS (Quality of Service) requirements.

The present invention discloses an input saturation passive control method for a collaborative adaptive cruise control system, which is used to solve the queue stability control problem in the CACC system. Specifically, it includes: 1. Establishing the kinematic equations between vehicles; 2. Converting the queue stability condition into an input saturation constraint, thereby obtaining a state space expression with saturated input; 3. Designing a passive controller for the system based on the Riccati equation, Lyapunov stability theory and matrix theory; 4. Verifying whether the designed controller can still maintain the stability of the queue in the presence of disturbances. The results verify that the device based on the passive control can not only have strong robustness to disturbances, but also has the function of input limiting, which ensures the stability of the queue and is easy to calculate.

This invention discloses a client selection method and system for multi-task federated learning. Addressing the shortcomings of client selection and insufficient consideration of task urgency in multi-task dynamic federated learning scenarios, this invention first constructs a multi-task federated learning system model, defining a utility function that includes learning quality and penalty terms. Second, it establishes fairness constraints and introduces a fairness queue to transform the problem into a queue stability problem. Then, based on Lyapunov optimization theory, it constructs a drift-plus-utility function, transforming a long-term stochastic optimization problem into a deterministic optimization problem for each round of communication by minimizing its upper bound. Finally, it constructs an auxiliary bipartite graph to transform client selection into a minimum-weight bipartite graph matching problem. This invention, by jointly optimizing fairness, learning quality, and task urgency through the Lyapunov framework, transforms long-term constraints into a solvable problem for each round, reducing computational complexity and achieving efficient and fair dynamic client selection.

An object recognition method using queue-based model selection and optical flow in an autonomous driving environment includes preprocessing data through a dense flow in a matrix form by calculating an optical flow of images captured consecutively in time by a sensor for an autonomous vehicle, generating a confidence mask by generating a vectorized confidence threshold representing a probability that there is a moving object for each cell of the preprocessed matrix, determining whether there is a moving object on the images by mapping the images captured consecutively in time to the confidence mask, and selecting an object recognition model using a tradeoff constant between object recognition accuracy and queue stability in each time unit. Accordingly, it is possible to improve the performance of object recognition in an autonomous driving environment by applying the optical flow to the confidence threshold of the object recognition system.

The invention provides a mixed traffic queue stability assessment method, unit and electronic equipment, and relates to the technical field of intelligent traffic. On the basis of considering the permeability of intelligent connected vehicles in mixed traffic, the information flow topological structure and the maximum queue size of a mixed vehicle queue are considered in an emphasized manner; based on the information flow topological structure of the hybrid vehicle queue, the maximum queue size and the permeability of the intelligent connected vehicles in the hybrid traffic, the stability of the hybrid traffic queue is evaluated, the stability of the hybrid traffic flow queue can be evaluated objectively and comprehensively, and the accuracy of stability evaluation of the hybrid traffic is improved.

The application provides a big data-based integral mall order rolling processing optimization method and system, which comprises the following steps: for the conflict order list, a dynamic priority adjustment mechanism is adopted, the order processing priority is adjusted based on the user behavior trajectory data including historical exchange preferences, and a resource allocation scheme is obtained; the order sequence is integrated through a queue reordering mechanism, the order sequence is rearranged based on the resource allocation scheme, a final processing sequence is obtained, the high-priority request is preferentially executed, and the queue stability is maintained; if there is a remaining conflict in the final processing sequence, a standby resource set scheduling mechanism is used to extract supplementary resources from a pre-device inventory, a complete execution plan is obtained, and the plan covers all order processing paths; based on the complete execution plan, the order processing progress is monitored, the real-time state is fed back through progress tracking and abnormality detection, iterative adjustment is performed, and a stable running order flow is obtained.

The invention discloses a traffic signal control system, method and device considering stability of average queuing length, and belongs to the technical field of intelligent traffic. The system comprises a vehicle-mounted unit, a roadside unit and a roadside signal machine, and the vehicle-mounted unit is connected with the roadside unit and used for collecting vehicle information and sending the vehicle information to the roadside unit; the roadside unit is connected with the roadside signal machine, analyzes the queue stability through a stability index calculation method based on a quadratic function based on vehicle information, and constructs a multi-objective optimization strategy of traffic signal control; and the roadside signal machine is used for receiving the multi-target optimization strategy to control the signal lamp. The signal lamp is controlled based on the multi-objective optimization strategy provided by the invention, and the traffic capacity of the intersection can be effectively improved.

The invention discloses a CACC controller parameter optimization method considering communication delay and a related device, and the method comprises the steps: building a CACC model, and determining the stability constraint and communication delay boundary of the CACC model; constructing an optimization objective function according to the CACC model, and constructing a Gaussian process model based on the optimization objective function; and based on the Gaussian process model, solving optimal parameters in the stable region by using a Bayesian optimization algorithm. On the basis of a stability optimization framework of the CACC model, the Bayesian optimization algorithm is introduced innovatively, accurate optimization of parameters of the CACC controller under communication delay constraints is realized, and queue stability and disturbance suppression capability are improved.

The present invention discloses a hybrid RIS-assisted long-term energy efficiency optimization method for a non-cellular network. The method comprises: establishing a multi-RAU multi-user link reception signal model; establishing a long-term energy efficiency optimization model based on the signal model, which performs hybrid RIS component switching scheduling, RAU precoding, hybrid RIS phase shifting, and network queue backlog stability control design based on physical layer channel and network layer queue information; transforming the long-term queue stability constraint into a joint optimization problem of minimizing Lyapunov drift and maximizing energy efficiency, and decoupling it into a transmission subproblem and a switching subproblem; transforming the discrete RIS component selection constraints based on the large-M method, and solving the transmission subproblem within each time slot using continuous convex approximation and semidefinite relaxation; deriving the maximum number of active components that can be enabled in the hybrid RIS, and transforming the component selection combinatorial optimization problem into multiple switching subproblems that can be solved in parallel using a greedy algorithm. The method can effectively stabilize the queue length within the Lyapunov framework and ensure system stability.

The application relates to a wireless network congestion control optimization method based on a heavy ball method, which comprises the following steps: initialization, selection of system parameters and iteration step length; emptying all queues at the initial state; initial value assignment of weights; iteration, start of calculation of the difference of the weight parameters, determination of a service rate for each link by a scheduling module to obtain a service rate vector; congestion control, determination of an integer random variable for each data flow, wherein the random variable needs to meet the constraint of queue stability; update of the queue length and update of the weight parameters by using the heavy ball method; and finally, return to the iteration start point until the algorithm converges. The application realizes the maximization of network utility under the constraint of queue stability by introducing the heavy ball method based on momentum, effectively reduces the queue delay, and achieves the effect of improving the communication quality by reliable resource allocation and routing scheduling when the devices accessing the data link network are continuously increased.

The invention discloses an MEC stable computing migration system based on safety and energy consumption perception. The MEC stable computing migration system comprises the steps that S1, a multi-time-slice constraint and cost optimization problem is decomposed into single time slices through Lyapunov optimization; s2, taking the data arrival scale and the channel gain in each time slot as the input of an act-critic model, and generating a plurality of candidate unloading actions; and S3, the risk probability constraint of the current time slot is satisfied, and the security service with the lowest time and energy consumption cost is selected. And S4, converting the transmission time distribution of the equipment which is determined to be unloaded into a knapsack problem for solving. And S5, selecting an unloading action with an optimal target value, and matching the unloading action with environment input to serve as a training sample. And S6, along with the continuous generation of the model, selecting, updating and outputting the optimal unloading strategy of each device in multiple time slots. The invention provides a security and energy consumption perception stable computation unloading (LySESO) scheme based on a Lyapunov framework in an MEC and an act-critic model in a DRL, and is used for solving the computation unloading problem with a dynamic MEC environment and security threats, so that the total energy consumption of a system is reduced while the stability of a task backlog queue is ensured. According to the method, openness and dynamism of the edge cloud environment are considered, long-term task queue stability and safety requirements are guaranteed, the total energy consumption of a task unloading system is reduced, and the method has excellent commercial value.

A switch dynamic ECN configuration method and system based on reinforcement learning and a switch belong to the field of network congestion control and AI optimization, and the method comprises the following steps: training a reinforcement learning model by using historical data, deploying the model, collecting multi-dimensional state data S of a switch port in real time, and outputting an ECN configuration action value A; and calculating a reward value R, updating an experience pool in combination with state transition data {S, A, R, S '}, and optimizing a model by adopting a double-inference mechanism, a gradual change epsilon-greedy strategy and historical optimal action backtracking. By dynamically optimizing the ECN threshold, balancing the throughput rate and the queue stability, reducing the packet loss rate and delay jitter and improving the network performance and the model reliability, the method is suitable for a real-time congestion control scene of a large-scale data center switch.

The invention belongs to the technical field of mobile communication, and particularly relates to a random task-oriented intelligent edge collaborative computing unloading method, which comprises the following steps of: constructing an MEC system model, and constructing a random task arrival model, a service cache model, a local task queue model, a collaborative task queue model and an overhead model; constructing a problem model by taking minimization of the long-term time average overhead of the system as an optimization target under a task queue long-term stability constraint condition; converting the problem model through a Lyapunov optimization theory to obtain a single time slot deterministic optimization problem; a single time slot deterministic optimization problem is converted into a De-POMDP problem, a LyMADRL algorithm framework is constructed, and an environment state, local observation, an action and a reward function are obtained; solving by adopting a LyMADRL algorithm based on a CTDE framework to obtain an optimal strategy; the system overhead can be reduced, and the stability of the system task queue is ensured.

The application relates to a micro-service scheduling method and system based on double-layer queue feedback and topology sensing, and the application introduces a shared graph attention network (GAT), deeply fuses and encodes residual computing power of a heterogeneous computing node and time-varying link quality, and gives the scheduling system a structure sensing capability of a global perspective; by establishing a dynamic feasibility action mask and a hierarchical degradation mechanism, the generation of illegal scheduling instructions is cut off from the root, and the physical executability of each decision is ensured. A virtual queue tracking mechanism is introduced to realize nanosecond-level real-time cumulative evaluation of scheduling actions in the same time slot on node load, and fine load sharing is realized in a concurrent storm; a Lyapunov drift and punishment principle is introduced to construct a composite reward function, guiding the DSAC agent to complete joint optimization of delay, energy consumption and queue stability in adaptive exploration.

The application provides a connected vehicle elastic distributed control method based on a limited time privacy protection mechanism, and relates to the technical field of intelligent transportation systems and vehicle control. The application realizes flexible privacy protection by introducing a mask function that decays over time, and realizes queue stability under hybrid attacks by combining a radial basis function neural network and a backstepping method to design an elastic controller.

The application belongs to the technical field of unmanned aerial vehicle cluster control, and particularly relates to an unmanned aerial vehicle cooperative reasoning and time delay control optimization method based on Lyapunov theory, which converts long-term average constraints into queue stability problems, designs suitable reward functions and algorithm architectures, and realizes effective balance among delay, energy consumption and system stability. First, an instant cost function is defined, and long-term average delay and energy consumption constraints are converted into instant delay and energy consumption of each time slot. Then, three queue models are constructed to describe the operation characteristics of the system: an actual task queue, a virtual delay queue and a virtual energy consumption queue. Finally, online optimization is carried out based on the Lyapunov algorithm, so as to minimize instant delay and energy consumption while ensuring system stability.

This invention discloses an energy-saving task scheduling method, apparatus, and equipment for campuses and data centers. The method includes: acquiring the directed acyclic graph structure, deadlines, and wireless link status of terminal jobs, and collecting electricity price information that changes dynamically over time; constructing a task scheduling model with energy consumption and electricity cost as optimization objectives; constructing an objective function and constraint terms reflecting multi-task resource competition and queue stability based on Lyapunov drift with penalty; constructing a heterogeneous graph containing task nodes and resource nodes, and using a graph neural network to jointly output task offloading decisions and task delay processing times. This invention achieves timed processing and collaborative offloading of campus and data center jobs under dynamic electricity price environments. While ensuring jobs do not exceed deadlines, it schedules executable tasks to periods with lower electricity prices as much as possible, improving resource utilization and reducing system energy consumption and electricity costs by sacrificing some communication costs.

A task-dependent long-slot general computing resource allocation method belongs to the field of communication, and comprises the following steps: calculating a data uploading rate by a CPU (Central Processing Unit); the CPU calculates task delay consumption of each user; the CPU constructs a long-time-slot task scheduling optimization model, decouples a long-time-slot task scheduling optimization problem into a single-time-slot optimization sub-problem by adopting a Lyapunov optimization method, and solves and obtains an optimal long-time-slot task scheduling scheme by utilizing a reinforcement learning method; and the CPU sends the optimal long time slot task scheduling scheme to the requesting user and each access point for service. According to the method, long-term queue stability, task dependence management and time delay optimization are converted into a real-time decision problem, a virtual queue mechanism is adopted to perceive a network state, and power distribution, a task unloading proportion and access point computing resource scheduling are optimized in combination with reinforcement learning. Through task dependency analysis, the execution sequence of the sub-tasks can be optimized, the waiting time is shortened, and the parallel processing capacity is improved under the condition that computing resources are limited.

The invention discloses a low-altitude unmanned aerial vehicle communication and sensing integrated beam forming method based on queue stability. The method comprises the following steps: establishing a system model in a low-altitude unmanned aerial vehicle communication and sensing integrated scene; the system model comprises a communication and sensing signal propagation model between the unmanned aerial vehicle and a ground user, and a data transmission queue model at an unmanned aerial vehicle end; establishing a long-time-slot optimization problem of low-altitude unmanned aerial vehicle flux-sensing integrated beam forming, and converting the long-time-slot optimization problem into a short-time-slot optimization problem based on a current time slot state; and solving a short-time slot optimization problem to obtain a beam forming weight vector meeting the requirements of communication performance, sensing performance and queue stability. According to the invention, while the communication and sensing performance is ensured, the emission power consumption and the data transmission stability of the unmanned aerial vehicle system are effectively balanced, and the minimization of long-term average power consumption is realized.