Internet of things transmission method and device based on depth deterministic strategy

Abstract

The invention discloses an Internet of Things transmission method, device and equipment based on a deep deterministic strategy, and a computer readable storage medium. The method comprises the following steps: establishing an information age model and an energy consumption model based on an Internet of Things system model; establishing an optimization problem by taking the minimum information age and energy consumption as optimization targets and taking the sampling decision and transmitting power of the base station and the Internet of Things equipment as optimization variables; two optimization variables of sampling decision and transmitting power in the optimization problem are simplified into one optimization variable with only transmitting power, a state space, an action space and a reward function are established, and a deep reinforcement learning framework is obtained; and an optimal transmission power distribution strategy is obtained by using a DDPG algorithm. According to the method provided by the invention, the problems of timeliness and energy consumption of transmission power in the Internet of Things system are solved through the DDPG algorithm, and the optimal transmission power strategy and the minimum information age and energy consumption of the Internet of Things equipment are solved.

Description

technical field [0001] The present invention relates to the technical field of the Internet of Things, and in particular, to an Internet of Things transmission method, apparatus, device and computer-readable storage medium based on a deep deterministic strategy. Background technique [0002] The Internet of Things (IoT) is a representative part of connecting the physical world with information and communication technology (Information and Communication, ICT). Analysts predict that by 2025, the economic volume related to the IoT industry can reach 11 trillion US dollars, and the number of IoT devices is predicted to reach 500 billion. By 2030, the Internet of Things can affect the entire economy. [0003] There is a typical IoT system architecture, which consists of three layers, namely the perception layer, the network layer and the application layer. The perception layer contains IoT devices (IoTDs) equipped with sensors that can sample information about physical features...

AI Technical Summary

Problems solved by technology

If the information is older, it means that the information received by the application layer is relatively old, and the control decisions obtained from it may not be accurate enough

Images