Internet of vehicles intrusion detection method and system based on deep reinforcement learning

A technology of intrusion detection and reinforcement learning, applied in the field of network security, can solve problems such as difficult normal behavior modeling

Active Publication Date: 2021-07-06
NORTHWESTERN POLYTECHNICAL UNIV
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Although many methods have been proposed to improve the accuracy of intrusion detection, a significant problem is that it is difficult to select effective features to model normal behavior.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of vehicles intrusion detection method and system based on deep reinforcement learning
  • Internet of vehicles intrusion detection method and system based on deep reinforcement learning
  • Internet of vehicles intrusion detection method and system based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0066] Such as figure 2 As shown, the attacker imposes DDoS attack on the infrastructure server side, we obtain the traffic data and calculate the statistical characteristics on the infrastructure server side, and then feed it back to the server manager, and the server manager uses the deep deterministic policy gradient method (such as image 3 shown) to calculate the predicted value of the traffic at the current moment, and then complete the intrusion detection of itself, so as to achieve the purpose of improving its own security.

[0067] Step 1: Collect traffic data on the infrastructure server side. The traffic data (X(t-100),...,X(t-1)) of the past 100 moments are divided into traffic data based on the TCP protocol (T(t-100),...,T( t-1)) and UDP-based traffic data (U(t-100),...,U(t-1)). Statistical features such as the mean, variance, and sparsity of traffic based on different protocols are calculated for the past 100 moments. The sparsity is the number of non-zero fl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an Internet of Vehicles intrusion detection method and system based on deep reinforcement learning. The method comprises the following steps: calculating statistical characteristics of traffic data at historical moments; establishing a flow prediction model based on a deep reinforcement learning algorithm-a deep deterministic strategy gradient algorithm; wherein the input of the flow prediction model is the statistical characteristics, and the output of the flow prediction model is predicted flow; establishing an intrusion detection model based on a depth deterministic strategy gradient algorithm; wherein the input of the intrusion detection model is the statistical characteristics and the predicted traffic, and the output of the intrusion detection model is a traffic threshold; and performing Internet of Vehicles intrusion detection by comparing the predicted traffic with the traffic threshold. According to the method, the complexity variability of the Internet of Vehicles, the finiteness of computing resources of the infrastructure server side and the accuracy of network intrusion detection can be considered, and the method is more practical. For a complex system of the Internet of Vehicles, the intrusion detection method based on deep reinforcement learning provided by the invention has better performance compared with other existing multipurpose methods.

Description

technical field [0001] The invention relates to the technical field of network security, in particular to a vehicle network intrusion detection method and system based on deep reinforcement learning. Background technique [0002] With the continuous development and successful application of communication network technology, people have put forward higher requirements for Internet of Vehicles services, which directly leads to the increasingly complex structure of Internet of Vehicles. With the increasing complexity and connectivity of modern vehicles, the network security risks of the Internet of Vehicles are becoming more and more prominent. In order to ensure the security and normal operation of the network, real-time and reliable security enhancement methods are essential. As a lightweight security enhancement method, the intrusion detection system can well detect internal and external threats to the network, and has good cost-effectiveness and high compatibility. It is c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06G06N20/00
CPCH04L63/1416H04L63/1458G06N20/00
Inventor 孙文韬吴诒轩聂来森宁兆龙
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products