Vehicle hardware-in-the-loop simulation training system and method based on deep reinforcement learning

A reinforcement learning and vehicle technology, which is applied in the field of vehicle hardware-in-the-loop simulation training system, can solve the problem that the deep reinforcement learning model cannot be effectively transplanted, and achieve the effects of avoiding inadaptability, improving stability, and ensuring adaptability

Active Publication Date: 2021-06-04
BEIHANG UNIV
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the above problems, the present invention proposes a hardware-in-the-loop simulation training system and method for vehicle motion planning based on deep reinforcement learning. The effective operation of the unmanned driving system, so as to solve the problem that the deep reinforcement learning model cannot be effectively transplanted from the virtual simulation vehicle to the unmanned real vehicle

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vehicle hardware-in-the-loop simulation training system and method based on deep reinforcement learning
  • Vehicle hardware-in-the-loop simulation training system and method based on deep reinforcement learning
  • Vehicle hardware-in-the-loop simulation training system and method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The present invention will be further described below in conjunction with the accompanying drawings and examples. It should be understood that the following examples are intended to facilitate the understanding of the present invention, and have no limiting effect on it.

[0046] like figure 1 As shown, the vehicle hardware-in-the-loop simulation training system based on deep reinforcement learning provided by this embodiment includes a virtual simulation unit and a real vehicle controller, wherein the virtual simulation unit includes a simulated vehicle module, a simulation control module, a real vehicle trajectory database, a simulation Sensor module, reset interface and start-stop interface; the real vehicle controller is equipped with ubuntu operating system, deep network learning module, virtual sensor data input interface, data processing module and action output interface.

[0047] The simulated vehicle module of the present invention includes a virtual vehicle m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of unmanned vehicle simulation testing, and particularly relates to a vehicle hardware-in-the-loop simulation training system and method based on deep reinforcement learning. The system comprises a virtual simulation unit and a real vehicle controller, wherein the virtual simulation unit comprises a simulation vehicle module, a simulation control module, a real vehicle track database, a simulation sensor module, a reset interface and a start-stop interface. The real vehicle controller and the virtual simulation scene are subjected to joint simulation training, effective operation of the deep reinforcement learning movementplanning model in a real vehicle unmanned driving system is achieved, and therefore the problem that the deep reinforcement learning model cannot be effectively transplanted from a virtual simulation vehicle to an unmanned real vehicle is solved.

Description

technical field [0001] The invention belongs to the field of unmanned vehicle simulation testing, in particular to a vehicle hardware-in-the-loop simulation training system and method based on deep reinforcement learning. Background technique [0002] The motion planning module is an important technical link for the vehicle to realize unmanned driving. It plays an important role in the unmanned driving perception-motion (planning)-control-execution technology chain, which is equivalent to the driver's brain. In the past, research on motion planning for unmanned vehicles mainly used rule-based methods, model-based methods, and deep learning data "feeding" methods. Since the rule-based and model-based methods can only perform parameter modeling for specific simple scenes, they are not suitable for complex and changeable urban driving scenes. The motion planning model based on deep learning not only needs to collect a large amount of scene data for learning, but also can guaran...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F30/15G06K9/62G06N3/04B60W50/00
CPCG06F30/15B60W50/00G06N3/045G06F18/214Y02T10/40
Inventor 余贵珍廖亚萍周彬李涵陈冠宏
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products