A Tidal Phenomena Control Method for Shared Bicycle System Based on Dynamic Electronic Fence and Reinforcement Learning

A technology of electronic fences and shared bicycles, applied in the field of intelligent transportation, can solve problems such as imbalance between supply and demand

Active Publication Date: 2022-04-05
BEIHANG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention proposes a tidal control scheme based on an electronic fence based on a shared bicycle system with reinforcement learning as the core. By regulating and inducing the parking position of pedestrians, the automatic allocation of the bicycle position before the arrival of the traffic peak is realized, thereby solving the problem caused by the tidal phenomenon. supply and demand imbalance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Tidal Phenomena Control Method for Shared Bicycle System Based on Dynamic Electronic Fence and Reinforcement Learning
  • A Tidal Phenomena Control Method for Shared Bicycle System Based on Dynamic Electronic Fence and Reinforcement Learning
  • A Tidal Phenomena Control Method for Shared Bicycle System Based on Dynamic Electronic Fence and Reinforcement Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The invention provides a tidal control method for a shared bicycle system based on reinforcement learning. As a typical reinforcement learning algorithm, Deep-Q-Network can avoid the establishment of complex and accurate mathematical models in the process of solving intelligent optimization problems, and effectively schedule the size of the electronic fence in the shared bicycle system before the tidal phenomenon of shared bicycles occurs. The bicycles are induced to the electronic fence area with high demand, thereby improving the utilization rate of shared bicycles and the satisfaction of pedestrians. In order to gain a clearer understanding of the technical solutions, features and advantages of the present invention, a detailed description will be given below in conjunction with the accompanying drawings. Overall structure of the present invention, see figure 1 As shown, its specific implementation steps are:

[0029] Step 1, determine the status information of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention faces the imbalance between supply and demand of the shared bicycle system, and proposes a tidal phenomenon control method of the shared bicycle system based on dynamic electronic fence and reinforcement learning, including the following steps: (1) determining the state information of the electronic fence group; (2) Determine the scheduling action of the electronic fence; (3) determine the behavior and interaction of the agent; (4) determine the current benefits that can be obtained by taking action a; (5) determine the reinforcement learning environment in the electronic fence scheduling system; (6) determine the The agent state transition rules of the DQN neural network; (7) Construct the DQN neural network and perform forward calculation; (8) Use the random exploration strategy to select each output action; (9) Training and parameter update of the DQN neural network model (10) Judging whether the training of the DQN neural network is completed; (11) Inputting the initial moment and the initial state of the electronic fence group into the trained neural network to obtain the control strategy of the electronic fence.

Description

(1) Technical field [0001] Aiming at the imbalance between supply and demand of the urban shared bicycle system, the present invention proposes a tidal phenomenon control method of the shared bicycle system based on dynamic electronic fence and reinforcement learning. This method is based on the premise of limited number of bicycles and dynamic electronic fence, and uses reinforcement learning method to scale the electronic fence and induce pedestrians to park their bicycles to a reasonable position before the tide phenomenon comes. This method aims to improve customer satisfaction and bicycle utilization, and establishes a reinforcement learning model based on Deep Q Network (DQN) to optimize the control and decision-making of the tidal phenomenon of shared bicycles, thereby alleviating or solving the tides in the shared bicycle system. Phenomenon. The method belongs to the field of intelligent transportation. (2) Background technology [0002] In order to alleviate urban...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06Q10/06G06Q30/06G06Q50/30G06N3/08
CPCG06Q10/0631G06Q30/0645G06Q50/30G06N3/084
Inventor 冯强贾露露任羿孙博杨德真王自力
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products