Intelligent traffic signal lamp intelligent control system and intelligent control device

Abstract

The invention discloses an intelligent traffic signal lamp intelligent control system, which comprises a signal lamp controller, a sensor module, a data processing module, an intelligent decision module and a communication module, and is characterized in that the signal lamp controller is used for receiving traffic data and adjusting signal lamp timing according to a preset algorithm; the sensor module comprises a vehicle detection sensor and a flow monitoring sensor and is used for collecting traffic flow, vehicle speed and traffic flow information in real time. The data processing module is used for processing data acquired by the sensor module and analyzing traffic conditions; the intelligent decision-making module intelligently adjusts a timing scheme of the signal lamp according to an analysis result of the data processing module; according to the wireless traffic signal lamp, the signal lamp body is controlled by adopting a wireless control method, so that the problem that the signal lamp body is bound by a cable is effectively solved.

Description

Technical Field

[0001] The present invention relates to the field of transportation, and in particular to an intelligent control system and an intelligent control device for signal lights of smart transportation. Background Art

[0002] Traditional traffic lights are operated by wired control methods, mainly by laying cables and using cables to transmit signals. However, this control method is relatively complex and costly in terms of construction and maintenance, so wireless control methods are gradually used to replace wired control. The application of wireless communication technology in traffic light control systems has brought significant advantages, including reducing construction costs, improving maintenance efficiency, enhancing expansion capabilities, and improving system performance. The application of this technology eliminates the need to lay cables for the control of traffic lights, thereby simplifying the construction process and reducing costs. In addition, wireless communication technology also supports remote monitoring and diagnostic functions, which can quickly locate faults and repair them, improving maintenance efficiency. At the same time, wireless communication technology makes it simple and quick to increase or decrease traffic light nodes, making it easy to flexibly respond to changes in traffic demand, and uses advanced wireless communication protocols and technologies to ensure the security and reliability of data transmission, thereby improving the overall performance of the system.

[0003] However, whether it is a wired controlled signal light or a wireless controlled signal light, when in use, they are directly fixed and erected at the intersection of the road for observation by the moving vehicles. However, when the moving vehicles are waiting for the signal light or are about to reach the signal light, the distance between the vehicles is not far. However, when a large truck appears in front of the vehicle, it will directly block the line of sight of the rear vehicle, so that the rear vehicle will not be able to observe the signal light well, which is not conducive to the driving of the rear vehicle. Summary of the invention

[0004] The purpose of the present invention is to provide an intelligent control system and an intelligent control device for traffic lights to solve the above-mentioned technical problems.

[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0006] A smart traffic signal light intelligent control system, comprising: a signal light controller, a sensor module, a data processing module, an intelligent decision-making module and a communication module, wherein the signal light controller is used to receive traffic data and adjust the signal light timing according to a preset algorithm;

[0007] The sensor module includes a vehicle detection sensor and a flow monitoring sensor for collecting traffic flow, vehicle speed, and vehicle flow information in real time;

[0008] The data processing module is used to process the data collected by the sensor module and analyze the traffic conditions;

[0009] The intelligent decision-making module intelligently adjusts the timing scheme of the traffic lights according to the analysis results of the data processing module;

[0010] The communication module is used to exchange data with other traffic management systems.

[0011] Preferably, the intelligent decision-making module has a built-in DQN model;

[0012] The DQN model consists of the following main components:

[0013] Q-network: A deep neural network that takes the state of the environment as input and outputs the Q-values ​​of each possible action, usually a convolutional neural network.

[0014] Experience replay: In order to break the correlation between data, DQN uses an experience replay buffer to store past experiences and randomly extracts these experiences for training during training;

[0015] Target network: During the training process, the target network is used to calculate the target Q value. Usually, the weights of the Q network are copied to the target network at regular intervals to stabilize the training process.

[0016] The training process of the DQN model includes the following steps:

[0017] initialization:

[0018] Initialize the Q network and the target network;

[0019] Initialize the experience replay buffer;

[0020] Execution and data collection:

[0021] Execute the current policy in the environment, collect experience and store it in the replay buffer;

[0022] Sample sampling: randomly sample a small batch of samples from the experience replay buffer;

[0023] Calculate the Q value:

[0024] Calculate the current Q value and the target Q value; the target Q value is usually calculated by the following formula:

[0025] target=reward+γ·maxa′Qtarget(s′,a′)

[0026] Among them, \gammaγ is the discount factor;

[0027] Qtarget(s',a') is the target network's estimate of the Q value of the next state s' and the next action a';

[0028] Update Q network:

[0029] Use gradient descent to minimize the mean square error of the Q value:

[0030] loss = (Q(s,a) - target) 2

[0031] Update the target network:

[0032] Periodically copy the weights of the Q network to the target network to stabilize training;

[0033] Strategy Optimization:

[0034] During the training process, the strategy is gradually optimized. In the early stage, experience is collected through random exploration. As the training progresses, the strategy will gradually tend to the optimal solution;

[0035] Use the ε-greedy strategy to balance exploration and exploitation during training.

[0036] An intelligent control device for a signal light of smart traffic, comprising a support frame, a mounting box is arranged on the support frame, and a signal light body is arranged on the mounting box;

[0037] A reciprocating mechanism, located inside the installation box and fixedly connected to the installation box, the reciprocating mechanism is used to drive the signal light body to reciprocate;

[0038] An alarm mechanism, fixedly mounted on the mounting box, and used to determine whether the reciprocating mechanism is working normally;

[0039] The lifting mechanism is installed inside the installation box, and the lifting mechanism is used to control the reciprocating mechanism to move up and down.

[0040] Preferably, the reciprocating mechanism comprises a mounting plate, which is located inside the mounting box and fixedly connected to the mounting box;

[0041] A double-shaft motor is fixedly connected to the mounting plate, a first reciprocating screw is fixedly connected to the power output shaft of the double-shaft motor, a rotating sleeve is rotatably connected to the first reciprocating screw, and the rotating seat is fixedly connected to the mounting box;

[0042] A threaded block is threadedly connected to the first reciprocating screw rod, and the threaded block is slidably connected to the installation box.

[0043] Preferably, the reciprocating mechanism further comprises a second connecting plate, the mounting box is provided with a groove, and the second connecting plate is located inside the groove;

[0044] The second connecting plate is fixedly connected to the threaded block, the first connecting plate is arranged on the second connecting plate, and the first connecting plate is connected to the second connecting plate by bolts.

[0045] Preferably, the alarm mechanism comprises a mounting cover, and the mounting cover is fixedly connected to the mounting box;

[0046] A sliding plate is slidably connected inside the mounting cover, a friction ring is fixedly connected to the sliding plate, a rack is fixedly connected to the sliding plate, a first gear is meshed on the rack, a third rotating shaft is fixedly connected to the first gear, and the third rotating shaft is rotatably connected to the mounting box;

[0047] The third rotating shaft is fixedly connected with a fifth rotating shaft, the fifth rotating shaft is rotatably connected with a power storage box, the power storage box is fixedly connected with a mounting box, and a coil spring is installed inside the power storage box in conjunction with the fifth rotating shaft.

[0048] Preferably, a pressing column is fixedly connected to the sliding disk, a self-resetting pressing switch is fixedly connected to the mounting box, an alarm is fixedly mounted on the mounting cover, and the alarm is electrically connected to the self-resetting pressing switch.

[0049] Preferably, the lifting mechanism includes a fourth rotating shaft, and the fourth rotating shaft is fixedly connected to the power output shaft of the dual-shaft motor;

[0050] The fourth rotating shaft is fixedly connected with a connecting rod, the connecting rod is fixedly connected with a driving disk, the driving disk is rotatably connected with the installation box, a tooth groove is penetrated through the driving disk, a second rotating shaft is arranged inside the tooth groove, a paddle piece is fixedly installed on the second rotating shaft, the paddle piece is located inside the tooth groove, a rotating frame is rotatably connected with the second rotating shaft, and the rotating frame is fixedly connected with the installation box.

[0051] Preferably, the lifting mechanism further comprises a first bevel gear, the first bevel gear is fixedly connected to the second rotating shaft, and a second bevel gear is meshed on the first bevel gear;

[0052] A second reciprocating screw rod is rotatably mounted inside the support frame, a slide groove is penetrated through the second reciprocating screw rod, a slide bar is slidably connected inside the slide groove, and the slide bar is fixedly connected to the second bevel gear;

[0053] A threaded plate is rotatably connected to the second bevel gear, the threaded plate is threadedly connected to the second reciprocating screw, the threaded plate is slidably connected to the support frame, and the threaded plate is fixedly connected to the installation box.

[0054] Preferably, a fourth bevel gear is fixedly connected to the second reciprocating screw, a third bevel gear is meshed with the fourth bevel gear, a first rotating shaft is fixedly connected to the third bevel gear, and the first rotating shaft passes through the support frame and is rotatably connected to the support frame.

[0055] The beneficial effects of the present invention are:

[0056] 1. The present invention controls the signal light body by adopting a wireless control method, which effectively solves the problem that the signal light body is bound by cables, and the signal light body can be controlled by a dual-axis motor to continuously slide back and forth on the installation box, so that the position of the signal light body will change continuously. In this way, when the vehicle behind the road is blocked by the vehicle in front, the indication of the signal light can still be observed after the signal light body moves to a certain position, which is convenient for the vehicle driver to effectively view the indication of the signal light body.

[0057] 2. In the process of controlling the reciprocating movement of the signal light body, the present invention will continuously squeeze the rack to move. The movement of the rack can drive the rotation of the coil spring, thereby achieving the effect of storing force. In this way, after each coil spring stores force and starts to release it, it can continuously drive the friction circle to move. The friction force of the friction circle will slow down its movement. In this way, when the pressing column has not pressed the self-resetting press switch, the rack is squeezed to squeeze the drive disk, so that the alarm can be controlled not to sound an alarm. However, when the alarm sounds an alarm, it means that there is a problem with the movement of the signal light body and it can be repaired in time.

[0058] 3. The present invention can make the signal light body continuously move down along the support frame by controlling the reverse rotation of the dual-axis motor, so that it is convenient to land the signal light body on the ground, which is convenient for subsequent inspection and maintenance. When the dual-axis motor and the signal light body fail at the same time, they can also be lowered by manual operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 It is a structural schematic diagram of the present invention; Figure 2 It is a rear view of the present invention; Figure 3 It is a schematic diagram of the internal structure of the installation box of the present invention; Figure 4 It is a schematic diagram of the internal structure of the mounting cover of the present invention; Figure 5 for Figure 4 A magnified schematic diagram of part A; Figure 6 It is a schematic diagram of the connection between the first bevel gear and the dual-shaft motor of the present invention; Figure 7 It is a schematic diagram of the internal structure of the support frame of the present invention; Figure 8 It is a schematic diagram of the connection between the second bevel gear and the second reciprocating screw rod of the present invention; Fig. 9 It is a schematic diagram of the internal structure of the power storage box of the present invention.

[0068] 1. The first gear is the gear of the first rotating shaft; 2. The second gear is the gear of the second rotating shaft; 3. The gear of the first rotating shaft is the gear of the second rotating shaft; 4. The gear of the first rotating shaft is the gear of the second rotating shaft; 5. The gear of the first rotating shaft is the gear of the second rotating shaft; 6. The gear of the first rotating shaft is the gear of the second rotating shaft; 7. The gear of the second rotating shaft is the gear of the first rotating shaft; 8. The gear of the first rotating shaft is the gear of the second rotating shaft; 9. The gear of the first rotating shaft is the gear of the second rotating shaft; 10. The gear of the first rotating shaft is the gear of the second rotating shaft; 11. The gear of the first rotating shaft is the gear of the second rotating shaft; 12. The gear of the first rotating shaft is the gear of the second rotating shaft; 13. The gear of the first rotating shaft is the gear of the second rotating shaft; 14. The gear of the second rotating shaft is the gear of the first rotating shaft; 15. The gear of the first rotating shaft is the gear of the first rotating shaft; 16. The gear of the first rotating shaft is the gear of the second rotating shaft; 17. The gear of the first rotating shaft is the gear of the first rotating shaft; 18. The gear of the first rotating shaft is the gear of the first rotating shaft; 19. The gear of the first rotating shaft is the gear of the second rotating shaft; 20. The gear of the first rotating shaft is the gear of the first rotating shaft; 21. The gear of the first rotating shaft is the gear of the first rotating shaft; 22. The gear of the first rotating shaft is the gear of the second rotating shaft; 23. The gear of the first rotating shaft is the gear of the first rotating shaft; 24. The gear of the first rotating shaft is the gear of the second rotating shaft; 25. The gear of the first rotating shaft is the gear of the first rotating shaft; 26. The gear of the first rotating shaft is the gear of the first rotating shaft; 27. The gear of the DETAILED DESCRIPTION

[0069] In order to make the technical means, creative features, objectives and effects of the present invention easy to understand, the present invention is further described below in conjunction with specific embodiments and drawings, but the following embodiments are only preferred embodiments of the present invention, not all. Based on the embodiments in the implementation mode, other embodiments obtained by those skilled in the art without creative work are all within the scope of protection of the present invention.

[0070] The specific embodiments of the present invention are described below with reference to the accompanying drawings.

[0071] Embodiment 1:

[0072] like Figure 1-9 As shown, a smart traffic signal light intelligent control device includes a support frame 1, a mounting box 3 is arranged on the support frame 1, and a signal light body 2 is arranged on the mounting box 3;

[0073] A reciprocating mechanism, located inside the installation box 3 and fixedly connected to the installation box 3, and used to drive the signal light body 2 to reciprocate;

[0074] An alarm mechanism, fixedly mounted on the mounting box 3, is used to determine whether the reciprocating mechanism is working normally;

[0075] The lifting mechanism is installed inside the installation box 3, and is used to control the reciprocating mechanism to move up and down.

[0076] The reciprocating mechanism includes a mounting plate 11, which is located inside the mounting box 3 and fixedly connected to the mounting box 3;

[0077] A dual-axis motor 10 is fixedly connected to the mounting plate 11, a first reciprocating screw rod 12 is fixedly connected to the power output shaft of the dual-axis motor 10, a rotating sleeve is rotatably connected to the first reciprocating screw rod 12, and a rotating seat 15 is fixedly connected to the mounting box 3;

[0078] A threaded block 16 is threadedly connected to the first reciprocating screw rod 12 , and the threaded block 16 is slidably connected to the installation box 3 .

[0079] The reciprocating mechanism further includes a second connecting plate 14. A groove is formed on the mounting box 3, and the second connecting plate 14 is located inside the groove.

[0080] The second connecting plate 14 is fixedly connected to the threaded block 16 . The first connecting plate 13 is disposed on the second connecting plate 14 . The first connecting plate 13 is connected to the second connecting plate 14 by bolts.

[0081] Start the dual-axis motor 10, the dual-axis motor 10 will drive the first reciprocating screw 12 to rotate, the first reciprocating screw 12 will drive the threaded block 16 to move, the threaded block 16 will drive the signal light body 2 to move through the first connecting plate 13 and the second connecting plate 14, so that the signal light body 2 can effectively move back and forth on the mounting box 3, which is convenient for the vehicle driver to view from multiple angles.

[0082] Embodiment 2:

[0083] like Figure 1-9 As shown, when other parts are the same as those of Example 1, the difference between this embodiment and Example 1 is that: the alarm mechanism includes a mounting cover 4, and the mounting cover 4 is fixedly connected to the mounting box 3;

[0084] A sliding plate 20 is slidably connected inside the mounting cover 4, a friction ring 19 is fixedly connected to the sliding plate 20, a rack 23 is fixedly connected to the sliding plate 20, a first gear 22 is meshed on the rack 23, a third rotating shaft 17 is fixedly connected to the first gear 22, and the third rotating shaft 17 is rotatably connected to the mounting box 3;

[0085] The third rotating shaft 17 is fixedly connected with a fifth rotating shaft 35 , and the fifth rotating shaft 35 is rotatably connected with a power storage box 21 . The power storage box 21 is fixedly connected with the installation box 3 , and a coil spring 36 is installed inside the power storage box 21 in coordination with the fifth rotating shaft 35 .

[0086] A pressing column is fixedly connected to the sliding plate 20 , a self-resetting pressing switch 18 is fixedly connected to the mounting box 3 , an alarm 5 is fixedly mounted on the mounting cover 4 , and the alarm 5 is electrically connected to the self-resetting pressing switch 18 .

[0087] Whenever the threaded block 16 moves to a position close to the mounting cover 4, the threaded block 16 will squeeze the rack 23, and the rack 23 will drive the driving plate 24 and the friction ring 19 away from the mounting box 3;

[0088] The rack 23 also drives the first gear 22 to rotate, the first gear 22 drives the third shaft 17 to rotate, the third shaft 17 drives the fifth shaft 35 to rotate, and the fifth shaft 35 drives the coil spring 36 to rotate, so that the coil spring 36 can effectively store force;

[0089] When the threaded block 16 does not act on the rack 23, the coil spring 36 releases its force, causing the drive disk 24 to continuously approach the mounting box 3. Due to the friction ring 19, the drive disk 24 moves slowly;

[0090] However, the threaded block 16 moves at a fast speed, so when the pressing column has not pressed the self-resetting pressing switch 18, the rack 23 is squeezed to squeeze the driving disk 24, so that the alarm 5 can be controlled not to sound an alarm. However, when the alarm 5 sounds an alarm, it indicates that there is a problem with the movement of the signal lamp body 2, and maintenance can be carried out in time.

[0091] Embodiment 3:

[0092] like Figure 1-9 As shown, when other parts are the same as those of Example 1, the difference between this embodiment and Example 1 is that the lifting mechanism includes a fourth rotating shaft 27, and the fourth rotating shaft 27 is fixedly connected to the power output shaft of the dual-axis motor 10;

[0093] A connecting rod 25 is fixedly connected to the fourth rotating shaft 27, and a driving disk 24 is fixedly connected to the connecting rod 25. The driving disk 24 is rotatably connected to the installation box 3. A tooth groove is penetrated through the driving disk 24, and a second rotating shaft 7 is arranged inside the tooth groove. A paddle plate 26 is fixedly installed on the second rotating shaft 7, and the paddle plate 26 is located inside the tooth groove. A rotating frame 9 is rotatably connected to the second rotating shaft 7, and the rotating frame 9 is fixedly connected to the installation box 3.

[0094] The lifting mechanism further includes a first bevel gear 8, which is fixedly connected to the second rotating shaft 7, and a second bevel gear 29 is meshed on the first bevel gear 8;

[0095] A second reciprocating screw rod 28 is rotatably mounted inside the support frame 1. A slide groove 33 is formed through the second reciprocating screw rod 28. A slide bar 34 is slidably connected inside the slide groove 33. The slide bar 34 is fixedly connected to the second bevel gear 29.

[0096] A threaded plate 30 is rotatably connected to the second bevel gear 29 , the threaded plate 30 is threadedly connected to the second reciprocating screw 28 , the threaded plate 30 is slidably connected to the support frame 1 , and the threaded plate 30 is fixedly connected to the installation box 3 .

[0097] A fourth bevel gear 32 is fixedly connected to the second reciprocating screw 28 , a third bevel gear 31 is meshed with the fourth bevel gear 32 , a first rotating shaft 6 is fixedly connected to the third bevel gear 31 , and the first rotating shaft 6 penetrates the support frame 1 and is rotationally connected to the support frame 1 .

[0098] By controlling the double-axis motor 10 to reverse, the double-axis motor 10 will drive the fourth rotating shaft 27 to rotate, the fourth rotating shaft 27 will drive the driving disk 24 to rotate through the connecting rod 25, the driving disk 24 will drive the second rotating shaft 7 to rotate through the toggle plate 26, the second rotating shaft 7 will drive the second reciprocating screw 28 to rotate through the second bevel gear 29 and the first bevel gear 8, the second reciprocating screw 28 will drive the threaded plate 30 to move downward, because the second bevel gear 29 slides on the second reciprocating screw 28, the entire installation box 3 and its signal lamp body 2 can be moved downward together, so that the signal lamp body 2 will be close to the place, which is convenient for disassembly, replacement and maintenance.

[0099] Embodiment 4:

[0100] like Figure 1-9 As shown, when other parts are the same as those in Example 1, the difference between this embodiment and Example 1 is that:

[0101] A smart traffic signal light intelligent control system, comprising: a signal light controller, a sensor module, a data processing module, an intelligent decision-making module and a communication module, wherein the signal light controller is used to receive traffic data and adjust the signal light timing according to a preset algorithm;

[0102] The sensor module includes a vehicle detection sensor and a flow monitoring sensor, which are used to collect traffic flow, vehicle speed, and vehicle flow information in real time;

[0103] The data processing module is used to process the data collected by the sensor module and analyze the traffic conditions;

[0104] The intelligent decision-making module intelligently adjusts the timing plan of traffic lights according to the analysis results of the data processing module;

[0105] The communication module is used to exchange data with other traffic management systems.

[0106] The intelligent decision-making module has a built-in DQN model;

[0107] The DQN model consists of the following main components:

[0108] Q-network: A deep neural network that takes the state of the environment as input and outputs the Q-values ​​of each possible action, usually a convolutional neural network.

[0109] Experience replay: In order to break the correlation between data, DQN uses an experience replay buffer to store past experiences and randomly extracts these experiences for training during training;

[0110] Target network: During the training process, the target network is used to calculate the target Q value. Usually, the weights of the Q network are copied to the target network at regular intervals to stabilize the training process.

[0111] The training process of the DQN model includes the following steps:

[0112] initialization:

[0113] Initialize the Q network and the target network;

[0114] Initialize the experience replay buffer;

[0115] Execution and data collection:

[0116] Execute the current policy in the environment, collect experience and store it in the replay buffer;

[0117] Sample sampling: randomly sample a small batch of samples from the experience replay buffer;

[0118] Calculate the Q value:

[0119] Calculate the current Q value and the target Q value; the target Q value is usually calculated by the following formula:

[0120] target=reward+γ·maxa′Qtarget(s′,a′)

[0121] Among them, \gammaγ is the discount factor;

[0122] Qtarget(s',a') is the target network's estimate of the Q value of the next state s' and the next action a';

[0123] Update Q network:

[0124] Use gradient descent to minimize the mean square error of the Q value:

[0125] loss = (Q(s,a) - target) 2

[0126] Update the target network:

[0127] Periodically copy the weights of the Q network to the target network to stabilize training;

[0128] Strategy Optimization:

[0129] During the training process, the strategy is gradually optimized. In the early stage, experience is collected through random exploration. As the training progresses, the strategy will gradually tend to the optimal solution;

[0130] Use the ε-greedy strategy to balance exploration and exploitation during training.

[0131] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and descriptions are only preferred examples of the present invention and are not intended to limit the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. An intelligent traffic light control system, comprising: A signal light controller, a sensor module, a data processing module, an intelligent decision-making module and a communication module, wherein the signal light controller is used to receive traffic data and adjust the signal light timing according to a preset algorithm; The sensor module includes a vehicle detection sensor and a flow monitoring sensor for collecting traffic flow, vehicle speed, and vehicle flow information in real time; The data processing module is used to process the data collected by the sensor module and analyze the traffic conditions; The intelligent decision-making module intelligently adjusts the timing scheme of the traffic lights according to the analysis results of the data processing module; The communication module is used to exchange data with other traffic management systems.

2. The intelligent traffic light control system according to claim 1 is characterized by: The intelligent decision-making module has a built-in DQN model; The DQN model consists of the following main components: Q-network: A deep neural network that takes the state of the environment as input and outputs the Q-values ​​of each possible action, usually a convolutional neural network. Experience replay: In order to break the correlation between data, DQN uses an experience replay buffer to store past experiences and randomly extracts these experiences for training during training; Target network: During the training process, the target network is used to calculate the target Q value. Usually, the weights of the Q network are copied to the target network at regular intervals to stabilize the training process. The training process of the DQN model includes the following steps: initialization: Initialize the Q network and the target network; Initialize the experience replay buffer; Execution and data collection: Execute the current policy in the environment, collect experience and store it in the replay buffer; Sample sampling: randomly sample a small batch of samples from the experience replay buffer; Calculate the Q value: Calculate the current Q value and the target Q value; the target Q value is usually calculated by the following formula: target=reward+γ·maxa′Qtarget(s′,a′) Among them, \gammaγ is the discount factor; Qtarget(s',a') is the target network's estimate of the Q value of the next state s' and the next action a'; Update Q Network: Use gradient descent to minimize the mean square error of the Q value: loss=(Q(s,a)-target) 2 Update the target network: Periodically copy the weights of the Q network to the target network to stabilize training; Strategy Optimization: During the training process, the strategy is gradually optimized. In the early stage, experience is collected through random exploration. As the training progresses, the strategy will gradually tend to the optimal solution; Use the ε-greedy strategy to balance exploration and exploitation during training.

3. A smart traffic signal light intelligent control device, comprising a support frame (1), characterized in that: The support frame (1) is provided with a mounting box (3), and the mounting box (3) is provided with a signal light body (2); A reciprocating mechanism, located inside the installation box (3) and fixedly connected to the installation box (3), the reciprocating mechanism being used to drive the signal light body (2) to reciprocate; An alarm mechanism, fixedly mounted on the mounting box (3), the alarm mechanism being used to determine whether the reciprocating mechanism is operating normally; A lifting mechanism is installed inside the installation box (3), and is used to control the reciprocating mechanism to move up and down.

4. The intelligent traffic light intelligent control device according to claim 3 is characterized by: The reciprocating mechanism comprises a mounting plate (11), wherein the mounting plate (11) is located inside the mounting box (3) and is fixedly connected to the mounting box (3); A double-axis motor (10) is fixedly connected to the mounting plate (11), a first reciprocating screw rod (12) is fixedly connected to the power output shaft of the double-axis motor (10), a rotating sleeve is rotatably connected to the first reciprocating screw rod (12), and the rotating seat (15) is fixedly connected to the mounting box (3); A threaded block (16) is threadedly connected to the first reciprocating screw rod (12), and the threaded block (16) is slidably connected to the installation box (3).

5. The intelligent traffic light intelligent control device according to claim 4 is characterized in that: The reciprocating mechanism further comprises a second connecting plate (14), the installation box (3) is provided with a groove, and the second connecting plate (14) is located inside the groove; The second connecting plate (14) is fixedly connected to the threaded block (16); a first connecting plate (13) is arranged on the second connecting plate (14); and the first connecting plate (13) is connected to the second connecting plate (14) via bolts.

6. The intelligent traffic light intelligent control device according to claim 4 is characterized in that: The alarm mechanism comprises a mounting cover (4), and the mounting cover (4) is fixedly connected to the mounting box (3); A sliding plate (20) is slidably connected inside the mounting cover (4), a friction ring (19) is fixedly connected to the sliding plate (20), a rack (23) is fixedly connected to the sliding plate (20), a first gear (22) is meshed on the rack (23), a third rotating shaft (17) is fixedly connected to the first gear (22), and the third rotating shaft (17) is rotatably connected to the mounting box (3); The third rotating shaft (17) is fixedly connected to a fifth rotating shaft (35), a power storage box (21) is rotatably connected to the fifth rotating shaft (35), the power storage box (21) is fixedly connected to the installation box (3), and a coil spring (36) is installed inside the power storage box (21) in conjunction with the fifth rotating shaft (35).

7. The intelligent traffic light intelligent control device according to claim 6 is characterized by: A pressing column is fixedly connected to the sliding plate (20), a self-resetting pressing switch (18) is fixedly connected to the mounting box (3), an alarm (5) is fixedly mounted on the mounting cover (4), and the alarm (5) is electrically connected to the self-resetting pressing switch (18).

8. The intelligent traffic light intelligent control device according to claim 6 is characterized by: The lifting mechanism comprises a fourth rotating shaft (27), and the fourth rotating shaft (27) is fixedly connected to the power output shaft of the dual-shaft motor (10); The fourth rotating shaft (27) is fixedly connected with a connecting rod (25), the connecting rod (25) is fixedly connected with a driving disk (24), the driving disk (24) is rotatably connected with the installation box (3), a tooth groove is penetrated through the driving disk (24), a second rotating shaft (7) is arranged inside the tooth groove, a paddle plate (26) is fixedly installed on the second rotating shaft (7), the paddle plate (26) is located inside the tooth groove, a rotating frame (9) is rotatably connected with the second rotating shaft (7), and the rotating frame (9) is fixedly connected with the installation box (3).

9. The intelligent traffic light intelligent control device according to claim 8 is characterized by: The lifting mechanism further comprises a first bevel gear (8), the first bevel gear (8) being fixedly connected to the second rotating shaft (7), and a second bevel gear (29) being meshed with the first bevel gear (8); A second reciprocating screw rod (28) is rotatably mounted inside the support frame (1), a slide groove (33) is penetrated through the second reciprocating screw rod (28), a slide bar (34) is slidably connected inside the slide groove (33), and the slide bar (34) is fixedly connected to the second bevel gear (29); A threaded plate (30) is rotatably connected to the second bevel gear (29), the threaded plate (30) is threadedly connected to the second reciprocating screw (28), the threaded plate (30) is slidably connected to the support frame (1), and the threaded plate (30) is fixedly connected to the installation box (3).

10. The intelligent traffic light intelligent control device according to claim 9 is characterized in that: The second reciprocating screw rod (28) is fixedly connected to a fourth bevel gear (32), the fourth bevel gear (32) is meshed with a third bevel gear (31), the third bevel gear (31) is fixedly connected to a first rotating shaft (6), and the first rotating shaft (6) passes through the support frame (1) and is rotationally connected to the support frame (1).

Images