Neural Network Energy Management Training via Simulated Driving Cycles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing complexity of on-board energy systems in motor vehicles, driven by enhanced functional requirements, comfort, safety, and energy efficiency needs, exceeds the capabilities of simple rule-based energy management strategies, necessitating a more sophisticated approach to manage energy efficiently and adapt to various driving scenarios.
Innovation Solution
A method involving reflex-augmented reinforcement learning is employed, where a neural network is trained using a simulated driving cycle to generate input vectors and a reward function, allowing the energy management system to learn and adapt operating strategies, with a reflex mechanism ensuring safety and optimizing energy use.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If simple rule-based operating strategies are used for electrical energy management, then the system is easy to implement and understand, but the system cannot effectively manage the increasing complexity of on-board energy systems with multiple voltage systems, high-voltage systems, and numerous electronic components
Solution Approach 1:
The patent replaces traditional rule-based mechanical control logic with machine learning algorithms and artificial intelligence models. The energy management system uses neural networks and reinforcement learning to automatically learn optimal control strategies from training data, eliminating the need for explicit programming of complex decision rules. This substitution enables the system to handle multi-voltage configurations, high-voltage systems, and numerous electronic components adaptively without requiring complex predefined logic for each scenario.
2Adaptability or versatility
If machine learning approaches are used to master system complexity, then the system can generalize from training data and handle previously unknown system states, but the system requires extensive training data and computational resources for model development
Solution Approach 1:
The patent implements a comprehensive training phase before actual operation, where the machine learning model is pre-trained using simulated driving cycles and training datasets that represent various driving scenarios, weather conditions, and system configurations. This preliminary action allows the model to learn optimal energy management strategies offline, so that during actual vehicle operation, the system can make rapid decisions without requiring additional training data. The training phase consolidates the data requirements into a one-time setup process rather than continuous data collection during operation.
3Reliability
If reflex-augmented reinforcement learning is implemented to stabilize the system, then safety is improved by requiring reflex acceptance for agent decisions, but the decision-making process becomes more complex with additional feedback loops
Solution Approach 1:
The patent introduces a reflex module as an intermediary layer between the reinforcement learning agent and the final control decisions. The agent proposes control actions, which are then evaluated by the reflex module that checks whether these actions satisfy predefined safety constraints and operational rules. This intermediary structure separates the learning function from the safety verification function, allowing the system to maintain high safety standards through explicit reflex checks while keeping the learning process relatively simple. The reflex module acts as a gatekeeper that filters agent proposals without requiring the agent itself to understand complex safety constraints.
Data Source
AI summary
A method and device for training an energy management system in an on-board energy supply system simulation, includes: simulating a driving cycle having defined recuperation; plotting state variables of the on-board energy supply system; calculating a recuperation power from a recu-peration current and a battery voltage; producing input vectors for a neural network; producing a reward function; and training the neural network.


