Orbital Mixer Model Predicts Electronic Structure

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current machine learning models for predicting molecular electronic structures require extensive training on specific properties and struggle with scalability and computational efficiency due to reliance on atomic coordinates alone, lacking effective incorporation of basis set information.

Innovation Solution

The orbital mixer model uses a deep learning architecture that directly operates on atomic orbital representations and overlap matrices, leveraging MLP mixer layers to predict the Hamiltonian matrix, which is more computationally efficient and scalable by incorporating basis set-specific information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If machine learning models use only atomic coordinates and molecular composition as input, then the model structure is simple, but the prediction accuracy and scalability are limited

Engineering Contradiction:
Improvemodel structureVSAvoidprediction accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent transforms the input representation from simple atomic coordinates to atomic orbital representations, adding a new dimension of basis set information. This dimensional enhancement allows the model to capture more nuanced electronic structure characteristics while maintaining computational efficiency through the structured nature of orbital data.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the input parameters from geometric coordinates to orbital-based representations that encode basis set information. This parameter transformation enables the model to leverage existing quantum chemical basis sets, improving prediction accuracy without requiring complex model architectures.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If machine learning models are trained on extensive datasets for specific properties, then prediction accuracy improves, but computational cost and training time increase

Engineering Contradiction:
Improveprediction accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent creates a universal machine learning model that can predict multiple electronic structure properties simultaneously by operating on atomic orbital representations. This multi-functional approach eliminates the need for separate specialized models for each property, reducing total training time and computational cost while maintaining high accuracy across diverse predictions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

By changing the input to atomic orbital representations, the model achieves better data efficiency and converges faster during training. The structured orbital data provides richer information that reduces the amount of training data needed compared to coordinate-based approaches, thereby reducing training time.

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If machine learning models rely on raw atomic coordinates, then the input processing is simple, but computational efficiency and scalability are reduced

Engineering Contradiction:
Improveinput processingVSAvoidcomputational efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent performs preliminary transformation of atomic coordinates into atomic orbital representations before feeding data to the machine learning model. This pre-processing step converts raw geometric information into a format that inherently encodes basis set characteristics, enabling more efficient computations and better scalability without adding significant processing overhead.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20230359929A1Orbital mixer machine learning method for predicting an electronic structure of an atomic system
Publication Date: 2023.11.09 ROBERT BOSCH GMBH
  • US20230359929A1 patent drawing
  • US20230359929A1 patent drawing
  • US20230359929A1 patent drawing

AI summary

A machine learning (ML) method for predicting an electronic structure of an atomic system. The method includes receiving an atomic identifier and an atomic position for atoms in the atomic system; receiving a basis set including rules for forming atomic orbitals of the atomic system; forming the atomic orbitals of the atomic system; and predicting an electronic structure of the atomic system based on the atom identifier, the atom position for the atoms in the atomic system, and the atomic orbitals of the atomic system. The ML method is capable of extremely accurate and fast molecular property prediction. The ML can directly purpose basis dependent information to predict molecular electronic structure. The ML method, which may be referred to as an orbital mixer model, uses multi-layer perception (MLP) mixer layers within a simple, intuitive, and scalable architecture to achieve competitive Hamiltonian and molecular orbital energy and coefficient prediction accuracies.