Material Microstructure Analysis via Hierarchical Q-Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques fail to accurately estimate microstructure based on mechanical properties, as they often rely on statistical methods that cannot extrapolate beyond the data range used for learning, leading to uncertainty about the physical propriety of material structures and limited prediction capabilities.

Innovation Solution

An analysis system that uses a combination of mathematical expressions and reinforcement learning, specifically Q-learning, to derive factors indicating the state of a material's microstructure and its mechanical properties, allowing for both interpolation and extrapolation by connecting physical phenomena across different spatial hierarchies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If statistical methods (neural networks) are used for predicting material properties, then prediction capability is improved, but extrapolation beyond data range becomes impossible

Engineering Contradiction:
Improveprediction accuracyVSAvoidextrapolation capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces a hierarchical framework with intermediate spatial levels (meso-scale) between micro-structure and macro-properties. This intermediary layer enables extrapolation by establishing physical relationships that can be scaled, rather than relying solely on statistical interpolation within the training data range.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds the dimension of spatial hierarchy (micro-meso-macro scales) to the prediction framework. By modeling relationships across multiple spatial dimensions and scales, the system can extrapolate to conditions outside the original data range while maintaining physical consistency.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If statistical learning methods are used to estimate material structure from properties, then prediction speed is improved, but physical propriety of estimated structures cannot be assured

Engineering Contradiction:
Improveprediction speedVSAvoidphysical propriety assurance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback loops where predicted structures are evaluated against physical laws and constraints, and predictions are refined iteratively. This feedback mechanism ensures that high-speed statistical predictions maintain physical propriety by continuously validating results against fundamental material science principles.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary actions by pre-establishing physical constraint rules and validation criteria before the actual prediction process. This allows rapid filtering and validation of predicted structures against known physical laws, ensuring physical propriety without significantly slowing down the prediction speed.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If inverse problem solving is performed across different spatial hierarchies (micro-structure to macro-properties), then estimation accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveestimation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the complex inverse problem into hierarchical sub-problems across different spatial scales (micro, meso, macro). Each level is solved separately with appropriate methods, reducing the overall computational complexity compared to solving the entire problem at once, while maintaining estimation accuracy through the hierarchical relationships.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11170146B2Analysis system, analysis method, and program
Publication Date: 2021.11.09 NIPPON STEEL CORPORATION
  • US11170146B2 patent drawing
  • US11170146B2 patent drawing
  • US11170146B2 patent drawing

AI summary

An analysis apparatus derives a second factor (102) according to a physical phenomenon with which an analysis target (104) is to comply. The analysis apparatus derives, based on the second factor (102), a third factor (103) according to a physical phenomenon with which the analysis target (104) is to comply. The analysis apparatus decides, based on a result of evaluating the third factor (103), a first factor (102) corresponding to the third factor. The second factor (102) indicates a state in the analysis target when the first factor (101) is given to the analysis target (104).