Medication Prediction Algorithm with Diversity Regularization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current machine learning models in healthcare struggle to capture infrequent patterns, alleviate overfitting, improve interpretability, compress model size, and efficiently learn large-scale models, particularly when dealing with unstructured clinical data and multi-medication therapy predictions.

Innovation Solution

A machine-learned medication-prediction algorithm with a diversity-promoting regularization model is used to select a subset of medications for patients, incorporating text encoding and medication correlation modules to consider dependencies and correlations among medications, and leveraging determinantal point processes and deep conditional models to enhance prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional machine learning models are used to predict medications from clinical data, then the model can be trained on available data, but the model fails to capture infrequent patterns and suffers from overfitting

Engineering Contradiction:
Improveprediction accuracyVSAvoidgeneralization to infrequent patterns
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the clinical data processing into multiple specialized modules: text encoding module for unstructured data, medication correlation module for drug-drug interactions, and note dependency module for clinical note relationships. This segmentation allows each module to specialize in capturing specific patterns including infrequent ones without being overwhelmed by the entire data complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a composite model architecture that integrates multiple types of information representations (text embeddings, medication vectors, note dependencies) into a unified prediction framework. This composite approach combines the strengths of different data modalities to improve both frequent and infrequent pattern recognition while reducing overfitting through diversified feature sources.

Inventive Principle:
Principle #40Composite materials

2Measurement precision

If the model considers correlations among multiple medications and dependencies between patient information, then prediction accuracy improves, but computational complexity and model size increase

Engineering Contradiction:
Improvemedication prediction accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary encoding of clinical texts, medications, and notes into fixed-dimensional vectors before the main prediction process. The text encoding module pre-processes unstructured clinical data into structured representations, and the medication correlation module pre-computes drug-drug interaction matrices. This preliminary action reduces the complexity of the main prediction task by transforming raw data into compact, informative features.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary modules that mediate between raw clinical data and the final prediction: the text encoding module mediates unstructured text into structured representations, the medication correlation module mediates drug interactions into compatibility scores, and the note dependency module mediates clinical note relationships into dependency graphs. These intermediaries simplify the overall model architecture while preserving complex relationships.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If diverse medication combinations are considered to promote treatment diversity, then the quality of care improves, but the difficulty of selecting optimal medication subsets increases

Engineering Contradiction:
Improvetreatment diversityVSAvoidsubset selection complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic medication subset selection process that adapts to each patient's specific clinical characteristics. The model dynamically weights different medication options based on patient-specific factors from clinical notes, lab results, and medication histories. This dynamic approach allows the system to explore diverse medication combinations while systematically evaluating them based on patient-specific needs rather than using a fixed selection criteria.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter space by transforming the discrete medication selection problem into a continuous optimization problem using probabilistic frameworks. Instead of directly selecting discrete medication subsets, the model predicts probabilities for each medication and uses these continuous parameters to guide subset selection. This parameter transformation simplifies the combinatorial complexity while maintaining diversity through probability-based exploration.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11101029B2Systems and methods for predicting medications to prescribe to a patient based on machine learning
Publication Date: 2021.08.24 PETUUM INC
  • US11101029B2 patent drawing
  • US11101029B2 patent drawing
  • US11101029B2 patent drawing

AI summary

A system for predicting medications to prescribe to a patient includes a text encoding module and a medication prediction module. The text encoding module is configured to obtain a clinical-information vector from clinical information of the patient. The medication prediction module configured to apply a machine-learned medication-prediction algorithm to the clinical-information vector to select a subset of medications to prescribe to the patient. The machine-learned medication-prediction algorithm is designed with a diversity-promoting regularization model, and is configured to simultaneously consider correlations among different medications and dependencies between patient information and medications when selecting a subset of medications to prescribe to the patient.