Methods and systems for utilizing radiomic-based measurements within a clinical decision support tool
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- ADVITA ORTHO LLC
- Filing Date
- 2026-01-28
- Publication Date
- 2026-08-06
Smart Images

Figure IMGF000001_0001 
Figure IMGF000002_0001 
Figure IMGF000003_0001
Abstract
Description
METHODS AND SYSTEMS FOR UTILIZING RADIOMIC-BASED MEASUREMENTS WITHIN A CLINICAL DECISION SUPPORT TOOLFIELD
[0001] The present disclosure relates to machine learning modeling for medical applications, and more specifically to methods and systems for utilizing radiomic-based measurements (and other image-based measurements) within a clinical decision support tool.BACKGROUND
[0002] Supervised machine learning is a class of artificial intelligence by which the computer learns the complex structure and relationships in large datasets to create predictive models with the help of labeled features. The machine learning model iteratively learns using the feature data to minimize predictive error. There are numerous commercial applications of various machine learning techniques.DRAWINGS
[0003] Some embodiments of the disclosure are herein described, by way of example only, with reference to the accompanying drawings. With specific reference now to the drawings in detail, it is stressed that the embodiments shown are by way of example and for purposes of illustrative discussion of embodiments of the disclosure. In this regard, the description taken with the drawings makes apparent to those skilled in the art how embodiments of the disclosure may be practiced.
[0004] Figure 1 is a block diagram of a system for utilizing radiomic-based measurements within a clinical decision support tool in accordance with one or more embodiments of the present disclosure;
[0005] Figure 2 illustrates 3D reconstructions of the scapula, proximal humerus, deltoid muscle, and rotator cuff muscles (left), with select radiomic measurements of the deltoid are extracted and presented(left), and also with the deltoid removed (right) to show the supraspinatus, infraspinatus, and subscapularis rotator cuff muscles (right), in this example (right) select radiomic measures of the supraspinatus, infraspinatus, and subscapularis rotator cuff muscles are extracted and presented in accordance with one or more embodiments of the present disclosure;
[0006] Figure 3 illustrates 3D reconstructions of the scapula, proximal humerus, and deltoid muscle (left), with segmentation of the 3D muscle volume into anatomically relevant sub-volumes of the deltoid (anterior, middle, and posterior deltoid,) for localized radiomic analysis (right), select radiomic measures of the middle deltoid are extracted and presented in accordance with one or more embodiments of the present disclosure;
[0007] Figure 4 illustrates multiple views of 3D reconstructions of a scapular bone (left), with segmentation / partitioning of the 3D volume into anatomically relevant sub-volumes of scapular bone segments for localized radiomic analysis (middle), in this example (right), select radiomic measures of the glenoid vault are extracted and presented in accordance with one or more embodiments of the present disclosure;
[0008] Figure 5 illustrates multiple views of 3D reconstructions of the proximal humerus (left), with segmentation / partitioning of the 3D volume into anatomically relevant sub-volumes of the proximal humeral bone segments for localized radiomic analysis (middle), in this example (right),select radiomic measures of the proximal humeral metaphysis and humeral head are extracted and presented in accordance with one or more embodiments of the present disclosure;
[0009] Figure 6 is a Scatter Plot of Pre-operative Abduction vs. Deltoid Volume Normalized by Age and Gender (left), with Corresponding 3D CT Reconstructed Deltoids Representative (i.e. Near) of the Centroid of each of the 4 Female Deltoid Cluster Cohorts. Note that Female Deltoid Cluster Fl is associated with Significantly more Pre-operative Abduction than Female Deltoid Cluster F2, as shown in the Table of Figure 35 below in accordance with one or more embodiments of the present disclosure;
[0010] Figure 7 is a Scatter Plot of 2-year Minimum Abduction vs. Deltoid Volume Normalized by Age and Gender (left), with Corresponding 3D CT Reconstructed Deltoids Representative (i.e. Near) of the Centroid of each of the 4 Male Deltoid Cluster Cohorts. Note that Male Deltoid Cluster M2 is associated with Significantly more 2-year Minimum Abduction than Male Deltoid Cluster Ml, as shown in the Table of Figure 36 below, in accordance with one or more embodiments of the present disclosure;
[0011] Figure 8 illustrates 3D CT Reconstructed Scapula Representative (i.e. Near) of the Centroid of each of the 4 Female (Left) and 4 Male (Right) Deltoid Cluster Cohorts in accordance with one or more embodiments of the present disclosure;
[0012] Figure 9 illustrates Multiple views of 3D reconstructions of a scapular bone (left), with segmentation / partitioning of the 3D volume into anatomically relevant sub-volumes of scapular bone segments for localized radiomic analysis (middle), in this example (right), outlier imagebased measurements (relative to a patient reference group) of the glenoid vault are identified and displayed for visual interpretation in accordance with one or more embodiments of the present disclosure;
[0013] Figure 10 illustrates multiple views of 3D reconstructions of a scapular bone (left), with segmentation / partitioning of the 3D volume into anatomically relevant sub-volumes of scapular bone segments for localized radiomic analysis (middle), in this example (right), outlier imagebased measurements (relative to a patient reference group) of the acromion are identified and displayed for visual interpretation in accordance with one or more embodiments of the present disclosure;
[0014] Figure 11 illustrates multiple views of 3D reconstructions of the proximal humerus (left), with segmentation / partitioning of the 3D volume into anatomically relevant sub-volumes of the proximal humeral bone segments for localized radiomic analysis (middle), in this example (right) outlier image-based measurements (relative to a patient reference group) of the proximal humerus are identified and displayed for visual interpretation in accordance with one or more embodiments of the present disclosure;
[0015] Figure 12 illustrates 3D reconstructions of the scapula, proximal humerus, and deltoid muscle (left), with segmentation / partitioning of the 3D muscle volume into anatomically relevant sub-volumes of the deltoid (middle deltoid, middle) for localized radiomic analysis (right), in this example (right) outlier image-based measurements (relative to a patient reference group) of the middle deltoid are identified and displayed for visual interpretation in accordance with one or more embodiments of the present disclosure;
[0016] Figure 13 illustrates 3D reconstructions of the scapula, proximal humerus, deltoid muscle, and rotator cuff muscles (left), with deltoid removed (middle, and with the supraspinatus rotator cuff muscle (right) highlighted for localized radiomic analysis (right), in this example (right) select radiomic measures of the supraspinatus are extracted and presented in tabular format relative to outlier image-based measurements (relative to a patient reference group) of thesupraspinatus are identified and displayed for visual interpretation in accordance with one or more embodiments of the present disclosure;
[0017] Figure 14 illustrates 3D reconstructions of the scapula, proximal humerus, and deltoid muscle. The table below the reconstruction displays the extracted radiomic measures of the patient’s deltoid muscle and compares image-based measurements relative to a control / reference patient cohort of deltoid radiomic measures to provide the physician and / or health care professional context of this patient’s image-based measurements in accordance with one or more embodiments of the present disclosure;
[0018] Figure 15 is a table showing Definitions of PyRadiomics Radiomic Feature Measurements in accordance with one or more embodiments of the present disclosure;
[0019] Figure 16 is a table showing CT image processing parameters used for the 7 different methods for the Deltoid muscle and Scapular bone sensitivity study in accordance with one or more embodiments of the present disclosure;
[0020] Figure 1 is a table showing PyRadiomics radiomic features deemed robust, stable, and unique / non-redundant after sensitivity analysis and correlation study for the Deltoid muscle in accordance with one or more embodiments of the present disclosure;
[0021] Figure 18 is a table showing PyRadiomics radiomic features deemed robust, stable, and unique / non-redundant after sensitivity analysis and correlation study for the Scapular Bone in accordance with one or more embodiments of the present disclosure;
[0022] Figure 19 is a table showing a comparison of the Mean Absolute Error (MAE) Associated with 2 Different Machine Learning Models (Deltoid Muscle Image data vs. No radiomic image data) to Predict Clinical Outcomes, Pre-operatively, 3 months, 6 months, lyr, 2-3yrs, and 3-5 yrs after Anatomic Total Shoulder Arthroplasty (aTSA) and Reverse Total Shoulder Arthroplasty (rTSA) in accordance with one or more embodiments of the present disclosure;
[0023] Figure 20 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Deltoid Muscle Image data vs. No radiomic image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the Minimal Clinically Important Difference (MCID) threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure;
[0024] Figure 21 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Deltoid Muscle Image data vs. No radiomic image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the substantial clinical benefit (SCB) threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure;
[0025] Figure 22 is a table showing a comparison of the Mean Absolute Error (MAE) Associated with 2 Different Machine Learning Models (Scapular Bone Image data vs. No radiomic image data) to Predict Clinical Outcomes, Pre-operatively, 3 months, 6 months, lyr, 2-3yrs, and 3-5yrs after aTSA and rTSA in accordance with one or more embodiments of the present disclosure;
[0026] Figure 23 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Scapular Bone Image data vs. No radiomic image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the MCID threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure;
[0027] Figure 24 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Scapular Bone Image model vs. No radiomic image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the SCB threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure;
[0028] Figure 25 is a table showing Comparison of the Top 20 Preoperative Model Inputs (by F-Score Ranking) Used to Predict Pre-operative Clinical Outcomes Using the Deltoid Muscle Model in accordance with one or more embodiments of the present disclosure;
[0029] Figure 26 is a table showing Comparison of the Top 20 Pre-operative Model Inputs (by F-Score Ranking) Used to Predict 2-3year Clinical Outcomes after aTSA and rTSA Using the Deltoid Muscle Model in accordance with one or more embodiments of the present disclosure;
[0030] Figure 27 is a table showing Comparison of Average Deltoid Muscle Radiomic Measurements Associated with Primary aTSA and rTSA Patients, Stratified by Gender and Age at the Time of Surgery in accordance with one or more embodiments of the present disclosure;
[0031] Figure 28 is a table showing Comparison of the Top 20 Preoperative Model Inputs (by F-Score Ranking) Used to Predict Pre-operative Clinical Outcomes Using the Scapular Bone Model in accordance with one or more embodiments of the present disclosure;
[0032] Figure 29 is a table showing a comparison of the Top 20 Pre-operative Model Inputs (by F-Score Ranking) Used to Predict 2-3-year Clinical Outcomes after aTSA and rTSA Using the Scapular Bone Model in accordance with one or more embodiments of the present disclosure;
[0033] Figure 30 is a table showing a comparison of Average Scapular Bone Radiomic Measurements Associated with Primary aTSA and rTSA Patients, Stratified by Gender and Age at the Time of Surgery in accordance with one or more embodiments of the present disclosure;
[0034] Figure 31 is a table showing a comparison of Average Deltoid Muscle Radiomic Measurements Associated with aTSA / rTSA Patients with and without High Preoperative Overhead Motion (defined as > 160° in abduction and / or forward elevation), stratified by the prosthesis type that they would later receive in accordance with one or more embodiments of the present disclosure;
[0035] Figure 32 is a table showing a comparison of Average Deltoid Muscle Radiomic Measurements Associated with Primary rTSA Patients with and without Adverse Event Reports of Instability in accordance with one or more embodiments of the present disclosure;
[0036] Figure 33 is a table showing a comparison of Average Scapula Bone Radiomic Measurements Associated with Primary rTSA Patients with and without Adverse Event Reports of Scapula Fractures in accordance with one or more embodiments of the present disclosure;
[0037] Figure 34 is a table showing a distribution of Deltoid Muscle Radiomic Measurements and Patient Demographics Associated with Male and Female Deltoid Clusters in accordance with one or more embodiments of the present disclosure;
[0038] Figure 35 is a table showing a comparison of Deltoid Clusters to Pre-operative Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure;
[0039] Figure 36 is a table showing a comparison of Deltoid Clusters to 2-Year Minimum Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure;
[0040] Figure 37 is a table showing a distribution of Scapular Bone Radiomic Measurements and Patient Demographics Associated with Male and Female Deltoid Clusters in accordance with one or more embodiments of the present disclosure;
[0041] Figure 38 is a table showing a comparison of Scapula Clusters to Pre-operative Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure;
[0042] Figure 39 is a table showing a comparison of Scapula Clusters to 2-Year Minimum Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure;
[0043] Figure 40 illustrates graphs of: within cluster sum of squares (WCSS) (top left), Silhouette score (top middle), the percentage of significant pairwise difference in clinical outcomes (top right), and the maximum difference in relative proportion between a single cluster and the remaining population for each of the different patient satisfaction rankings (bottom row) for various combinations of predictor variables and cluster numbers for the Scapula bone in accordance with one or more embodiments of the present disclosure;
[0044] Figure 41 illustrates graphs of: within cluster sum of squares WCSS (top left), Silhouette score (top middle), the percentage of significant pairwise difference in clinical outcomes (top right), and the maximum difference in relative proportion between a single cluster and the remaining population for each of the different patient satisfaction rankings (bottom row) forvarious combinations of predictor variables and cluster numbers for the Deltoid muscle in accordance with one or more embodiments of the present disclosure;
[0045] Figure 42 is an exemplary flow diagram 100 for modeling predictive outcomes of arthroplasty surgical procedures in accordance with one or more embodiments of the present disclosure; and
[0046] Figure 43 is a flowchart of a method for utilizing radiomi c-based measurements (and other image-based measurements) within a clinical decision support tool in accordance with one or more embodiments of the present disclosure.DETAILED DESCRIPTION
[0047] Among those benefits and improvements that have been disclosed, other objects and advantages of this disclosure will become apparent from the following description taken in conjunction with the accompanying figures. Detailed embodiments of the present disclosure are disclosed herein; however, it is to be understood that the disclosed embodiments are merely illustrative of the disclosure that may be embodied in various forms. In addition, each of the examples given regarding the various embodiments of the disclosure which are intended to be illustrative, and not restrictive.
[0048] Throughout the specification and claims, the following terms take the meanings explicitly associated herein, unless the context clearly dictates otherwise. The phrases "in one embodiment," “in an embodiment,” and "in some embodiments" as used herein do not necessarily refer to the same embodiment(s), though it may. Furthermore, the phrases "in another embodiment" and "in some other embodiments" as used herein do not necessarily refer to adifferent embodiment, although it may. All embodiments of the disclosure are intended to be combinable without departing from the scope or spirit of the disclosure.
[0049] As used herein, the term "based on" is not exclusive and allows for being based on additional factors not described, unless the context clearly dictates otherwise. In addition, throughout the specification, the meaning of "a," "an," and "the" include plural references. The meaning of "in" includes "in" and "on."
[0050] As used herein, terms such as “comprising” “including,” and “having” do not limit the scope of a specific claim to the materials or steps recited by the claim.
[0051] All prior patents, publications, and test methods referenced herein are incorporated by reference in their entireties.
[0052] Variations, modifications and alterations to embodiments of the present disclosure described above will make themselves apparent to those skilled in the art. All such variations, modifications, alterations and the like are intended to fall within the spirit and scope of the present disclosure, limited solely by the appended claims.
[0053] While several embodiments of the present disclosure have been described, it is understood that these embodiments are illustrative only, and not restrictive, and that many modifications may become apparent to those of ordinary skill in the art. For example, all dimensions discussed herein are provided as examples only, and are intended to be illustrative and not restrictive.
[0054] Any feature or element that is positively identified in this description may also be specifically excluded as a feature or element of an embodiment of the present as defined in the claims.
[0055] The domain of clinical decision support tools (CDSTs) has traditionally relied on generalized patient data, clinical guidelines, and basic imaging assessments to assist healthcare professionals in making informed decisions. However, these conventional approaches often may lack the granularity and specificity required to account for patient-specific anatomical and physiological variations. For example, while preoperative planning software has been used to generate 3D reconstructions of bones and fit implants to match patient anatomy, such software has historically failed to incorporate detailed assessments of bone quality, muscle quality, and other quantitative image-based measurements. This technical problem may hinder the ability of healthcare professionals to predict post-treatment outcomes, assess risks of complications, and optimize surgical planning based on individualized patient data. Furthermore, the lack of interpretability of highly granular image-based data may pose challenges for clinicians, as raw radiomic measurements often may fail to provide actionable insights without additional processing or contextualization.[00056J In at least some embodiments disclosed herein may address these technical problems by introducing a novel system and method for utilizing radiomic-based measurements and other image-based data within a clinical decision support tool. This technical solution may integrate machine learning (ML) frameworks with standard medical imaging modalities (e.g., CT, MRI, X- ray) to extract, analyze, and interpret pixel- and voxel-level data from regions of interest, such as muscles, tendons, bones, and ligaments. By leveraging specialized algorithms, the system may perform quantitative analyses of image-based features, including shape, texture, and intensity metrics, and may combine these measurements with patient-specific data (e.g., demographics, comorbidities, clinical history) and traditional clinical outcomes. The system may employ advanced ML models, such as clustering algorithms and predictive regression models, to transformraw image-based data into clinically relevant classifications and predictions. These classifications may be aggregated into hierarchies that align with reference patient groups, enabling clinicians to visualize and interpret the data more effectively.
[0057] In at least some embodiments, the technical solutions described herein may further enhance usability by deploying pre-trained ML models within surgical planning software, allowing healthcare professionals to prospectively assign patients to clinically relevant classification systems based on their specific anatomical and radiomic profiles. This approach may not only improve the accuracy of clinical outcome predictions but also facilitate the identification of outlier measurements associated with poor functional performance or elevated complication risks. Additionally, the system may incorporate dimensionality reduction techniques and visualization tools, such as heat maps and adaptive tables, to simplify the presentation of granular data and improve interpretability. By integrating these capabilities, the system may transform complex healthcare data into actionable insights, enabling personalized treatment planning, risk assessment, and improved patient outcomes.
[0058] Clinical decision support tools (CDST) may be generally described without limitation as software designed to assist healthcare professionals in making informed decisions about patient care. These tools may use a variety of techniques, including artificial intelligence, to analyze patient data, clinical guidelines, and / or other relevant information to provide recommendations and / or alerts. The key features of CDSTs may include, but are not limited to:o Data analysis: CDSTs may analyze large amounts of patient data, including electronic health records, lab results, and imaging studies, to identify patterns and trends that may be relevant to patient care.o Clinical guideline integration: CDSTs may incorporate clinical guidelines and best practices to ensure that care decisions align with evidence-based standards. o Decision support: CDSTs may provide specific recommendations and / or alerts to clinicians, such as suggesting diagnostic tests, recommending treatments, or flagging potential drug interactions.o Personalized medicine: CDSTs may use patient-specific data to tailor recommendations and improve the accuracy of diagnoses and treatment plans. o Workflow integration: CDSTs may be integrated into electronic health records and other healthcare workflows to streamline the decision-making process.
[0059] Machine learning techniques for healthcare applications may offer the potential to transform complex healthcare data into practical knowledge that can help surgeons better understand their patients and the complexities of their patient’s conditions. By leveraging large quantities of high-quality clinical outcomes data, machine learning analyses can identify previously hidden correlations and relationships in datasets to create predictive models that can better inform individual patient treatment decisions.
[0060] In orthopedics, predictive models derived from high-quality outcomes and patient data may represent a patient-specific implementation of evidence-based decision-making tools, that may transform complex healthcare data into practical knowledge to support more-informed treatment decision making. While the commercial usage of machine learning may be new to orthopedics, its usage in research has increased in recent years. Many machine learning applications have been image-based analyses, but there is a growing interest to use machine learning techniques to predict clinical outcomes. Predictive outcomes models may assist theorthopedic surgeon to better identify which patients will benefit from elective procedures, such as arthroplasty, and also help better-align patient and surgeon expectations for clinical improvement by leveraging the experiences of previous patients with similar demographics, diagnoses, comorbidities, clinical history, and treatments. With more insight into the factors that predict patient-specific improvement, and with better alignment between predicted and actualized outcomes, patient satisfaction levels may likely increase through the use of such an evidenced-based predictive outcomes tool.
[0061] Embodiments of the present disclosure herein describe methods and systems for utilizing radiomic-based measurements (and other image-based measurements) for modeling predictive outcomes of arthroplasty surgical procedures. Arthroplasty may be used to repair or replace any joint in the body, including but not limited to the hips, knees, shoulders, elbows, and ankles, for example. However, to further illustrate these methods and systems, shoulder arthroplasty is used herein as an exemplary embodiment throughout this disclosure.
[0062] Radiomic measurements (and other image-based measurements) may include quantitative features extracted from medical images, such as for example, but not limited to computed tomography (CT) scans, Magnetic Resonance Imaging (MR1) scans, and / or Positron Emission Tomography (PET) scans. These features may describe the characteristics of tissues and lesions within the image, going beyond the simple visual assessment by a radiologist. Radiomic features may be broadly categorized into several types without limitation such as first-order statistics, texture features, and / or shape features. With regard to first-order statistics, these features may describe, for example, the distribution of pixel intensities within a region of interest (ROI), such as mean, standard deviation, skewness, and kurtosis. With regard to texture features, these features may capture the spatial distribution of pixel intensities, providing information about thetexture and / or heterogeneity of the tissue. Common texture features may include but are not limited to gray-level co-occurrence matrix (GLCM), gray-level run-length matrix (GLRLM), and / or neighborhood gray-level difference (NGTDM) features. With regard to shape features, these features may describe the geometric properties of the region of interest (ROI), such as for example, volume, surface area, and / or sphericity.
[0063] In at least some embodiments, clinical decision support software may leverage standard of care medical imaging (CT, MRI, X-ray, Ultrasound, etc), in combination with surgical planning software, along with a machine learning framework to: 1) analyze a volume / region of interest from medical images (where the region of interest could be a portion of (or a full) muscle, tendon, bone (cortical or cancellous), or ligament, 2) perform numerous different quantitative image-based analyses, 3) compare these image-based measurements to a clinically relevant reference group of similar patients (to provide clinical context to the measurements - this comparison group may be derived or a learned group), specifically with the aid of a library of pre-trained image-based classification models and / or groups, for example a cluster model, that may be prospectively assigned to an individual patient in the software, and 4) use that image-based data (and / or aggregated data in the form of one or multiple groups / classes) to perform one or more clinically relevant predictions (i.e. regression or classification predictions) that may aid a physician and / or health care professional to diagnose, understand, and / or treat a musculoskeletal injury (degenerative or otherwise).
[0064] Figure 1 is a block diagram of a surgical assistance system 10 for utilizing radiomic-based measurements (and other image-based measurements) within a clinical decision support software 80 in accordance with one or more embodiments of the present disclosure. The surgical assistance system 10 may include a medical computing device 15, a medical imaging system 35,a plurality of N electronic medical resources denoted ELECTRONIC RESOURCE 1 40A....ELECTRONIC RESOURCE N 40B, where N is an integer, and a computing device 77 of a user 20 all communicating 32 over a communication network 30. The computing device 77 of the user 20 may also be communicatively coupled 37 directly to the medical computing device 15.
[0065] In at least some embodiments, the user 20 that may interact with a graphic user interface (GUI) 75 on the computing device 77, may be a physician discussing an arthroplasty surgical procedure to be performed on a patient 25. In other embodiments, the computing device 77 may be placed in any suitable location such as an operating room where the joint arthroplasty surgical procedure may be performed.
[0066] The medical computing device 15 may include a processor 45, a non-transitory memory 60, a communication circuitry 70 for communicating 32 over the communication network 30, and / or I / O devices 65, such as a display for displaying the GUI 75 to the user 20, a keyboard 65A and a mouse 65B, for example.
[0067] In at least some embodiments, the medical computing device 15 may be configured to execute the clinical decision support software 80 that may include any or all of the different software modules listed below to perform the functions in the surgical assistance system 10 as described herein. The different software modules may include, but are not limited to, a patientspecific data collection module 46, a Medical Imaging Preprocessing Analyzer 48, a medical imaging machine learning model (MLM) module 50, a surgical planning software module 52, a machine learning model training module 54, and / or a GUI manager module 56 for controlling the GUI 75 on the user’s computing device 77.
[0068] In at least some embodiments, the non-transitory memory 60 may be configured to store a clinical outcome database 62 with a plurality of clinical outcomes of different types of arthroplasty surgical procedures performed on a plurality of patients.
[0069] In at least some embodiments, the patient-specific data collection module 46 may query any of the plurality of electronic medical resources 40A and 40B over the communication network 30 to obtain medical data from the patient 25. The plurality of electronic medical resources 40A and 40B may be managed by the patient’s health management organization HMO, a hospital that the patient 25 received medical treatment, a doctor that the patient 25 received medical treatment, for example.
[0070] In at least some embodiments, the Medical Imaging Preprocessing Analyzer 48 may analyze the data from medical images received from the medical imaging system 35. The medical imaging system 35 may generate an X-ray image, a computed tomography (CT) image, a magnetic resonance image, and / or a three-dimensional (3D) medical image, for example.
[0071] In at least some embodiments, the machine learning model (MLM) training module 54 may generate a training dataset for training any or all of the machine learning models used in the surgical assistance system 10.
[0072] The general overview of the image-based analysis in clinical decision support software 80 may be described hereinbelow.
[0073] In at least some embodiments, a machine learning analysis of the medical image may be performed by the Medical Imaging MLM 50 to identify clinically relevant data that may be useful for diagnosis and / or treatment decision making. These pixel / voxel level image-based analyses may be machine learning inferred characteristics (like embeddings) or more direct measurements, basedon pre-defined formulas. As an example, radiomic image-based measurements may extract shapebased, first-order, and / or texture (second-order) measurements to define the characteristics associated with a patient's region and / or volume of interest (bone, muscle, tendon, ligament, or a portion or combination of each).
[0074] In at least some embodiments, the automated image-based measurements may be combined in the surgical planning software module 52 with patient data (demographics, comorbidities, diagnoses) and / or traditional clinical outcomes data (pre-operative patient reported outcomes, range of motion, pain scores, as well as post-operative results for each associated with numerous different treatments) and complication / revision data associated with numerous different treatments, along with data obtained from the planning software (joint relationship measurements, bone shape measurements of deformity, best-fit implants sizes / types which may match the anatomy of a given patient to best reconstruct the joint / match a bone shape, etc.) to better characterize the patients, with applications for diagnosis of pathology and defining potential options for treatment.
[0075] In at least some embodiments, these image-based measurements may be combined with pre-operative and / or postoperative clinical outcomes data, and / or surgical planning software data and may be used to train using the model training module 54, a machine learning (ML)-based predictive model to predict pre-operative and / or post-operative outcomes at various timepoints for different treatment options, as well as be used to predict clinical complications and risks of revision (for example, anatomic total shoulder arthroplasty vs. reverse total shoulder arthroplasty). However this process may not be limited to shoulder hip, knee, and / or ankle arthroplasty, but may be used for other treatment outcomes as well, such as trauma repair using open-reduction internalfixation plates, pins, screws, or nails and / or sports applications (rotator cuff, ligament, and / or bone repair, etc.)
[0076] In at least some embodiments, the clinical decision support software 80 may identify which of the image-based measurements may be clinically relevant. The feature importance data associated with the ML model inputs may be analyzed and rank-ordered so as to identify what features may be clinically relevant and meaningful within the medical images. The clinical decision support software 80 may compare these rank-ordered features relative to the same analysis from a reference patient group that may be used to identify outliers and unique morphological / anatomic parameters of interest to the physician and / or health care professional for a particular patient.
[0077] In at least some embodiments, the clinical decision support software 80 may prospectively deploy these ML models within the surgical planning software 52 in the clinical decision support software 80. Specifically, after the health care professional may upload medical images such as for example, a CT image into the planning software, the ML framework may create the 3D models on various regions of interest (bone, muscle, ligament, tendon, etc) and then may extract the radiomic data and combine it with other automated inputs and / or manual inputs (from the planning software) about a specific patient. The medical imaging MLM 50 may output to the surgeon (e.g., the user 20) within the Surgical Planning software 52 in order to aid in the diagnosis of a musculoskeletal injury (degenerative or otherwise), for example, and / or to aid them in decision-making related to which treatment option to select so as to optimize post-operative clinical outcomes.
[0078] One technical problem associated with image-based measurements which consider pixel / vox el -level granularity, is that these highly quantitative measurements may lack intuitive clinical interpretation such that the clinical meaning / rel evance of these image-based measurements may not be readily apparent to the physician and / or health care professional. To solve these technical problems and aid the physician and / or health care professional to visualize and interpret the image-based measurements, the clinical decision support software 80 may conduct additional analyses and may be displayed within the software to reduce the dimensionality of the data and transform relevant image-based measurements into clinically relevant classification systems, which may be aggregated based on similarities to reference patient groups (these reference groups may be either learned or derived). For example, rather than displaying some or all of the raw or calculated image-based measurements associated with a given patient to the user in the surgical planning software 52, the surgical planning software 52 may provide the output of additional ML models and techniques which may be relevant to those measurements. To clarify, the software may provide one or more classification groups that may be representative of the patient's image measurements, where these pre-defined classifications may be derived from prior ML analyses, (e.g. a clustering algorithm) which may aggregate a series of image-based measurements (with or without corresponding patient data) and may output a clinically relevant classification system associated with an anatomic region / volume of interest. For example, there may be a library of image-based measurements which may include, a class 1 / 2 / 3 / 4 supraspinatus (rotator cuff muscle) describing the shape, size, or quality (and other radiomic measurements) of that muscle, and a class A / B / C / D / E proximal humeral bone which may describe the shape, size, or quality of that bone (and other radiomic measurements), and / or a class A / B / C / D scapular spine / acromion bone that may describe the shape, size, or quality of that bone, etc. These multiple radiomic measurementsmay be aggregated together into a single class or classification / type using an ML based clustering algorithm.
[0079] In at least some embodiments, the clinical decision support software 80 may aggregate numerous image-based measurements associated with a given patient that may improve the clinical interpretation of these pixel / voxel-level image-based measurements, as well as improve usability of the software. Moreover, the planning software may also have the capability to visualize in 2D or 3D the region of interest as a model, and to overlay a relevant image-based measurement alongside the original medical image (CT slide, 3D reconstruction, etc) so that the clinical meaning of the pixel / voxel-level measurements may be visualized and more easily interpreted by the physician and / or health care professional. If the physician and / or health care professional wants to be aware of a specific automated feature used by the ML models with high predictive importance, that data may be visualized on the display, if prompted.
[0080] In at least some embodiments, the clinical decision support software 80 may facilitate a development of a library of pre-defined classification systems derived from clinically relevant image-based measurements that may provide some additional usability advantages as well, since these bone / muscle groups / clusters may be prospectively identified. They may be numerically or visually displayed in the pre-operative planning software, mitigating the need to display multiple tables of radiomic measurements, which may have likely limited utility to the user.
[0081] In at least some embodiments, the advantage of ML based approaches to aggregate the data into clinically relevant classification systems that may be readily displayed in the software display 75 may be that it facilitates the physician and / or health care professional to more simply understand what may be clinically meaningful from this granular pixel / voxel-level image-basedassessment. Additionally, by analyzing multiple, individual regions / volumes of interest (e.g., clinically relevant radiomics associated bone, tendon, and / or ligament), the interaction between these different anatomic structures / classification groups may be better understood, which may translate to an improved understanding of a patient's potential improvement capability and / or the patient's complication / revision risk, that may greatly simplify the meaning of the radiomic data.
[0082] In at least some embodiments, regarding the image-based analysis and clinical deployment of the clinical decision support software 80 that may utilize standard of care medical images from various hospitals and imaging manufacturers, using different image acquisition protocols, image pre-processing may be required to normalize and standardize the analysis, to be incorporated into the framework. Regardless of the imaging modality, this image processing may occur through various steps, most commonly: normalization, resampling, and discretization. Normalization may adjust the pixel gray level intensity values within an image-based on the mean and standard deviation of gray levels of that image. Resampling may adjust image resolution to standardize voxel size and ensure consistent spatial dimensions between images. Depending on the original image resolution, this process may up-sample (which may increase resolution but may introduce noise; interpolation may create new pixels in the gaps) or down-sample (which may decrease resolution and may reduce noise; interpolation may combine pixel values to reduce the number of pixels). Discretization may convert continuous intensity values into discrete values, simplifying image analysis and reducing storage requirements. This process may be performed using two methods: 1) a fixed bin width (which may distribute pixel intensities into bins of equal width, so the number of bins may vary across all images) or 2) a fixed bin count (which may distribute pixel intensities into a fixed number of bins, ensuring the number of bins may remain the same across all images). After these aforementioned image processing steps, image basedmeasurements and / or radiomic features may be generated and extracted from the region / volume of interest. The region of interest may be derived using various methods, including manual segmentation, automated segmentation, and / or landmark / bounding boxes, etc.
[0083] In at least some embodiments, the at least one segmentation algorithm may include defined inputs and outputs, where the inputs may include PVG corrected medical images, image metadata that may preserve voxel spacing, orientation, and origin, configuration parameters for segmentation that may include anatomical priors, landmarks, or bounding boxes, and optional user edits that may refine automated results in semi-automated workflows. The outputs may include at least one ROI image map boundary that may provide a three dimensional, voxel aligned delineation of inclusion or exclusion for a specified region of interest, and an at least one ROI image map that may include the at least one ROI image map boundary and the PVG corrected image data that may be within the boundary for downstream preprocessing, feature extraction, classification, prediction, and visualization.
[0084] In at least some embodiments, at least one ROI image map boundary may include a three- dimensional, voxel aligned delineation that may encode inclusion or exclusion of image elements for a specified region of interest. At least one ROI image map boundary value may indicate membership in an anatomic structure or sub structure. This may define the region’s boundary and interior in the same spatial frame as the PVG corrected medical images. The at least one ROI image map boundary may be generated by automated, semi-automated, or manual segmentation workflows. It may be stored as a binary or multi class 3D label map that may preserve voxel spacing, orientation, and origin metadata. It may be used by the at least one processor to constrain preprocessing, feature extraction, classification, prediction, and visualization to the labeled region.
[0085] In at least some embodiments, at least one ROI image map may include the at least one ROI image map boundary and the PVG corrected image data from the plurality of PVG corrected medical images that may be within the at least one ROI image map boundary. The at least one ROI image map may be provided, together with the associated metadata, to one or more medical image analysis machine learning models for subsequent analysis and display.
[0086] In at least some embodiments, with regard to arthroplasty procedures such as for example, shoulder arthroplasty, the machine learning techniques used in the clinical decision support software 80 may be further used to pre-operatively predict clinical outcomes at various post-operative timepoints after surgery for patients receiving total shoulder arthroplasty. For example, these predictions may be used to inform the surgeon of what a particular patient may expect to experience after anatomic total shoulder arthroplasty (aTSA) and / or reverse total shoulder arthroplasty (rTSA), for example. A list of model inputs may be obtained from the health care professional and / or automatically from the patient’s electronic medical record through software integration by querying any of the electronic medical resources as previously described. While this disclosure focuses on aTSA and rTSA outcomes prediction, these models could also be applied to other shoulder arthroplasty applications, like hemiarthroplasty, fracture reconstruction, endoprostheses, resurfacing, and primary vs. revision arthroplasty outcomes predictions. These types of models may also be used in other orthopedic procedures, such as hip, knee, or ankle arthroplasty, spine or trauma procedures, as well as sports (muscle / tendon / ligament repair) procedures.
[0087] In at least some embodiments, regarding the inputs to these predictive models, the predictive outcomes for a given total shoulder arthroplasty patient may be further refined toprovide recommendations for optimal clinical outcomes using different implant sizes, such as different sizes of humeral heads, humeral stems, glenospheres, glenoid or humeral augments, for example, implant types, such as aTSA, rTSA, hemiarthroplasty, resurfacing, short stem, stemless, fracture arthroplasty, endoprostheses, revision devices, for example, and / or surgical techniques, such as delto-pectoral, superior-lateral, subscapularis sparing, for example, in order to account for the patient specific diagnoses and bone / soft tissue morphological considerations.
[0088] In at least some embodiments, the machine learning predictive outcome algorithms in the clinical decision support software 80 as described herein may be used to pre-operatively predict a patient’s post-operative clinical outcomes that may have numerous additional practical applications that may be valuable to the patient and surgeon. First, the ability to differentiate pre- operatively which patients may achieve clinical improvement after aTSA and rTSA relative to patient satisfaction anchor-based minimal clinically important difference (MCID) and substantial clinical benefit (SCB) thresholds for multiple different patient reported outcome measures (PROMs) and active range of motion (ROM) measurements may be useful to the orthopedic surgeon to objectively identify which patients are appropriate candidates for these elective procedures. It may also assist the orthopedic surgeon to decide between implant types for a particular patient. As a non-operative treatment may be best for some patients, this foreknowledge may represent a more efficient resource allocation for the patient, surgeon, hospital, and / or payer.
[0089] In this disclosure, the terms “outcome metric” and “outcome measure” may be used interchangeably herein. The terms “machine learning model”, “machine learning module”, “machine learning predictive outcome algorithms”, “predictive outcome algorithms” and / or “predictive outcome model” may be used interchangeably herein.
[0090] In at least some embodiments, a patient-specific prediction of clinical improvement at multiple post-surgical timepoints may be helpful to align patient and surgeon expectations on what is achievable after this elective procedure. Given the association between pre-operative expectations and post-operative satisfaction, better surgeon-patient alignment on both the magnitude and rate of clinical improvement may result in greater levels of patient satisfaction. Furthermore, an improved understanding of the amount of clinical improvement that can be expected at different post-surgical timepoints for a given patient may aid the surgeon in establishing protocols for rehabilitation. This may also help both the surgeon and patient weigh these gains versus the procedure-specific risks associated with aTSA and rTSA, such as: instability, aseptic loosening, and infection.
[0091] In at least some embodiments, the predictive models used by the clinical decision support software 80 may provide a better understanding of the factors influencing outcomes, which may assist the orthopedic surgeon to personalize care for each patient in terms of patient-specific requirements for pain relief, function, and mobility, as well as to help the patient better understand how well the arthroplasty surgical procedure may meet their needs based upon that patients unique characteristics that are input to and accounted for in the predictive model output.
[0092] In at least some embodiments, there may be numerous clinical applications for the clinical decision support software 80 using the automated image-based clinical decision support tool (e.g., the medical imaging pre-processing analyzer 48 and / or the medical imaging machine learning model (MLM) 50, when incorporated into a CT based pre-operative planning software (e g., the surgical planning software 52) as described in the four clinical applications hereinbelow.
[0093] In at least some embodiments, the medical imaging machine learning model (MLM) module 50 may include defined inputs and outputs, where the inputs may include PVG correctedmedical images of the joint, at least one ROI image map boundary, an at least one ROI image map that may include the at least one ROI image map boundary and the PVG corrected image data within the boundary, segmentation outputs identifying at least one region of interest such as bone, connective tissue, or muscle, patient specific data including demographics, comorbidities, diagnosis, preoperative range of motion and pain metrics, surgical planning data and arthroplasty parameters including implant type, size, and planned positions, reference cohort and classification library data for outlier detection and class assignment, and image preprocessing metadata and radiomics configuration including normalization, resampling, and discretization settings.
[0094] In at least some embodiments, the outputs may include at least one image based measurement and / or radiomic feature extracted from the region of interest, at least one implant complication risk assessment that may predict probabilities for instability, aseptic loosening, fracture, infection, or revision within defined windows, prospective class or cluster assignments based on image-based measurements, predicted postoperative joint performance metrics at multiple timepoints that may include range of motion values and pain metrics when provided with the reconstruction plan and patient data, visualization artifacts that may improve interpretability such as heat maps, class activation maps, and color coded indicators, alerts that may identify outlier image-based measurements linked to decreased function or increased complication risk, and at least one 3D representation and overlay that may integrate measurements and risk assessments for display in the GUI.
[0095] In at least some embodiments, in a first Clinical Application for improving the accuracy of aTSA and rTSA Clinical Outcome Predictions, the addition of automated image-based measurements may provide additional objective data that may be used to improve the accuracy of clinical outcome predictions. With improved accuracy of outcomes associated with multipledifferent treatments, the clinical decision support software 80 may be used to improve surgeon and patient understanding of what may be possible with different treatments such as for example, identifying patients with higher / lower potential for clinical improvement for a given treatment. Post-operative patient satisfaction may increase if actual results may be more closely aligned with pre-operative patient expectations related to a given treatment.
[0096] In at least some embodiments, to demonstrate the capability of these image-based measurements to improve clinical outcome predictions, a study was performed on pre-operative CT images and clinical data from 4,009 primary shoulder arthroplasty patients (2099 female, 1910 male; age = 69.6 ± 8.4, range: 23 - 97 years; 1011 aTSA and 2998 rTSA) enrolled in a multicenter, IRB-approved clinical outcome study of a single platform shoulder prosthesis (See for example, Equinoxe; Exactech, Inc., Gainesville, FL). Specifically, 3D masks of the deltoid muscle (2597 patients) and scapular bone (3,358 patients) may be auto-segmented from pre-operative CT images using a ML-based framework. Using this framework, numerous radiomic measures of the deltoid muscle and / or scapular bone may be extracted. These radiomic measurements may be used to quantify deltoid muscle and scapular bone characteristics, including, for example: shape-based features, first order Hounsfield (HU) intensity-based features, and / or second order “texture” features. A sensitivity study may be performed to demonstrate that these radiomic measures may be stable and robust across the range of CT image acquisition parameters and across the image processing parameters that may be deployed.
[0097] Figure 15 is a table showing Definitions of PyRadiomics Radiomic Feature Measurements in accordance with one or more embodiments of the present disclosure. In at least some embodiments, a description of these radiomic parameters may be shown in the Table of Figure 15. The parameters used in the sensitivity study are presented in the Table of Figure 16.
[0098] Figure 16 is a table showing CT image processing parameters used for the 7 different methods for the Deltoid muscle and Scapular bone sensitivity study in accordance with one or more embodiments of the present disclosure.
[0099] Figure 17 is a table showing PyRadiomics radiomic features deemed robust, stable, and unique / non-redundant after sensitivity analysis and correlation study for the Deltoid muscle in accordance with one or more embodiments of the present disclosure.[000100] Figure 18 is a table showing PyRadiomics radiomic features deemed robust, stable, and unique / non-redundant after sensitivity analysis and correlation study for the Scapular Bone in accordance with one or more embodiments of the present disclosure.[000101] In at least some embodiments, machine learning models may be developed to predict pre-operative pain, motion, and function, as well as clinical outcomes after aTSA and rTSA. Predictive models were trained using 3 different sets of inputs. The study control may be trained using inputs for patient demographics and comorbidities, along with data from pre-operative planning software (implant type / size and / or joint measurements). A second model may be trained using the control inputs in combination with deltoid muscle radiomic data. A third model may be trained using the control inputs in combination with scapular bone radiomic data. Specifically, XGBoost may be used to construct ML regression models that may predict the ASES, Constant, Shoulder Function, VAS Pain, and the Shoulder Arthroplasty Smart (SAS) scores, as well as active abduction, forward elevation, external rotation with the arm at the side, and the internal rotation (IR) score. Regression models may predict each of these clinical measures preoperatively (except ASES and Constant) and post-operatively at 3-6 months, 6-9 months, 1-year (9-18 months), 2-3 years (18-36 months), and 3-5 years (36-60 months) outcomes after aTSA and rTSA. Additionally,classification models may predict 2-3 year clinical improvement relative to the minimal clinically important difference (MCID) and substantial clinical benefit for each outcome measure.[000102] In at least some embodiments, the deltoid model may utilize data from 2597 patients (1502 F, 1095 M) with 4970 post-operative visits (610 aTSA patients (311 F, 299 M), average latest follow-up=23.6 ± 19.2 months; 1987 rTSA patients (1191 F, 796 M), average latest follow-up=21.1 ± 18.0 months), that may be distributed across timepoints as follows: pre-operatively (aTSA= 610 and rTSA= 1987), 3-6 months (aTSA= 284 and rTSA= 1014 visits), 6-9 months (aTSA= 105 and rTSA= 534 visits), 1 year (aTSA= 351 and rTSA= 1075 visits), 2-3 years (aTSA= 281 and rTSA= 766 visits), and 3-5 years (aTSA= 160 and rTSA= 400 visits). Similarly, the scapular bone model may utilize data from 3,358 patients (1740 F, 1618 M) with 6,972 postoperative visits (877 primary aTSA patients (368 F, 509 M), average latest follow-up=25.8 ± 19.2 months; 2481 primary rTSA patients (1372 F, 1109 M), average latest follow-up=23.5 ± 18.2 months), that may be distributed across timepoints as follows: pre-operatively (aTSA= 877 and rTSA= 2481), 3-6 months (aTSA= 398 and rTSA= 1187 visits), 6-9 months (aTSA= 156 and rTSA= 664 visits), 1 year (aTSA= 530 and rTSA= 1485 visits), 2-3 years (aTSA= 462 and rTSA= 1174 visits), and 3-5 years (aTSA= 274 and rTSA= 642 visits). This data may be randomly split into 80%:20% mutually exclusive datasets to build and test the predictive models at each timepoint; the process may be repeated using k-fold cross validations (n=5) to reduce overfitting. The predictive performance of each regression model may be quantified by the Mean Absolute Error (MAE) and the predictive performance of each 2-3 year MCID and SCB classification model was quantified using accuracy, precision, recall, and the area under the receiver operating curve (AUROC).[000103] Figure 19 is a table showing a comparison of the Mean Absolute Error (MAE) Associated with 2 Different Machine Learning Models (Deltoid Muscle Image data vs. No-image data) to Predict Clinical Outcomes, Pre-operatively, 3 months, 6 months, lyr, 2-3yrs, and 3-5yrs after aTSA and rTSA in accordance with one or more embodiments of the present disclosure.[000104] Figure 20 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Deltoid Muscle Image data vs. No-image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the MCID threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure.[000105] Figure 21 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Deltoid Muscle Image data vs. No-image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the SCB threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure.[000106] In at least some embodiments, the addition of deltoid muscle radiomic data to the XGBoost ML models may improve the accuracy of 110 of 156 (70.5%) regression predictions of clinical outcomes before and after aTSA and rTSA as shown in the Table of Figure 19. For all patients, the largest improvements in predictive accuracy were observed for abduction (preoperative = 10.8% improvement and 3-5 years = 9.3% improvement). Some marginal differences were observed with the other outcome measures. rTSA predictions (37 of 52, 71.2%) were improved more frequently than aTSA predictions (35 of 52, 67.3%) by the addition of the deltoid muscle radiomic data; however, the largest improvements in prediction accuracy (Constant at 3-5 years = 16.3% improvement) and the largest reduction in prediction accuracy (IR score at 6months = 15.7% decline) were observed with aTSA patients. The addition of the deltoid muscle radiomic data achieved similar MCID (see the Table in Figure 20) and SCB (see the Table in Figure 21) classification prediction performance.[000107] Figure 22 is a table showing a comparison of the Mean Absolute Error (MAE) Associated with 2 Different Machine Learning Models (Scapular Bone Image data vs. No-image data) to Predict Clinical Outcomes, Pre-operatively, 3 months, 6 months, lyr, 2-3yrs, and 3-5yrs after aTSA and rTSA in accordance with one or more embodiments of the present disclosure.[000108] Figure 23 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Scapular Bone Image data vs. No-image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the MCID threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure.[000109] Figure 24 is a table showing Classification Predictions Performance Associated with 2 Different Machine Learning Models (Scapular Bone Image model vs. No radiomic image data) to Predict aTSA and rTSA clinical improvement at 2-3 years follow-up greater than the SCB threshold for multiple different outcome measures in accordance with one or more embodiments of the present disclosure.[000110] In at least some embodiments, the addition of scapular bone radiomic data to the XGBoost ML models may improve the accuracy of 105 of 156 (67.3%) regression predictions of clinical outcomes before and after aTSA and rTSA. (See the Table of Figure 22) For all patients, the largest improvements in predictive accuracy may be observed for abduction (6 month =9.7% improvement and 1 year = 10.2% improvement), forward elevation (preoperative = 8.6% improvement, 1 year = 9.4% improvement, 3-5 year = 11.1% improvement), and Constant (3-5year = 13.7% improvement). Some marginal differences may be observed with the other outcome measures. rTSA predictions (36 of 52, 69.2%) may be improved more frequently than aTSA predictions (32 of 52, 61.5%) by the addition of the scapular bone radiomic data; however, the largest improvements in prediction accuracy may be observed for aTSA patients, for each of forward elevation (1 year = 20.0% improvement), abduction (6 months = 19.4% improvement), and SAS score (1 year = 18.3% improvement). The addition of the scapular bone radiomic data achieved similar MCID (See the Table of Figure 23) and SCB (See the Table of Figure 24) classification prediction performance.[000111] In some embodiments in a second clinical application, the clinical decision support software 80 may be configured to identify patients with Outlier Image-based Measurements and to trigger physician alerts when detecting these Outlier Measurements are Associated with Poor Functional Performance. The clinical decision support software 80 may identify patients with outlier image-based measurements by: identifying radiomic measurements which were most clinically relevant and meaningful, identifying typical ranges associated with those measurements, and then comparing the ranges to clinically relevant functional thresholds to determine if an outlier image-based measurement is associated with a poor functional performance.[000112] In at least some embodiments, the clinical decision support software 80 may utilize the clinical data and ML models as described above, specifically for the ML models trained with radiomic data. The relative importance of each input may be quantified to predict each outcome measure pre-operatively and may be quantified to predict each outcome measure 2-3 years post- operatively by using an F-score. The F-score feature importance data may be averaged across the outcome measures and rank ordered to identify the consensus top deltoid muscle radiomicmeasures and the scapular bone radiomic measurements that may be most predictive of preoperative pain, motion, and / or function, as well as clinical outcomes after aTSA and / or rTSA. These most clinically relevant radiomic measures may then be compared between patients for various functional differences.[000113] Figure 25 is a table showing Comparison of the Top 20 Preoperative Model Inputs (by F-Score Ranking) Used to Predict Pre-operative Clinical Outcomes Using the Deltoid Muscle Model in accordance with one or more embodiments of the present disclosure.[000114] Figure 26 is a table showing Comparison of the Top 20 Pre-operative Model Inputs (by F-Score Ranking) Used to Predict 2-3year Clinical Outcomes after aTSA and rTSA Using the Deltoid Muscle Model in accordance with one or more embodiments of the present disclosure.[000115] Figure 27 is a table showing Comparison of Average Deltoid Muscle Radiomic Measurements Associated with Primary aTSA and rTSA Patients, Stratified by Gender and Age at the Time of Surgery in accordance with one or more embodiments of the present disclosure.[000116] In at least some embodiments, the F-score feature importance data for the deltoid muscle model may be rank-ordered to identify the most predictive features driving the pre-operative predictions (see the Table of Figure 25), as well as the 2-3 year predictions (see the Table of Figure 26). Deltoid muscle data may be commonly used by the ML models, with 13 of the top 20 features driving the pre-operative model (see the Table of Figure 25) and 6 of the top 20 features driving the 2-3 year model (see the Table of Figure 26). Across these timepoints, the consensus top 8 most predictive deltoid muscle features may be: normalized volume, flatness, elongation, sphericity, max 2D diameter column, max 2D diameter row, fat percentage, and 10th percentile HU. The Table of Figure 27 may compare the variability of these 8 features across the aTSA and rTSA patients, stratified by age and gender, and may demonstrate that deltoid elongation, flatness, fatpercentage, max 2D diameter row / column measurements may all differ significantly by gender across the range of patient age at the time of surgery.[000117] Figure 28 is a table showing Comparison of the Top 20 Preoperative Model Inputs (by F-Score Ranking) Used to Predict Pre-operative Clinical Outcomes Using the Scapular Bone Model in accordance with one or more embodiments of the present disclosure.[000118] Figure 29 is a table showing a comparison of the Top 20 Pre-operative Model Inputs (by F-Score Ranking) Used to Predict 2-3-year Clinical Outcomes after aTSA and rTSA Using the Scapular Bone Model in accordance with one or more embodiments of the present disclosure.[000119] Figure 30 is a table showing a comparison of Average Scapular Bone Radiomic Measurements Associated with Primary aTSA and rTSA Patients, Stratified by Gender and Age at the Time of Surgery in accordance with one or more embodiments of the present disclosure.[000120] The F-score feature importance data for the scapular bone model were rank-ordered to identify the most predictive features driving the pre-operative predictions (see the Table of Figure 28), as well as the 2-3 year predictions (see the Table of Figure 29). Scapular bone data was commonly used by the ML models, with 13 of the top 20 features driving the preoperative model (see the Table of Figure 28) and 7 of the top 20 features driving the 2-3 year model (see the Table of Figure 29). Across these timepoints, the consensus top 8 most predictive scapular bone features are: flatness, elongation, sphericity, max 2D diameter column, max 2D diameter slice, least axis length, 10th percentile HU, and max 2D diameter row. The Table of Figure 30 may compare the variability of these 8 features across the aTSA and rTSA patient cohorts, stratified by age and gender, and demonstrates these scapular bone measurements all differ significantly by gender across the range of patient age at the time of surgery, with only a few exceptions: elongation and sphericity for patients <60 years of age.[000121] Figure 31 is a table showing a comparison of Average Deltoid Muscle Radiomic Measurements Associated with aTSA / rTSA Patients with and without High Preoperative Overhead Motion (defined as > 160° in abduction and / or forward elevation), stratified by the prosthesis type that they would later receive in accordance with one or more embodiments of the present disclosure.[000122] In at least some embodiments, to assess the clinical relevance of the deltoid image measurements and identify which radiomic measures may be associated with poor functional performance, primary aTSA and rTSA patients with high-levels of pre-operative overhead motion (defined as >160° in abduction and / or forward elevation) may be compared to patients with lower- levels of pre-operative overhead motion. As described in the table of Figure 31, prior to surgery aTSA patients with high overhead motion may have comparatively larger, rounder, and thicker deltoids as demonstrated by the significantly larger values of deltoid normalized volume (p=0.047), elongation (p=0.013), flatness (p=0.017), least axis length (p=0.014), mesh volume (p=0.023), and a significantly lower deltoid surface to volume ratio (p=0.049) as compared to aTSA patients with lower overhead motion. Similar findings may be observed for rTSA patients, as described in the Table of Figure 31, where rTSA patients with high overhead motion pre- operatively, may have comparatively larger, rounder, and thicker deltoids as demonstrated by the significantly larger values of deltoid normalized volume (p=0.001), elongation (p<0.001), mesh volume (p<0.001), sphericity (<0.001) and a significantly lower deltoid surface to volume ratio (p<0.001) as compared to rTSA patients with lower overhead motion.[000123] Figure 2 illustrates 3D reconstructions of the scapula, proximal humerus, deltoid muscle, and rotator cuff muscles (left), with select radiomic measurements of the deltoid are extracted and presented(left), and also with the deltoid removed (right) to show the supraspinatus, infraspinatus,and subscapularis rotator cuff muscles (right), in this example (right) select radiomic measures of the supraspinatus, infraspinatus, and subscapularis rotator cuff muscles are extracted and presented in accordance with one or more embodiments of the present disclosure. Figure 2 illustrates the individual muscles as referenced in this disclosure.[000124] Figure 3 illustrates 3D reconstructions of the scapula, proximal humerus, and deltoid muscle (left), with segmentation of the 3D muscle volume into anatomically relevant sub-volumes of the deltoid (anterior, middle, and posterior deltoid,) for localized radiomic analysis (right), select radiomic measures of the middle deltoid are extracted and presented in accordance with one or more embodiments of the present disclosure. Particularly, Figure 3 illustrates the deltoid muscle as a region of interest (ROI) 200 and a ROI image map boundary 205 (e.g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. The ROI image map boundary 205 and the PVG corrected image data of the region of interest 200 of the deltoid muscle may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the region of interest 200 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000125] In at least some embodiments, while one example may be demonstrated here, it should be understood that similar analyses between image data and clinical performance may be performed for any number of good / poor performing cohorts for any clinical outcome measure. For example as described in Figure 2, radiomics associated with the deltoid and rotator cuff muscles may be analyzed and compared between patients with and without full range of motion, and in doing so may identify the radiomic parameters that may be associated with patients who experienced more range of motion as compared to patients with less range of motion, and maythen use that knowledge prospectively as a risk-profiler for new patients to alert the physician and / or health care professional if a particular patient may be at risk for less range of motion after a given treatment. This comparison of radiomic parameters may be performed on the full muscle volume or may be performed on a segment of the muscle, if that may be more clinically appropriate, for example the middle deltoid sub-volume as depicted in Figure 3. These analyses may also be performed on other soft-tissue, like tendons or ligaments.[000126] In some embodiments in a third clinical application, the clinical decision support software 80 may be configured to identify Patients with Outlier Image-based Measurements and to alert the physician if these outlier measurements may be associated with a complication.[000127] Figure 32 is a table showing a comparison of Average Deltoid Muscle Radiomic Measurements Associated with Primary rTSA Patients with and without Adverse Event Reports of Instability in accordance with one or more embodiments of the present disclosure.[000128] In at least some embodiments, similarly, to the process described above, the clinical decision support software 80 may compare outlier image measurements between patients with and without complications and may determine if an outlier image-based measurement may be associated with a particular treatment complication. To assess the clinical relevance of the deltoid muscle measurements to complications, as an example, the deltoid muscle radiomic measurements may be associated with rTSA patients who experienced post-operative instability as compared to deltoid muscle radiomic measurements for rTSA patients without a report of instability. As described in the table of Figure 32, rTSA patients with instability may have comparatively larger, longer, wider, and thicker deltoids preoperatively as demonstrated by the significantly larger values of deltoid normalized volume (p=0.016), least axis length (p=0.0024), max 2D diametercolumn (p=0.009), max 2D diameter row (p=0.001) and a significantly lower deltoid surface to volume ratio (p=0.001) as compared to rTSA patients without instability.[000129] Figure 33 is a table showing a comparison of Average Scapula Bone Radiomic Measurements Associated with Primary rTSA Patients with and without Adverse Event Reports of Scapula Fractures in accordance with one or more embodiments of the present disclosure.[000130] To assess the clinical relevance of the scapular bone measurements to complications, as an example, scapular bone radiomic measurements may be associated with primary rTSA patients who experienced scapular fractures that may be compared to scapular bone radiomic measurements associated with rTSA patients without scapular fractures. As described in the table of Figure 33, rTSA patients with scapular fractures may have comparatively smaller, thinner, shorter, and less- spherical scapula preoperatively as demonstrated by the significantly smaller values of scapula least axis length (p=0.004), minor axis length (p=0.012), max 2D diameter row (p=0.016), max 2D diameter slice (p=0.009), mesh volume (p=0.001), sphericity (p=0.049), and a significantly larger scapula surface to volume ratio (p<0.001) as compared to rTSA patients without scapular fractures. Some differences may also be observed with texture measurements as well, where rTSA patients with scapular fractures may have significantly higher values of NGTDM Strength (p<0.001) as compared to rTSA patients without scapular fractures.[000131] Figure 4 illustrates multiple views of 3D reconstructions of a scapular bone (left), with segmentation of the 3D volume into anatomically relevant sub-volumes of scapular bone segments for localized radiomic analysis (middle), in this example (right), select radiomic measures of the glenoid vault are extracted and presented in accordance with one or more embodiments of the present disclosure. Particularly, Figure 4 illustrates the scapula 215 having a region of interest(RO I) 210 and a ROI image map boundary 215 (e.g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. The ROI image map boundary 215 and the PVG corrected image data of the region of interest 210 of the scapula may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the region of interest 210 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000132] Figure 5 illustrates multiple views of 3D reconstructions of the proximal humerus (left), with segmentation of the 3D volume into anatomically relevant sub-volumes of the proximal humeral bone segments for localized radiomic analysis (middle), in this example (right), select radiomic measures of the proximal humeral metaphysis and humeral head are extracted and presented in accordance with one or more embodiments of the present disclosure. Particularly, Figure 5 illustrates the proximal humerus 240 having a region of interest (ROI) 245 of a bone segment of the proximal humerus 240 and a ROI image map boundary 250 (e.g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. The ROI image map boundary 250 and the PVG corrected image data of the region of interest 245 of the proximal humerus 240 may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the region of interest 245 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000133] In at least some embodiments, that while two examples may be demonstrated here, it should be understood that similar analyses between image data and complications may be performed for any number of different cohorts with and without complications of various types (intra-operative, post-operative, revision, etc.) For example, as described in Figure 4, radiomicsassociated with the glenoid vault may be analyzed and compared between patients with and without aseptic aTSA / rTSA glenoid loosening, and in doing so may identify the radiomic parameters that may be associated with patients that experienced this complication, and then may use that knowledge prospectively as a risk-profiler for new patients to alert the physician and / or health care professional if a particular patient may be at risk for glenoid implant loosening because they may have a glenoid vault with low bone quality and / or a radiomic profile similar to other patients that may have previously experienced the same failure mode.[000134] In at least some embodiments, as another example described in Figure 5, radiomics associated with the proximal humerus metaphysis may be analyzed and may be compared between patients with and without humeral stem loosening, and in doing so may identify the radiomic parameters that may be associated with patients that experienced this complication, and then use that knowledge prospectively as a risk-profiler for new patients to alert the physician and / or health care professional if a particular patient may be at risk for humeral implant loosening because they may have a proximal humerus with low bone quality and / or with a radiomic profile similar to other patients that may have previously experienced the same failure mode. Additionally, the examples provided for this risk profiler applications may be based on radiomic image-based measurements, but this image-based data may be based on other measurements, like embeddings or class activation maps.[000135] In some embodiments in a fourth clinical application, the clinical decision support software 80 may be configured to create a library of clinically relevant classification systems derived using predictive image-based automated measurements, which may be prospectively matched to an individual patient in the Clinical Decision Support Tools (CDSTs). One barrier tothe adoption of ML based CDSTs may be the need for clinicians to understand the basis of the predictions. The clinical interpretability of CDSTs utilizing image-based measurements may vary with technique. For example, when considering model inputs, shape based radiomic inputs may be more intuitive than first-order and second-order / texture inputs, since these pixel and / or voxel level measurements may be imperceptible to the naked eye. However, even if an individual imagebased measurement may be intuitive to the health care professional user of the software, because there may be potentially so many different measurements that may be used, it may not be practical to communicate all of these image-based measurements to the user. One potentially user-friendly method to leverage numerous image-based measurements may aggregate these most clinically relevant image-based data into classification groups by utilizing one or more ML based methods, such as principal component analysis or clustering. As an illustrative example, clustering may be an unsupervised ML based approach to classify complex datasets into distinct groups having unique characteristics. This dimensionality reduction technique may improve the interpretation of image-based analysis by consolidating numerous pixel and / or voxel level measurements into macro-patterns that may be morphologically distinct and may be more readily visualized. Moreover, these types of ML based methods may be used singularly or may be combined to aggregate the most-predictive image-based measurements which may naturally occur in a reference population to create clinically relevant classification systems associated with different anatomical structures or performance characteristics.[000136] In at least some embodiments, the clinical utility and / or specificity of the classification systems may be objectively assessed to select the methodology by which classification systems are derived, including choice of ML technique and / or associated model parameters. Model parameters may include the number of groups and / or classes and the number of image-basedmeasurements and / or patient parameters based on which the classes may be formed. Objective assessment may include internal validation metrics which may assess the compactness and separation of clusters and / or “groups” formed by the ML algorithms based on the number of clusters. Additionally, clinical utility and / or relevance of the classification systems may be objectively examined in the context of clinical outcomes, patient satisfaction, and / or complications to determine if prospective assignment of certain classes may be associated with higher / lower outcomes, higher / lower patient satisfaction, and / or higher / lower risk of a complication compared to other singular classes and / or the rest of the population to aid in both outlier detection and / or interpretability of the associated image-based measurements.[000137] In at least some embodiments, as a non-limiting example, perturbations of centroidbased k-means clustering were performed for the scapular bone and deltoid muscle by varying the number of clusters and / or the number of image-based parameters utilized as predictors on which the algorithms formed clusters. Both internal validation metrics and / or clinical-based metrics quantifying separation of clusters were plotted against the number of clusters for various combinations of image-based predictors. Predictors were rank ordered from the feature importance analysis and clustering was performed using the top 4, 8, 12, and all radiomic measurements as predictors to form clusters for the scapula and deltoid. The scapular bone clustering may also include native morphological measurements that were used as features in the predictive ML models. Internal validation metrics may be included within cluster sum of squares (WCSS) and the Silhouette score. Clinical metrics may include the percentage of pairwise significant differences between clusters for nine clinical outcome measures pre-operatively and for 2-year minimum post-operative and pre-to-postoperative improvement. Additionally, the maximum difference in the percentage of patients falling within a given patient satisfaction ranking(unchanged / worse, better, much better) at latest 2-year minimum follow-up between one cluster and the rest of the population was plotted.[000138] Figure 40 illustrates graphs of: within cluster sum of squares (WCSS) (top left), Silhouette score (top middle), the percentage of significant pairwise difference in clinical outcomes (top right), and the maximum difference in relative proportion between a single cluster and the remaining population for each of the different patient satisfaction rankings (bottom row) for various combinations of predictor variables and cluster numbers for the Scapula bone in accordance with one or more embodiments of the present disclosure.[000139] Figure 41 illustrates graphs of: within cluster sum of squares WCSS (top left), Silhouette score (top middle), the percentage of significant pairwise difference in clinical outcomes (top right), and the maximum difference in relative proportion between a single cluster and the remaining population for each of the different patient satisfaction rankings (bottom row) for various combinations of predictor variables and cluster numbers for the Deltoid muscle in accordance with one or more embodiments of the present disclosure.[000140] In at least some embodiments, the elbow of the WCSS, which may be considered the optimal number of clusters from a compactness standpoint, does not shift based on the number of predictors, despite scaling differences in the magnitude. On the other hand, the silhouette score, a measure of both compactness and separation of clusters, is higher when less clusters may be used and when only 4 predictors may be used versus 8, 12, or all. A higher silhouette score may be considered better from a cluster compactness and separation standpoint. Additionally, the percentage of pairwise significant differences in outcomes between clusters is largely not impacted by the number of predictors, but increases with a lower number of clusters. However, low numbersof clusters may represent a trade-off relative to clinical specificity with detection of outliers. This may be illustrated by the patient satisfaction charts, which generally show there is larger separation between at least one cluster and the rest of the population within a given satisfaction ranking with an increased number of clusters. In this manner, various internal validation and clinical metrics may be analyzed separately or in parallel to understand the impact of clustering methodology and parameters on the ability of a resulting classification system identify patients that may have outlier outcomes and / or elevated risk of complications.[000141] In at least some embodiments, it should be noted that additional internal validation metrics and / or clinical relevance metrics to objectively assess, compare, and optimize classification systems may be derived and deployed and the non-limiting example(s) herein may be intended to be representative of potential methodologies. Classification systems may also be formed separately on the basis of patient demographic information such as gender, and / or include patient demographic information / characteristics as target parameters. Once classification systems may be derived and optimized relative to technique / parameters, more detailed information pertaining to morphological variation, clinical outcomes, and / or complication risks may be analyzed and presented to aid the surgeon with interpretability of radiomic measurements, groups within which a given patient falls based on these measurements, and whether or not these groups of patients may have outlier performance or complication risks.[000142] In at least some embodiments, as an example, to facilitate clinical interpretation of the radiomic features in an analysis of >4000 shoulder arthroplasty patients, an unsupervised ML clustering analysis may be performed to aggregate the most predictive radiomic measurements of deltoid muscles and / or scapula bones into distinct morphological groups and / or classes within thestudy population. Specifically, a centroid-based k-means clustering algorithm may analyze a deltoid muscle cohort and / or a scapular bone cohort, using the top 8 most predictive radiomic measurements, for example, from the feature importance analysis, along with patient age and gender. Four clusters (4F, 4M) for each deltoid muscle and scapular bone may be defined. Preoperative and 2-year minimum post-operative clinical outcomes (deltoid muscle cohort= 37.9 ± 15.1 months, scapular bone cohort=37.7± 14.8 months) may be compared using a Kruskal-Wallis to identify whether clusters may be associated with different outcomes, where p<0.05 defined significance.[000143] Figure 6 is a Scatter Plot of Pre-operative Abduction vs. Deltoid Volume Normalized by Age and Gender (left), with Corresponding 3D CT Reconstructed Deltoids Representative (i.e. Near) of the Centroid of each of the 4 Female Deltoid Cluster Cohorts. Note that Female Deltoid Cluster Fl is associated with Significantly more Pre-operative Abduction than Female Deltoid Cluster F2, as shown in the Table of Figure 35 below in accordance with one or more embodiments of the present disclosure.[000144] Figure 7 is a Scatter Plot of 2-year Minimum Abduction vs. Deltoid Volume Normalized by Age and Gender (left), with Corresponding 3D CT Reconstructed Deltoids Representative (i.e. Near) of the Centroid of each of the 4 Male Deltoid Cluster Cohorts. Note that Male Deltoid Cluster M2 is associated with Significantly more 2-year Minimum Abduction than Male Deltoid Cluster Ml, as shown in the Table of Figure 36 below, in accordance with one or more embodiments of the present disclosure.[000145] Figure 8 illustrates 3D CT Reconstructed Scapula Representative (i.e. Near) of the Centroid of each of the 4 Female (Left) and 4 Male (Right) Deltoid Cluster Cohorts in accordance with one or more embodiments of the present disclosure.[000146] Figure 34 is a table showing a distribution of Deltoid Muscle Radiomic Measurements and Patient Demographics Associated with Male and Female Deltoid Clusters in accordance with one or more embodiments of the present disclosure.[000147] Figure 35 is a table showing a comparison of Deltoid Clusters to Pre-operative Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure.[000148] Figure 36 is a table showing a comparison of Deltoid Clusters to 2-Year Minimum Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure.[000149] In at least some embodiments, using the image-based radiomic measurements, clusters may be created for 4 unique deltoid muscles (Figures 6-7) and 4 unique scapular bones (Figure 8) for male and female patients who received aTSA or rTSA. The distribution of image-based data used in these deltoid muscle clusters is described in the Table of Figure 34. Some of these deltoid muscle clusters and scapular bone clusters were associated with significantly more / less motion, function, and pain before / after shoulder arthroplasty, though clusters were not associated with differences in every outcome measure. Where specifically as described in the Table of Figure 35, significant differences between at least two deltoid muscle clusters for male patients in abduction, forward elevation, IR score, Constant score, and SAS Score prior to surgery. Similarly, as described in in the Table of Figure 35, deltoid muscle clusters for female patients were identified with significant differences in abduction (see Figure 6), forward elevation, IR score, external rotation, VAS pain score, global shoulder function score, Constant score, ASES score, and SASScore prior to surgery. As described in in the Table of Figure 36, deltoid muscle clusters for male patients were identified with significantly better / worse abduction (see Figure 6), IR score, and external rotation at 2-years minimum follow-up. Similarly, as described in in the Table of Figure 36, deltoid muscle clusters for female patients were identified with significantly better / worse forward elevation, IR score, global shoulder function score, Constant score, ASES score, and SAS Score at 2-years minimum follow-up.[000150] Figure 37 is a table showing a distribution of Scapular Bone Radiomic Measurements and Patient Demographics Associated with Male and Female Deltoid Clusters in accordance with one or more embodiments of the present disclosure.[000151] Figure 38 is a table showing a comparison of Scapula Clusters to Pre-operative Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure.[000152] Figure 39 is a table showing a comparison of Scapula Clusters to 2-Year Minimum Clinical Outcomes Measures of Active Range of Motion, Pain, Function, and Patient Reported Outcome Measures for Male and Female Patients in accordance with one or more embodiments of the present disclosure.[000153] In at least some embodiments, the distribution of image-based data used in these scapular bone clusters may be described in the Table in Figure 37. Comparing the scapular bone clusters to clinical outcomes may also demonstrate significant differences between at least 2 scapular bone clusters for male patients in IR score, global shoulder function score, and constant score prior to surgery. Similarly, as described in the Table in Figure 38, scapular bone clusters for female patients may be identified with significantly differences in abduction, external rotation, VAS pain score,and ASES score prior to surgery. Finally, as described in the Table in Figure 39, scapular bone clusters for female patients may be identified with significantly better / worse external rotation at 2-years minimum follow-up; no 2-year minimum clinical outcome differences in scapular bone clusters were observed for male patients.[000154] In at least some embodiments, these classes and / or clusters of patients may be identified prospectively and may be utilized in the software, such that when a physician and / or health care professional may upload their patient’s medical image into the planning software, the framework may be able to automatically assign one or multiple classifications (e.g. clusters) which may most closely represent and / or resemble that patient’s 3D reconstruction and associated image-based measurements. This software may include a library of classifications, and those classifications which may most closely represent and / or resemble the patient may be communicated to the physician and / or health care professional. These classifications may be trained and developed for numerous use cases. For example, classes may be developed which may be associated with good, medium, and / or poor results for any number of different clinical outcome measures (ROM, pain, function, PROMs) and / or may identify patients who may have the greatest risk (or lowest risk) for any number of different complications. For example, if the library of classification systems may include multiple bone and / or muscle classes associated with patients who may be at high risk and / or low risk for different complications, including implant loosening (e.g. glenoid loosening or humeral loosening), bone fracture, muscle tears, tendon or ligament tears, etc, then any and all classifications which may most closely represent and / or resemble that patient’s bone and / or muscle, may be communicated to the physician and / or health care professional, so that they may better communicate to the patient the risks and benefits of a given treatment. This method of training a hierarchy of classification systems may be based on different risk factors andprospectively matching any and all relevant classes and / or clusters that may resemble a given patient from this library may be potentially an effective software workflow for personalized risk management to identify patients with risk factors for complications and / or lower potential for improvement.[000155] In at least some embodiments, the clinical applications of prospective assignment of classification models within the CDST from a pre-trained library of ML derived classes may have many uses beyond just the prediction of outcomes after one or multiple treatments. For example, this method of prospective classification assignment may be effectively utilized within the imagebased planning software to perform a diagnosis of a clinical pathology, identification of a unique anatomic morphology, and / or identification of tumors, anomalies, or fracture patterns. As an example, in the case of shoulder arthroplasty, patients that may be treated with aTSA or rTSA may typically be diagnosed with osteoarthritis, osteonecrosis, irreparable rotator cuff tears with or without arthritis, rotator cuff tear arthropathy, rheumatoid arthritis, or proximal humerus fracture (acute or sequelae). One or multiple classification systems may be trained for each of these different diagnoses (including subcategories within these classifications to describe joint wear patterns - like Walch or Favard or Antuna classification glenoid wear and / or defect systems) and then the planning software may prospectively assign the class or groups of classes which may most closely represent and / or resemble the image-based measurements associated with a particular patient as method of diagnosis and / or as a confirmation of diagnosis by the physician and / or health care professional. One clinical benefit of this approach may be that a given patient may very likely be prospectively assigned one or multiple classes for different diagnoses, which may imply that the historical diagnosis classification methods may be incomplete and patients may actually experience a continuum of degenerative conditions as opposed to one single diagnosis consistingof a narrow definition. This method of deployment of pre-trained classification systems for diagnoses may be deployed to create new, more granular diagnosis classifications which may better define a patient’s condition (on a continuum) prior to treatment.[000156] In at least some embodiments, regardless of the clinical use case, different ML based methods may be utilized to derive these classification systems, for example, principal component analysis or clustering. Additionally, there may be multiple different methodologies associated within a given technique. For example, there may be multiple different clustering techniques (centroid-based, hierarchical, density based, distribution based, etc ), different input parameters, and also different types of input data. Regarding the input data, there may be many different types of image-based data that may be used to train the ML classification algorithms. For example, in the case of shoulder arthroplasty, the planning software may utilize traditional joint degeneration or joint relationship measurements, like glenoid retroversion angle, beta angle, or humeral head subluxation percentage. These measurements may be automatically collected by the software from a 3D reconstructed image. Additionally, if using radiomic based measurements as ML model inputs, clustering algorithms may use shape-based measures, first-order measures, second- order / texture measures, embeddings, and / or from any combination of these image-based measurements. Additionally, many different datasets may be used to supplement these imagebased data when training this library of classifications. For example, various data may be readily available in the patient’s electronic medical record (blood work, subjective pain scores, range of motion data, comorbidities, demographics, previous medical history, etc.) and any or all of that data may be used as inputs to the ML models when building this library of clusters / classifications.[000157] In at least some embodiments, another potential application of this prospective class assignment method may be to define important different clinically relevant thresholds for treatment, for example: 1) to define when a patient stops being “healthy” and actually may have a diagnosis for a pathology (by comparing an individual patient’s class to that of classes developed from healthy control patients), 2) to define when a patient may need to transition from one type of treatment (a more conservative treatment, like physical therapy, NSAIDs, or a cortisone injection for pain) to another type of treatment (a more end-stage treatment, like joint replacement procedure like shoulder, hip, knee or ankle arthroplasty), or 3) to define the precise time in which a patient may get a joint replacement procedure as waiting longer may subject the patient to greater risk from performing the procedure or waiting longer will result in greater amounts of joint deformity which may make the procedure less bone-conserving and more difficult to recover from. Deployment of this type of application may have potential to greatly improve the surgeon-patient shared decision-making process by helping both the surgeon and patient learn, based on the aggregate previous experiences of similar patients, as to when may be the ideal time to perform the joint replacement surgery. Various methods may be used to visualize the stage in the process for an individual patient. For example, a dial clock may indicate if a particular patient may be early in the degenerative process and may indicate green for methods of treatment - suggesting that the patient may wait for 1-2 years before more aggressive treatments are necessary if they perform other tasks to reduce pain (NSAIDs, cortisone shots) and may improve function (physical therapy). Alternatively, the dial clock may indicate yellow or red if the patient is worse than typical patient and may be in need of more aggressive treatment options. For example, in the case of shoulder arthroplasty, the image-based software may calculate the amount of joint wear and may compare that to other image-based measurements, where specifically a cluster based model may bedeveloped from the glenoid vault measurements for patients who may have previously had glenoid loosening after shoulder arthroplasty and may be compared to a given patient in order to determine if that particular patient already may have had a significant amount of glenoid wear (which may progress with time) and may compromise the ability to place an implant where desired based on increased risk of glenoid implant loosening.[000158] In at least some embodiments, another post-operative application may be to redefine the complication risk for a patient after the procedure based on the specific implants and techniques used to perform the procedure. For example, if a surgeon may utilize thicker implants than was originally planned when performing an aTSA procedure, that patient may have an elevated risk of rotator cuff failure and an image-based assessment from a medical image may be used to identify that the rotator cuff muscles may have an elevated strain (change in length divided by native / pre- operative length) because they have been stretched beyond their native length by the use of the thicker implant components (relative to the amount of bone removed during the procedure). The software may calculate the change in length and may also calculate the strain in the deltoid and / or rotator cuff by comparing the prosthesis displacement for a given configuration, position, and use of a specific implant size. Another application of this type of image-based joint relationship calculation may be to perform this calculation prior to the procedure for all the various combinations of implants sizes and combinations and to recommend against specific combinations of sizes, and / or positions for surgical planning that will result in elevated strain. Moreover, these image-based measurements may be used as inputs to computational models / finite element analyses which may be incorporated into the software and / or used to simulate stresses and strains in the bone, muscles, and / or implants for various implant size / type configurations and / or various implant positioning on the bone for different physiologically-relevant loading scenarios. In doing so theseinputs and corresponding computational models may effectively generate a “digital twin” that may be utilized by the clinician to simulate different clinical decisions that may reduce the occurrence of complications, such as evaluation and / or selection of different treatment types, different implant types / sizes / configurations, and / or different implant positioning for a given surgical technique in order to minimize complication risk and / or probability of occurrence of a risk by reducing bone or soft tissue stresses, etc. Similarly, these inputs and corresponding computational models may be utilized by the clinician to simulate different clinical decisions that may impact post-operative factors of interest to the patient, such as pain, impingement, range of motion, and / or patient reported outcome measures or other functional measurements, such that this tool may be used to help the clinician make decisions that optimize these factors based on the needs of the patients.[000159] Figure 9 illustrates Multiple views of 3D reconstructions of a scapular bone (left), with segmentation of the 3D volume into anatomically relevant sub-volumes of scapular bone segments for localized radiomic analysis (middle), in this example (right), outlier image-based measurements (relative to a patient reference group) of the glenoid vault displayed for visual interpretation in accordance with one or more embodiments of the present disclosure. Particularly, Figure 9, as in Figure 4, illustrates the scapula 215 having a region of interest (ROI) 210 of the glenoid vault and a ROI image map boundary 215 (e g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. Figure 9 also illustrates a medical image enlarged region 225 showing the glenoid vault within the shoulder with the region of interest 210 as highlighted 227. The ROI image map boundary 215 and the PVG corrected image data of the region of interest 210 of the scapula may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement inthe region of interest 210 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000160] Figure 10 illustrates multiple views of 3D reconstructions of a scapular bone (left), with segmentation of the 3D volume into anatomically relevant sub-volumes of scapular bone segments for localized radiomic analysis (middle), in this example (right), outlier image-based measurements (relative to a patient reference group) of the acromion displayed for visual interpretation in accordance with one or more embodiments of the present disclosure. Particularly, Figure 10 illustrates the scapula 215 having a region of interest (ROI) 230 of the acromion and a ROI image map boundary 235 (e.g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. Figure 10 also illustrates a medical image enlarged region 237 showing the acromion within the shoulder with the region of interest 230 as highlighted 227. The ROI image map boundary 215 and the PVG corrected image data of the region of interest 238 of the scapula may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the region of interest 230 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000161] Figure 11 illustrates multiple views of 3D reconstructions of the proximal humerus (left), with segmentation of the 3D volume into anatomically relevant sub-volumes of the proximal humeral bone segments for localized radiomic analysis (middle), in this example (right) outlier image-based measurements (relative to a patient reference group) of the proximal humerus are displayed and presented for visual interpretation in accordance with one or more embodiments of the present disclosure. Particularly, Figure 11 illustrates the proximal humerus 240 having a region of interest (ROI) 245 of a bone segment of the proximal humerus 240 and a ROI image mapboundary 250 (e.g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. Figure 11 also illustrates a medical image enlarged region 255 showing the proximal humerus 240 within the shoulder with the region of interest 245 as highlighted 257. The ROI image map boundary 250 and the PVG corrected image data of the region of interest 245 of the proximal humerus 240 may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the region of interest 245 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000162] Figure 12 illustrates 3D reconstructions of the scapula, proximal humerus, and deltoid muscle (left), with segmentation of the 3D muscle volume into anatomically relevant sub-volumes of the deltoid (middle deltoid, middle) for localized radiomic analysis (right), in this example (right) outlier image-based measurements (relative to a patient reference group) of the middle deltoid are displayed and presented for visual interpretation in accordance with one or more embodiments of the present disclosure. Particularly, Figure 12, as in Figure 3, illustrates the deltoid muscle as a region of interest (ROI) 200 and a ROI image map boundary 205 (e.g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. Figure 12 also illustrates a medical image enlarged region 260 showing the deltoid muscle region of interest 200 within the shoulder as highlighted 262. The ROI image map boundary 205 and the PVG corrected image data of the region of interest 200 of the deltoid muscle may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the region of interest 200 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000163] Figure 13 illustrates 3D reconstructions of the scapula, proximal humerus, deltoid muscle, and rotator cuff muscles (left), with deltoid removed (middle, and with the supraspinatus rotator cuff muscle (right) highlighted for localized radiomic analysis (right), in this example (right) select radiomic measures of the supraspinatus are extracted and presented and outlier image-based measurements (relative to a patient reference group) of the supraspinatus are displayed and presented for visual interpretation in accordance with one or more embodiments of the present disclosure. Particularly, Figure 13 illustrates the supraspinatus muscle as a region of interest (ROI) 270 and a ROI image map boundary 273 (e.g., ROI outline) that are the output of the at least one segmentation algorithm as described hereinabove. Figure 13 also illustrates a medical image enlarged region 275 showing the supraspinatus muscle region of interest 270 within the shoulder as highlighted 277. The ROI image map boundary 273 and the PVG corrected image data of the region of interest 270 of the supraspinatus muscle may be inputted into the at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the region of interest 270 and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000164] Figure 14 illustrates 3D reconstructions of the scapula, proximal humerus, and deltoid muscle. The table below the reconstruction displays the extracted radiomic measures of the patient’s deltoid muscle relative to a control / reference patient cohort of deltoid radiomic measures to provide the physician and / or health care professional context of this patient’s image-based measurements in accordance with one or more embodiments of the present disclosure.[000165] In at least some embodiments, the usability of an image-based CDST tool may be challenged with the presentation of highly granular data. As such, to improve the ease-of-use, it may be important that the method of communication of the clinically relevant data may bepresented clearly and concisely to the user. There may be various methods to communicate the most important and clinically relevant data to the user. The ML based methods of developing classification systems presented above, when trained on data that may be composed of the greatest feature importance for a given clinical use case, may be a dimensional reduction technique to condense and / or aggregate the dataset to what may be most relevant to the user. However, there may be numerous additional methods to present the raw image data visually. One method may be a heat density map, or a class activation map may be used to help the physician and / or health care professional visualize a particular region of the image that may be clinically relevant. For example, for a patient with image-based measurements which may suggest that the patient may have a lesion and / or cavity in the scapular glenoid bone which may prevent the surgeon from achieving glenoid fixation. As depicted in Figure 9, by the software directing the user to this region of interest, the likelihood that the surgeon may notice this bone abnormality may be increased, thereby reducing the risk that the region of poor-quality bone may be missed and ignored during the procedure. There may be many additional use cases for this kind of heat map identification of outlier data, for example, Figure 10 depicts a heat map of image-based measurements of the acromion that may be outside the normal distribution of one or more measures of bone quality, density, and / or strength, in the acromion and / or scapular spine for an elderly patient who may be considering rTSA - for that patient, they may have an elevated risk of a scapular fracture). This software may be used to identify and communicate abnormalities in this manner from the full muscle, tendon, or ligament or from a sub-volume of any of these anatomic structures, if their image-based measurements may be outside the normal distribution relative to a comparison cohort, even if the abnormality may not be predictive of any particular complication. As additional examples, the bone defect in theproximal humerus depicted in Figure 11, the abnormality in the middle deltoid depicted in Figure 12, and abnormality in the supraspinatus rotator cuff muscle depicted in Figure 13.[000166] In at least some embodiments, heat maps may be visually effective, but communication of the raw data may be helpful for learning and future research applications. As such, the user interface of the software may be configured to have adaptive tables which may numerically represent the image-based measurements with the greatest feature importance for one or multiple outcomes. The user interface may output the one or multiple outcomes in tables that may be modifiable by the user so that they may flip through the various tables for different outcome predictions and / or complication predictions. These adaptive tables may also be configured to only present the patient’s image-based data if it is outside of the expected range as defined by a predetermined patient cohort - for example, patients of the similar age, gender, diagnosis. As an example, these tables may be configured to filter out data by some statistical based method, like 1 or 2 standard deviations from the mean or as a location within the range of the patient control cohort, as depicted in Figure 14. Furthermore, these tables may also have an adaptable user interface such that it displays data that may be more “abnormal” or further from the mean of the cohort using a color coding or a bar chart.[000167] Some embodiments of the present disclosure presented many practical applications of creating a library of different classification models derived using various different ML based methods and trained on image-based measurements, which may be used in the planning software for a prospective assignment to an individual patient, for example:1) Clinical outcome prediction tool (outcomes prediction to identify if a patient may have a more / less potential for clinical improvement after different treatments, this may be basedon pre-operative image-based measurements and / or may be refined with additional postoperative image-based measurements)2) Risk profiler complication prediction (complication prediction tool to help patients better understand if they have elevated risk factors for one or multiple post-operative complications after various treatments, this tool may be based on pre-operative imagebased measurements and / or could be refined with additional post-operative image-based measurements)3) Patient Expectation tool (combining these features into a single tool which communicates the patient specific potential for improvement, along with the risks and benefits of a given treatment, as compared to other patients)4) Muscle size / shape / quality modeling / analysis tool for research and clinical purposes, 5) Bone size / shape / quality modeling / analysis tool for research and clinical purposes, 6) Tendon size / shape / quality modeling / analysis tool for research and clinical purposes, 7) Ligament size / shape / quality modeling / analysis tool for research and clinical purposes, 8) Joint characteristic tool to aggregate the measurements of the muscles, bone, tendons, and / or ligaments for all the anatomic structures in a joint, compare the relationships between those anatomic structures and compare trends associated with other patients for a more stratified, personalized analysis to a more relevant comparison cohort.9) Diagnosis assignment and / or anatomy / morphology abnormality / outlier identification tool for research and clinical purposes10) Treatment clock (to indicate when a patient may be treated with more conservative vs more aggressive treatments for a given pathology)[000168] In at least some embodiments, a method may include performing at least one joint pre- surgical medical imaging procedure to image a portion of a joint of a patient prior to an implantation of at least one implant into the joint of the patient. By at least one processor (e.g., the at least one processor 45), image data of a plurality of medical images of the portion of the joint acquired from at least one medical imaging device (e.g., from the medical imaging system 35) may be received. A plurality of pixel-voxel granularity (PVG) corrected medical images may be generated by applying at least one PVG pre-processing algorithm (e.g., the medical imaging postprocessing (PP) analyzer 48) to the image data of each image from the plurality of medical images. The at least one PVG pre-processing algorithm may be configured to: normalize pixel values in the image data in each medical image by adjusting pixel gray level intensity values within each medical image of the plurality of medical images to a common gray scale; resample the image data to increase or decrease a number of pixels in each medical image-based on a standard voxel size between images; and convert the pixel values in each image to digital pixel values to generate each PVG corrected medical image in the plurality of PVG corrected medical images. The at least one processor may segment the image data of each PVG corrected medical image of the portion of the joint using at least one segmentation algorithm to segment the plurality of PVG corrected medical images to identify at least one region of interest in the portion of the joint associated with: at least one bone member of the joint, at least one connective tissue associated with the joint, at least one muscle associated with the joint, or any combination thereof. The at least one region of interest in the portion of the joint and the plurality of PVG corrected medical images may be inputted by the at least one processor into at least one medical image analysis machine model (e.g., the medicalimaging MLM 50) that may be trained to output: at least one image based measurement and / or at least one radiomic feature in the at least one region of interest, and at least one implant complication risk assessment for the implantation of the implant into the joint. At least one 3- dimensional (3D) representation of the joint and the at least one implant complication risk assessment based on the plurality of PVG corrected medical images may be displayed to a user on a display (e.g., via the GUI manager 56).[000169] In at least some embodiments, the method hereinbelow that may be performed by the at least one processor 45 executing the surgical planning software 52 may further include receiving, by the at least one processor, pre-operative patient specific data for an arthroplasty surgery to implant the at least one implant in the joint of the patient. The pre-operative patient specific data (e.g., collected by the patient-specific data collection module 46) may include a medical history of the patient, a measured range of movement for at least one type of joint movement of the joint, and at least one pain metric associated with the joint. At least one arthroplasty surgical parameter based on the at least one implant complication risk assessment may be received, by the at least one processor, from the user. The at least one arthroplasty surgical parameter may include the at least one implant, at least one implant size, at least one arthroplasty surgical procedure, at least one position for implanting the at least one implant in the joint, or any combination thereof. A reconstruction plan of the joint of the patient may be generated based at least in part on the plurality of PVG corrected medical images of the joint, the at least one implant complication risk assessment, and the at least one arthroplasty surgical parameter. The pre-operative patient specific data and reconstruction plan data may be inputted into at least one postoperative joint performance machine learning model to determine a predicted post-operative joint performance data output at a plurality of post-operative timepoints after surgery. The predicted post-operative jointperformance data output may include at least: a predicted range of movement for the at least one type of joint movement of thejoint, and at least one predicted pain metric associated with the joint. The at least one postoperative joint performance machine learning model may be trained to output data comprising a plurality of values for the predicted post-operative joint performance data output at the plurality of post-operative timepoints after surgery, each value is at a particular timepoint of the plurality of post-operative timepoints after surgery. Input data to train the at least one postoperative joint performance machine learning model may include at least: the pre-operative patient specific data, the at least one implant complication risk assessment, the at least one region of interest in the portion of thejoint, and the reconstruction plan data. The reconstruction plan data and the predicted post-operative joint performance data output at the plurality of post-operative timepoints after the arthroplasty surgery may be displayed on the display to the user. The arthroplasty surgery may be performed to implant the at least one implant based on the reconstruction plan of thejoint of the patient and the at least one arthroplasty surgical parameter.[000170] In at least some embodiments, the surgical assistance system 10 may be used to assist the surgeon during an arthroplasty surgical procedure identify at least one of but not limited to: at least one implant complication risk assessment, at least one post-operative outcome, at least one position of the implant into a joint, at least one size of the implant, at least one type of the implant, at least one resection associated with at least one of a first bone member or a second bone member at thejoint, at least one soft tissue parameter, at least one position of at least one of the first bone member or the second bone member within thejoint, an alignment angle of at least one of the first bone member or the second bone member, a flexion angle of at least one of the first bone member or the second bone member, or an axial rotation angle of at least one of the first bone member or the second bone member.[000171] In at least some embodiments, the medical computing device 15 may be configured to operate in robotic and / or computer arthroplasty systems and / or other sensor devices that may include providing the graphic user interface 75 to the surgeon in the surgeon console where the surgeon sits to control the robotic arm or other similar instruments. In other embodiments, the at least one processor 45 may be configured to execute controller software for controlling a surgical robotic arm and / or the surgical instruments coupled to the robotic arm, or the highly precise and maneuverable arm that holds and manipulates the surgical instruments for performing the arthroplasty surgery.[000172] In at least some embodiments, radiomic measurements may include quantitative descriptors that may be extracted from PVG corrected medical images within anatomically segmented regions of interest, such as muscles, tendons, ligaments, and / or bones. These descriptors may include shape features, first-order intensity statistics, and / or second-order texture features that may numerically characterize geometry, density, and spatial intensity organization. Shape features may include volume, surface area, surface-to-volume ratio, sphericity, flatness, elongation, principal-axis lengths, and maximum two-dimensional diameters in row, column, and slice planes. First-order features may include statistics derived from voxel intensities, such as mean, median, minimum, maximum, range, interquartile range, standard deviation, entropy, percentiles, skewness, and kurtosis. Texture features may include matrix-based statistics that may quantify spatial relationships among gray levels, including gray-level co-occurrence matrix (GLCM) measures such as contrast, correlation, homogeneity (Id), joint energy, joint entropy, maximum probability, autocorrelation, sum entropy, and maximal correlation coefficient; gray-level run length matrix (GLRLM) measures such as run entropy; gray-level size zone matrix (GLSZM) measures such as gray level variance, gray level non-uniformity normalized, size-zonenon-uniformity normalized, low gray level zone emphasis, and zone entropy; gray-level dependence matrix (GLDM) measures such as dependence entropy, dependence variance, gray level variance, and large / small dependence emphases; and neighborhood gray-tone difference matrix (NGTDM) measures such as coarseness and strength. These radiomic measurements may be produced after normalization, resampling to a standard isotropic voxel size, and discretization, where such PVG preprocessing may improve robustness across scanners and imaging protocols.[000173] In at least some embodiments, other image-based measurements may include quantitative outputs that may extend beyond hand-engineered radiomics by leveraging learned representations, geometric modeling, modality-specific biophysical surrogates, and / or planning-oriented joint metrics. Such other measurements may include deep learning embeddings and intermediate feature maps that may encode high-level morphological patterns; class activation maps and saliency maps that may localize image regions influential to model predictions; bone mineral density surrogates and Hounsfield unit-derived density gradients; mesh-based or statistical shape model parameters, principal geodesic modes, local and principal curvature, cortical thickness maps, signed distance fields, and geometric strain proxies; joint relationship and alignment metrics that may include joint space width, congruency, subluxation percentages, version and inclination angles, center of rotation, and impingement clearances; multi-scale texture and structure measures such as fractal dimension, lacunarity, structure tensor metrics, Gabor filter responses, and local binary patterns; registration-derived deformation field summaries that may capture local expansions, compressions, and asymmetries; segmentation uncertainty maps that may quantify boundary confidence; lesion and defect quantifications such as cystic volume, sclerotic rim thickness, osteophyte burden, erosions, marrow edema, and subchondral voids; biomechanics-informed surrogates that may estimate contact patches, contact pressure tendencies,moment arms, and surrogate strain fields; and modality-specific parameters, including T1 / T2 / T2* relaxometry, diffusion -weighted apparent diffusion coefficients, dynamic contrast-enhanced timeintensity parameters, ultrasound elastography shear wave velocities, and PET standardized uptake values.[000174] In at least some embodiments, radiomic measurements may emphasize standardized, interpretable descriptors that may be directly calculated from voxel intensities and segmented geometries, while other image-based measurements may emphasize learned latent features, higher-order geometric constructs, registration- or biomechanics-derived surrogates, and multi-modal physiological parameters. Radiomic measurements may be particularly suited to robust, reproducible quantification after PVG preprocessing and may provide consistent inputs to predictive models, risk assessment, prospective class assignment, and outlier detection. Other image-based measurements may complement radiomics by capturing information that radiomics may not fully represent, such as complex appearance patterns learned by neural networks, patient-specific anatomical relationships important to implant planning, localized regions of abnormality highlighted by class activation techniques, and modality-specific biophysical signals that may inform tissue quality and function. Together, these measurement families may provide a comprehensive quantitative foundation that may enable the clinical decision support tool to transform heterogeneous medical images into actionable prognostic and prescriptive insights.[000175] Figure 42 is an exemplary flow diagram 100 for modeling predictive outcomes of arthroplasty surgical procedures in accordance with one or more embodiments of the present disclosure. The exemplary flow diagram 100 with reference to Figure 1 may include the patient 25 entering a clinic (step 105) to consult with the doctor 20 about an arthroplasty surgical procedure to improve or replace a joint. The doctor 20 may collect pre-op patient-specific data from thepatient 25 that may be entered into the patient-specific data collection module 46 executed by the processor 45 on the computing device 77. Alternatively, and / or optionally, the patient-specific data collection module 46 may query the plurality of N electronic resources (40A and 40B) for patientspecific pre-operative data that may be received by the server 15 over the communication network 30. The received dataset may include pre-operative patient specific data for an arthroplasty surgery to be performed on a joint of a patient where the pre-operative patient specific data may further include a medical history of the patient, a measured range of movement for at least one type of joint movement, at least one pain metric associated with the joint, or any combination thereof.[000176] In at least some embodiments, the received pre-operative patient specific data may be inputted to an initial preop prediction machine learning model (MLM) 115. The initial preop prediction MLM 115 may determine a first predicted post-operative joint performance data output that includes at least one first predicted post-operative performance metric of the joint, which may then be displayed on the display of the computing device 77 to a user, such as the user 20 (e.g., the doctor 20), for example.[000177] In at least some embodiments, the doctor 20 and the patient 25 may have an initial patient consultation 120. The doctor 20 and / or the patient 25 may decide to continue with the arthroplasty surgery of the joint, or to delay the surgery or to pursue other treatment 125 for the diseased joint.[000178] In at least some embodiments, the doctor 20 may request that the patient 25 may receive at least one medical image of the joint, such as a computerized tomography (CT) scan 130, for example, obtained from at least one medical imaging procedure performed on the patient 25. The at least one medical image of the joint may include an X-ray image, a computerized tomography (CT) image, a magnetic resonance image, a three-dimensional (3D) image, and / or a 3D medicalimage based on multiple X-ray images. The at least one medical image of the joint may also include images of the bones and / or the connective tissues attached to and / or forming the joint.[000179] In at least some embodiments, in a guided personalized surgery (GPS) Preop Planning 135 step, a CT image-based (GPS) Joint Reconstruction Planning module, which may be a software program executed by the processor 45, may generate a reconstruction plan of the joint that is display on the GUI 75. The CT image-based (GPS) Joint Reconstruction Planning module may be part of the surgical planning software module 52 of the clinical decision support software 80.[000180] In at least some embodiments, the reconstruction plan may utilize at least one arthroplasty surgical parameter chosen by the doctor in response to the doctor viewing the first predicted post-operative joint performance data output. The reconstruction plan may include at least one arthroplasty surgical parameter that is selected from, but not limited to, at least one implant, at least one implant size, at least one arthroplasty surgical procedure, and / or at least one position for implanting the at least one implant in the joint. The reconstruction plan may include different views of the at least one medical image of the joint, such as the CT scan 130, that may be displayed on the GUI 75 along with images of the at least one implant implanted in the joint.[000181] In at least some embodiments, the at least one arthroplasty surgical parameter may be inputted to a final Preop prediction model 140. The at least one arthroplasty surgical parameter may include any of the data inputs to the final Preop prediction model 140.[000182] In at least some embodiments, the data inputs to the final Preop prediction model 140 may include any of the inputs to the initial preop prediction MLM 115 as well as any suitable parameters extracted from the reconstruction plan.[000183] In at least some embodiments, the surgical planning software module 52 may include the initial preop prediction MLM 115 and / or the final Preop prediction model 140.[000184] In at least some embodiments, the initial preop prediction MLM 115 and the final Preop prediction model 140 may be the same machine learning model.[000185] In at least some embodiments, the software application for modeling the predictive outcomes of arthroplasty surgical procedures may be executed by the processor 45 and the GUI manager 56 may remotely control the GUI 75 running on the computing device 77 for providing inputs and / or outputs from the server 15.[000186] In at least some embodiments, the first predicted post-operative joint performance data output and / or the second predicted post-operative joint performance data output may be displayed on the GUI 75 to the doctor 20 in any suitable format, such as outputting a list of predicted postoperative outcome metrics of the joint based on data inputs such as pre-operative patient specific data, medical images of the joint, and arthroplasty surgical parameters to the predictive outcome machine learning models. A visual representation of the implant implanted in a joint based on the medical images of the joint. The visual representation of the implant implanted in a joint may include raw, enhanced, and / or augmented images of the joint that may be displayed on GUI 75.[000187] In at least some embodiments, the second predicted post-operative joint performance data output may include displaying on the GUI 75 at least one arthroplasty surgery recommendation of combinations of surgical procedures, implant types, implant sizes, implant positions along with the predicted post-operative outcome metrics from the models for each combination so as to allow the surgeon to optimize the post-operative joint performance by varying the arthroplasty surgical parameters. This optimization may be performed before and / or during the surgery.[000188] In at least some embodiments, the at least one arthroplasty surgery recommendation may include a recommendation not to proceed with the arthroplasty surgical procedure and / or to pursue another treatment.[000189] In at least some embodiments, the final Preop prediction model 140 may determine a second predicted post-operative joint performance data output that includes the at least one second predicted post-operative performance metric of the joint, which may then be displayed on the GUI 75 of the computing device 77 to a user, such as the doctor 20, for example.[000190] In at least some embodiments, the doctor 20 may review second predicted post-operative joint performance data output and conduct a final patient consultation 145 with the patient 25. The doctor 20 and / or the patient 25 may decide to schedule the arthroplasty surgery 155 of the joint, or to delay the surgery or to pursue other treatment 150 for the diseased joint.[000191] In at least some embodiments, Figure 42 for modeling flow of predictive outcomes of arthroplasty surgical procedures that may also integrate radiomic image processing within the outcome modeling steps, where the flow may include receiving standard of care medical images, applying PVG preprocessing that may normalize gray level intensities, may resample to an isotropic voxel size, and may discretize intensities, performing at least one segmentation that may generate at least one ROI image map boundary and an at least one ROI image map, extracting image based measurements and / or at least one radiomic features that may include shape, first order intensity, and second order texture measures from the ROI, and passing these features to the medical imaging MLM module 50 which, together with patient specific data and surgical planning parameters, may generate at least one implant complication risk assessment and predicted postoperative joint performance metrics at multiple timepoints; the flow may further include visualization and alert steps that may display heat maps, class activation maps, and color codedindicators on the ROI, and may provide prospective class or cluster assignments, so that the image based measurements and / or radiomic features and ML outputs may be reused downstream in the decision steps of Figure 42 to update recommendations and may enable iterative optimization of implant type, size, and position.[000192] In at least some embodiments, the clinical decision support software 80 of Figure 1 may include a coordinated set of algorithms mapped to its modules. The Medical Imaging Pre-Processing (PP) Analyzer 48 may include PVG preprocessing that may normalize gray-level intensities using z-score normalization. It may resample to an isotropic voxel size using B-spline or Welch-Sinc interpolation. It may discretize intensities using fixed bin width or fixed bin count strategies.[000193] In at least some embodiments, the Medical Imaging MLM module 50 may include segmentation algorithms that may be automated, semi-automated, or manual with anatomical priors, landmarks, or bounding boxes. It may include U-net or other neural network architectures. It may execute image based measurement extraction and / or radiomic feature extraction that may include shape, first-order intensity, and second-order texture families such as GLCM, GLRLM, GLSZM, GLDM, and NGTDM. It may use deep learning representation methods that may include embeddings, saliency maps, and class activation maps. It may apply dimensionality reduction that may include principal component analysis. It may run unsupervised classification that may include centroid-based k-means clustering with internal validation metrics such as WCSS and Silhouette score. It may perform outlier detection that may include statistical thresholding against reference cohorts. It may compute feature importance rankings that may include F-score analyses. It may generate complication risk assessments that may predict instability, aseptic loosening, fracture,infection, and revision. It may produce postoperative joint performance models that may predict timepoint-specific range of motion and pain metrics.[000194] In at least some embodiments, the Model Training module 54 may include XGBoost regression and classification pipelines. It may include neural network training workflows with periodic or continual retraining. It may include cluster optimization across predictor sets and cluster counts.[000195] In at least some embodiments, the Surgical Planning Software 52 may include iterative optimization routines that may adjust implant type, size, and position based on predicted outcomes and risk signals. It may include digital twin or biomechanics-informed computations that may estimate contact tendencies and surrogate strain fields. It may include statistical shape modeling and geometric analysis that may evaluate principal geodesic modes, curvature, cortical thickness, and signed distance fields. It may include registration-driven deformation field analyses that may summarize local expansions and compressions. It may include multi-scale texture and structure analyses that may include fractal dimension, lacunarity, structure tensor metrics, Gabor filters, and local binary patterns.[000196] In at least some embodiments, the GUI Manager 56 may include visualization algorithms that may render heat maps, class activation overlays, color coded indicators, 3D representations, and alerts. The Patient Specific Data Collection module 46 may ingest demographics, comorbidities, diagnosis, PROMs, and ROM data for integration with the imaging driven algorithms across the platform.[000197] In at least some embodiments, the processor 45 may be configured to receive preoperative patient specific data for an arthroplasty surgery to implant the at least one implant in the joint of the patient. The pre-operative patient specific data may include for example, but not limitedto a medical history of the patient, a measured range of movement for at least one type of joint movement of the joint, and at least one pain metric associated with the joint. The processor 45 may be further configured to receive from the user, at least one arthroplasty surgical parameter based on the at least one implant complication risk assessment. The at least one arthroplasty surgical parameter may be selected from, but not limited to the at least one implant, at least one implant size, at least one arthroplasty surgical procedure, at least one position for implanting the at least one implant in the joint, or any combination thereof. The processor 45 may be further configured to generate a reconstruction plan of the joint of the patient based at least in part on the plurality of PVG corrected medical images of the joint, the at least one implant complication risk assessment, and the at least one arthroplasty surgical parameter, and to input the pre-operative patient specific data and reconstruction plan data into at least one postoperative joint performance machine learning model to determine a predicted post-operative joint performance data output at a plurality of post-operative timepoints after surgery. The predicted post-operative joint performance data output may include but is not limited to a predicted range of movement for the at least one type of joint movement of the joint, and / or at least one predicted pain metric associated with the joint. The at least one postoperative joint performance machine learning model may be trained to output data that may include a plurality of values for the predicted post-operative j oint performance data output at the plurality of post-operative timepoints after surgery, each value is at a particular timepoint of the plurality of post-operative timepoints after surgery. The input data to train the at least one postoperative joint performance machine learning model may include but is not limited to the preoperative patient specific data, the at least one implant complication risk assessment, the at least one region of interest in the portion of the joint, and / or the reconstruction plan data. The processor 45 may be further configured to display on the display 75 to the user 20 (e.g., a doctor, forexample), the reconstruction plan data and the predicted post-operative joint performance data output at the plurality of post-operative timepoints after the arthroplasty surgery and perform the arthroplasty surgery based on the reconstruction plan data and the at least one arthroplasty surgical parameter.[000198] In at least some embodiments, this application may incorporate by reference U.S. Patent No. 11,490,966 in its entirety. The incorporated disclosure may provide additional technical background, exemplary implementations, and variations that may be applicable to the systems, methods, and algorithms described herein, including but not limited to medical image processing, machine learning model construction and deployment, clinical decision support workflows, and visualization techniques.[000199] Figure 43 is a flowchart of a method 300 for utilizing radiomic-based measurements (and other image-based measurements) within a clinical decision support tool in accordance with one or more embodiments of the present disclosure. The method 300 may be performed by the processor 45 of the medical computing device 15.[000200] In at least some embodiments, the method 300 may include receiving 310 image data of a plurality of medical images of a portion of a joint acquired from at least one medical imaging device prior to an implantation of at least one implant into the joint of a patient.[000201] In at least some embodiments, the method 300 may include generating 320 a plurality of pixel-voxel granularity (PVG) corrected medical images by applying at least one PVG preprocessing algorithm to the image data of each image from the plurality of medical images, where the applying of the at least one PVG pre-processing algorithm may include: normalizing pixel values in the image data in each medical image by adjusting pixel gray level intensity values within each medical image of the plurality of medical images to a common gray scale, resampling theimage data to increase or decrease a number of pixels in each medical image based on a standard voxel size between images; and converting the pixel values in each image to digital pixel values to generate PVG corrected image data for each PVG corrected medical image in the plurality of PVG corrected medical images.[000202] In at least some embodiments, the method 300 may include segmenting 330 the PVG corrected image data of each PVG corrected medical image of the portion of the joint using at least one segmentation algorithm to segment the plurality of PVG corrected medical images to identify at least one region of interest (ROI) in the portion of the joint that is represented by at least one ROI image map boundary and associated with at least one of: at least one bone member of the joint, at least one muscle associated with the joint, or both.[000203] In at least some embodiments, the at least one region of interest (ROI) in the portion of the joint that is represented by at least one ROI image map boundary may also be associated with at least one connective tissue associated with the joint.[000204] In at least some embodiments, the method 300 may include inputting 340 the at least one ROI image map boundary and the PVG corrected image data from the plurality of PVG corrected medical images into at least one medical image analysis machine learning model that is trained to output: at least one image based measurement in the at least one region of interest, and at least one implant complication risk assessment for the implantation of the at least one implant into the joint.[000205] In at least some embodiments, the method 300 may include displaying 350 to a user on a display, at least one three-dimensional (3D) representation of the joint and the at least one implant complication risk assessment based on the plurality of PVG corrected medical images.[000206] The technical problems as described above that highly granular image-based measurements lack intuitive clinical interpretation and consistency across heterogeneous scannersand protocols is solved by the system and methods disclosed herein. The technical solutions related to the lack of interpretability in highly granular image data by first standardizing acquired medical images into analysis-ready volumes. The technical flow may include receiving medical imaging data of a joint and may include applying pixel-voxel granularity preprocessing that may normalize gray-level intensities to a common scale, may resample to a standardized isotropic voxel size, and may convert intensities to discrete digital values for robust feature extraction across scanners and protocols. This preprocessing may produce consistent inputs that may enable downstream analytics to operate on harmonized, high-fidelity image information.[000207] In at least some embodiments, the system may then identify anatomically relevant regions by generating three-dimensional, voxel-aligned label maps that may preserve spacing, orientation, and origin metadata. These label maps may define regions of interest such as bone segments, connective tissues, and muscles, where feature calculations may be constrained to the labeled voxels. From these regions, the system may extract quantitative descriptors that may include shape measures, first-order intensity statistics, and second-order texture metrics, and may further use learned representations and class activation maps to highlight localized patterns that may influence predictions.[000208] In at least some embodiments, the extracted measurements and patient-specific inputs may be analyzed by trained models that may output implant complication risk assessments, prospective class or cluster assignments, and time-phased predictions of postoperative performance. The outputs may be visualized in a surgical planning interface that may include three-dimensional reconstructions with heat maps and adaptive tables, and may include alerts when outlier measurements are linked to decreased function or elevated risk. Figures 1, 42, and 43 mayhighlight this coordinated workflow across modules for preprocessing, segmentation, feature extraction, prediction, visualization, and user interaction.[000209] In at least some embodiments, the clinical decision support flow may be integrated into a method of treatment for arthroplasty. The pre-operative steps may include collecting patient data, acquiring standard-of-care images, and generating risk assessments and predicted outcomes that may guide implant type, size, and positioning. Intraoperatively, the planning outputs and visual overlays may direct attention to regions of concern and may confirm resections and implant placement. Postoperatively, the predicted recovery trajectory (e.g., at different post-operative timepoints) may inform rehabilitation plans and follow-up decisions. By embedding the end-to-end analysis into the treatment pathway, the system may help the surgeon select patient-specific strategies that may reduce complication risk and may improve functional outcomes.[000210] In at least some embodiments, radiomic features may be a defined, standardized subset of image-based features focused on shape, first-order intensity, and texture statistics calculated from segmented ROI voxels. Image-based measurements may include radiomics and may also include learned, geometric, biomechanical, registration-derived, and modality-specific metrics that capture information radiomics may not fully represent.[000211] In at least some embodiments, a method may include receiving, by at least one processor, image data of a plurality of medical images of a portion of a joint acquired from at least one medical imaging device prior to an implantation of at least one implant into the joint of a patient; may include generating, by the at least one processor, a plurality of pixel-voxel granularity (PVG) corrected medical images by applying at least one PVG pre-processing algorithm to the image data of each image from the plurality of medical images; may include that the applying of the at leastone PVG pre-processing algorithm may include normalizing pixel values in the image data in each medical image by adjusting pixel gray level intensity values within each medical image of the plurality of medical images to a common gray scale; may include resampling the image data to increase or decrease a number of pixels in each medical image based on a standard voxel size between images; and may include converting the pixel values in each image to digital pixel values to generate PVG corrected image data for each PVG corrected medical image in the plurality of PVG corrected medical images; may include segmenting, by the at least one processor, the PVG corrected image data of each PVG corrected medical image of the portion of the joint using at least one segmentation algorithm to segment the plurality of PVG corrected medical images to identify at least one region of interest (ROI) in the portion of the joint that is represented by at least one ROI image map boundary and associated with at least one of at least one bone member of the joint, at least one muscle associated with the joint, or both; may include inputting, by the at least one processor, the at least one ROI image map boundary and the PVG corrected image data from the plurality of PVG corrected medical images into at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the at least one region of interest, and at least one implant complication risk assessment for the implantation of the at least one implant into the joint; and may include displaying, by the at least one processor, to a user on a display, at least one three-dimensional (3D) representation of the joint and the at least one implant complication risk assessment based on the plurality of PVG corrected medical images.[000212] In at least some embodiments, the at least one region of interest may include at least one of a deltoid muscle, a rotator cuff muscle, a scapula including a glenoid vault and an acromion, and a proximal humerus including a metaphysis and a humeral head.[000213] In at least some embodiments, the at least one image based measurement may include at least one shape feature, at least one first order intensity feature, and at least one second order texture feature, the at least one shape feature may include at least one of volume, surface area, sphericity, flatness, elongation, least axis length, and maximum two dimensional diameter in a row, column, or slice plane.[000214] In at least some embodiments, the at least one PVG pre-processing algorithm may include normalizing the image data by z score normalization, resampling to an isotropic voxel size using an interpolation method, may include at least one of B spline or Welch Sine interpolation, and discretizing the pixel gray level intensity values using at least one of a fixed bin width or a fixed bin count.[000215] In at least some embodiments, the at least one implant complication risk assessment may include a predicted probability of occurrence of at least one complication selected from instability, aseptic loosening, bone fracture, infection, or revision within a defined postoperative time window.[000216] In at least some embodiments, the method may include comparing, by the at least one processor, the at least one image based measurement and / or radiomic feature to a reference cohort to identify an outlier measurement based on a pre-defined statistical threshold; and may include generating, by the at least one processor, an alert in response to the outlier measurement being associated with a decreased functional performance or an increased complication risk.[000217] In at least some embodiments, displaying the at least one 3D representation of the joint may include overlaying at least one of a heat map, a class activation map, or a color-coded indicator on the at least one region of interest to visualize at least one of the at least one radiomic feature, the outlier measurement, or the at least one implant complication risk assessment.[000218] In at least some embodiments, the method may include, by the at least one processor, assigning the patient to at least one pre-defined classification selected from a plurality of machine learned classes derived from image-based measurements, and the at least one implant complication risk assessment may be conditioned on the at least one pre-defined classification.[000219] In at least some embodiments, the at least one medical image analysis machine learning model may include a trained predictive model configured to generate the at least one implant complication risk assessment based at least in part on the at least one radiomic feature and one or more patient specific inputs may include at least one of age, sex, diagnosis, comorbidities, range of motion, or pain score.[000220] In at least some embodiments, the method may include receiving, by the at least one processor, pre-operative patient specific data and at least one arthroplasty surgical parameter, may include generating a reconstruction plan of the joint based at least in part on the plurality of PVG corrected medical images and the at least one implant complication risk assessment, and may include displaying the reconstruction plan on the display.[000221] In at least some embodiments, the method may include inputting, by the at least one processor, the pre-operative patient specific data, the at least one region of interest, and the reconstruction plan into at least one postoperative joint performance model trained to output a predicted postoperative range of motion and at least one predicted postoperative pain metric at a plurality of postoperative timepoints.[000222] In at least some embodiments, the at least one medical imaging device may include a computed tomography scanner, and the plurality of PVG corrected medical images may include Hounsfield unit calibrated volumes.[000223] In at least some embodiments, discretizing the pixel gray level intensity values may include selecting a fixed bin width in Hounsfield unit increments and may include mapping the plurality of PVG corrected medical images to selected bins prior to image based measurement extraction and / or radiomic feature extraction.[000224] In at least some embodiments, the resampling of the image data may include resampling the image data to an isotropic voxel size between 0.5 mm and 1.5 mm.[000225] In at least some embodiments, the method may include receiving, by the at least one processor, pre-operative patient specific data for an arthroplasty surgery to implant the at least one implant in the joint of the patient; may include that the pre-operative patient specific data may include a medical history of the patient, a measured range of movement for at least one type of joint movement of the joint, and at least one pain metric associated with the joint; may include receiving, by the at least one processor, from the user, at least one arthroplasty surgical parameter based on the at least one implant complication risk assessment; may include that the at least one arthroplasty surgical parameter may be selected from the at least one implant, at least one implant size, at least one arthroplasty surgical procedure, at least one position for implanting the at least one implant in the joint, or any combination thereof; may include generating, by the at least one processor, a reconstruction plan of the joint of the patient based at least in part on the plurality of PVG corrected medical images of the joint, the at least one implant complication risk assessment, and the at least one arthroplasty surgical parameter; may include inputting, by the at least one processor, the pre-operative patient specific data and reconstruction plan data into at least one postoperative joint performance machine learning model to determine a predicted post-operative joint performance data output at a plurality of post-operative timepoints after surgery; may include that the predicted post-operative joint performance data output may include at least a predictedrange of movement for the at least one type of joint movement of the joint, and at least one predicted pain metric associated with the joint; may include that the at least one postoperative joint performance machine learning model may be trained to output data may include a plurality of values for the predicted post-operative joint performance data output at the plurality of post-operative timepoints after surgery, each value may be at a particular timepoint of the plurality of post-operative timepoints after surgery; may include that input data to train the at least one postoperative joint performance machine learning model may include at least the pre-operative patient specific data, the at least one implant complication risk assessment, the at least one region of interest in the portion of the joint, and the reconstruction plan data; and may include displaying, by the at least one processor, on the display to the user, the reconstruction plan data and the predicted post-operative joint performance data output at the plurality of post-operative timepoints after the arthroplasty surgery, and may include performing the arthroplasty surgery based on the reconstruction plan data and the at least one arthroplasty surgical parameter.[000226J In at least some embodiments, a system may include at least one processor; and may include a non-transitory memory storing instructions that, when executed by the at least one processor, may cause the at least one processor to receive image data of a plurality of medical images of a portion of a joint acquired from at least one medical imaging device prior to an implantation of at least one implant into the joint of a patient; may include generating a plurality of pixel-voxel granularity (PVG) corrected medical images by applying at least one PVG pre-processing algorithm to the image data of each image from the plurality of medical images; may include that the at least one PVG pre-processing algorithm may be configured to normalize pixel values in the image data in each medical image by adjusting pixel gray level intensity values within each medical image of the plurality of medical images to a common gray scale; may includeresampling the image data to increase or decrease a number of pixels in each medical image based on a standard voxel size between images; and may include converting the pixel values in each image to digital pixel values to generate PVG corrected image data for each PVG corrected medical image in the plurality of PVG corrected medical images; may include segmenting the PVG corrected image data of each PVG corrected medical image of the portion of the joint using at least one segmentation algorithm to segment the plurality of PVG corrected medical images to identify at least one region of interest (ROI) in the portion of the joint that is represented by at least one ROI image map boundary and associated with at least one of at least one bone member of the joint, at least one muscle associated with the joint, or both; may include inputting the at least one ROI image map boundary and the PVG corrected image data from the plurality of PVG corrected medical images into at least one medical image analysis machine learning model that is trained to output at least one image based measurement in the at least one region of interest, and at least one implant complication risk assessment for the implantation of the at least one implant into the joint; and may include displaying to a user on a display at least one 3-dimensional (3D) representation of the joint and the at least one implant complication risk assessment based on the plurality of PVG corrected medical images.[000227] In at least some embodiments, the at least one region of interest of the system may include at least one of a deltoid muscle, a rotator cuff muscle, a scapula including a glenoid vault and an acromion, and a proximal humerus including a metaphysis and a humeral head.[000228] In at least some embodiments, the at least one image based measurement and / or at least one radiomic feature of the system may include at least one shape feature, at least one first order intensity feature, and at least one second order texture feature, the at least one shape feature mayinclude at least one of volume, surface area, sphericity, flatness, elongation, least axis length, and maximum two dimensional diameter in a row, column, or slice plane.[000229] In at least some embodiments, the at least one PVG pre-processing algorithm of the system may be configured to normalize the image data by z-score normalization, to resample to an isotropic voxel size using an interpolation method may include at least one of B-spline or Welch-Sinc interpolation, and to discretize the pixel gray level intensity values using at least one of a fixed bin width or a fixed bin count.[000230] In at least some embodiments, the at least one implant complication risk assessment of the system may include a predicted probability of occurrence of at least one complication selected from instability, aseptic loosening, bone fracture, infection, or revision within a defined postoperative time window.[000231] In at least some embodiments, the at least one processor of the system may include comparing at least one of the image based measurements to a reference cohort to identify an outlier measurement based on a pre-defined statistical threshold and may include generating an alert in response to the outlier measurement being associated with a decreased functional performance or an increased complication risk.[000232] In at least some embodiments, the at least one processor of the system may include displaying the at least one 3D representation of the joint by overlaying at least one of a heat map, a class activation map, or a color coded indicator on the at least one region of interest to visualize at least one of the at least one image based measurement, the outlier measurement, or the implant complication risk assessment.[000233] In at least some embodiments, the at least one processor of the system may include assigning the patient to at least one pre-defined classification selected from a plurality of machinelearned classes derived from image-based measurements, and the at least one implant complication risk assessment may be conditioned on the assigned classification.[000234] In at least some embodiments, the at least one medical image analysis machine learning model of the system may include a trained predictive model configured to generate the at least one implant complication risk assessment based at least in part on the at least one image based measurement and one or more patient specific inputs may include at least one of age, sex, diagnosis, comorbidities, range of motion, or pain score.[000235] In at least some embodiments, the at least one processor of the system may include receiving preoperative patient specific data and at least one arthroplasty surgical parameter, may include generating a reconstruction plan of the joint based at least in part on the PVG corrected medical images and the at least one implant complication risk assessment, and may include displaying the reconstruction plan on the display.[000236] In at least some embodiments, the at least one processor of the system may include inputting the preoperative patient specific data, the at least one region of interest, and the reconstruction plan into at least one postoperative joint performance model trained to output a predicted postoperative range of motion and at least one predicted postoperative pain metric at a plurality of postoperative timepoints.[000237] In at least some embodiments, the at least one medical imaging device of the system may include a computed tomography scanner, and the plurality of PVG corrected medical images may include Hounsfield unit calibrated volumes.[000238] In at least some embodiments, discretizing the pixel gray level intensity values of the system may include selecting a fixed bin width in Hounsfield unit increments and may includemapping the PVG corrected medical images to the selected bins prior to image based measurement and / or radiomi c feature extraction.[000239] In at least some embodiments, the at least one PVG pre-processing algorithm of the system may be configured to resample the image data by resampling the image data to an isotropic voxel size between 0.5 mm and 1.5 mm.[000240] In at least some embodiments, the at least one image based measurement may include at least one radiomic feature.[000241] In at least some embodiments, the at least one processor of the system may include receiving pre-operative patient specific data for an arthroplasty surgery to implant the at least one implant in the joint of the patient; may include that the pre-operative patient specific data may include a medical history of the patient, a measured range of movement for at least one type of joint movement of the joint, and at least one pain metric associated with the joint; may include receiving from the user, at least one arthroplasty surgical parameter based on the at least one implant complication risk assessment; may include that the at least one arthroplasty surgical parameter may be selected from the at least one implant, at least one implant size, at least one arthroplasty surgical procedure, at least one position for implanting the at least one implant in the joint, or any combination thereof; may include generating a reconstruction plan of the joint of the patient based at least in part on the plurality of PVG corrected medical images of the joint, the at least one implant complication risk assessment, and the at least one arthroplasty surgical parameter; may include inputting the pre-operative patient specific data and reconstruction plan data into at least one postoperative joint performance machine learning model to determine a predicted post-operative joint performance data output at a plurality of post-operative timepoints after surgery; may include that the predicted post-operative joint performance data output mayinclude at least a predicted range of movement for the at least one type of joint movement of the joint, and at least one predicted pain metric associated with the joint; may include that the at least one postoperative joint performance machine learning model may be trained to output data may include a plurality of values for the predicted post-operative joint performance data output at the plurality of post-operative timepoints after surgery, each value may be at a particular timepoint of the plurality of post-operative timepoints after surgery; may include that input data to train the at least one postoperative joint performance machine learning model may include at least the pre-operative patient specific data, the at least one implant complication risk assessment, the at least one region of interest in the portion of the joint, and the reconstruction plan data; and may include displaying on the display to the user, the reconstruction plan data and the predicted post-operative joint performance data output at the plurality of post-operative timepoints after the arthroplasty surgery and may include performing the arthroplasty surgery based on the reconstruction plan data and the at least one arthroplasty surgical parameter.[000242J In at least some embodiments, exemplary inventive, specially programmed computing systems / platforms with associated devices are configured to operate in the distributed network environment, communicating with one another over one or more suitable data communication networks (e.g., the Internet, satellite, etc.) and utilizing one or more suitable data communication protocol s / m odes such as, without limitation, IPX / SPX, X.25, AX.25, AppleTalk(TM), TCP / IP (e.g., HTTP), near-field wireless communication (NFC), RFID, Narrow Band Internet of Things (NBIOT), 3G, 4G, 5G, GSM, GPRS, WiFi, WiMax, CDMA, satellite, ZigBee, and other suitable communication modes. In at least some embodiments, the NFC can represent a short-range wireless communications technology in which NFC-enabled devices are “swiped,” “bumped,” “tap” or otherwise moved in close proximity to communicate. In at least some embodiments, theNFC could include a set of short-range wireless technologies, typically requiring a distance of 10 cm or less. In at least some embodiments, the NFC may operate at 13.56 MHz on TSO / IEC 18000-3 air interface and at rates ranging from 106 kbit / s to 424 kbit / s. In at least some embodiments, the NFC can involve an initiator and a target; the initiator actively generates an RF field that can power a passive target.In at least some embodiments, this can enable NFC targets to take very simple form factors such as tags, stickers, key fobs, or cards that do not require batteries. In at least some embodiments, the NFC’s peer-to-peer communication can be conducted when a plurality of NFC-enable devices (e.g., smartphones) within close proximity of each other.[000243] The material disclosed herein may be implemented in software or firmware or a combination of them or as instructions stored on a machine-readable medium, which may be read and executed by one or more processors. A machine-readable medium may include any medium and / or mechanism for storing or transmitting information in a form readable by a machine (e.g., a computing device). For example, a machine-readable medium may include read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; electrical, optical, acoustical or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.), and others.[000244] Examples of hardware elements may include processors, microprocessors, circuits, circuit elements (e.g., transistors, resistors, capacitors, inductors, and so forth), integrated circuits, application specific integrated circuits (ASIC), programmable logic devices (PLD), digital signal processors (DSP), field programmable gate array (FPGA), logic gates, registers, semiconductor device, chips, microchips, chip sets, and so forth. In at least some embodiments, the one or more processors may be implemented as a Complex Instruction Set Computer (CISC) or ReducedInstruction Set Computer (RISC) processors; x86 instruction set compatible processors, multicore, or any other microprocessor or central processing unit (CPU). In various implementations, the one or more processors may be dual-core processor(s), dual-core mobile processor(s), and so forth.[000245] Computer-related systems, computer systems, and systems, as used herein, include any combination of hardware and software. Examples of software may include software components, operating system software, middleware, firmware, software modules, routines, subroutines, functions, methods, procedures, software interfaces, application program interfaces (API), instruction sets, computer code, computer code segments, words, values, symbols, or any combination thereof. Determining whether an embodiment is implemented using hardware elements and / or software elements may vary in accordance with any number of factors, such as desired computational rate, power levels, heat tolerances, processing cycle budget, input data rates, output data rates, memory resources, data bus speeds and other design or performance constraints.[000246] One or more aspects of at least one embodiment may be implemented by representative instructions stored on a machine-readable medium which represents various logic within the processor, which when read by a machine causes the machine to fabricate logic to perform the techniques described herein. Such representations, known as “IP cores” may be stored on a tangible, machine readable medium and supplied to various customers or manufacturing facilities to load into the fabrication machines that make the logic or processor. Of note, various embodiments described herein may, of course, be implemented using any appropriate hardware and / or computing software languages (e.g., C++, Objective-C, Swift, Java, JavaScript, Python, Perl, QT, etc.).[000247] In at least some embodiments, one or more of exemplary inventive computer-based systems / platforms, exemplary inventive computer-based devices, and / or exemplary inventive computer-based components of the present disclosure such as the computing device 77 may include or be incorporated, partially or entirely into at least one personal computer (PC), laptop computer, ultra-laptop computer, tablet, touch pad, portable computer, handheld computer, palmtop computer, personal digital assistant (PDA), cellular telephone, combination cellular telephone / PDA, television, smart device (e.g., smart phone, smart tablet or smart television), mobile internet device (MID), messaging device, data communication device, and so forth.[000248] As used herein, the term “server” should be understood to refer to a service point which provides processing, database, and communication facilities. By way of example, and not limitation, the term “server” can refer to a single, physical processor with associated communications and data storage and database facilities, or it can refer to a networked or clustered complex of processors and associated network and storage devices, as well as operating software and one or more database systems and application software that support the services provided by the server. Cloud servers are examples.[000249] In at least some embodiments, as detailed herein, one or more of exemplary inventive computer- based systems / platforms, exemplary inventive computer-based devices, and / or exemplary inventive computer-based components of the present disclosure may obtain, manipulate, transfer, store, transform, generate, and / or output any digital object and / or data unit (e.g., from inside and / or outside of a particular application) that can be in any suitable form such as, without limitation, a file, a contact, a task, an email, a social media post, a map, an entire application (e.g., a calculator), etc. In at least some embodiments, as detailed herein, one or moreof exemplary inventive computer-based systems / platforms, exemplary inventive computer-based devices, and / or exemplary inventive computer-based components of the present disclosure may be implemented across one or more of various computer platforms such as, but not limited to: (1) FreeBSD, NetBSD, OpenBSD; (2) Linux; (3) Microsoft Windows; (4) OS X (MacOS); (5) MacOS 11; (6) Solaris; (7) Android; (8) iOS; (9) Embedded Linux; (10) Tizen; (11) WebOS; (12) IBM i; (13) IBM AIX; (14) Binary Runtime Environment for Wireless (BREW); (15) Cocoa (API); (16) Cocoa Touch; (17) Java Platforms; (18) JavaFX; (19) JavaFX Mobile; (20) Microsoft DirectX; (21) .NET Framework; (22) Silverlight; (23) Open Web Platform; (24) Oracle Database; (25) Qt; (26) Eclipse Rich Client Platform; (27) SAP NetWeaver; (28) Smartface; and / or (29) Windows Runtime.[000250] In at least some embodiments, exemplary inventive computer-based systems / platforms, exemplary inventive computer-based devices, and / or exemplary inventive computer-based components of the present disclosure may be configured to utilize hardwired circuitry that may be used in place of or in combination with software instructions to implement features consistent with principles of the disclosure. Thus, implementations consistent with principles of the disclosure are not limited to any specific combination of hardware circuitry and software. For example, various embodiments may be embodied in many different ways as a software component such as, without limitation, a stand-alone software package, a combination of software packages, or it may be a software package incorporated as a “tool” in a larger software product.[000251] For example, exemplary software specifically programmed in accordance with one or more principles of the present disclosure may be downloadable from a network, for example, a website, as a stand-alone product or as an add-in package for installation in an existing softwareapplication. For example, exemplary software specifically programmed in accordance with one or more principles of the present disclosure may also be available as a client-server software application, or as a web-enabled software application. For example, exemplary software specifically programmed in accordance with one or more principles of the present disclosure may also be embodied as a software package installed on a hardware device.[000252] In at least some embodiments, exemplary inventive computer-based systems / platforms, exemplary inventive computer-based devices, and / or exemplary inventive computer-based components of the present disclosure may be configured to handle numerous concurrent users that may be, but is not limited to, at least 100 (e.g., but not limited to, 100-999), at least 1,000 (e.g., but not limited to, 1,000-9,999 ), at least 10,000 (e.g., but not limited to, 10,000-99,999 ), at least 100,000 (e.g., but not limited to, 100,000-999,999), at least 1,000,000 (e.g., but not limited to, 1,000,000-9,999,999), at least 10,000,000 (e.g., but not limited to, 10,000,000-99,999,999), at least 100,000,000 (e.g., but not limited to, 100,000,000-999,999,999), at least 1,000,000,000 (e.g., but not limited to, 1,000,000,000-999,999,999,999), and so on.[000253] In at least some embodiments, exemplary inventive computer-based systems / platforms, exemplary inventive computer-based devices, and / or exemplary inventive computer-based components of the present disclosure may be configured to output to distinct, specifically programmed graphical user interface implementations of the present disclosure (e.g., a desktop, a web app., etc ). In various implementations of the present disclosure, a final output may be displayed on a displaying screen which may be, without limitation, a screen of a computer, a screen of a mobile device, or the like. In various implementations, the display may be a holographic display. In various implementations, the display may be a transparent surface that may receive avisual projection. Such projections may convey various forms of information, images, and / or objects. For example, such projections may be a visual overlay for a mobile augmented reality (MAR) application.[000254] As used herein, the term “mobile electronic device,” or the like, may refer to any portable electronic device that may or may not be enabled with location tracking functionality (e.g., MAC address, Internet Protocol (IP) address, or the like). For example, a mobile electronic device can include, but is not limited to, a mobile phone, Personal Digital Assistant (PDA), Blackberry ™, Pager, Smartphone, or any other reasonable mobile electronic device.[000255] As used herein, the terms “cloud,” “Internet cloud,” “cloud computing,” “cloud architecture,” and similar terms correspond to at least one of the following: (1) a large number of computers connected through a real-time communication network (e.g., Internet); (2) providing the ability to run a program or application on many connected computers (e.g., physical machines, virtual machines (VMs)) at the same time; (3) network-based services, which appear to be provided by real server hardware, and are in fact served up by virtual hardware (e.g., virtual servers), simulated by software running on one or more real machines (e g., allowing to be moved around and scaled up (or down) on the fly without affecting the end user).[000256] In at least some embodiments, the exemplary inventive computer-based systems / platforms, the exemplary inventive computer-based devices, and / or the exemplary inventive computer-based components of the present disclosure may be configured to securely store and / or transmit data by utilizing one or more of encryption techniques (e.g., private / public key pair, Triple Data Encryption Standard (3DES), block cipher algorithms (e.g., IDEA, RC2,RC5, CAST and Skipjack), cryptographic hash algorithms (e.g., MD5, RIPEMD-160, RTRO, SHA-1, SHA-2, Tiger (TTH), WHIRLPOOL, RNGs).[000257] The aforementioned examples are, of course, illustrative and not restrictive.[000258] As used herein, the term “user” shall have a meaning of at least one user. In the context as used herein, the user may be a doctor, or a surgeon or someone acting on behalf of the doctor, or surgeon, a laboratory technician, surgical staff, and the like.[000259] In at least some embodiments, the exemplary inventive computer-based systems / platforms, the exemplary inventive computer-based devices, and / or the exemplary inventive computer-based components of the present disclosure may be configured to utilize one or more exemplary Al / machine learning techniques chosen from, but not limited to, decision trees, boosting, support-vector machines, neural networks, nearest neighbor algorithms, Naive Bayes, bagging, random forests, and the like. In at least some embodiments and, optionally, in combination of any embodiment described above or below, an exemplary neutral network technique may be one of, without limitation, feedforward neural network, radial basis function network, recurrent neural network, convolutional network (e.g., U-net) or other suitable network. In at least some embodiments and, optionally, in combination of any embodiment described above or below, an exemplary implementation of Neural Network may be executed as follows:i) Define Neural Network architecture / model,ii) Transfer the input data to the exemplary neural network model,iii) Train the exemplary model incrementally,iv) determine the accuracy for a specific number of timesteps,v) apply the exemplary trained model to process the newly-received input data,vi) optionally and in parallel, continue to train the exemplary trained model with a predetermined periodicity.[000260] In some embodiments and, optionally, in combination of any embodiment described above or below, the exemplary trained neural network model may specify a neural network by at least a neural network topology, a series of activation functions, and connection weights. For example, the topology of a neural network may include a configuration of nodes of the neural network and connections between such nodes. In at least some embodiments and, optionally, in combination of any embodiment described above or below, the exemplary trained neural network model may also be specified to include other parameters, including but not limited to, bias values / functions and / or aggregation functions. For example, an activation function of a node may be a step function, sine function, continuous or piecewise linear function, sigmoid function, hyperbolic tangent function, or other type of mathematical function that represents a threshold at which the node is activated. In at least some embodiments and, optionally, in combination of any embodiment described above or below, the exemplary aggregation function may be a mathematical function that combines (e.g., sum, product, etc.) input signals to the node. In at least some embodiments and, optionally, in combination of any embodiment described above or below, an output of the exemplary aggregation function may be used as input to the exemplary activation function. In at least some embodiments and, optionally, in combination of any embodiment described above or below, the bias may be a constant value or function that may be used by the aggregation function and / or the activation function to make the node more or less likely to be activated.[000261] The disclosure described herein may be practiced in the absence of any element or elements, limitation or limitations, which is not specifically disclosed herein. Thus, for example, in each instance herein, any of the terms "comprising," "consisting essentially of and "consisting of’ may be replaced with either of the other two terms, without altering their respective meanings as defined herein. The terms and expressions which have been employed are used as terms of description and not of limitation, and there is no intention in the use of such terms and expressions of excluding any equivalents of the features shown and described or portions thereof, but it is recognized that various modifications are possible within the scope of the disclosure.
Claims
CLAIMS1. A method, comprising:receiving, by at least one processor, image data of a plurality of medical images of a portion of a joint acquired from at least one medical imaging device prior to an implantation of at least one implant into the joint of a patient;generating, by the at least one processor, a plurality of pixel-voxel granularity (PVG) corrected medical images by applying at least one PVG pre-processing algorithm to the image data of each image from the plurality of medical images;wherein the applying of the at least one PVG pre-processing algorithm comprises:normalizing pixel values in the image data in each medical image by adjusting pixel gray level intensity values within each medical image of the plurality of medical images to a common gray scale;resampling the image data to increase or decrease a number of pixels in each medical image based on a standard voxel size between images; and converting the pixel values in each image to digital pixel values to generate PVG corrected image data for each PVG corrected medical image in the plurality of PVG corrected medical images;segmenting, by the at least one processor, the PVG corrected image data of each PVG corrected medical image of the portion of the joint using at least one segmentation algorithm to segment the plurality of PVG corrected medical images to identify at least one region of interest (ROT) in the portion of the joint that is represented by at least one ROT image map boundary and associated with at least one of:at least one bone member of the joint,at least one muscle associated with the joint, orboth;inputting, by the at least one processor, the at least one ROI image map boundary and the PVG corrected image data from the plurality of PVG corrected medical images into at least one medical image analysis machine learning model that is trained to output:at least one image based measurement in the at least one region of interest, and at least one implant complication risk assessment for the implantation of the at least one implant into the joint; anddisplaying, by the at least one processor, to a user on a display, at least one three- dimensional (3D) representation of the joint and the at least one implant complication risk assessment based on the plurality of PVG corrected medical images.
2. The method of claim 1, wherein the at least one region of interest comprises at least one of: a deltoid muscle, a rotator cuff muscle, a scapula including a glenoid vault and an acromion, and a proximal humerus including a metaphysis and a humeral head.
3. The method of claim 1, wherein the at least one image based measurement comprises at least one shape feature, at least one first-order intensity feature, and at least one second-order texture feature, the at least one shape feature comprising at least one of volume, surface area, sphericity, flatness, elongation, least axis length, and maximum two-dimensional diameter in a row, column, or slice plane.
4. The method of claim 1, wherein the at least one PVG pre-processing algorithm comprises normalizing the image data by z-score normalization, resampling to an isotropic voxel size using an interpolation method, comprising at least one of: B-spline or Welch-Sinc interpolation, and discretizing the pixel gray level intensity values using at least one of: a fixed bin width or a fixed bin count.
5. The method of claim 1, wherein the at least one implant complication risk assessment comprises a predicted probability of occurrence of at least one complication selected from instability, aseptic loosening, bone fracture, infection, or revision within a defined postoperative time window.
6. The method of claim 1, further comprising comparing, by the at least one processor, the at least one image based measurement to a reference cohort to identify an outlier measurement based on a pre-defined statistical threshold; and generating, by the at least one processor, an alert in response to the outlier measurement being associated with a decreased functional performance or an increased complication risk.
7. The method of claim 6, wherein displaying the at least one 3D representation of the joint comprises overlaying at least one of a heat map, a class activation map, or a color-coded indicator on the at least one region of interest to visualize at least one of the at least one image based measurement, the outlier measurement, or the at least one implant complication risk assessment.
8. The method of claim 1, further comprising, by the at least one processor, assigning the patient to at least one pre-defined classification selected from a plurality of machine-learned classes derived from image-based measurements, and wherein the at least one implant complication risk assessment is conditioned on the at least one pre-defined classification.
9. The method of claim 1, wherein the at least one medical image analysis machine learning model comprises a trained predictive model configured to generate the at least one implant complication risk assessment based at least in part on the at least one image based measurement and one or more patient-specific inputs comprising at least one of age, sex, diagnosis, comorbidities, range of motion, or pain score.
10. The method of claim 1, further comprising receiving, by the at least one processor, preoperative patient-specific data and at least one arthroplasty surgical parameter, generating a reconstruction plan of the joint based at least in part on the plurality of PVG corrected medical images and the at least one implant complication risk assessment, and displaying the reconstruction plan on the display.
11. The method of claim 10, further comprising inputting, by the at least one processor, the pre-operative patient-specific data, the at least one region of interest, and the reconstruction plan into at least one postoperative joint performance model trained to output a predicted postoperative range of motion and at least one predicted postoperative pain metric at a plurality of postoperative timepoints.
12. The method of claim 1, wherein the at least one medical imaging device comprises a computed tomography scanner, and the plurality of PVG corrected medical images comprise Hounsfield-unit calibrated volumes.
13. The method of claim 1, wherein discretizing the pixel gray level intensity values comprises selecting a fixed bin width in Hounsfield-unit increments and mapping the plurality of PVG corrected medical images to selected bins prior to image based feature extraction.
14. The method of claim 1, wherein the resampling of the image data comprises resampling the image data to an isotropic voxel size between 0.5 mm and 1.5 mm.
15. The method of claim 1, wherein the at least one image based measurement comprises at least one radiomic feature.
16. The method of claim 1, further comprising receiving, by the at least one processor, preoperative patient specific data for an arthroplasty surgery to implant the at least one implant in the joint of the patient;wherein the pre-operative patient specific data comprises:a medical history of the patient,a measured range of movement for at least one type of joint movement of the joint, andat least one pain metric associated with the joint;receiving, by the at least one processor, from the user, at least one arthroplasty surgical parameter based on the at least one implant complication risk assessment;wherein the at least one arthroplasty surgical parameter is selected from:the at least one implant,at least one implant size,at least one arthroplasty surgical procedure,at least one position for implanting the at least one implant in the joint, or any combination thereof;generating, by the at least one processor, a reconstruction plan of the joint of the patient based at least in part on the plurality of PVG corrected medical images of the joint, the at least one implant complication risk assessment, and the at least one arthroplasty surgical parameter;inputting, by the at least one processor, the pre-operative patient specific data and reconstruction plan data into at least one postoperative joint performance machine learning model to determine a predicted post-operative joint performance data output at a plurality of postoperative timepoints after surgery;wherein the predicted post-operative joint performance data output comprises at least:a predicted range of movement for the at least one type of joint movement of the joint, andat least one predicted pain metric associated with the joint; wherein the at least one postoperative joint performance machine learning model is trained to output data comprising a plurality of values for the predicted post-operative jointperformance data output at the plurality of post-operative timepoints after surgery, each value is at a particular timepoint of the plurality of post-operative timepoints after surgery;wherein input data to train the at least one postoperative joint performance machine learning model comprises at least:the pre-operative patient specific data,the at least one implant complication risk assessment,the at least one region of interest in the portion of the joint, and the reconstruction plan data; anddisplaying, by the at least one processor, on the display to the user, the reconstruction plan data and the predicted post-operative joint performance data output at the plurality of postoperative timepoints after the arthroplasty surgery, and performing the arthroplasty surgery based on the reconstruction plan data and the at least one arthroplasty surgical parameter.
17. A system, comprising:at least one processor; anda non-transitory memory storing instructions that, when executed by the at least one processor, cause the at least one processor to:receive image data of a plurality of medical images of a portion of a joint acquired from at least one medical imaging device prior to an implantation of at least one implant into the joint of a patient;generate a plurality of pixel-voxel granularity (PVG) corrected medical images by applying at least one PVG pre-processing algorithm to the image data of each image from the plurality of medical images;wherein the at least one PVG pre-processing algorithm is configured to:normalize pixel values in the image data in each medical image by adjusting pixel gray level intensity values within each medical image of the plurality of medical images to a common gray scale;resample the image data to increase or decrease a number of pixels in each medical image based on a standard voxel size between images; and convert the pixel values in each image to digital pixel values to generate PVG corrected image data for each PVG corrected medical image in the plurality of PVG corrected medical images;segment the PVG corrected image data of each PVG corrected medical image of the portion of the joint using at least one segmentation algorithm to segment the plurality of PVG corrected medical images to identify at least one region of interest (ROI) in the portion of the joint that is represented by at least one ROI image map boundary and associated with at least one of:at least one bone member of the joint,at least one muscle associated with the joint, orboth;input the at least one ROI image map boundary and the PVG corrected image data from the plurality of PVG corrected medical images into at least one medical image analysis machine learning model that is trained to output:at least one image based measurement in the at least one region of interest, andat least one implant complication risk assessment for the implantation of the at least one implant into the joint; anddisplay to a user on a display at least one 3-dimensional (3D) representation of the joint and the at least one implant complication risk assessment based on the plurality of PVG corrected medical images.
18. The system of claim 17, wherein the at least one region of interest comprises at least one of: a deltoid muscle, a rotator cuff muscle, a scapula including a glenoid vault and an acromion, and a proximal humerus including a metaphysis and a humeral head.
19. The system of claim 17, wherein the at least one image based measurement comprises at least one shape feature, at least one first order intensity feature, and at least one second order texture feature, the at least one shape feature comprising at least one of volume, surface area, sphericity, flatness, elongation, least axis length, and maximum two dimensional diameter in a row, column, or slice plane.
20. The system of claim 17, wherein the at least one PVG pre-processing algorithm is configured to normalize the image data by z-score normalization, to resample to an isotropic voxel size using an interpolation method comprising at least one of B-spline or Welch-Sinc interpolation, and to discretize the pixel gray level intensity values using at least one of: a fixed bin width or a fixed bin count.
21. The system of claim 17, wherein the at least one implant complication risk assessment comprises a predicted probability of occurrence of at least one complication selected from instability, aseptic loosening, bone fracture, infection, or revision within a defined postoperative time window.
22. The system of claim 17, wherein the at least one processor is further configured to compare the at least one image based measurement to a reference cohort to identify an outlier measurement based on a pre-defined statistical threshold, and to generate an alert in response to the outlier measurement being associated with a decreased functional performance or an increased complication risk.
23. The system of claim 22, wherein the at least one processor is configured to display the at least one 3D representation of the joint by overlaying at least one of a heat map, a class activation map, or a color coded indicator on the at least one region of interest to visualize at least one of the at least one image based measurement, the outlier measurement, or the implant complication risk assessment.
24. The system of claim 17, wherein the at least one processor is further configured to assign the patient to at least one pre-defined classification selected from a plurality of machine learned classes derived from image-based measurements, and wherein the at least one implant complication risk assessment is conditioned on the assigned classification.
25. The system of claim 17, wherein the at least one medical image analysis machine learning model comprises a trained predictive model configured to generate the at least one implant complication risk assessment based at least in part on the at least one image based measurement and one or more patient specific inputs comprising at least one of: age, sex, diagnosis, comorbidities, range of motion, or pain score.
26. The system of claim 17, wherein the at least one processor is further configured to receive preoperative patient specific data and at least one arthroplasty surgical parameter, to generate a reconstruction plan of the joint based at least in part on the PVG corrected medical images and the at least one implant complication risk assessment, and to display the reconstruction plan on the display.
27. The system of claim 26, wherein the at least one processor is further configured to input the preoperative patient specific data, the at least one region of interest, and the reconstruction plan into at least one postoperative joint performance model trained to output a predicted postoperative range of motion and at least one predicted postoperative pain metric at a plurality of postoperative timepoints.
28. The system of claim 17, wherein the at least one medical imaging device comprises a computed tomography scanner, and the plurality of PVG corrected medical images comprise Hounsfield unit calibrated volumes.
29. The system of claim 17, wherein the at least one PVG pre-processing algorithm is configured to resample the image data by resampling the image data to an isotropic voxel size between 0.5 mm and 1.5 mm.
30. The system of claim 17, wherein the at least one processor is further configured to:receive pre-operative patient specific data for an arthroplasty surgery to implant the at least one implant in the joint of the patient;wherein the pre-operative patient specific data comprises:a medical history of the patient,a measured range of movement for at least one type of joint movement of the joint, andat least one pain metric associated with the joint;receive from the user, at least one arthroplasty surgical parameter based on the at least one implant complication risk assessment;wherein the at least one arthroplasty surgical parameter is selected from:the at least one implant,at least one implant size,at least one arthroplasty surgical procedure,at least one position for implanting the at least one implant in the joint, or any combination thereof;generate a reconstruction plan of the joint of the patient based at least in part on the plurality of PVG corrected medical images of the joint, the at least one implant complication risk assessment, and the at least one arthroplasty surgical parameter;input the pre-operative patient specific data and reconstruction plan data into at least one postoperative joint performance machine learning model to determine a predicted post-operative joint performance data output at a plurality of post-operative timepoints after surgery;wherein the predicted post-operative joint performance data output comprises at least:a predicted range of movement for the at least one type of joint movement of the joint, andat least one predicted pain metric associated with the joint; wherein the at least one postoperative joint performance machine learning model is trained to output data comprising a plurality of values for the predicted post-operative joint performance data output at the plurality of post-operative timepoints after surgery, each value is at a particular timepoint of the plurality of post-operative timepoints after surgery;wherein input data to train the at least one postoperative joint performance machine learning model comprises at least:the pre-operative patient specific data,the at least one implant complication risk assessment,the at least one region of interest in the portion of the joint, and the reconstruction plan data; anddisplay on the display to the user, the reconstruction plan data and the predicted post-operative joint performance data output at the plurality of post-operative timepoints after the arthroplasty surgery and perform the arthroplasty surgery based on the reconstruction plan data and the at least one arthroplasty surgical parameter.