Techniques for monitoring and predicting orthopedic device impaction during orthopedic surgical procedures

Abstract

A technique for monitoring impaction and predicting impaction status during an orthopaedic surgical procedure includes one or more impaction sensors generating sensor data. The surgical procedure includes impaction of an orthopaedic tool, such as a surgical instrument or prosthetic component. An impaction analyzer generates a prediction of the impaction status with a machine learning model based on the sensor data. The predicted impaction status can include an unseated state, a seated state, and a fracture state. An impaction status user interface outputs the predicted impaction status. A model trainer can train the machine learning model with the labeled sensor data.

Description

[Technical Field]

[0001] The present disclosure relates generally to orthopaedic surgical tools and systems, and more particularly to techniques for monitoring and predicting the impaction status of orthopaedic surgical instruments during an associated orthopaedic surgical procedure. [Background technology]

[0002] Joint arthroplasty is a well-known surgical procedure that replaces a diseased and / or damaged natural joint with an artificial joint, which may include one or more orthopedic implants. For example, in a hip arthroplasty procedure, the socket joint of a patient's natural hip joint is partially or completely replaced with an artificial hip joint. A typical artificial hip joint includes an acetabular cup component and a femoral head component. The acetabular cup component generally includes an outer shell configured to engage the patient's acetabulum and an inner bearing or liner coupled to the shell and configured to engage the femoral head. The femoral head component and the inner liner of the acetabular component form a socket joint that approximates a natural hip joint. Similarly, in a knee arthroplasty procedure, the patient's natural knee joint is partially or completely replaced with an artificial knee joint.

[0003] To facilitate replacing a natural joint with a prosthetic joint, an orthopaedic surgeon may use a variety of orthopaedic surgical instruments, such as, for example, reamers, broaches, drill guides, drills, positioners, insertion tools, and / or other surgical instruments. For example, a surgeon may prepare a patient's femur to receive a femoral component by impacting a femoral broach into the patient's surgically-prepared femur until the broach is sufficiently impacted or seated within the patient's surrounding bony anatomy.

[0004] One type of orthopedic implant that can be used to replace a patient's joint is known as a cementless orthopedic implant. Cementless implants are implanted into a patient's bony anatomy by impacting the implant into the patient's corresponding bone. For example, a cementless acetabular prosthesis typically includes an acetabular cup shell configured to be implanted into the patient's acetabulum. To do so, the orthopedic surgeon impacts the shell into the patient's acetabulum until the shell is sufficiently seated within the patient's surrounding bony anatomy. Similarly, in other arthroplasty surgical procedures, such as knee arthroplasty surgical procedures, the orthopedic surgeon strives to properly seat a corresponding orthopedic implant.

[0005] Typically, orthopaedic surgeons rely on experience and tactile and auditory feedback during a surgical procedure to determine whether a surgical instrument and / or orthopaedic implant is sufficiently impacted or seated within a patient's bony anatomy. For example, the surgeon may rely on the tactile sensation felt through an impactor or inserter tool while the surgeon strikes the surgical tool with an orthopaedic mallet to impact the implant or instrument into the patient's bony anatomy. However, relying solely on such environmental feedback may result in insufficient or over-impact of the orthopaedic surgical instrument or implant within the patient's bone. Over-impact may result in a fracture of the patient's corresponding bone, while under-impact may result in premature loosening of the orthopaedic implant. Summary of the Invention [Means for solving the problem]

[0006] In one aspect, a system for predicting an impaction state during an orthopaedic surgical procedure includes one or more impaction sensors for generating sensor data indicative of an impaction state of an orthopaedic surgical instrument relative to a patient's bone, an impaction data collector for collecting the sensor data from the impaction sensors during the orthopaedic surgical procedure, an impaction analyzer for generating a prediction of the impaction state with a machine learning model based on the sensor data, the prediction of the impaction state comprising an unseated state, a seated state, or a fractured state, and an impaction state user interface for outputting the prediction of the impaction state. In one embodiment, the orthopaedic surgical instrument comprises a femoral broach or a prosthetic component.

[0007] In one embodiment, the system further includes a surgical instrument impaction handle, wherein the one or more impaction sensors include a vibration sensor coupled to the impaction handle, an inertial measurement unit coupled to the impaction handle, and an external microphone.

[0008] In one embodiment, generating a prediction of the impaction condition with the machine learning model based on the sensor data includes preprocessing the sensor data to generate processed sensor data and inputting the processed sensor data to the machine learning model. In one embodiment, preprocessing the sensor data includes transforming the sensor data to a frequency domain to generate frequency-domain sensor data and reducing the dimensionality of the frequency-domain sensor data to generate the processed sensor data.

[0009] In one embodiment, generating a prediction of the impaction condition with the machine learning model based on the sensor data includes inputting the sensor data to a recurrent neural network to generate anomaly prediction data, and inputting the anomaly prediction data to a classifier to generate the prediction of the impaction condition. In one embodiment, the recurrent neural network includes a long short-term memory network and the classifier includes a random forest predictive model.

[0010] In one embodiment, the system further includes a computing device including one or more impaction sensors, an impaction data collector, an impaction analyzer, and an impaction status user interface, wherein the one or more impaction sensors include a microphone of the computing device, and the impaction status user interface includes a display screen of the computing device.

[0011] According to another aspect, one or more non-transitory machine-readable media include a plurality of instructions that, upon execution, cause one or more processors to: collect sensor data from an impaction sensor during an orthopaedic surgical procedure, the sensor data indicating an impaction state of the orthopaedic surgical tool relative to the patient's bone; generate a prediction of the impaction state with a machine learning model based on the sensor data, the prediction of the impaction state comprising an unseated state, a seated state, or a fractured state; and output the prediction of the impaction state.

[0012] In one embodiment, collecting sensor data from the impaction sensor includes collecting vibration data from a vibration sensor coupled to the surgical instrument, collecting motion data from an inertial measurement unit coupled to the surgical instrument, and collecting audio data from an external microphone.

[0013] In one embodiment, generating a prediction of the impaction condition with the machine learning model based on the sensor data includes pre-processing the sensor data to generate processed sensor data and inputting the processed sensor data into the machine learning model.

[0014] In one embodiment, generating a prediction of the impaction condition with the machine learning model based on the sensor data includes inputting the sensor data to a recurrent neural network to generate anomaly prediction data, and inputting the anomaly prediction data to a classifier to generate the prediction of the impaction condition. In one embodiment, the recurrent neural network includes a long short-term memory network and the classifier includes a random forest predictive model.

[0015] According to another aspect, one or more non-transitory machine-readable media include a plurality of instructions that, upon execution, cause one or more processors to: collect sensor data from an impaction sensor, wherein the sensor data indicates an impaction state of the orthopedic surgical device relative to the bone or bone analog; label the sensor data with an impaction state label to generate labeled sensor data, wherein the impaction state label includes an unseated state, a seated state, or a fracture state; and train a machine learning model based on the labeled sensor data to predict an impaction state for the input sensor data.

[0016] In one embodiment, training the machine learning model based on the labeled sensor data includes preprocessing the labeled sensor data to generate processed sensor data and training the machine learning model based on the processed sensor data. In one embodiment, preprocessing the labeled sensor data includes transforming the labeled sensor data to a frequency domain to generate frequency-domain sensor data and reducing the dimensionality of the frequency-domain sensor data to generate the processed sensor data. In one embodiment, reducing the dimensionality of the frequency-domain sensor data includes performing principal component analysis of the frequency-domain sensor data.

[0017] In one embodiment, training a machine learning model based on the labeled sensor data to predict an in-place condition for the input sensor data includes training a recurrent neural network with the labeled sensor data to identify anomalies in the labeled sensor data and training a classifier with the anomalies in the labeled sensor data to predict the in-place condition. In one embodiment, the recurrent neural network includes a long short-term memory network. In one embodiment, the classifier includes a random forest predictive model. [Brief explanation of the drawings]

[0018] The concepts described herein are illustrated by way of example, and not by way of limitation, in the accompanying drawings. For simplicity and clarity of illustration, elements illustrated in the figures have not necessarily been drawn to scale. Where considered appropriate, reference numerals have been repeated among the figures to indicate corresponding or analogous elements. The detailed description makes specific reference to the following drawings: [Figure 1] 1 is a schematic diagram of a system for monitoring and predicting the impaction status of an orthopaedic surgical instrument in use during an orthopaedic surgical procedure. [Figure 2] FIG. 2 is a simplified block diagram of an environment that may be established by the system of FIG. 1. [Figure 3] FIG. 3 is a simplified block diagram of a machine learning model of the intrusion analyzer of the system of FIGS. 1-2. [Figure 4] FIG. 4 is a simplified flow diagram of a method for training a machine learning model that may be performed by the system of FIGS. 1-3. [Figure 5] FIG. 4 is a simplified flow diagram of a method for monitoring and predicting the impaction status of an orthopedic surgical device that may be performed by the system of FIGS. 1-3. [Figure 6] FIG. 4 is a schematic diagram of at least one embodiment of a user interface for the system of FIGS. 1-3. DETAILED DESCRIPTION OF THE INVENTION

[0019] While the concepts of the present disclosure are susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawings and are herein described in detail. It should be understood, however, that it is not the intention of this disclosure to limit the concepts of the present disclosure to the particular forms disclosed, but rather the intention is to cover all modifications, equivalents, and alternatives falling within the scope of the present disclosure and the appended claims.

[0020] Terms denoting anatomical references, such as anterior, posterior, medial, lateral, superior, inferior, etc., may be used throughout this specification with respect to the orthopedic implants or prostheses and surgical instruments described herein, as well as with reference to the patient's natural anatomy. Such terms have well-understood meanings both in the study of anatomy and in the field of orthopedic surgery. Use of such anatomical reference terms in the written description and claims is intended to be consistent with their well-understood meanings, unless otherwise specified.

[0021] References herein to "one embodiment," "embodiment," "exemplary example," and the like indicate that the embodiment being described may include a particular element, structure, or feature, but not all embodiments necessarily include that particular element, structure, or feature. Moreover, such phrases do not necessarily refer to the same embodiment. Furthermore, when a particular element, structure, or feature is described in connection with one embodiment, it is believed to be within the knowledge of one of ordinary skill in the art to implement such element, structure, or feature in connection with other embodiments, whether or not expressly stated. Furthermore, it will be understood that items listed in the format "at least one of A, B, and C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). Similarly, items listed in the format "at least one of A, B, or C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C).

[0022] The disclosed embodiments may be implemented as hardware, firmware, software, or any combination thereof, as the case may be. The disclosed embodiments may also be implemented as instructions retained or stored on a transient or non-transitory machine-readable (e.g., computer-readable) storage medium that can be read and executed by one or more processors. A machine-readable storage medium may be embodied as any storage device, mechanism, or other physical structure for storing or transmitting information in a form readable by a machine (e.g., volatile or non-volatile memory, media disk, or other media device).

[0023] In the figures, some structural or method elements may be shown in a particular arrangement and / or order. However, it should be recognized that such a particular arrangement and / or order may not be required. Rather, in some embodiments, such elements may be arranged in a different form and / or order than that shown in the illustrative figures. Additionally, the inclusion of a structural or method element in a particular figure does not imply that such element is required in all embodiments, and may not be included in some embodiments or may be combined with other elements.

[0024] 1 , surgical instrument system 10 is used during an orthopaedic surgical procedure, illustratively shown as a total hip arthroplasty (THA) procedure. During the procedure, an orthopaedic surgeon impacts a surgical broach 14 into a patient's femur 16 by striking an instrument handle 12 attached to the broach 14 using an orthopaedic mallet 32 ​​(or other impactor). As the surgeon strikes the handle 12, acquisition device 100 captures sensor data from multiple sensors in the operating environment, including sensors attached to the handle 12 and / or mallet 32 ​​and / or external sensors. Acquisition device 100 provides the sensor data to analysis device 120, which uses machine learning models to generate a prediction of the impaction status of the broach 14 based on the sensor data. In an exemplary embodiment, the impaction state is defined as one of unseated (i.e., the broach 14 is not seated in the femur 16), seated (i.e., the broach 14 is securely seated in the femur 16), or fractured (i.e., the femur 16 is fractured). The user interface 140 outputs a prediction, which provides feedback to the surgeon regarding the impaction state. Thus, the system 10 can assist the surgeon in determining when the broach 14 is securely seated and in identifying and preventing proximal femur fractures during a THA surgical procedure.

[0025] Additionally, although described as involving impacting a femoral broach 14, it should be understood that the concepts of the present disclosure may be applied to other orthopaedic surgical instruments and other orthopaedic surgical procedures. Orthopaedic surgical instruments may include orthopaedic surgical instruments, such as broaches and trial components, as well as prosthetic components. For example, the concepts of the present disclosure may also be applied to impacting cementless orthopaedic implants, such as cementless acetabular cup shells.

[0026] As shown in FIG. 1 , the broach 14 includes an outer surface having a plurality of cutting teeth formed thereon. The broach 14 is configured to prepare an intramedullary canal in a patient's femur 16 for receiving a femoral component (not shown). The broach 14 is formed from a metallic material such as, for example, stainless steel or cobalt chrome. The proximal end of the broach 14 includes a mounting post or other mounting bracket that can be attached to the instrument handle 12.

[0027] The instrument handle 12 is also formed from a metallic material, such as stainless steel or cobalt chrome, and includes an elongated body extending from a mounting tip to a striking plate. The mounting tip is configured to be attached to the broach 14 and, in some embodiments, may also be configured to be attached to one or more other surgical instruments and / or orthopedic implants. The instrument handle 12 includes a grip configured to receive the hand of a surgeon or other user and enable the user to manipulate the handle 12. The striking plate of the handle 12 includes a durable surface suitable for use with a striking tool, such as an orthopedic mallet 32.

[0028] The instrument handle 12 also includes or is otherwise coupled to a number of impaction sensors 18. As described further below, the impaction sensors 18 are configured to generate sensor data indicative of the impaction status of the broach 14 into the patient's femur 16. By way of example, the impaction sensors 18 include a force sensing resistor (FSR) and / or load cell 20, a thermometer 22, a vibration sensor 24, a displacement sensor 26, an inertial measurement unit (IMU) sensor 28, and an audio sensor 30.

[0029] The FSR 20 and / or load cell 20 measure the force applied to the striking plate of the instrument handle 12 by the orthopedic mallet 32. The FSR sensor may be embodied as a polymer sheet or film having a resistance that changes based on the applied force or pressure. Similarly, the load cell may be embodied as a transducer that converts force into a measurable electrical output. In some embodiments, the handle 12 may include one or both of the FSR and / or load cell.

[0030] The thermometer 22 measures the temperature of the instrument handle 12 and / or the temperature of the surgical environment. The thermometer 22 may be embodied as a digital temperature sensor, a thermocouple, or other temperature sensor.

[0031] The vibration sensor 24 measures vibrations in the handle 12 during engagement in the form of pressure, acceleration, and force on the handle 12. The vibration sensor 24 may be embodied as a piezoelectric vibration sensor or other electronic vibration sensor. Piezoelectric sensors measure changes in pressure, acceleration, strain, or force by converting those quantities into an electric charge using the piezoelectric effect.

[0032] The displacement sensor 26 measures the position and / or change in position of the broach 14 relative to the femur 16. The displacement sensor 26 may be embodied as an optical time-of-flight sensor that senses distance by measuring the amount of time required for an infrared laser emitted by the sensor 26 to reflect off a surface and return to the displacement sensor 26. The displacement sensor 26 can measure the distance traveled by the broach 14 into the patient's femur 16 for each strike of the orthopedic mallet 32.

[0033] The IMU sensor 28 measures and reports motion data related to the instrument handle 12, including the specific forces / accelerations and angular velocities of the instrument handle 12, as well as the magnetic field surrounding the instrument handle 12 (which may indicate its overall orientation). The IMU sensor 28 may be embodied as or otherwise include a digital accelerometer, gyroscope, and magnetometer for each axis of motion. An exemplary IMU sensor 28 is embodied as a 9-DOF IMU (e.g., capable of measuring linear acceleration, angular acceleration, and magnetic field in each of three axes).

[0034] The audio sensor 30 measures the acoustic signals generated during impaction of the broach 14. The audio sensor 30 may be embodied as a microphone, a digital-to-analog converter, or other acoustic-to-electric transducer or sensor.

[0035] As shown in FIG. 1 , the orthopedic mallet 32 ​​includes a handle and a mallet head connected to the handle via a shaft. Similar to a typical hammer or mallet, an orthopedic surgeon can grasp the mallet 32 ​​by the handle and swing the mallet 32 ​​to cause impaction of the mallet head with the instrument handle 12 (or other structure). The orthopedic mallet 32 ​​also includes an IMU sensor 34 that measures motion data including acceleration, angular velocity, and magnetic fields of the mallet 32. While only one IMU sensor 34 is shown in FIG. 1 , it should be understood that, like the instrument handle 12, the orthopedic mallet 32 ​​can include additional impaction sensors 18 in other embodiments. In such embodiments, the multiple impaction sensors 18 can be of the same or different types.

[0036] In some embodiments, the orthopedic mallet 32 ​​may be embodied as an automated impactor (not shown) rather than a manual mallet. For example, the automated impactor may be embodied as a component of the Kincise™ surgical automation system, available from DePuy Synthes (Warsaw, Indiana). In such embodiments, the automated impactor may include an IMU sensor 34 and / or other impaction sensors 18. Similarly, in some embodiments, the orthopedic mallet 32 ​​may be embodied as a dynamic impulse hammer that measures the force applied to the handle 12 when the hammer tip strikes the handle 12.

[0037] The system 10 may also include one or more external impaction sensors 36 that are not located on either the instrument handle 12 or the orthopedic mallet 32. The external impaction sensor(s) 36 may embody any type of sensor capable of generating sensor data indicative of impaction of the broach 14, even if the sensor 36 is not in physical contact with either the instrument handle 12 or the orthopedic mallet 32. For example, in one embodiment, the external impaction sensor 36 includes an audio sensor (e.g., a microphone) capable of generating audio sensor data indicative of impaction between the instrument handle 12 and the orthopedic mallet 32, an image sensor (e.g., a camera) capable of generating image data indicative of impaction between the instrument handle 12 and the orthopedic mallet 32, and / or any other sensor capable of generating data indicative of impaction between the instrument handle 12 and the orthopedic mallet 32.

[0038] Although illustrated as including an impaction sensor 18 coupled to the instrument handle 12, an impaction sensor 34 coupled to the orthopedic mallet 32, and an external sensor 36, it should be understood that in some embodiments, the system 10 may include a different number and / or arrangement of sensors 18, 34, 36. For example, in one embodiment, the system 10 may include a vibration sensor 24 and an IMU sensor 28 coupled to the handle 12 and an external microphone 36. Thus, in these embodiments, one or more components of the system 10 (e.g., the orthopedic mallet 32) may be embodied as a typical orthopedic tool and may not include electronic components.

[0039] As shown in FIG. 1 , the sensors 18, 34, 36 are coupled to an acquisition device 100, which may be embodied as a single device such as a multi-channel data acquisition system, a circuit board, an integrated circuit, an embedded system, a field-programmable gate array (FPGA), a system-on-a-chip (SOC), or other integrated system or device. In an exemplary embodiment, the acquisition device 100 includes a controller 102 and an input / output (I / O) subsystem 104. The controller 102 may be embodied as any type of controller or other processor capable of performing the functions described herein. For example, the controller 102 may be embodied as a microcontroller, a digital signal processor, a single- or multi-core processor(s), a discrete computing circuit, or other processor or processing / control circuitry. The acquisition device 100 may also include volatile and / or non-volatile memory or data storage capable of storing data, such as sensor data generated by the impaction sensors 18, 34, 36.

[0040] Acquisition device 100 is communicatively coupled to other components of system 10 via I / O subsystem 104, which may be embodied as circuits and / or components for facilitating input / output operations with controller 102 and other components of system 10. For example, I / O subsystem 104 may be embodied as or include a memory controller hub, an input / output control hub, a firmware device, a communication link (i.e., a point-to-point link, a bus link, a wire, a cable, a light guide, a printed circuit board trace, etc.), and / or other components and subsystems for facilitating input / output operations.

[0041] As shown, acquisition device 100 is communicatively coupled to analysis device 120, which may be embodied as any type of device or collection of devices capable of performing various computing functions and the functions described herein, such as a desktop computer, workstation, server, specially constructed computing device, mobile computing device, laptop computer, tablet computer, or other computer or computing device. In an exemplary embodiment, analysis device 120 includes a processor 122, memory 124, an I / O subsystem 126, and communications circuitry 128. Processor 122 may be embodied as any type of processor capable of performing the functions described herein. For example, processor 122 may be embodied as a single or multi-core processor(s), digital signal processor, microcontroller, discrete computing circuitry, or other processor or processing / control circuitry. Similarly, memory 124 may be embodied as any type of volatile and / or non-volatile memory or data storage device capable of storing data, such as sensor data and / or model data received from acquisition device 100, as described further below. Analysis device 120 may also include other components typically found in a computing device, such as a data storage device and various input / output devices (e.g., a keyboard, a mouse, a display, etc.). Furthermore, although illustrated as a single device, it should be understood that in some embodiments analysis device 120 may be formed from multiple computing devices distributed across a network operating, for example, within a public or private cloud.

[0042] The analysis device 120 is communicatively coupled to other components of the system 10 via an I / O subsystem 126, which may be embodied as circuits and / or components for facilitating input / output operations by the analysis device 120 (e.g., by the processor 122 and / or memory 124) and other components of the system 10. For example, the I / O subsystem 126 may be embodied as or include a memory controller hub, an input / output control hub, a firmware device, a communication link (i.e., a point-to-point link, a bus link, a wire, a cable, a light guide, a printed circuit board trace, etc.), and / or other components and subsystems for facilitating input / output operations.

[0043] The communications circuitry 128 is configured to communicate with external devices, such as the acquisition device 100, the user interface 140, other analysis devices 120, and / or other remote devices. The communications circuitry 128 may be embodied as any type of communications circuitry or device capable of facilitating communications between the analysis device 120 and other devices. To do so, the communications circuitry 128 may be configured to perform such communications using any one or more communications technologies (e.g., wired or wireless communications) and associated protocols (e.g., Ethernet, Bluetooth, Wi-Fi, WiMAX, LTE, 5G, etc.).

[0044] The user interface 140 may be embodied as a collection of various output and / or input devices to facilitate communication between the system 10 and a user (e.g., an orthopaedic surgeon). Illustratively, the user interface 140 includes one or more output devices 144 and / or one or more input devices 142. Each of the output devices 144 may be embodied as any type of output device capable of providing notifications or other information to an orthopaedic surgeon or other user. For example, the output devices 144 may be embodied as visual, audible, or tactile output devices. In an illustrative embodiment, the user interface 140 includes one or more visual output devices, such as light-emitting diodes (LEDs), lights, a display screen, etc. Each of the input devices 142 may be embodied as any type of input device capable of being controlled or actuated by the orthopaedic surgeon to provide input, data, or instructions to the system 10. For example, the input devices 142 may be embodied as buttons (e.g., on / off buttons), switches, touchscreen displays, etc.

[0045] While illustrated as including a separate acquisition device 100, analysis device 120, and user interface 140, it should be understood that in some embodiments, one or more of these devices may be incorporated into the same device and / or other components of system 10. For example, in some embodiments, the functionality of acquisition device 100 and analysis device 120 may be combined within a single computing device. Additionally or alternatively, the functionality of user interface 140 may be combined with analysis device 120. In some embodiments, user interface 140 may be combined with or otherwise attached to one or more surgical instruments, such as instrument handle 12 and / or orthopedic mallet 32. Furthermore, in some embodiments, analysis device 120 may be directly coupled to one or more sensors, such as IMU 34 and / or external sensor 36, without the use of acquisition device 100.

[0046] In some embodiments, the functionality of the external sensor 36, acquisition device 100, analysis device 120, and user interface 140 may be combined within a single computing device. For example, a tablet computer may include a microphone or other external sensor 36. Continuing with that example, the tablet computer may capture sensor data from the microphone 36, use machine learning models to generate a prediction of the impaction status of the broach 14 based on the sensor data, and output the prediction using a display screen of the tablet computer.

[0047] 2 , in an exemplary embodiment, system 10 establishes environment 200 during operation. Exemplary environment 200 includes sensors 202, an intrusion data collector 204, a model trainer 208, an intrusion analyzer 212, and an intrusion status user interface 218. Various components of environment 200 may be embodied as hardware, firmware, software, or a combination thereof. Thus, in some embodiments, one or more of the components of environment 200 may be embodied as a circuit or collection of electrical devices (e.g., sensors 18, 34, 36, acquisition device 100, analysis device 120, and / or user interface 140). For example, in an exemplary embodiment, sensor 202 may be embodied as sensors 18, 34, 36, impaction data collector 204 may be embodied as acquisition device 100, model trainer 208 and impaction analyzer 212 may be embodied as analysis device 120, and impaction status user interface 218 may be embodied as user interface 140. Furthermore, in some embodiments, one or more of the exemplary components may form part of another component and / or one or more of the exemplary components may be independent of one another.

[0048] The sensor 202 is configured to generate sensor data indicative of the impaction of the orthopaedic surgical tool relative to the patient's bone. For example, the sensor 202 may include the vibration sensor 24, the IMU 28, and / or the external microphone 36. The impaction data collector 204 is configured to collect the sensor data from the impaction sensor 202 during the orthopaedic surgical procedure. The impaction data collector 204 provides the collected sensor data 206 to an impaction analyzer 212.

[0049] The impaction analyzer 212 is configured to generate a prediction of the impaction state with a machine learning model based on the sensor data 206. The prediction of the impaction state includes a classification 216 of the sensor data 206. The classification 216 includes an unseated state, a seized state, or a fracture state. In some embodiments, the prediction of the impaction state may also include a probability or other relative score. The impaction analyzer 212 can store model data 214 associated with the machine learning model, including historical data, model weights, decision trees, and other model data 214.

[0050] The impaction state user interface 218 is configured to output a prediction of the impaction state, which may include displaying a visual representation of the prediction of the impaction state, outputting an audible indication or alert of the prediction of the impaction state, or outputting the prediction of the impaction state in any other manner.

[0051] The model trainer 208 is configured to label the collected sensor data 206 with an impaction state label to generate labeled sensor data. Similar to predicting an impaction state, the impaction state label includes an unseated state, a seated state, or a fracture state. The model trainer 208 is further configured to train a machine learning model of the impaction analyzer 212 based on the labeled sensor data 206 to predict an impaction state for the input sensor data 206. The model trainer 208 can train the machine learning model by providing and / or modifying weights 210 associated with the machine learning model.

[0052] 3, diagram 300 illustrates one potential embodiment of a machine learning model that may be established by intrusion analyzer 212. As shown, sensor data 206 is input to a preprocessing / dimensionality reduction stage 302. Preprocessing stage 302 may, for example, transform sensor data 206 into the frequency domain to generate frequency-domain sensor data, and subsequently reduce the dimensionality of the frequency-domain sensor data to generate processed sensor data. Preprocessing stage 302 may reduce the dimensionality using a principal component analysis procedure.

[0053] As shown, the processed sensor data is input into a recurrent neural network (RNN) 304. The RNN 304 is illustratively a long-short-term memory (LSTM) trained to identify anomalies in the processed sensor data. Anomaly detection is the identification of data points, items, observations, or events that do not fit the expected pattern for a given group. These anomalies may occur infrequently, but may indicate large-scale and / or otherwise significant events. Illustratively, detected anomalies include a fully seated broach 14 and a fracture of the femur 16.

[0054] The output from the RNN 304 is passed to a classifier 306, which illustratively is a random forest (RF) predictive model. The classifier 306 generates a classification 216 based on the output from the RNN 304. The classification 216 indicates whether the impaction condition is predicted to be unseated, seated, or fractured, and in some embodiments may include a probability or other relative score. Of course, it should be understood that other machine learning models may be used in other embodiments.

[0055] Referring now to FIG. 4, during use, the instrument system 10 may perform a method 400 for training a machine learning model of the impaction analyzer 212. For example, the operations of the method 400 may be performed by one or more components of the environment 200 described above in connection with FIG. 2. The method 400 begins at block 402, where the system 10 determines whether to begin training. For example, a surgeon or other operator may use the user interface 140 or other control device to instruct the system 10 to begin training. If the system 10 determines that training should begin, the method 400 proceeds to block 404. Otherwise, the method 400 loops back to block 402.

[0056] In block 404, the acquisition device 100 collects sensor data from one or more sensors 18, 34, and / or 36 while impacting the broach 14 into the patient's femur 16. As described above, during an orthopaedic surgical procedure, a surgeon impacts the broach 14 into the patient's femur 16 by using an orthopaedic mallet 32 ​​to strike the instrument handle 12 attached to the broach 14. The acquisition device 100 captures sensor signals, including acceleration, vibration, and acoustic signals, as the surgeon impacts the instrument handle 12. The sensor data may be captured during the orthopaedic surgical procedure or during a testing procedure or other data collection operation. In a testing procedure, the surgeon or other operator may impact the broach 14 into a replica femur or other bone analog. The surgeon may impact the instrument handle 12 at different locations and / or angles on a striking plate. As described further below, a machine learning model may be trained to recognize sensor data associated with impactions at different locations and / or different impact angles. After collecting the sensor data, the acquisition device 100 provides the sensor data to the analysis device 120 for further processing.

[0057] In some embodiments, the acquisition device 100 receives vibration and / or audio sensor data at block 406. In an exemplary embodiment, the acquisition device 100 receives vibration data from a vibration sensor 24 coupled to the instrument handle 12 and audio data from an external audio sensor 36. Additionally or alternatively, in some embodiments, the acquisition device 100 can receive audio data from an audio sensor 30 coupled to the instrument handle 12.

[0058] In some embodiments, the acquisition device 100 receives IMU sensor data at block 408. In an exemplary embodiment, the acquisition device 100 receives IMU data (indicative of motion including linear acceleration, angular velocity, and magnetic fields) from an IMU sensor 28 coupled to the instrument handle 12. Additionally or alternatively, in some embodiments, the acquisition device 100 may receive IMU data from an IMU sensor coupled to the orthopedic mallet 32.

[0059] In some embodiments, at block 410, the acquisition device 100 receives load or pressure data from an FSR / load cell 20 coupled to the instrument handle 12. In some embodiments, at block 412, the acquisition device 100 receives displacement data from a displacement sensor 26 coupled to the instrument handle 12.

[0060] At block 414, the analysis device 120 (or in some embodiments, the acquisition device 100) labels the collected sensor data. By labeling the sensor data, the received sensor data can be used to train machine learning models, as described further below. The sensor data may be labeled by an operator of the system 10, for example, by selecting appropriate labels using the user interface 140.

[0061] In block 416, a label of unseated, seated, or fracture is assigned to each data point or group of data points of the sensor data. Unseated indicates that the broach 14 is not fully seated in the femur 16. In the unseated state, the broach 14 is loose within the femur 16 and has low motion resistance and low rotational stability. In the unseated state, the femur 16 has a low risk of fracture. Seated indicates that the broach 14 is firmly seated in the femur 16 and does not advance upon impaction. In the seated state, the broach 14 is firmly seated within the femur 16 and has high motion resistance and high rotational stability. In the seated state, the femur 16 has a high risk of fracture due to further impaction. Fracture indicates that the femur 16 has a fracture in one or more locations (e.g., a fracture of the calcar and / or proximal femur). In the fractured state, the broach 14 may be sufficiently seated to resist attempted movement. Further impaction in the fractured state may exacerbate the fracture.

[0062] In some embodiments, at block 418, a label may be assigned to the sensor data during impaction. For example, a surgeon or other operator may input a label using the user interface 140 during the impaction procedure. As another example, a label may be pre-assigned for a series of impactions during a testing procedure. Continuing with this example, during a testing procedure, a replica femur may be pre-fractured before performing the testing procedure. In this example, all sensor data collected during testing using the pre-fractured replica femur may be labeled as fractured.

[0063] In block 420, the analysis device 120 preprocesses the sensor data to prepare it for input to the machine learning model. The analysis device 120 may perform one or more filtering, normalization, and / or feature extraction processes to prepare the sensor data for processing. In block 422, the analysis device 120 converts the sensor data (collected as time-series data) into frequency-domain data using a fast Fourier transform (FFT). Converting to the frequency domain can remove noise and enable improved identification of peaks in the sensor data. In block 424, the analysis device 120 performs principal component analysis to reduce the dimensionality of the sensor data. Reducing the dimensionality can improve processing efficiency by combining and / or eliminating dependent variables in the sensor data. It should be understood that in some embodiments, the system 10 may not reduce the dimensionality of the sensor data and may instead reduce the amount of input sensor data, for example, by removing certain sensors from the system 10.

[0064] At block 426, the analysis device 120 trains a machine learning model with the labeled data. The machine learning model is trained to identify anomalies in the sensor data, including fully seated broach 14 in the femur 16 and fractures of the femur 16. The machine learning model is further trained to classify the sensor data into unseated, seated, and fractured states based on any identified anomalies. The analysis device 120 can train the machine learning model using any suitable training algorithm. At block 428, the analysis device 120 trains a long-short-term memory (LSTM) recurrent neural network to detect anomalies based on the labeled sensor data. The LSTM model may be trained using a gradient descent algorithm or other model training algorithm. In particular, the LSTM model may be trained to recognize seating of the broach 14 in the bone 16 and fractures of the bone 16 based on the sequence of input sensor data. Thus, during training, the LSTM model can recognize and explain differences in technique between individual strikes on the instrument handle 12, including differences in impact position and other differences in impact angle. At block 430, the analysis device 120 trains a random forest (RF) predictive model / classifier based on the output from the LSTM model and the labeled sensor data. The RF model is trained to classify the output from the LSTM model as not seated, seated, or fractured based on the labels associated with the sensor data. The RF model may be trained using any suitable decision tree learning algorithm.

[0065] In block 432, system 10 determines whether model training is complete. For example, analysis device 120 may determine whether the machine learning model has reached a particular error threshold or may otherwise determine whether the machine learning model is sufficiently trained. If additional training is required, method 400 loops back to block 402 to continue training the machine learning model. If no further training is required, method 400 is complete. After training, the machine learning model can be used to perform inference, as described below in connection with FIG. 5.

[0066] Referring now to FIG. 5 , during use, instrument system 10 can implement a method 500 for monitoring and predicting an impaction condition during a surgical procedure. For example, the operations of method 500 can be implemented by one or more components of environment 200 described above in connection with FIG. 2 . Method 500 begins at block 502, where system 10 determines whether to monitor impaction and predict an impaction condition. For example, a surgeon or other operator can use user interface 140 or other control device to instruct system 10 to begin monitoring impaction. If system 10 determines to begin monitoring impaction and predicting an impaction condition, method 500 proceeds to block 504. Otherwise, method 500 loops back to block 502.

[0067] At block 504, acquisition device 100 collects sensor data from one or more sensors 18, 34, and / or 36 while impacting broach 14 into patient's femur 16. As described above, during an orthopaedic surgical procedure, a surgeon impacts broach 14 into patient's femur 16 by using an orthopaedic mallet 32 ​​to strike instrument handle 12 attached to broach 14. Acquisition device 100 captures sensor signals, including acceleration, vibration, and acoustic signals, as the surgeon impacts instrument handle 12. After collecting the sensor data, acquisition device 100 provides the sensor data to analysis device 120 for further processing.

[0068] In some embodiments, the acquisition device 100 receives vibration and / or audio sensor data at block 506. In an exemplary embodiment, the acquisition device 100 receives vibration data from a vibration sensor 24 coupled to the instrument handle 12 and audio data from an external audio sensor 36. Additionally or alternatively, in some embodiments, the acquisition device 100 can receive audio data from an audio sensor 30 coupled to the instrument handle 12.

[0069] In some embodiments, the acquisition device 100 receives IMU sensor data at block 508. In an exemplary embodiment, the acquisition device 100 receives IMU data (indicative of motion including linear acceleration, angular velocity, and magnetic fields) from an IMU sensor 28 coupled to the instrument handle 12. Additionally or alternatively, in some embodiments, the acquisition device 100 may receive IMU data from an IMU sensor coupled to the orthopedic mallet 32.

[0070] In some embodiments, at block 510, the acquisition device 100 receives load or pressure data from an FSR / load cell 20 coupled to the instrument handle 12. In some embodiments, at block 512, the acquisition device 100 receives displacement data from a displacement sensor 26 coupled to the instrument handle 12.

[0071] At block 514, the analysis device 120 preprocesses the sensor data to prepare it for input to the machine learning model. The analysis device 120 may perform one or more filtering, normalization, and / or feature extraction processes to prepare the sensor data for processing. In particular, the analysis device 120 may perform the same preprocessing operations as described above in connection with block 420 of FIG. 4 . At block 516, the analysis device 120 converts the sensor data (collected as time-series data) into frequency-domain data using a fast Fourier transform (FFT). Converting to the frequency domain can remove noise and enable improved identification of peaks in the sensor data. At block 518, the analysis device 120 performs principal component analysis to reduce the dimensionality of the sensor data. Reducing the dimensionality can improve processing efficiency by combining and / or eliminating dependent variables in the sensor data. It should be understood that in some embodiments, the system 10 may not reduce the dimensionality of the sensor data and instead reduce the amount of input sensor data, for example, by removing certain sensors from the system 10.

[0072] At block 520, the analysis device 120 performs inference of a predicted impaction state using a machine learning model trained on the preprocessed sensor data. As described above, the machine learning model is trained to identify anomalies in the sensor data, including full seating of the broach 14 in the femur 16 and fractures of the femur 16. The machine learning model is further trained to classify the sensor data into unseated, seated, and fracture states based on any identified anomalies. To perform inference, at block 522, the analysis device 120 inputs the preprocessed sensor data into an LSTM model. The LSTM model outputs data indicative of detected and / or predicted anomalies based on the input sensor data, including seating of the broach 14 in the bone 16 and fractures of the bone 16. The output from the LSTM model can recognize anomalies regardless of any differences in technique between individual strikes on the instrument handle 12. At block 524, the analysis device 120 inputs the output from the LSTM model into an RF classifier. The RF classifier outputs a classification of the predicted impaction condition as unseated, seated, or fractured.

[0073] At block 526, the analysis device 120 outputs the impaction status prediction using the user interface 140. The user interface 140 may output the impaction status using any suitable output modality. For example, the impaction status prediction may be displayed visually using a graphical display, a warning light, or other display. As another example, the impaction status prediction may be output as an alarm, alert, or other sound using an audio device. In some embodiments, at block 528, the user interface 140 may indicate whether the impaction status prediction is unseated, seated, or fractured. In some embodiments, at block 530, the user interface 140 may indicate a probability or other relative score associated with the prediction. For example, the score may indicate a relative confidence level that the broach 14 is unseated or seated and / or a relative confidence level that a fracture is present in the femur 16. After outputting the impaction status prediction, the method 500 loops back to block 502 to continue monitoring impaction.

[0074] Referring now to FIG. 6 , diagram 600 illustrates one potential embodiment of user interface 140. The exemplary user interface 140 is a tablet computer having a display 144. The display 144 shows a graphical representation 602 of impaction state predictions. The exemplary graphical representation 602 includes a pointer 604 pointing to the current impaction state prediction. Each potential impaction state includes a color-coded bar (represented as a shade in FIG. 6 ). For example, in one embodiment, an unseated state may be color-coded as yellow, a seated state may be color-coded as green, and a fractured state may be color-coded as red. In an exemplary embodiment, pointer 604 indicates a relative score associated with the impaction state prediction by its relative position within the associated color-coded bar. In some embodiments, the graphical representation 602 may include a gradation or other indicator of the relative score.

[0075] Of course, other embodiments of the user interface 140 may be used. For example, in some embodiments, the user interface 140 may be included on the orthopedic mallet 32. In these embodiments, the user interface 140 may include a set of LEDs or other indicator lights. One or more of the LEDs may be illuminated based on the predicted impaction state. For example, the user interface 140 may illuminate a yellow LED if the predicted impaction state is unseated, a green LED if the predicted impaction state is seated, and a red LED if the predicted impaction state is fractured.

[0076] While certain exemplary embodiments have been set forth in detail in the drawings and foregoing description, it is understood that such illustration and description are merely illustrative in nature and should not be regarded as restrictive, and that exemplary embodiments have been shown and described merely, and that all changes and modifications that come within the spirit of the disclosure are desired to be protected.

[0077] The present disclosure has multiple advantages based on various features of the methods, apparatus, and systems described herein. It should be noted that alternative embodiments of the methods, apparatus, and systems of the present disclosure may not include all of the described features, but still benefit from at least some of the advantages of such features. Those skilled in the art will readily be able to independently implement methods, apparatus, and systems that incorporate one or more of the features of the present invention and are within the spirit and scope of the present disclosure as defined in the appended claims.

[0078] [Embodiment] (1) A system for predicting impaction conditions during an orthopedic surgical procedure, comprising: one or more impaction sensors for generating sensor data indicative of an impaction of the orthopaedic surgical tool relative to the patient's bone; an impaction data collector for collecting the sensor data from the impaction sensor during the orthopaedic surgical procedure; an impaction analyzer for generating a prediction of an impaction state with a machine learning model based on the sensor data, the prediction of the impaction state comprising an unseated state, a seated state, or a fractured state; and an impaction state user interface for outputting the impaction state prediction. (2) The system of embodiment 1, wherein the orthopedic surgical instrument comprises a femoral broach or an artificial component. (3) The system of embodiment 1, further comprising a surgical instrument impaction handle, wherein the one or more impaction sensors include: (i) a vibration sensor coupled to the impaction handle; (ii) an inertial measurement unit coupled to the impaction handle; and (iii) an external microphone. (4) generating a prediction of the fitment state using the machine learning model based on the sensor data, pre-processing the sensor data to generate processed sensor data; and inputting the processed sensor data into the machine learning model. (5) preprocessing the sensor data transforming the sensor data into a frequency domain to generate frequency domain sensor data; and reducing the dimensionality of the frequency domain sensor data to generate the processed sensor data.

[0079] (6) generating a prediction of the fitment state using the machine learning model based on the sensor data, inputting the sensor data into a recurrent neural network to generate abnormality prediction data; and inputting the anomaly prediction data into a classifier to generate a prediction of the impaction condition. (7) The recurrent neural network includes a long-short-term memory network; 7. The system of claim 6, wherein the classifier comprises a random forest predictive model. (8) further comprising a computing device including the one or more impaction sensors, the impaction data collector, the impaction analyzer, and the impaction status user interface; the one or more intrusion sensors include a microphone of the computing device; 2. The system of claim 1, wherein the engagement status user interface includes a display screen of the computing device. (9) in response to the execution, to one or more processors: collecting sensor data from an impaction sensor during an orthopaedic surgical procedure, the sensor data indicative of an impaction of an orthopaedic surgical tool relative to a bone of the patient; generating a prediction of an impaction state with a machine learning model based on the sensor data, the prediction of the impaction state comprising an unseated state, a seated state, or a fracture state; and outputting the prediction of the impaction state. (10) collecting the sensor data from the impacted sensor, collecting vibration data from a vibration sensor coupled to the surgical instrument; collecting motion data from an inertial measurement unit coupled to the surgical instrument; and collecting audio data from an external microphone.

[0080] (11) Generating a prediction of the fitment state using the machine learning model based on the sensor data includes: pre-processing the sensor data to generate processed sensor data; and inputting the processed sensor data into the machine learning model. (12) Generating a prediction of the fitment state using the machine learning model based on the sensor data includes: inputting the sensor data into a recurrent neural network to generate abnormality prediction data; and inputting the anomaly prediction data into a classifier to generate a prediction of the impaction state. (13) One or more non-transitory machine-readable media described in embodiment 12, wherein the recurrent neural network includes a long-short-term memory network and the classifier includes a random forest predictive model. (14) in response to the execution, to one or more processors: collecting sensor data from an impaction sensor, the sensor data indicative of an impaction state of the orthopaedic surgical device relative to the bone or bone analog; labeling the sensor data with an impaction state label to generate labeled sensor data, the impaction state label comprising a non-seated state, a seated state, or a fracture state; training a machine learning model based on the labeled sensor data to predict an impaction state for input sensor data; and (15) Training the machine learning model based on the labeled sensor data includes: pre-processing the labeled sensor data to generate processed sensor data; and training the machine learning model based on the processed sensor data.

[0081] (16) Preprocessing the labeled sensor data includes: transforming the labeled sensor data into a frequency domain to generate frequency domain sensor data; and reducing the dimensionality of the frequency domain sensor data to generate the processed sensor data. (17) One or more non-transitory machine-readable media described in embodiment 16, wherein reducing the dimensionality of the frequency domain sensor data includes performing a principal component analysis of the frequency domain sensor data. (18) Training the machine learning model based on the labeled sensor data to predict an in-place state for input sensor data includes: training a recurrent neural network with the labeled sensor data to identify anomalies in the labeled sensor data; training a classifier on the anomalies in the labeled sensor data to predict the impaction state. (19) One or more non-transitory machine-readable media described in embodiment 18, wherein the recurrent neural network includes a long-short-term memory network. (20) The one or more non-transitory machine-readable media of embodiment 19, wherein the classifier comprises a random forest predictive model.

Claims

1. 1. A system for predicting impaction conditions during an orthopaedic surgical procedure, comprising: one or more impaction sensors for generating sensor data indicative of an impaction of the orthopaedic surgical instrument relative to the patient's bone; an impaction data collector for collecting the sensor data from the one or more impaction sensors during the orthopaedic surgical procedure; an impaction analyzer for generating a prediction of an impaction state with a machine learning model based on the sensor data, the prediction of the impaction state comprising an unseated state, a seated state, or a fractured state; and an in-fit state user interface for outputting the prediction of the in-fit state; generating a prediction of the impaction state with the machine learning model based on the sensor data, pre-processing the sensor data to generate processed sensor data; inputting the processed sensor data into the machine learning model; Preprocessing the sensor data includes: transforming the sensor data into a frequency domain to generate frequency domain sensor data; reducing the dimensionality of the frequency domain sensor data to generate the processed sensor data.

2. The system of claim 1 , wherein the orthopaedic surgical instrument comprises a femoral broach or a prosthetic component.

3. 10. The system of claim 1, further comprising a surgical instrument impaction handle, wherein the one or more impaction sensors comprise: (i) a vibration sensor coupled to the impaction handle; (ii) an inertial measurement unit coupled to the impaction handle; and (iii) an external microphone.

4. A system for predicting impaction conditions during an orthopedic surgical procedure, comprising: one or more impaction sensors for generating sensor data indicative of an impaction of the orthopaedic surgical instrument relative to the patient's bone; an impaction data collector for collecting the sensor data from the one or more impaction sensors during the orthopaedic surgical procedure; an impaction analyzer for generating a prediction of an impaction state with a machine learning model based on the sensor data, the prediction of the impaction state comprising an unseated state, a seated state, or a fractured state; and and an in-fit state user interface for outputting the prediction of the in-fit state, wherein generating the prediction of the in-fit state with the machine learning model based on the sensor data includes: inputting the sensor data into a recurrent neural network to generate abnormality prediction data; and inputting the anomaly prediction data into a classifier to generate a prediction of the impaction condition.

5. the recurrent neural network includes a long-short-term memory network; The system of claim 4 , wherein the classifier comprises a random forest predictive model.

6. a computing device including the one or more impaction sensors, the impaction data collector, the impaction analyzer, and the impaction status user interface; the one or more intrusion sensors include a microphone of the computing device; The system of claim 1 , wherein the engagement status user interface comprises a display screen of the computing device.

7. In response to the execution, the one or more processors collecting sensor data from an impaction sensor during an orthopaedic surgical procedure, the sensor data indicative of an impaction of an orthopaedic surgical tool relative to a bone of the patient; generating a prediction of an impaction state with a machine learning model based on the sensor data, the prediction of the impaction state comprising an unseated state, a seated state, or a fracture state; and outputting the prediction of the impaction state. generating a prediction of the impaction state with the machine learning model based on the sensor data, inputting the sensor data into a recurrent neural network to generate abnormality prediction data; and inputting the anomaly prediction data into a classifier to generate a prediction of the impaction condition.

8. Collecting the sensor data from the impaction sensor includes: collecting vibration data from a vibration sensor coupled to the surgical instrument; collecting motion data from an inertial measurement unit coupled to the surgical instrument; and collecting audio data from an external microphone.

9. generating a prediction of the impaction state with the machine learning model based on the sensor data, pre-processing the sensor data to generate processed sensor data; and inputting the processed sensor data into the machine learning model.

10. 8. The one or more non-transitory machine-readable media of claim 7, wherein the recurrent neural network comprises a long short-term memory network and the classifier comprises a random forest predictive model.

11. In response to the execution, the one or more processors collecting sensor data from an impaction sensor, the sensor data indicative of an impaction state of the orthopaedic surgical device relative to the bone or bone analog; labeling the sensor data with an impaction state label to generate labeled sensor data, the impaction state label comprising a non-seated state, a seated state, or a fracture state; training a machine learning model based on the labeled sensor data to predict an impaction state for input sensor data; and Training the machine learning model based on the labeled sensor data includes: pre-processing the labeled sensor data to generate processed sensor data; training the machine learning model based on the processed sensor data; Preprocessing the labeled sensor data includes: transforming the labeled sensor data into a frequency domain to generate frequency domain sensor data; and reducing the dimensionality of the frequency-domain sensor data to generate the processed sensor data.

12. The one or more non-transitory machine-readable media of claim 11 , wherein reducing the dimensionality of the frequency-domain sensor data comprises performing a principal component analysis of the frequency-domain sensor data.

13. In response to execution, to one or more processors: collecting sensor data from an impaction sensor, the sensor data indicative of an impaction state of the orthopaedic surgical device relative to the bone or bone analog; labeling the sensor data with an impaction state label to generate labeled sensor data, the impaction state label comprising a non-seated state, a seated state, or a fracture state; training a machine learning model based on the labeled sensor data to predict an impaction state for input sensor data; and Training the machine learning model based on the labeled sensor data to predict an in-place state for input sensor data includes: training a recurrent neural network with the labeled sensor data to identify anomalies in the labeled sensor data; and training a classifier on the anomalies in the labeled sensor data to predict the impaction condition.

14. 14. The one or more non-transitory machine-readable media of claim 13, wherein the recurrent neural network comprises a long short-term memory network.

15. The one or more non-transitory machine-readable media of claim 14 , wherein the classifier comprises a random forest predictive model.

Images