Operating room instrument board
The development of a system for analyzing and screening surgical data solves the challenges of medical centers in managing surgical resources and improving efficiency, enabling a dynamic resource management and user-friendly interface.
Patent Information
- Application Number
- CN202380076464.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-11-03
- Filing Date
- 2023-11-03
- Publication Date
- 2025-06-13
AI Technical Summary
Medical centers face challenges in managing surgical resources and improving surgical efficiency, especially in the context of population growth and increased demand for medical services.
By developing a system that includes memory devices and processors for accessing and analyzing surgical data captured from multiple surgical procedures. The system can independently determine insights, filter data based on filter criteria, and display updated insights and user information elements on the operating room dashboard.
The system can dynamically manage computer memory resources and network traffic, reduce consumption of irrelevant content, improve user experience, and reduce data storage needs through dynamic determination insights.
Smart Images

Figure CN120153430A_ABST
Abstract
Description
BACKGROUND OF THE DISCLOSURE
[0001] The present disclosure generally relates to computing technology and, more particularly, to improvements in systems that facilitate providing guidance regarding a surgical procedure in a hospital environment where a surgical video stream is captured.
[0002] Healthcare centers (e.g., hospitals, clinics, ambulatory surgery centers, etc.) must manage the demand for services such as performing surgical procedures based on limited healthcare resources such as operating rooms, surgeons, staff, instruments, etc. As the total population and the demand for healthcare services grow, it is crucial to use limited resources to increase the efficiency of meeting such growing demand. Inefficiencies in the patient care process involving surgical services can be extremely costly to healthcare centers, patients, and society as a whole. SUMMARY OF THE INVENTION
[0003] According to one aspect, a system includes a memory device and one or more processors coupled to the memory device, the one or more processors configured to perform a plurality of operations. The operations include accessing surgical data captured from a plurality of surgical procedures, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure. Autonomously determining one or more insights regarding the surgical data. Receiving one or more filtering criteria and filtering the surgical data based on the one or more filtering criteria to adjust a base data set of user information elements. Updating the one or more insights regarding the surgical data based on the adjustment to the base data set. Displaying updates to the user information elements and the one or more insights based on the adjustment to the base data set.
[0004] According to another aspect, a method includes accessing surgical data captured from a plurality of surgical procedures, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure. The method further includes analyzing the surgical data to determine one or more insights regarding the use of the operating room and actions performed by one or more surgeons, and displaying the one or more insights on an operating room dashboard. The method further includes: filtering the surgical data based on one or more filtering criteria; updating the one or more insights regarding the surgical data based on the filtering; and displaying updates to the one or more insights on the operating room dashboard.
[0005] According to a further aspect, a computer program product includes a memory device storing computer-readable instructions thereon, wherein execution of the computer-readable instructions by one or more processing units causes the one or more processing units to perform a plurality of operations, the operations including accessing surgical data captured from a plurality of surgical procedures, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure. The operations further include analyzing the surgical data to determine one or more insights regarding the surgical procedures and displaying the one or more insights. The operations further include: filtering the surgical data based on one or more filtering criteria; updating the one or more insights regarding the surgical data based on the filtering; and displaying the update to the one or more insights.
[0006] When taken in conjunction with the accompanying drawings, the above and other features and advantages of the present disclosure will become apparent from the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The details of the proprietary rights described herein are particularly pointed out and distinctly claimed in the claims at the end of the specification. The foregoing and other features and advantages of aspects of the invention will become apparent from the following detailed description when taken in conjunction with the accompanying drawings, in which:
[0008] Figure 1 A computer-assisted surgical system is shown in accordance with one or more aspects;
[0009] Figure 2 An example user-interactive report of a surgical procedure performed using an operating room of a medical center is depicted in accordance with one or more aspects;
[0010] Figures 3A to 3B An example view of an analyzed surgical procedure is depicted in accordance with one or more aspects;
[0011] Figure 4 An example user-interactive view of a surgical procedure analyzed by surgeon is depicted in accordance with one or more aspects;
[0012] Figures 5A to 5C An example user interactivity of a report is depicted in accordance with one or more aspects;
[0013] Figure 6 A filtered report is depicted in accordance with one or more aspects;
[0014] Figures 7A to 7B An example user-interactive view for analyzing a selected surgical procedure is depicted in accordance with one or more aspects;
[0015] Figure 8 An example of a display on a mobile device is depicted in accordance with one or more aspects;
[0016] Figure 9 depicts a flowchart of a method according to one or more aspects;
[0017] Figure 10 depicts a surgical system according to one or more aspects; and
[0018] Figure 11 depicts a block diagram of a computer system according to one or more aspects.
[0019] The figures depicted herein are illustrative. Without departing from the spirit of the present invention, there can be many variations to these figures or the operations described therein. For example, actions can be performed in a different order, or actions can be added, deleted, or modified. Additionally, the term "coupled" and its variations describe having a communication path between two elements and do not imply a direct connection between the elements without intermediate elements / connections. All such variations are considered to be a part of this specification. Detailed Description
[0020] Exemplary aspects of the technical solutions described herein relate, among other things, to devices, systems, methods, computer-readable media, techniques, and methodologies for using machine learning and computer vision to improve the computerized management system of a medical center. In particular, aspects of the technical solutions herein improve the computerized management system of operating rooms in a medical center.
[0021] An operating room dashboard can provide insights into the utilization of resources in a medical center such as an operating room and other resources (human and material) used during a surgical procedure. The dashboard can provide such insights based on the captured (multiple) surgical videos of the surgical procedure being performed. The (multiple) videos can include in-vivo videos from within the patient's body and ex-vivo videos captured from within the (multiple) operating rooms. The insights provided can be automatically determined to facilitate one or more responsive actions by operators in the medical center, such as staff, administrators, surgeons, etc.
[0022] In one or more aspects, when the technical solutions described herein are capturing and analyzing surgical data, structures are predicted dynamically and substantially in real time. The predicted structures can be anatomical structures, surgical instruments, etc. Exemplary aspects of the technical solutions described herein further facilitate generating an enhanced view of the surgical site using semantic surgical representations based on the prediction of one or more structures in the surgical data. Further, based on the structures and features detected from the captured surgical data, the technical solutions herein can determine the stage, actions, and other specific aspects of the surgical procedure being performed. Based on the determination of such information regarding the ongoing surgical procedure, aspects of the technical solutions herein facilitate providing insights (e.g., charts, notifications, highlights, etc.) for an administrator to manage one or more resources. The management resources here can include scheduling resources, allocating resources, replacing resources, etc. As described elsewhere, resources can include human resources (e.g., surgeons, staff, etc.) and / or material resources (e.g., operating rooms, tools, equipment, drugs, dyes, etc.).
[0023] Technical effects can include managing computer memory resources and network traffic by allowing a user to select and configure user information elements on an operating room dashboard. For example, allowing the user to add or remove user information elements to show only the content of interest reduces the usage of memory resources, processing resources, and network resources by content that is irrelevant or useless to the user. Further, the ability to rearrange user information elements on the operating room dashboard in the order of user preferences can allow the user to group more relevant or more related views of interest physically adjacent to each other on the display, thereby reducing scrolling and search actions that may cause more resource consumption. For example, since user information elements and insights are dynamically populated when shifted to the visual position on the display, excessive scrolling and searching for the desired user information elements may cause additional resource utilization when populating uninteresting content if the selection of user information elements is not configurable. Further, insights can be determined dynamically based on dataset filters. Dynamically determining insights can reduce data storage requirements compared to pre-populating the database with possible insights that may not be accessed or considered useless.
[0024] Figure 1 An example system is depicted in accordance with one or more aspects. System 100 includes at least a surgical data capture system 102, a video recording system 104, and a surgical instrument system 106 in each operating room (OR) 101. There can be N operating rooms OR-1 101A, OR-2 101B,..., OR-N 101N, where N is any integer.
[0025] In each operating room 101, the actor 112 can be a medical staff member performing a surgical operation on the patient 110 using the system 100. The medical staff member can be a surgeon, an assistant, a nurse, an administrator, or any other actor interacting with the system 100 in the surgical environment. The surgical operation can be any type of surgery, such as but not limited to cataract surgery, laparoscopic cholecystectomy, endoscopic transsphenoidal approach (eTSA) pituitary adenoma resection, or any other surgical operation. In other examples, the actor 112 can be a technician, an administrator, an engineer, or any other such person interacting with the system 100. For example, the actor 112 can record data from the system 100, configure / update one or more attributes of the system 100, check the past performance of the system 100, repair the system 100, etc.
[0026] The surgical operation can include multiple phases, and each phase can include one or more surgical actions. "Surgical action" can include cutting, compressing, stapling, clamping, suturing, cauterizing, closing, or any other such action performed to complete a phase in the surgical operation. "Phase" refers to a surgical event consisting of a series of steps (e.g., closing). "Step" means achieving a specified surgical goal (e.g., hemostasis). During each step, certain surgical instruments 108 (e.g., forceps) are used to achieve a specific goal by performing one or more surgical actions.
[0027] The surgical instrument system 106 provides electrical energy to operate one or more surgical instruments 108 to perform surgical actions. The electrical energy triggers the activation of the surgical instrument 108. The electrical energy can be provided in the form of an electric current or voltage. The activation can cause the surgical action to be performed. The surgical instrument system 106 can further include an electrical energy sensor, an impedance sensor, a force sensor, a bubble and blockage sensor, and various other types of sensors. The electrical energy sensor can measure and indicate the amount of electrical energy applied to one or more surgical instruments 108 used in the surgical operation. The impedance sensor can indicate the amount of impedance measured by the surgical instrument 108 (e.g., from the tissue being operated on). The force sensor can indicate the magnitude of the force applied by the surgical instrument 108. Measurements from various other sensors (such as position sensors, pressure sensors, flow meters) can also be input.
[0028] The video recording system 104 includes one or more cameras, such as an operating room camera, an endoscope camera, etc. The cameras capture video data of the surgical procedure being performed. The video recording system 104 includes one or more video capture devices, and the one or more video capture devices may include cameras placed in the operating room to capture events around the patient undergoing surgery (i.e., outside the body). The video recording system 104 further includes cameras (e.g., endoscope cameras) that pass through the patient's body to capture endoscope data. The endoscope data provides videos and images of the surgical procedure (e.g., Figure 4 ).
[0029] The surgical data capture system 102 includes one or more memory devices, one or more processors, user interface devices, and other components. The surgical data capture system 102 can execute one or more computer-executable instructions. The execution of the instructions facilitates the surgical data capture system 102 to perform one or more methods, including the methods described herein. The surgical data capture system 102 can communicate with other computing systems via wired and / or wireless networks. In one or more examples, the surgical data capture system 102 includes one or more trained machine learning models, and the one or more trained machine learning models can detect and / or predict characteristics of the surgical procedure being performed or previously performed. The characteristics may include structures (such as anatomical structures) and surgical instruments 108 in the surgical procedure. The characteristics may further include events such as stages and actions in the surgical procedure. The detected characteristics may further include actors 112 and patients 110. In one or more examples, based on the detection, the surgical data capture system 102 can provide suggestions for subsequent actions to be taken by the actor 112. Alternatively or additionally, the surgical data capture system 102 can provide one or more reports based on the detection. The detection by the machine learning model can be performed in an autonomous or semi-autonomous manner.
[0030] The machine learning model may include an artificial neural network (such as a deep neural network, a convolutional neural network, a recurrent neural network), an encoder, a decoder, or any other type of machine learning model. The machine learning model can be trained in a supervised, unsupervised, or hybrid manner. The machine learning model can be trained to perform detection and / or prediction using one or more types of data obtained by the system 100. For example, the machine learning model can use video data captured via the video recording system 104. Alternatively or additionally, the machine learning model uses surgical instrument data from the surgical instrument system 106. In still other examples, the machine learning model uses a combination of video and surgical instrument data.
[0031] Additionally, in some examples, the machine learning model can also use audio data captured during a surgical procedure. The audio data can include sounds emitted by the surgical instrument system 106 when activating one or more surgical instruments 108. Alternatively or additionally, the audio data can include voice commands, snippets, or conversations from one or more actors 112. The audio data can further include sounds made by the surgical instrument 108 during its use.
[0032] In one or more examples, the machine learning model can detect surgical actions, surgical phases, anatomical structures, surgical instruments, and various other features from data associated with a surgical procedure. In some examples, the detection can be performed in real time. Alternatively or additionally, the surgical data capture system 102 analyzes the surgical data (i.e., various types of data captured during a surgical procedure) in an offline manner (e.g., after the surgery).
[0033] The surgical data capture system 102 from each operating room 101 can communicate with the OR dashboard 120. The OR dashboard 120 can be a computing system (or part of a computing system). For example, the OR dashboard 120 can be part of a hospital management system (HMS) or any other such enterprise-level system. In some aspects, the OR dashboard 120 can include the machine learning capabilities described herein. Alternatively or additionally, the OR dashboard receives information and commands from one or more surgical data capture systems 102. Further, in some aspects, the OR dashboard 120 provides data and commands to the surgical data capture system 102.
[0034] Figure 2 An example report depicting the analysis performed by the surgical data capture system 102 using the surgical data is shown. The report 200 is user-interactive and is displayed on the OR dashboard 120. The report 200 can be displayed via the user interface of the OR dashboard 120. In some aspects, the report can also be displayed by the surgical data capture system 102.
[0035] The report 200 can include a user information element 202 (e.g., total number of cases and case prediction view as user information elements), which indicates the number of surgeries performed during a selected duration (e.g., fiscal year, month, or any other selected duration). Further, the user information element 202 includes a prediction of the number of surgical procedures expected to be performed in an upcoming period (e.g., quarter, month, etc.). The user information element 202 can include one or more interactive elements that the user can configure. In an example, the number of surgical procedures performed and predicted can be shown in the form of a chart. The user can configure the type of chart, e.g., line chart, bar chart, pie chart, etc., and the user can also configure one or more visual attributes associated with the user information element 202, such as color, shape, etc.
[0036] In some aspects, the user may provide the target number of surgeries, or the OR dashboard may receive the target number of surgeries. The user information element 202 may show a comparison between the number of surgeries performed, the predicted number of surgeries, and the target number of surgeries.
[0037] Further, the report 200 may include user information elements 204 that provide further details about the surgeries performed during the selected duration to date. For example, the user information element 204 may list the surgeries performed according to the type of surgery. For example, a list of predetermined surgery types and the volume of each type of surgery is provided. This information may be provided in text, graphics, or any other way or a combination thereof. Alternatively or additionally, the user information element 204 may classify the surgeries performed during the selected duration (in 202) according to the duration of each surgery. This information may be provided in text, graphics, or any other way or a combination thereof.
[0038] Additionally, the report 200 includes an insights view 206 that provides anomalies or patterns automatically detected in the surgical data associated with the surgeries selected (in 202), where the user insights view 206 displays one or more insights as user information elements. For example, anomalies or patterns associated with the surgical data may enable identification of surgeries that take longer (or shorter) than the typical time for this type of surgery. Alternatively or additionally, the insights may be based on anomalies or patterns associated with the types of surgeries performed in the past certain number of days. The detected anomalies or patterns may be configurable by the user, for example, by specifying factors for detecting such deviations from the norm. For example, these factors may include duration, type, surgeon, staff, equipment, etc. and combinations thereof.
[0039] It should be understood that Figure 2 the number of insights shown, the number of surgeries selected and / or analyzed, and other such aspects depicted are exemplary and may vary in other aspects.
[0040] Further, in response to a first interaction (such as hovering, clicking, right - clicking, touching, voice command, etc.), each of the user information elements 202, 204, 206 representing a surgery provides detailed information about the surgery via another user information element (not shown). For example, the other user information element may identify the surgery being performed, the stage of the surgery, the duration of the surgery, the personnel involved, the equipment used, patient information, etc.
[0041] Further, in response to another interaction with a user interactive element (e.g., click, double - click, right - click, etc.), the visualization report 200 displays a view 300. Figure 3A Illustrates an example view 300.
[0042] The view 300 includes a user information element 302 that provides detailed information about the surgeries in each operating room 101. For example, the user information element 302 indicates the number of surgeries performed in each operating room 101, the average number of surgeries per operating room 101, and the amount of video recordings performed in each operating room 101. In some aspects, additional parameters can also be configured for display.
[0043] Further, the view 300 includes a user information element 304 that provides further details about one or more parameters associated with the operating room 101. In some aspects, the user information element 304 is displayed in response to a user's interaction with one or more of the parameters depicted in the user information element 302. For example, when the average number of surgeries per operating room is selected in the user information element 302, the user information element 304 displays a timeline for the selected duration (in 202) for all operating rooms 101 and a graph with the average number of surgeries performed in each operating room 101. For example, color - code the average number of surgeries per day or any other selected parameter for each operating room, where the color - coding is shown as an index. The color - coding can be performed dynamically or based on a pre - selected list of colors for each operating room. In other aspects, as a supplement or alternative to colors, other visual attributes can be used to represent the selected parameters.
[0044] Figure 3B Illustrates another example of the user information element 304, in which a color - coded line graph is used to display the surgeries performed in each operating room 101, and each line graph depicts the duration of the surgeries performed over a timeline. In some aspects, the user can interact with each line graph to cause the display of another operating room (not shown), thereby providing details of the surgeries performed in the operating room 101 corresponding to the selected (or interacted - with) line graph.
[0045] Further, in some aspects, the user information element 304 shows an indication that an operating room is being used as an emergency room for surgeries on emergency cases only. Such an operating room may have specific / special attributes associated with it, which may result in excluding data from that operating room when generating certain insights. Alternatively or additionally, certain insights can be generated based only on the operating rooms 101 used for emergency cases.
[0046] Figure 4Depicts an example of another view 400. In some aspects, view 400 may be displayed in response to user interaction with one or more user information elements in other figures herein. View 400 includes a user information element 402 that depicts a surgical procedure performed during a selected duration (in 202) based on one or more of the persons involved (e.g., based on a surgeon). Details shown by surgeon may include type of surgery, total number of surgeries, average number of surgeries (per day), average duration per case, average daily duration, etc. In some aspects, the information may further include a complexity rating associated with the surgical procedures performed by each surgeon. The complexity rating may be based on automated identification of surgical procedure characteristics, where the rating is assigned based on the presence (or absence) of one or more surgical procedure characteristics. Alternatively or additionally, the complexity rating may be based on one or more annotations provided by the surgeon during the surgical procedure. In some aspects, the complexity rating may be depicted using one or more visual attributes such as color.
[0047] View 400 may further include a user information element 404 that displays information about surgical procedures based on the surgical data capture system 102 in each operating room 101. The surgical data capture system 102 may move from one operating room 101 to another, so the number of surgical procedures recorded by the surgical data capture system 102 may be different from the number of surgical procedures in the operating room 101 in which it is located. The information depicted in user information element 404 includes the number of surgical procedures recorded on each surgical data capture system 102 connected to the OR dashboard 120, and details of each such surgical procedure.
[0048] Figure 5A Depicts an example user interactivity of a report 200 according to one or more aspects. For example, report 200 includes a user interactive element 502 that facilitates adding more views (300, 400, etc.) to report 200. Interaction with the user interactive element 502 (e.g., click, hover, double click, touch, etc.) causes a menu bar 504 to be displayed. The menu bar 504 includes several types of views that the user can add to report 200. The view types may be represented by labels, buttons, or any other selectable and interactive elements in the menu bar 504. Interaction with one or more types of views in the menu bar 504 causes the corresponding view to be added to report 200. Figure 5B Depicts where according to Figure 5A the interaction depicted in adds a corresponding view 506 for the case complexity rating view to report 200.
[0049] Figure 5CDepicts additional example interactivity with report 200. For example, one or more views of report 200 can be moved from one location to another. In Figure 5C , the positions of view 506 and view 404 are swapped. Further, each of the views (200, 300, 400, etc.) includes a user-interactive element 508. Interaction with the user-interactive element 508 displays a menu bar dedicated to the context of that view. The menu bar includes one or more selectable options. For example, the options can be made selectable by being represented as buttons, icons, images, labels, etc. The options can facilitate removing a view, sending feedback about the view to the developer of the OR dashboard 120, switching between a graphical view / list view, etc. The options can also include removing a view from report 200.
[0050] Figure 6 Depicts view 600 depicted in response to interaction with user-interactive element 208 (see Figure 2 ). The user-interactive element 208 facilitates filtering the surgical data used to generate report 200, including one or more views (300, 400, etc.) in the report. In some aspects, interaction with the user-interactive element 208 displays view 600. View 600 includes a menu bar 602 with one or more selectable filters. The filters are made selectable by representing them as menu items, such as labels, icons, buttons, etc. Each filter can include one or more parameters that the user can select to filter the surgical data accordingly. For example, the filter can include filtering the surgical data according to date, time, day of the week, or any other time aspect. Further, the filter can include filtering the surgical data according to details of each surgical procedure (e.g., case duration, personnel (e.g., surgeon), type of surgery, specialty, operating room, complexity rating, patient information, etc. or a combination thereof). Once the filters are configured and applied, all views in the report are updated accordingly.
[0051] Refer to Figure 2, Report 200 includes a menu bar 210. The menu bar 210 includes one or more selectable menu items. Each menu item can be a button, label, icon, etc., and interacting with it can cause one or more response actions. For example, the menu bar includes items that cause Report 200 to be saved or downloaded. Report 200 can be saved digitally in one or more formats such as Portable Document Format (PDF), Extensible Markup Language (XML), or any other file format. The menu bar 210 further includes an item that facilitates printing Report 200. Printing can be performed using any printer driver accessible to the OR dashboard 120. Further, the menu bar 210 includes an item that facilitates opening a manual related to the OR dashboard 120. Still further, the menu item can facilitate opening a settings menu that facilitates configuring one or more settings of the OR dashboard and / or Report 200. For example, the settings can include visual properties, default values, etc.
[0052] Further, the menu bar 210 can include a menu item that facilitates sharing Report 200. Sharing can send a link to Report 200 to another user of the OR dashboard 120, and the other user can access Report 200 using the link. In one or more aspects, the sharer can specify the accessibility level of the other user, such as view only, edit, etc.
[0053] Report 200 further includes user interactive elements 212 that allow an operator to display additional views for further analysis of surgical data. Figure 7A An example view 700 is depicted that is displayed in response to an interaction with the user interactive elements 212 of view 202. View 700 facilitates identifying different durations of a performed surgical procedure in a timeline, where specific attributes of the surgical procedure can typically be found. View 700 includes characteristics or categories of the surgical procedure listed as user interactive elements 702. Each user interactive element 702 can be displayed using different visual attributes (e.g., different colors). Further, in view 700, surgical procedures starting from a specific duration (e.g., fiscal year, quarter, month, within a specific date, etc.) are represented along a timeline 704 spanning the specific duration.
[0054] Surgical procedures that meet a certain characteristic are marked with the same visual attribute associated with the user interactive element 702 of that characteristic. In some aspects, the marking is performed by generating and displaying a visual element 706 (e.g., a line) in view 702 that is orthogonal to the timeline 704 and intersects the location of the surgical procedure that meets the characteristic. The visual element 706 has the same visual attribute as the user interactive element 702 of that characteristic.
[0055] The user-interactive element 702 representing the feature can be selected / interacted with by the operator. Figure 7B An example view generated when interacting with the user-interactive element 702 representing the feature is depicted. For example, the first user-interactive element 702 selected by the operator is highlighted (or other user-interactive elements 702 are dimmed) to depict the selection of the first user-interactive element 702. Further, the first visual element 706 corresponding to the first user-interactive element 702 is highlighted (or other visual elements 706 corresponding to other user-interactive elements 702 are dimmed). In one or more aspects, the operator can select the first visual element 706 (instead of the first user-interactive element 702) and achieve the same view 700 as Figure 7B shown. Further, upon such selection of the first user-interactive element 702 or visual element 706, the view 700 is updated to show the updated count of the currently selected surgical procedures (compare Figure 7A and Figure 7B for the top left corner). The insight view 206 is also updated to show the anomalies and patterns detected from the newly selected surgical procedures that match the selection of the user-interactive element 702 (or visual element 706).
[0056] In one or more aspects, the operator can add the annotation 710 as a multi-user comment box to the view 700. For example, she / he can interact with a certain location (e.g., right-click, click, etc.) and add the annotation 710. The annotation can be input via typing, voice commands, etc. In some aspects, the input annotation 710 can be shared / channeled to a specific user of the OR dashboard 120. In some aspects, the annotation is stored as a communication thread and other users of the OR dashboard 120 can add / edit their respective comments / annotations to it.
[0057] It should be noted that while the reports and views depicted in the figures are generally shown as having a landscape view, the reports and views can also be configured to be displayed in a portrait mode, for example, when viewing and interacting with the OR dashboard 120 on a device such as a smartphone, tablet computer, or other such electronic devices. The positioning of the views, user-interactive elements, visual elements, and other items shown in the figures herein is configurable and can be dynamically adjusted based on the orientation, resolution, and other characteristics of the device used to operate the OR dashboard 120.
[0058] The examples described herein facilitate providing a user-interactive system to visualize and analyze large amounts of data associated with System 100. For a human, generating a user-interactive report of such large amounts of data is impracticable. Thus, the technical solutions described herein provide practical applications to address technical challenges and provide improvements to computing systems such as operating room management systems, hospital management systems, etc. For example, the technical solutions described herein facilitate a service provider to examine surgical procedures performed at a medical center over a certain period (e.g., month, quarter, etc.) and provide feedback to the hospital, actors, or any other stakeholders.
[0059] The technical solutions described herein facilitate improving the performance of surgical actions, such as by identifying actors, cases in which a particular surgical action has been performed in the past. The technical solutions herein can also identify for an actor (such as a first surgeon) all instances of a surgical action (e.g., closure) that she / he has performed during a surgical procedure and a comparison of the number of the same surgical action performed by other surgeons. The first surgeon can interactively view the surgical actions being performed by himself / herself and other surgeons and determine ways to improve. For example, the first surgeon can observe the duration ranges of various surgical procedures and phases performed by other surgeons and mimic the protocols used in such other surgeries.
[0060] The technical solutions described herein can further facilitate comparisons of hospital care quality, surgeons, operating room usage, surgical data capture systems, etc.
[0061] The examples described herein can be executed using a computer (such as a server computer, desktop computer, tablet computer, etc.). In one or more examples, the technical solutions herein can be implemented using cloud computing technologies.
[0062] Figure 8 An example of a display 800 on a mobile device is depicted in accordance with one or more aspects. The display 800 can provide an extended version of the OR dashboard 120 for a mobile device (such as a cellular phone or tablet computer). The display 800 can be configured to receive touch-sensitive input, thereby allowing a user to browse the mobile version of the OR dashboard 120 by tapping, scrolling / sliding, and other such gestures. In Figure 8 the example of, is depicted as similar to Figure 2The user information element 802 of the user information element 202. One or more insights 804 can also be output on the display 800. In some aspects, the OR dashboard 120 can be configured to display other user information elements in response to a first user input 806 scrolling in a first direction, and to display one or more insights 804 in response to a second user input 808 scrolling in a second direction orthogonal to the first direction. For example, an up / down scrolling action can display and populate other user information elements, while a left / right scrolling action can display additional insights 804. User interactive elements 810 can be provided on the display 800 to allow filtering of the underlying data set, thereby updating the user information elements and insights 804. Further, the selection and sorting of the user information elements can also be configured through the display 800.
[0063] Now turning to Figure 9 , there is generally shown a flowchart of a method 900 for OR dashboard generation and display in accordance with one or more aspects. All or a portion of the method 900 can be implemented, for example, by Figure 1 system 100, Figure 10 system 1000, and / or Figure 11 all or a portion of computer system 1500.
[0064] At block 902, the system can access surgical data captured from multiple surgical procedures based on an operating room, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure.
[0065] At block 904, the system can autonomously determine one or more insights regarding the surgical data.
[0066] At block 906, the system can display a report (e.g., report 200) indicating one or more insights on an operating room dashboard (e.g., OR dashboard 120) including a plurality of user information elements.
[0067] At block 908, the system can receive one or more filtering criteria, for example, through user interactive element 208. The one or more filtering criteria can include, but are not limited to, one or more of the following: date range selection, case duration selection, surgeon selection, procedure selection, specialty selection, operating room selection, complexity score selection, and patient selection.
[0068] At block 910, the system can filter the surgical data based on the one or more filtering criteria to adjust the underlying data set of the user information elements.
[0069] At block 912, the system can update one or more insights regarding the surgical data based on the adjustment to the underlying data set.
[0070] At block 914, the system can display updates to user information elements and one or more insights based on adjustments to a base data set.
[0071] According to some aspects, one or more insights can be determined based on a video stream of a surgical procedure. The one or more insights can be viewed, for example, via the insights view 206 and / or as the insight 804.
[0072] According to some aspects, multiple user information elements can include, but are not limited to, one or more of the following: total case count and case prediction view (e.g., user information element 202), operating room view by case (e.g., user information element 302), average daily cases and usage view (e.g., user information element 304), surgical procedure view classified by duration (e.g., user information element 204), surgical procedure view classified by volume (e.g., user information element 204), case complexity view (e.g., user information element 506), capture computer view by case (e.g., user information element 404), and surgeon overview view (e.g., user information element 402).
[0073] In some aspects, the total case count and case prediction view (e.g., user information element 202) can include user interactive elements 702 that display filtering options to highlight one or more of the following: for example, long case duration, short case duration, high volume of complex cases, and cases with reduced staff. One or more insights can be automatically updated based on detecting that the user selects one of the display filtering options from the user interactive elements 702.
[0074] In some aspects, the OR dashboard 120 can be configured to add a multi - user comment box (e.g., annotation 710) to a user - selected portion of a user information element (e.g., on the visual element 706) based on a user - initiated comment command. The multi - user comment box can trigger sending a message to a target user to request a response to a comment entered in the multi - user comment box.
[0075] In some aspects, the OR dashboard 120 can be configured to add, delete, or reposition user information elements based on user commands, e.g., via user interactive elements such as user interactive element 502. Additions to the OR dashboard 120 can be performed via a menu, such as menu 504. In some aspects, the OR dashboard 120 can be configured to display a menu of items available for display in user information elements and to add new user information elements to the OR dashboard 120 based on a user's selection from the menu. As a non-limiting example, the item menu can include two or more of the following: method, complexity score, instrument score, engagement, specialty, trainee, average case timing, daily usage, computer identifier, insight, operating room, surgeon, total number of cases, and type of surgery.
[0076] In some aspects, the OR dashboard 120 is configured for display on a mobile device by: displaying user information elements in response to a first user input 806 scrolling in a first direction; and displaying one or more insights in response to a second user input 808 scrolling in a second direction orthogonal to the first direction.
[0077] Figure 9 The processes shown are not intended to dictate the order in which operations are to be performed or that all operations shown are to be included in every case. Additionally, Figure 9 in Figure 9 the processes shown may include any suitable number of additional operations.
[0078] Now turning to Figure 10 , a surgical system 1000 is generally shown in accordance with one or more aspects. Figure 10 Examples of Figure 1 depict a surgical support system 1002 that can include or can be coupled to Figure 1When performing a surgical operation on patient 110, the surgical support system 1002 can store, access, and / or update surgical data 1014 associated with a training dataset and / or real-time data. The surgical support system 1002 can store, access, and / or update surgical objectives 1016 to assist in training and guiding one or more surgical operations. The user configuration 1018 can track and store user preferences.
[0079] The surgical support system 1002 can also communicate with other systems via the network 1030. For example, the surgical support system 1002 can communicate with a surgical data dashboard viewer 1040 and a surgical data post-processing system 1050 via the network 1030. Other types of devices such as computing device 1034 (e.g., mobile phone, laptop computer, personal computer, or tablet computer) can communicate directly with the surgical support system 1002 or via the network 1030. As an example, the user interface 1010 can be connected to the surgical support system 1002 via a wired connection or integrated with the surgical support system, while the computing device 1034 is connected to the surgical support system 1002 via a wireless connection. In some aspects, the computing device 1034 can execute or be linked to another computer system that executes a surgical data management system to access various data sources via the network 1030.
[0080] The surgical data post-processing system 1050 can receive the surgical data and associated data generated by the surgical support system 1002 and can also be stored and protected separately by other data storage devices. Access to specific data or portions of data by the surgical data post-processing system 1050 may be restricted by associated permissions. The surgical data post-processing system 1050 can include features such as video viewing, video sharing, data analysis, and selective data extraction.
[0081] The surgical data dashboard viewer 1040 can provide view access to various data sources such as surgical data 1014, data collected in one or more storage devices, and post-processing data generated by the surgical data post-processing system 1050. For example, surgical instrument data, video data, and artificial intelligence-generated data can be accessed via the surgical data dashboard viewer 1040 for viewing. The surgical data post-processing system 1050 can generate surgical performance metrics and comparison data for datasets collected at multiple locations, making the analysis data available to the surgical data dashboard viewer 1040. The surgical data dashboard viewer 1040 can access one or more surgical dashboards, such as Figure 1 the OR dashboard 120. In some aspects, the surgical data dashboard viewer 1040 and / or the surgical data post-processing system 1050 can be components of a surgical data management system.
[0082] One or more computing devices 1064 (e.g., mobile phone, laptop computer, personal computer, or tablet computer) may execute a surgical data management system to access various data sources via a network 1060. The network 1030 may be within one or more facilities maintained within a private network. The network 1060 may be a wide area network, such as the Internet. Thus, the network 1030 and the network 1060 may access different files and data sets and may provide shared access to selected files and data sets. In some aspects, the network 1030 and the network 1060 may be combined.
[0083] Turning now to Figure 11 , generally shown is a computer system 1500 according to one aspect. As described herein, the computer system 1500 may be an electronic computer framework including and / or employing any number of computing devices and networks utilizing various communication technologies and combinations thereof. The computer system 1500 may be readily expandable, extensible, and modular and have the ability to change to different services or reconfigure some features independently of other features. The computer system 1500 may be, for example, a server, desktop computer, laptop computer, tablet computer, or smartphone. In some examples, the computer system 1500 may be a cloud computing node. The computer system 1500 may be described in the general context of computer-executable instructions, such as program modules, executed by the computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc., that perform particular tasks or implement particular abstract data types. The computer system 1500 may be practiced in a distributed cloud computing environment where tasks are performed by remote processing devices linked through a communication network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
[0084] As Figure 11As shown, computer system 1500 has one or more central processing units (CPUs) 1501a, 1501b, 1501c, etc. (collectively or generically referred to as (multiple) processors 1501). The processor 1501 can be a single-core processor, a multi-core processor, a computing cluster, or any number of other configurations. The processor 1501 can be any type of circuit capable of executing instructions. The processor 1501 is also referred to as a processing circuit, which is coupled to the system memory 1503 and various other components via the system bus 1502. The system memory 1503 can include one or more memory devices, such as read-only memory (ROM) 1504 and random access memory (RAM) 1505. The ROM 1504 is coupled to the system bus 1502 and can include a basic input / output system (BIOS) that controls certain basic functions of the computer system 1500. The RAM is a read-write memory coupled to the system bus 1502 for use by the processor 1501. The system memory 1503 provides temporary storage space for the operation of the instructions during operation. The system memory 1503 can include random access memory (RAM), read-only memory, flash memory, or any other suitable memory system.
[0085] The computer system 1500 includes an input / output (I / O) adapter 1506 and a communication adapter 1507 coupled to the system bus 1502. The I / O adapter 1506 can be a small computer system interface (SCSI) adapter that communicates with the hard disk 1508 and / or any other similar components. The I / O adapter 1506 and the hard disk 1508 are collectively referred to as a mass storage device 1510 herein.
[0086] The software 1511 for execution on the computer system 1500 can be stored in the mass storage device 1510. The mass storage device 1510 is an example of a tangible storage medium readable by the processor 1501, where the software 1511 is stored as instructions to be executed by the processor 1501 to operate the computer system 1500, as described below with reference to various figures. Examples of computer program products and the execution of such instructions are discussed in more detail herein. The communication adapter 1507 interconnects the system bus 1502 with a network 1512, which can be an external network that enables the computer system 1500 to communicate with other such systems. In one aspect, a portion of the system memory 1503 and the mass storage device 1510 together store an operating system, which can be any suitable operating system that coordinates Figure 11 the functions of the various components shown.
[0087] Additional input / output devices are shown connected to the system bus 1502 via a display adapter 1515 and an interface adapter 1516. In one aspect, adapters 1506, 1507, 1515, and 1516 can be connected to one or more I / O buses that are connected to the system bus 1502 via an intermediate bus bridge (not shown). A display 1519 (e.g., a screen or display monitor) is connected to the system bus 1502 by the display adapter 1515, which can include a graphics controller and a video controller for enhancing the performance of graphics-intensive applications. A keyboard, mouse, touch screen, one or more buttons, speakers, etc. can be interconnected with the system bus 1502 via the interface adapter 1516, which can include, for example, a Super I / O chip that integrates multiple device adapters into a single integrated circuit. Suitable I / O buses for connecting peripheral devices such as hard disk controllers, network adapters, and graphics adapters typically include common protocols such as Peripheral Component Interconnect (PCI). Thus, as Figure 11 configured, the computer system 1500 includes processing capabilities in the form of a processor 1501, and storage capabilities including a system memory 1503 and a mass storage device 1510, input devices such as buttons, touch screens, etc., and output capabilities including speakers 1523 and a display 1519.
[0088] In some aspects, the communication adapter 1507 can transmit data using any suitable interface or protocol (such as Internet Small Computer System Interface, etc.). The network 1512 can be a cellular network, a radio network, a Wide Area Network (WAN), a Local Area Network (LAN), or the Internet, etc. An external computing device can be connected to the computer system 1500 via the network 1512. In some examples, the external computing device can be an external network server or a cloud computing node.
[0089] It should be understood that Figure 11 the block diagram is not intended to indicate that the computer system 1500 will include Figure 11 all the components shown. Instead, the computer system 1500 can include Figure 11 any suitable fewer or additional components not shown in
[0090] Aspects disclosed herein may be systems, methods, and / or computer program products at any possible level of integration technology detail. A computer program product may include a computer-readable storage medium (or media) having computer-readable program instructions thereon to cause a processor to perform aspects of the present invention.
[0091] In some aspects, a method includes accessing surgical data captured from multiple surgeries, the surgical data identifying one or more surgeons and an operating room associated with each surgery. The method also includes analyzing the surgical data to determine one or more insights regarding the use of the operating room and actions performed by one or more surgeons, and displaying the one or more insights on an operating room dashboard. The method further includes: filtering the surgical data based on one or more filtering criteria; updating the one or more insights regarding the surgical data based on the filtering; and displaying the update to the one or more insights on the operating room dashboard.
[0092] In some aspects, the method may include determining one or more insights based on a video stream of a surgery. In some aspects, the method may include: displaying a plurality of user information elements on the operating room dashboard; adjusting a base data set of the user information elements based on the filtering; and displaying an update to the user information elements based on the adjustment to the base data set. In some aspects, the method may include: displaying a menu of items available for display in the user information elements; adding a new user information element to the operating room dashboard based on a user selection from the menu; and deleting or repositioning a user information element on the operating room dashboard based on a user command.
[0093] In some aspects, the menu of items may include two or more of the following: method, complexity score, instrument score, engagement, specialty, trainee, average case time, daily usage, computer identifier, insight, operating room, surgeon, total number of cases, and type of surgery, and the one or more filtering criteria may include one or more of the following: date range selection, case duration selection, surgeon selection, surgery selection, specialty selection, operating room selection, complexity score selection, and patient selection.
[0094] In some aspects, a computer program product includes a memory device (e.g., a computer-readable storage medium) storing computer-readable instructions thereon, wherein execution of the computer-readable instructions by one or more processing units causes the one or more processing units to perform a plurality of operations, the operations including accessing surgical data captured from a plurality of surgical procedures, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure. The operations also include analyzing the surgical data to determine one or more insights regarding the surgical procedures, and displaying the one or more insights. The operations further include: filtering the surgical data based on one or more filtering criteria; updating the one or more insights regarding the surgical data based on the filtering; and displaying the updated one or more insights.
[0095] In some aspects, one or more insights can be determined based on a video of the surgical procedure. In some aspects, the operations can include: displaying a plurality of user information elements on an operating room dashboard; adjusting a base data set of the user information elements based on the filtering; and displaying an update to the user information elements based on the adjustment to the base data set, wherein the user information elements can include one or more of the following: total case count and case prediction view, operating room view by operating room, average daily case count and usage view, surgical procedure view classified by duration, surgical procedure view classified by volume, case complexity view, captured computer view by computer, and surgeon overview view. In some aspects, the operating room dashboard can be configured for display on a mobile device by: displaying the user information elements in response to a first user input scrolling in a first direction; and displaying the one or more insights in response to a second user input scrolling in a second direction orthogonal to the first direction.
[0096] A computer-readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer-readable storage medium can be, for example but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer-readable storage medium includes the following: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), a memory stick, a floppy disk, a mechanically encoded device such as a punch card or raised structures in grooves recorded thereon with instructions, and any suitable combination of the foregoing. The computer-readable storage medium as used herein should not be construed as an instantaneous signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., an optical pulse transmitted through an optical fiber cable), or an electrical signal transmitted through a wire.
[0097] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to a corresponding computing / processing device via a network (e.g., the Internet, a local area network, a wide area network, and / or a wireless network), or to an external computer or an external storage device. The network can include a copper transmission cable, an optical transmission fiber, a wireless transmission, a router, a firewall, a switch, a gateway computer, and / or an edge server. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium within the corresponding computing / processing device.
[0098] The computer-readable program instructions for performing the operations of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, configuration data for integrated circuits, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C++, and procedural programming languages such as the "C" programming language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet, using an Internet service provider). In some aspects, an electronic circuit, including, for example, a programmable logic circuit, a field-programmable gate array (FPGA), or a programmable logic array (PLA), may execute the computer-readable program instructions by using the state information of the computer-readable program instructions to personalize the electronic circuit in order to perform aspects of the present invention.
[0099] Aspects of the present invention are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to aspects of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0100] These computer-readable program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions executed via the processor of the computer or other programmable data processing apparatus create a means for implementing the functions / acts specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions may also be stored in a computer-readable storage medium, which may direct a computer, a programmable data processing apparatus, and / or other devices to operate in a particular manner, such that the computer-readable storage medium in which the instructions are stored comprises an article of manufacture that includes instructions for implementing aspects of the functions / acts specified in one or more blocks of the flowchart and / or block diagram.
[0101] Computer-readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus, or other devices, thereby producing a computer-implemented process such that the instructions executed on the computer, other programmable apparatus, or other devices implement the functions / actions specified in one or more boxes of the flowchart and / or block diagram.
[0102] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various aspects of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of instructions, which includes one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
[0103] The description of the various aspects of the present invention has been presented for purposes of illustration, but is not intended to be exhaustive or limited to the disclosed aspects. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described aspects. The terms used herein were chosen to best explain the principles of the aspects, the practical application, or the technical improvement of technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the aspects described herein.
[0104] Aspects of the present invention are described herein with reference to the associated drawings. Alternative aspects of the present invention may be devised without departing from the scope of the present invention. Various connections and positional relationships between components (e.g., above, below, adjacent, etc.) are set forth in the following description and the associated drawings. Unless otherwise specified, these connections and / or positional relationships may be direct or indirect, and the present invention is not intended to be limited in this respect. Accordingly, the coupling of entities may refer to direct or indirect coupling, and the positional relationship between entities may be direct or indirect positional relationship. Additionally, the various tasks and process steps described herein may be incorporated into a more comprehensive program or process having additional steps or functionality not described in detail herein.
[0105] The following definitions and abbreviations are used to explain the claims and the specification. As used herein, the terms "comprises", "comprising", "includes", "including", or any other variation thereof are intended to cover a non-exclusive inclusion. For example, a composition, mixture, process, method, article, or apparatus that comprises a series of elements is not necessarily limited to those elements, but may include other elements not expressly listed or inherent to such composition, mixture, process, method, article, or apparatus.
[0106] Additionally, the term "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any aspect or design described herein as "exemplary" is not necessarily to be construed as more preferred or advantageous than other aspects or designs. The terms "at least one" and "one or more" can be understood to include any integer greater than or equal to one, i.e., one, two, three, four, etc. The term "plurality" can be understood to include any integer greater than or equal to two, i.e., two, three, four, five, etc. The term "connected" can include indirect "connection" and direct "connection".
[0107] The terms "about", "substantially", "approximately", and variations thereof are intended to include the degree of error associated with measuring a particular quantity based on the equipment available at the time of filing the application. For example, "about" can include a range of ±8% or 5% or 2% of a given value.
[0108] For the sake of brevity, conventional techniques related to various aspects of manufacturing and using the present invention may or may not be described in detail herein. In particular, aspects of the computing systems and specific computer programs for implementing the various technical features described herein are well known. Accordingly, for the sake of brevity, many conventional implementation details are only briefly mentioned or completely omitted herein, without providing well-known system and / or process details.
[0109] It should be understood that the various aspects disclosed herein can be combined in combinations different from those specifically presented in the specification and the drawings. It should also be understood that, according to examples, certain actions or events of any process or method described herein can be performed in a different order, can be added, combined, or completely omitted (e.g., all described actions or events may not be necessary for implementing these techniques). Additionally, although certain aspects of the present disclosure are described for clarity as being performed by a single module or unit, it should be understood that the techniques of the present disclosure can be performed by a combination of units or modules associated with, for example, a medical device.
[0110] In one or more examples, the described techniques may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on a computer-readable medium as one or more instructions or code and executed by a hardware-based processing unit. The computer-readable medium may include non-transitory computer-readable media corresponding to tangible media such as data storage media (e.g., RAM, ROM, EEPROM, flash memory, or any other medium that can be used to store the required program code in the form of instructions or data structures and that can be accessed by a computer).
[0111] The instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other equivalent integrated or discrete logic circuitry. Accordingly, the term "processor" as used herein may refer to any of the foregoing structures or any other physical structure suitable for implementing the described techniques. Additionally, the techniques may be implemented entirely in one or more circuits or logic elements.
Claims
1. A system, comprising: a memory device; and one or more processors coupled to the memory device, the one or more processors being configured to: access surgical data captured from multiple surgical procedures based on an operating room, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure; automatically determine one or more insights regarding the surgical data; display a report indicating the one or more insights on an operating room dashboard including multiple user information elements; receive one or more filtering criteria; filter the surgical data based on the one or more filtering criteria to adjust a base data set of these user information elements; update the one or more insights regarding the surgical data based on the adjustment of the base data set; and display updates to these user information elements and the one or more insights based on the adjustment of the base data set.
2. The system according to claim 1, wherein, the one or more insights are determined based on a video stream of these surgical procedures.
3. The system according to claim 1, wherein, the multiple user information elements include one or more of the following: total case count and case prediction view, view by operating room, average daily case count and usage view, surgical procedure view classified by duration, surgical procedure view classified by quantity, case complexity view, view by capture computer, and surgeon overview view.
4. The system according to claim 3, wherein, the total case count and case prediction view includes display filtering options for highlighting one or more of the following: long case duration, short case duration, large number of complex cases, and cases with reduced staff.
5. The system according to claim 4, wherein, the one or more insights are automatically updated based on detecting that a user selects one of these display filtering options.
6. The system according to claim 1, wherein, the one or more processors are configured to add a multi-user comment box to a user-selected portion of these user information elements based on a user-initiated comment command, and wherein the multi-user comment box triggers sending a message to a target user to request a response to a comment entered in the multi-user comment box.
7. The system according to claim 1, wherein, the operating room dashboard is configured to add, delete, or reposition these user information elements based on a user command.
8. The system according to claim 1, wherein, the one or more processors are further configured to: display a menu of items available for display in these user information elements; and add a new user information element to the operating room dashboard based on a user's selection from the menu.
9. The system according to claim 8, wherein, the item menu includes two or more of the following: method, complexity score, instrument score, engagement, specialty, trainee, average case timing, daily usage, computer identifier, insight, operating room, surgeon, total case count, and surgical procedure type.
10. The system according to claim 1, wherein, The one or more screening criteria include one or more of the following: date range selection, case duration selection, surgeon selection, procedure selection, specialty selection, operating room selection, complexity score selection, and patient selection.
11. The system according to claim 1, wherein, the operating room dashboard is configured to be displayed on a mobile device by: displaying these user information elements in response to a first user input scrolling in a first direction; and displaying the one or more insights in response to a second user input scrolling in a second direction orthogonal to the first direction.
12. A method, comprising: accessing surgical data captured from multiple surgical procedures, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure; analyzing the surgical data to determine one or more insights regarding the use of these operating rooms and the actions performed by the one or more surgeons; displaying the one or more insights on an operating room dashboard; filtering the surgical data based on the one or more screening criteria; updating the one or more insights regarding the surgical data based on the filtering; and displaying an update to the one or more insights on the operating room dashboard.
13. The method according to claim 12, wherein, the one or more insights are determined based on video streams of these surgical procedures.
14. The method according to claim 12, further comprising: displaying a plurality of user information elements on the operating room dashboard; adjusting a base data set of these user information elements based on the filtering; and displaying an update to these user information elements based on the adjustment to the base data set.
15. The method according to claim 14, further comprising: displaying a menu of items available for display in these user information elements; adding a new user information element to the operating room dashboard based on a user selection from the menu; and deleting or repositioning these user information elements on the operating room dashboard based on a user command.
16. The method according to claim 15, wherein, the menu of items includes two or more of the following: method, complexity score, instrument score, engagement, specialty, trainee, average case timing, daily usage, computer identifier, insight, operating room, surgeon, total number of cases, and type of procedure, and wherein the one or more screening criteria include one or more of the following: date range selection, case duration selection, surgeon selection, procedure selection, specialty selection, operating room selection, complexity score selection, and patient selection.
17. A computer program product comprising a memory device having computer-readable instructions stored thereon, wherein, execution of the computer-readable instructions by one or more processing units causes the one or more processing units to perform a plurality of operations, the operations including: accessing surgical data captured from multiple surgical procedures, the surgical data identifying one or more surgeons and an operating room associated with each surgical procedure; analyzing the surgical data to determine one or more insights regarding these surgical procedures; Display the one or more insights; Filter the surgical data based on the one or more filtering criteria; Update one or more insights regarding the surgical data based on the filtering; and Display the update to the one or more insights.
18. The computer program product according to claim 17, wherein, the one or more insights are determined based on videos of these surgical procedures.
19. The computer program product according to claim 17, wherein, the operations further include: Display a plurality of user information elements on an operating room dashboard; Adjust a base data set of these user information elements based on the filtering; and Display an update to these user information elements based on the adjustment to the base data set, wherein the user information elements include one or more of the following: total case count and case prediction view, operating room view by case, average daily case count and usage view, surgical procedure view classified by duration, surgical procedure view classified by volume, case complexity view, capture computer view by case, and surgeon overview view.
20. The computer program product according to claim 19, wherein, the operating room dashboard is configured to be displayed on a mobile device by: displaying the user information elements in response to a first user input scrolling in a first direction; and displaying the one or more insights in response to a second user input scrolling in a second direction orthogonal to the first direction.