Systems and methods for tracking surgical instruments

Abstract

To provide a method and system for tracking a surgical instrument.SOLUTION: The method for tracking a surgical instrument executed by at least one processor includes: receiving at least one image including at least one surgical instrument; determining a first collection of surgical instrument; determining a second collection of surgical instruments on the basis of at least one received image at least partially; and providing a notification on the basis of the first collection and the second collection of the surgical instruments.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] Priority Claim This application claims priority to U.S. Provisional Patent Application No. 62 / 856,701, filed June 3, 2019, entitled “System and Method for Tracking Surgical Instruments”, which is incorporated herein by reference in its entirety. The entire content of which is incorporated herein by reference.

[0002] The subject matter disclosed herein relates generally to the field of medical technology, and more specifically to new and useful systems and methods for tracking surgical instruments. Such systems include dedicated machines that facilitate tracking of surgical instruments, software-implemented computerized variations of such dedicated machines and improvements to such variations, as well as improvements in technology where such dedicated machines are improved over other dedicated machines that facilitate tracking of surgical instruments. Including improvements to technology that can be improved.

Background Art

[0003] Tracking surgical instruments during medical procedures can be important to reduce the risk of inadvertently leaving instruments inside a patient's body. Current methods for ensuring that no surgical instruments are left inside the body focus on manual tracking and counting of surgical instruments. However, due to staff fatigue, complex surgeries that make tracking difficult, inadequate counting systems, and instruments getting tangled or otherwise unaccounted for, manual counting is often inaccurate. Additionally, compliance with established protocols may be incomplete particularly for long and complex procedures. Therefore, retained surgical instruments are still a concerning issue. may be incomplete especially for long and complex procedures. Therefore, retained surgical instruments ​This remains a serious problem during medical procedures. Instruments left inside the patient's body during surgery can be a problem for the patient. This poses a significant health risk and increases the overall time and cost of medical care. This means that new and improved methods and systems for tracking surgical instruments during medical procedures have been developed. It may be desirable. [Brief explanation of the drawing]

[0004] [Figure 1] This is a schematic block diagram illustrating a method for tracking surgical instruments according to several exemplary embodiments. [Figure 2] This is a schematic block diagram illustrating a method for tracking surgical instruments according to several exemplary embodiments. [Figure 3] This figure shows a graphical user interface that displays information related to a first aggregation of surgical instruments, according to several exemplary embodiments. [Figure 4] This is a schematic diagram showing a container configured to receive surgical instruments for aggregation, according to several exemplary embodiments. [Figure 5] This is a schematic diagram showing a mounting structure configured to hold an imaging device, according to several exemplary embodiments. [Figure 6] This is a schematic diagram illustrating a protocol for assembling surgical instruments, based on several exemplary embodiments. [Figure 7] This is a schematic diagram showing a user operating a mobile device to take an image of a container configured to receive surgical instruments, according to several exemplary embodiments. [Figure 8] This is a schematic block diagram showing the components of a method for locating surgical instruments according to several exemplary embodiments. [Figure 9] This figure shows the display of information generated by a method for tracking surgical instruments, according to several exemplary embodiments. [Figure 10]This figure shows the display of information generated by a method for tracking surgical instruments, according to several exemplary embodiments. [Figure 11] This figure shows a graphical user interface that facilitates user verification of the location of surgical fibers, according to several exemplary embodiments. [Figure 12] This is a schematic diagram illustrating a method for analyzing surgical fibers according to several exemplary embodiments. [Figure 13] This figure shows a graphical user interface that displays information related to tracking surgical instruments, according to several exemplary embodiments. [Figure 14] This figure shows a graphical user interface that displays information related to tracking surgical instruments at intermediate points during a surgical procedure, according to several exemplary embodiments. [Figure 15] This figure shows a graphical user interface, including a summary report of the location of surgical instruments, according to several exemplary embodiments. [Figure 16] This figure shows a summary report in several exemplary embodiments. [Modes for carrying out the invention]

[0005] The exemplary method (e.g., algorithm) facilitates the tracking of surgical instruments, and the exemplary system A system (for example, a specialized machine configured with specialized software) tracks surgical instruments. It is configured to facilitate this. The example is merely typical of possible variations. Unless otherwise specified. Unless otherwise specified, the structure (structural components such as modules) is optional and can be combined in various ways. It can be combined or subdivided. Also, operations (treatments, algorithms, other functions, etc.) The order can be changed, combined, and subdivided. In the following explanation, for the purpose of explanation... Numerous specific details are provided to give a complete understanding of various exemplary embodiments. present. However, it will be apparent to those skilled in the art that the present subject matter may be practiced without these specific details will be apparent.

[0006] One or more of the exemplary methods and systems described herein may be used to track (e.g., identify, locate, monitor, etc.) one or more surgical instruments . For example, such methods and systems may be used to compare the number of surgical instru ments at various time points to determine whether all surgical instruments have been accounted for . Such methods and systems utilize computing techniques such as computer vision, machine learning, deep learning, or any suitable combination thereof, to provide accurate identification and counting of surgical instruments. Use of advanced computing techniques can, for example, improve the accuracy of counting surgical instruments, improve compliance with counting protocols, streamline the process of locating surgical instruments, reduce the overall cost and time associated with the risk of retained surgical instruments , or achieve any suitable combination thereof. Accurate location of surgical instruments introduced during a medical procedure can help avoid inadvertent retention of a surgical instrument in a patient after the medical procedure Tracking surgical instruments also provides useful information regarding use of surgical instruments during a procedure, compliance with established protocols, or both, and can help a user trigger various responses when certain indications are present.

[0007] The methods and systems described herein may be used in hospital or clinic settings (e.g., surgical or clinical settings), military settings (e.g., battlefield), or other suitable treatment settings, including It can be used in various settings. The methods and systems described herein are mainly manual Surgical instruments such as surgical fibers (e.g., surgical sponge or surgical gauze pads) While the traces are described, in other deformations, such methods and systems are further Alternatively, it may be used to track other instruments (e.g., surgical instruments or equipment). obtain.

[0008] Exemplary methods are described herein primarily in relation to tracking surgical fibers, but Such methods can be applied to any instrument used in medical procedures. For example, Methods such as scalpels, scissors, sutures, needles, gauze, bandages, or any other suitable instrument are used. This may include identifying, locating, or tracking other surgical instruments such as tools. Various types To locate surgical instruments, multiple compartments are used for counting surgical instruments such as surgical fibers. The use of containers may also be included. Such multi-compartment containers are sometimes called "collection bags." Yes, however, in some exemplary embodiments, the method for tracking surgical instruments is, There are cases where tally bags are not used. The calculation technique involves tallying the equipment without using tally bags. It can be applied to gather instruments that are grouped or organized in any appropriate way. It can be used for measurement.

[0009] Summary of Examples This specification describes, among other things, exemplary methods for tracking surgical instruments. These methods can be performed by one or more processors. In an exemplary embodiment, a method for tracking surgical instruments is a first tally of surgical instruments It receives one or more images, each image including one or more surgical instruments. Depicts the field of view and, at least partially, based on one or more received images, for surgical This includes determining the second total of the apparatus. Some exemplary methods of the method described herein Another embodiment may include a first group of surgical instruments, a second group of surgical instruments, or both. This may include providing a notice based on the first count and hand of surgical instruments. For example, the notice may include the first count and hand of surgical instruments. This may be provided based on a comparison with a second count of surgical instruments. Several exemplary implementations In this situation, the first tally can generally be determined before the medical procedure, and the second tally can generally be determined before the medical procedure. This may be decided during or after medical treatment.

[0010] The first receipt of surgical instruments identifies one or more surgical instruments depicted in the image. This may include distinguishing between different types of surgical instruments. For example, the identification of one or more surgical instruments can be done using a computer. This includes the use of John, machine learning, other computing techniques, or any appropriate combination thereof. Obtain. In some exemplary embodiments, the reception of a first aggregate of surgical instruments is at least Partially, this can be based on detecting the weight of one or more surgical instruments. In a typical exemplary embodiment, the first aggregation of surgical instruments is at least partially user input The determination of the second count of surgical instruments may be based on one or more received images. This may include identifying one or more surgical instruments depicted in the received image. One or more images, for example, depth images (e.g., infrared depth images), color images, or others. It may be an appropriate type of image. In some exemplary embodiments, one or more The identification of one or more surgical instruments depicted in the image includes at least one compartment. This includes identifying and characterizing containers depicted in one or more images. The marking may include determining one or more parameters of the container. Alternatively, determining multiple parameters is, for example, quantifying one or more compartments within a container, container Determination of the geometric arrangement of one or more sections within, at least one or more sections Determining the presence or absence of several (for example, each) surgical instruments, or any appropriate combination thereof. This may include combinations. In various exemplary embodiments, the determination of a second total number of surgical instruments. In addition or alternatively, it holds at least one or more surgical instruments in part. This can be based on detecting changes in the weight of a container configured in such a way.

[0011] The determination of the second tally for surgical instruments may include updating the current index values ​​for surgical instruments. Some exemplary embodiments of the methods described herein are displayed on a display (for example) (On the graphical user interface of a mobile computing device) This includes displaying the current indicator values ​​of surgical instruments. Specific exemplary implementations of such methods. The forms are: a first group of surgical instruments, a second group of surgical instruments, or both of surgical instruments. This includes prompting users to verify the accuracy of the calculations. Various examples of these methods The embodiments include a first tally of surgical instruments, a second tally of surgical instruments, notification, or their This includes displaying any suitable combination on a display (e.g., a display screen). Example For example, some exemplary embodiments of the methods described herein are traceable surgical instruments This includes providing a summary report of the device. In a particular exemplary embodiment, this method is the first This includes providing a notice based on a comparison between the first aggregate and the second aggregate, provided that the first aggregate is the second This may include generating a warning in response to a discrepancy in the aggregate of 2. The warning may include a predetermined It may follow a protocol. For example, a warning may display a predetermined protocol or follow the protocol. It can either guide the user or both.

[0012] This specification particularly refers to the use of surgical instruments for identification, tracking, and locating. An example system is also described. A system for tracking surgical instruments is one or more It may include multiple processors. For example, one or more processors may be used for surgical instruments. The first aggregate is received, one or more images are received, and each image is one or more surgical Describe the field of view including the instrument, and at least in part based on one or more received images. It may be configured to determine a second count of surgical instruments. One or more processors It is also based on the first count of surgical instruments, the second count of surgical instruments, or both. Notifications can be provided. For example, the notification may include the first total of surgical instruments and the surgical instruments It may be provided based on a comparison with the second aggregate. One or more processors also one Alternatively, it can be configured to identify one or more surgical instruments depicted in multiple received images. This can be done. One or more surgical instruments may be made of surgical fibers (e.g., surgical sponge or (This could be a piece of surgical gauze.) At least one of the received images may be a depth image. In some exemplary embodiments, the depth image is an infrared image. At least one of the received images Another possibility is a color image. One or more processors also have at least one Includes a section and identifies and characterizes containers depicted in one or more images. It can be configured as follows. In some exemplary embodiments, one or more processors are It is configured to determine one or more parameters of the container. Examples of parameters include: Geometric arrangement of one or more compartments within the vessel, each of the surgical This includes the presence or absence of equipment, or both. The container has a lining and a grid (e.g., rectangular). It may be a flexible container that includes multiple pockets arranged in a grid. The container may be transparent. The container lining may be opaque, colored, or otherwise. It can be composed of an appropriate combination of meanings.

[0013] Certain exemplary embodiments of the systems described herein include one or more processes Further includes an optical sensor configured to generate an image received by the sensor. In one exemplary embodiment, the system displays a summary report of the tracked surgical instruments. Includes a display screen configured to do so. The display screen also includes, for example, a first aggregate and a second aggregate. It can be configured to display a notification based on a comparison with the metric. According to the implementation method, if the first aggregate does not match the second aggregate, the notification will follow a predetermined protocol. Includes warnings in accordance with the following: According to a particular exemplary embodiment, one or more processors At least one of them is included in mobile computing devices. The computing device is removable from the stand or other suitable mounting device. It can be attached to a Noh theater.

[0014] Specific exemplary embodiments of the methods described herein include one or more surgical instruments The method includes determining the existence of by one or more processors This can be done. For example, tracking a surgical instrument may include receiving images of the field of view, and the field of view This includes one or more surgical instruments, and the presence of one or more surgical instruments in the image is To determine and provide indication of the determined presence of one or more surgical instruments in the image. This may include. A specific exemplary method is to use at least one machine learning model to analyze images within Further includes quantifying one or more surgical instruments. Several exemplary implementations In terms of form, a machine learning model can incorporate one or more deep learning techniques. By using additional or alternative computational techniques, one or more surgical instruments in an image The presence can be determined. An exemplary method is to determine each of one or more compartments of the container. This may include detecting instruments. The determination of the presence of one or more surgical instruments is made within the image. This may include detecting the presence of a container, the container comprising multiple compartments, each compartment comprising at least It is also configured to accept one or more surgical instruments. The instrument consists of one or more surgical fibers, one or more surgical instruments, or their respective... This may include an appropriate combination of intents. According to some exemplary embodiments, this specification describes The method to be revealed involves classifying each compartment of the container based on the presence or absence of surgical instruments. To provide a representation of the determined presence of surgical instruments, at least one depicted in the image This may include providing an indication of the determined presence of surgical instruments.

[0015] Examples of methods for tracking surgical instruments This specification describes methods for tracking surgical instruments during medical procedures (e.g., identification). This is an example of a method for identifying, detecting, locating, and detecting objects over time. (Surgical instruments) Such methods for tracking include processors, optical detection systems, and computer vision. Examples include machine learning, deep learning algorithms, or any suitable combination thereof. Using various computational components, the process of identifying, tracking, and locating surgical instruments is performed. It can be automated and streamlined. Figure 1 shows tracking of surgical instruments in medical procedures. Schematic diagrams of several exemplary embodiments of Method 100 are provided. Method 100 is one or The first total of multiple surgical instruments S110 is determined, and one or more surgical instruments S12 Determine the second count of 0, and the first count of one or more surgical instruments and one or more The provision includes providing a notification S130 based on at least one of a second aggregate of surgical instruments. For example, a notification may be provided based on a comparison between the first aggregate and the second aggregate. For example, check for a match between the first and second tally, if the first and second tally match Track the progress of gradually increasing the aggregation until the first aggregation and second aggregation are reached. If the match fails (e.g., no match), warn the user or adjust any of the conditions. (A poignant combination.)

[0016] An additional exemplary embodiment of method 200 for tracking surgical instruments is shown in Figure 2. Method 200 involves one or more processors performing a first aggregation of surgical instruments S220. It receives one or more images S230, and each image contains one or more surgical instruments. The field of view includes, and based at least partially on one or more received images, surgical instruments Method 200 may include determining the second total of the surgical instruments S240. This includes providing a notification S250 based on a comparison between the total and a second total of surgical instruments. It is visible.

[0017] In some exemplary embodiments, a first aggregate of surgical instruments is associated with a first time. On the other hand, the second count of surgical instruments is associated with the second time after the first time. To obtain. For example, the first count of surgical instruments could be the "initial count," which is introduced into the operating room and packaged. Corresponds to the number of surgical instruments removed from their packaging or prepared for use during medical procedures. The second count of surgical instruments may correspond to the number of surgical instruments used during medical procedures. Where used herein, the term “used” refers to equipment intended for disposal. Used instruments may be soiled or unsoiled (e.g., blood, other fluids, other The contents may be, or any suitable combination thereof. The second tally is at the intermediate time. Measured at a single point, or at the end of the procedure (e.g., after the procedure is completed, but before the surgery is finished) It can be measured as the "final total" at the "final" point in time.

[0018] Maintain (e.g., update) and compare the number of surgical instruments at various points in time during medical procedures. This can make it easier to pinpoint the exact location of surgical instruments. This may offer the advantage of preventing the substance from being retained in the patient's body. Several exemplary implementations In terms of form, the method for comparing the totals is to match the initial total of surgical instruments with the final total of surgical instruments. This may include (for example, checking whether the initial total matches the final total) This match indicates whether the location of all surgical instruments was confirmed before the end of the surgery. It may offer the advantage of making a decision. According to certain exemplary embodiments, as described herein One method is to provide a notification to the user based on whether the first aggregate matches the second aggregate. This may further include: if the first and second tally do not match, such method It notifies the user to take one or more predetermined actions, or warns them in other ways. This may include (for example, searching for surgical instruments whose whereabouts are unknown).

[0019] As described above, for tracking (e.g., identifying and / or detecting) surgical instruments Any one or more of the methods described herein may use one or more computational techniques It can be implemented in some exemplary embodiments, such as tracking surgical instruments. Such methods include computer vision, machine learning, deep learning algorithms, or those. This includes the use of any appropriate combination of the following. For example, computer vision uses images, a series of images. This may include one or more computational techniques for identifying objects within an image or video frame. As another example, machine learning or deep learning techniques can be used to analyze surgical instruments in images. By identifying complex patterns, training and planning are possible to perform specific tasks. This may include the use of arithmetic models (e.g., still images, sequences of images, or frames of a video). (Depicted within the frame). In some machine learning techniques, computer algorithms are used by a large number of people. Includes labeled images (for example, labeled with features associated with surgical instruments) By being trained on various datasets, it becomes possible to perform complex tasks. "Training." Using a labeled dataset, it learns to recognize specific patterns. This allows you to train machine learning models on programmed tasks. This can be done with a high level of accuracy. In some implementations, when the model is used However, the algorithm is updated based on the actual data received over time, and para By continuously updating the meter to improve object tracking, detection performance, or both, Learning can be continued. For example, machine learning can be used to identify one or more devices. Alternatively, it is possible to generate a model that aggregates multiple instruments, or both. Deep learning is a tool for this purpose. It is a type of machine learning that, for example, uses multiple layers or analyses to extract relevant characteristics from input data. Based on artificial neural networks that extract features and detect, identify, or track surgical instruments. It may be. When used herein, the term “computational techniques” is used as described herein. It should refer to one or more of the methods and be limited to describing one technique. There is no such thing. Furthermore, in some implementations, it is possible to combine multiple aspects of computation techniques. Yes, it is possible. For example, one or more computer vision technologies, machine learning, deep learning, It can be implemented via or both. For example, a cord used to identify surgical instruments. ComputerVision uses machine learning algorithms, deep learning algorithms, or both. This can be used to identify surgical instruments.

[0020] According to various exemplary embodiments, mobile computers such as mobile phones or tablets A tracking device is one of the methods described herein for tracking surgical instruments. or it is used to perform multiple different actions. For example, one on a mobile device Alternatively, using a software application that can run on multiple processors, Determination of the first tabulation, determination of the second tabulation, comparison of the first tabulation and the second tabulation, and comparison One or more actions can be performed, including notifying the user based on the mobile device. One or more processors on the device can be configured to analyze images. One or more processors of the device may be any one of the methods described herein or Related to multiple topics, machine learning algorithms, computer vision technologies, and deep learning algorithms They can be configured to perform Zoom, or any suitable combination thereof. In an exemplary embodiment, the mobile application provides a method for tracking surgical instruments. Perform all steps and based on one or more operations (e.g., steps) of the method performed It is configured to display information to one or more users on a mobile device. Implementing one or more such methods for tracking surgical instruments will allow you to determine the location of the surgical instruments. This not only automates and streamlines the identification process, but also facilitates the precise location of surgical instruments. Provides an additional virtual presence to guide the user through an appropriate location verification protocol. This offers the advantage of implementing computing technology on mobile devices. This involves an improved method for tracking surgical instruments that is highly accessible and intuitive to use. It may help to make it possible. In other exemplary embodiments, some of the operations of the method All of these can be run using one or more external processors. For example, mobile Using a device, acquire one or more images, receive information, and display the information. It is possible to use an external processor to use one or more machine learning algorithms. This allows you to perform analysis on one or more images.

[0021] Example of determining the first aggregation. Some exemplary embodiments of a method for tracking surgical instruments include the first of the surgical instruments. This includes receiving aggregated data. In some implementations, the first aggregate is used in medical procedures. Introduced or prepared for use (e.g., introduced into an operating room, removed from packaging) (or both), a corresponding number of one or more surgical instruments can be established. The aggregation can be established once at any point during the process. In some implementations, the first aggregation is , the number of surgical instruments introduced before or at the start of the surgical procedure, or including such instruments. In some implementations, the first aggregate is then updated throughout the entire process of the treatment. For example, when a surgical instrument is introduced into the operating room, when it is taken out of its packaging, or (Both cases). For example, one package of surgical instruments is brought into the operating room, and at the start of the procedure ( For example, it may be removed from its packaging (before the patient's surgical procedure begins). Subsequently, the surgery is performed. At some point during the medical procedure, such as while the surgical instruments are being used, the second packaging of the surgical instruments is collected and returned to the operating room. The surgical instruments are introduced and can be removed from their packaging. Therefore, the first count is the second The number of surgical instruments in the packaging may be updated (e.g., incremented). At any point during the procedure We can introduce a number of surgical instruments, and each time a new set of surgical instruments is introduced... The first tally can be updated.

[0022] Establishing a first count of instruments involves confirming the location of all surgical instruments at the end of the procedure. It may offer the benefit of making things easier. For example, the method described herein is the final step of the procedure. The total number of instruments present is compared with the first total to confirm the location of all surgical instruments. This may include determining whether or not (for example, whether or not it is retained within the patient). Using various appropriate methods, establish a first count of surgical instruments as described below. This is possible. In some implementations, establishing the first aggregation of the devices is done manually. For example, the first total for surgical instruments may be received as manual input or other user input. It is possible. As another example, the first count of surgical instruments may be additionally or alternatively, One or more processors (for example, one or more, as described below) It can be established (through computational techniques). A computational technique for establishing the first aggregation is, for example, Compared to manual methods, it improves accuracy, reduces user error, and establishes the first aggregation. This could offer the advantage of streamlining the process for determining the aggregated figures.

[0023] In some exemplary embodiments, as described above, the first aggregation of the device is based on user input and It can be received as follows. For example, establishing a first count of surgical instruments is a manual counting technique. This may include. The user manually counts multiple surgical instruments to determine the first count, and the user The first aggregation can be provided via the interface. For example, the user can provide 1 Accept a package containing one or more surgical instruments, retrieve the instruments from the package, for example, When users separate the fibers from each other, such as when they are placing them on a surface like a table. Surgical fibers can be tallied. In some implementations, manual tally is done by the user. Input into the calculation system (for example, manual input via keypad or touchscreen) (e.g., verbal answers). For example, a user can run on a mobile computing device. Manual calculations can be entered into the calculation system via a mobile application. In some implementations, mobile applications may prompt users to manually enter data. ru.

[0024] In some exemplary embodiments, the determination of the first total number of surgical instruments is additional or alternative. Alternatively, computer vision, machine learning, deep learning, other computing techniques, or their respective roles. This may include the use of an appropriate combination of intentions. For example, establishing the first aggregation is one Alternatively, it identifies multiple surgical instruments and divides images to aggregate one or more surgical instruments. This may include analyzing, or both. One or more aggregated in the first aggregate. Images of surgical instruments can be obtained using any suitable imaging device. Example For example, on mobile computing devices (e.g., mobile phones, tablets, etc.) Using an imaging system like this, capture images of one or more surgical instruments. It is possible. The image can be a still image or a frame from a video feed. In some implementations, multiple images (for example, multiple frames from a video feed) are processed. The first total number of surgical instruments is determined. In some implementations, the image is color - Whether it is an image or contains one, but in other implementations, the image is a depth image (e.g., red (Extraneous radiography, stereoscopic imaging, ultrasound, etc.), hyperspectral imaging, or other appropriate types of imaging It is present or includes. Furthermore, multiple images of one or more surgical instruments are simultaneously In addition, different types (for example, combined with depth images) may be acquired almost simultaneously or sequentially. (A color image) is possible. Generally, one or more processors are one or more To receive an image, analyze one or more images, or both. It can be configured. Furthermore, one or more processors can perform computational techniques (e.g., computing). (Using Tavision, machine learning, deep learning, or any suitable combination thereof) This implements a mechanism to identify one or more surgical instruments and aggregate the number of surgical instruments. It can do either or both. One or more processors can process the received image. It depicts one or more surgical instruments. Such a processor is mobile It can be implemented in computing devices such as computing devices. In some implementations, mobile apps can run on computing devices. The cation is used in combination with one of the following variations to perform the first surgical instrument. It is possible to retrieve, receive, and process data related to the aggregation of item 1.

[0025] In some exemplary embodiments, image analysis is used to determine a first count of surgical instruments. This includes the following operations: The user uses one or more surgical instruments, such as surgical fibers. Obtain the packaging containing the ingredients and bring the packaging into the operating room. The user will undergo one or more surgical procedures. Remove the instruments from their packaging, separate the surgical instruments, and place them on a surface such as a table. This is possible. Next, the user can take images from a camera on their mobile computing device. Using a colorization system, acquire images of one or more surgical instruments on a table. This can be done. Next, the processor of the mobile computing device analyzes the image. Identify individual surgical instruments within the image, count the number of surgical instruments in the image, or perform other actions. Quantify by method, or both. For example, the first count of surgical instruments is calculated as follows: Pyutavision, machine learning, deep learning technologies, or any suitable combination thereof Which calculation technique can be used to determine the second total for surgical instruments? This includes one or more of the following, which are described in more detail below: Process The system can store information regarding the detection and counting of surgical instruments in its memory. In one implementation, the first aggregation decision is made based on the surgical instruments aggregated by the processor within the image. Update the first count by adding the number to the previously counted number of surgical instruments. This includes (for example, surgical instruments depicted in images taken at a previous point in time). Additionally, Alternatively, the first determination of the count is to count the number of surgical instruments in the images taken at a given point in time. This may include (for example, if surgical instruments have not been previously counted).

[0026] In some exemplary embodiments, one or more calculation techniques are used for the first surgical instrument. This includes detecting characteristic arm movements of the user in order to determine the aggregation. Movement can be characterized in any appropriate way. For example, detecting characteristic arm movements. When the user removes the surgical fibers from the packaging, the medical professional will perform the surgery during the procedure. Because the fibers are often "distributed" on the surface and then gathered together, the user separates the surgical instruments. This may include identifying the "countermeasure" actions taken during the process. An imaging system equipped with a camera, The system may be configured to observe the user's arm movements (e.g., front view, side view, top view). (or any suitable combination thereof), the processor processes a still frame image or video. The deodorant can be received from the imaging system. The user removes the surgical fiber from its packaging and places it on the surface. The sweeping (e.g., distributing) arm movements when positioning surgical fibers are visualized by the imaging system. And can be detected using computational analysis (e.g., performed by a processor). Therefore, each arm movement detected by the processor is aggregated for the surgical instruments. This can be addressed and contribute to the first aggregation of surgical instruments.

[0027] In a particular exemplary embodiment, one or more computational techniques utilize weight information to perform the following: Determine the total for 1. For example, surgical instruments can be placed on the scale in order, and surgical instruments To determine the first total weight of the ingredients, the incremental weight change is measured by one or more processors. It can be detected. That is, it occurs when additional surgical instruments are placed on the scale. Based on the incremental weight change, the processor can detect the presence of additional surgical instruments. It is possible that the processor will detect an incremental weight change. The total can be increased.

[0028] Additionally or alternatively, according to some exemplary embodiments, a plurality of surgical instruments are It can be arranged, and information on the weight of each individual surgical instrument can be used for the surgery. The first total of the device can be determined. For example, the user can determine the user interface. You may be prompted to input the type of surgical instrument to be weighed. For example, by searching a database of existing surgical instrument types, By navigating the hierarchical menu of instrument types, or by selecting surgical instrument types It can be entered by typing. The type of surgical instrument is, for example, its function (example). For example, the type of fiber, surgical instrument, etc.) or instrument-specific information such as brand, size, material, etc. They can be classified based on their characteristics or distinguished in other ways. Additionally or alternatively, The type of surgical instrument may be determined based on other identifications (e.g., related to the type of surgical instrument). Scan the attached barcode or radio frequency identification (RFID) tag. The trusting processor determines the weight of a single surgical instrument based on the type of surgical instrument it accepts. Information regarding quantity can be received. Therefore, information regarding the weight of surgical instruments is either manually entered by the user or stored in the lookup table's memory, Alternatively, by scanning barcodes or electronic tags such as RFID tags on surgical instruments. This can be obtained. Based on information about the weight of a single surgical instrument, the processor can obtain multiple By dividing the total weight of several surgical instruments by the known weight of a single surgical instrument, the total weight of several surgical instruments can be calculated on a scale. The number of surgical instruments can be determined.

[0029] As described above, the mobile application determines one or more of the first aggregates. It can be used in combination with weight-based methods. Figure 3 shows the use of a scale. A graphical user interface 3 that shows information related to determining the first aggregation. An exemplary embodiment of 00 is shown. The graphical user interface in Figure 3 is aggregated The type of surgical instrument 310 being used and the current determination 320 of the first tally are displayed. The graphical user interface 300 displays new surgical instruments on the scale 330. The user is instructed to place it. Furthermore, the graphical user interface 300 The user manually disables the first aggregation (340a) and provides manual aggregation, and the first aggregation Icons 340a and 340 are selectable to allow termination (340b). b provides (for example, all surgical instruments of the selected type, at least for now) (This indicates that it has been included in the first tabulation.)

[0030] In some exemplary embodiments, one additional or alternative determination of the first aggregate Alternatively, multiple computing techniques can be used to scan scannable tags (e.g., RFID, barcodes, or similar). This includes the use of any appropriate combination of the following: For example, surgical instruments are used in the operating room. When introduced, when they are removed from their packaging, or at some other point before use This may include individual RFID tags that can be scanned. In other situations, the packaging of surgical instruments may be scanned. The system is configured to allow the location of multiple surgical instruments to be confirmed with a single scan of the tags. It may include scanned tags. For example, the packaging of surgical instruments may be included in the first count. It may include a scannable tag that communicates the number of devices in the packaging to the processor. The method for determining the first tally is to use surgical instruments or hands to determine the first tally. This may include scanning tags on the packaging of surgical instruments.

[0031] The determination of the first aggregation may include one or more of the methods described above. Some examples: In a typical embodiment, a plurality of methods for determining the first aggregation are used to check the accuracy of the first aggregation. I testify that the methods for determining the first tally can be combined in any suitable way. For example, detecting incremental weight changes on a scale, or the known weight of a single surgical instrument. Weight-based methods, such as those utilizing information, are used to identify and tally surgical instruments in images. It can be combined with image-based methods, such as using one or more computational techniques. As another example, image-based methods include one or the recognition of characteristic user movements. It can be combined with multiple computational techniques. Using one or more manual aggregation techniques , verify one or more of the methods described herein for determining the first aggregate It is possible. In some exemplary embodiments, the mobile application is a computation The user is prompted to verify the decision of the first aggregation generated using the technology. In an exemplary embodiment, as described above with respect to Figure 3, this method allows the user to perform a first If it is determined that the aggregation is inaccurate, the user can determine the automatic or calculated determination of the first aggregation. This includes making it possible to disable the default setting.

[0032] In some exemplary embodiments, the determination of the first total number of surgical instruments is divided by the number of surgical instruments. This includes similarity. The determination of the first count involves distinguishing between different surgical instruments and the same surgical instruments. This may include different types of decisions, or both. For example, different types of surgical fibers. These can be distinguished from one another (for example, by material, function, size, brand, or any of these). (By the appropriate combination of) another example, two different types of surgical instruments They can be distinguished (for example, the female can be distinguished from the pair of scissors). Using any suitable method that includes one or more of the following computational techniques, one or more It is possible to determine the type of one or more surgical instruments, such as the type of surgical fiber. In some implementations, the first aggregation decision is made regardless of type, all aggregated data. In addition to the first total of all surgical instruments, separate categories of the first total are shown. Includes. For example, the first aggregate is the first type specific to 18 inches x 18 inches of surgical fiber. This may include a total of 4 inches x 4 inches, and a first total specific to another type of surgical fiber. ru.

[0033] Any of the methods described herein for determining the first aggregate is used to determine the second aggregate. It can be used additionally or alternatively to determine the first aggregate. Additional or alternative use of any of the methods described herein for the purpose of surgical instruments Other appropriate analyses can be performed (for example, as described below, used Tracking of equipment, tracking of unused equipment, or both.

[0034] Example of determining the second calculation. Some exemplary embodiments of a method for tracking surgical instruments include the second of the surgical instruments. This further includes determining the total. As mentioned above, the second total for surgical instruments is surgical The first count of instruments can be compared with the second count of procedures (e.g., surgical procedures). The decision can be made at any appropriate time during the medical procedure. For example, the second calculation is the treatment. This could be an "interim summary" determined at an intermediate point during the process, between the start and end points. The decision for the interim tally is made during the course of the procedure (for example, throughout the procedure) (for example, when surgical instruments are used). Update the indicator counter of the surgical instrument (when it is used or designated for disposal). This may include comparing the interim summary with the first summary, and the remaining data on site during the course of the procedure. This can show the number of "used" surgical instruments. The second count is the final count of the procedure. This can also serve as a calculation. By comparing the final count with the first count, the location of all surgical instruments can be confirmed. To determine whether or not surgical instruments are present and to assess the risk of them remaining inside the patient's body during the procedure. Restriction may be desirable in some cases. The termination of treatment can be indicated by any appropriate method. Example For example, the procedure is complete when the patient is ready to leave the operating room (for instance, when the surgical site is (After closure), or before the patient's surgical site is closed, but after the surgical procedure is completed. could be.

[0035] In addition to or alternatively to any of the methods described herein for determining the second aggregation, Specifically, it can be used to determine the first aggregate. Similarly, it can be used to determine the second aggregate. Use any of the methods described herein additionally or alternatively to perform the procedure for surgical instruments Any other suitable analysis can be performed (for example, using as described below). Tracking completed equipment, tracking unused equipment, or both.

[0036] Examples of using a tally bag In some exemplary embodiments, the arrangement of surgical instruments is used to determine the location of surgical fibers. This includes the use of counting bags for verification. Using counting bags ensures the accurate distribution of surgical fibers. This could facilitate systematic data collection and reduce the risk of surgical instruments remaining in a patient's body. One or more users will be asked to discard data to facilitate efficient and accurate aggregation. The specified surgical fibers can be placed in the pocket of the collection bag. Furthermore, surgical Disposal of fibers or other materials involves, in some exemplary embodiments, a multi-stage material collection process. This may include ses. For example, in some operating room procedures, after the surgical fibers have been used in the procedure, They are one or more collection containers (for example, near the operating table or in another location within the operating room). An example of a metal bucket lined with a positioned plastic liner, shaped like a "kick bucket". It may accumulate in (Ts). During or after the procedure, one or more healthcare workers may subsequently Remove surgical fibers from one or more collection containers and gather surgical instruments for counting. They can be placed in a measuring bag. In other exemplary embodiments, surgical fibers are stored in a separate collection bag. It can be placed directly into the collection bag without using a collection container. All used in the procedure The location of the surgical fibers can be confirmed using a tally bag. As mentioned above, The term "used" refers to surgical fibers used to absorb blood or other fluids. Not limited to, but including, any method of introduction into the operating room and subsequent disposal, or otherwise This may refer to any surgical fibers designated to be discarded. Some examples are available. According to the embodiment, manual counting of surgical fibers is performed using a specific protocol as described below. This includes placing surgical instruments, such as surgical fibers, into compartments of the collection bag. Or one or more devices that implement multiple computing techniques to locate surgical instruments. Errors related to manual aggregation using one or more aggregation bags using this method This can be automated and reduced.

[0037] In some situations, healthcare workers use one or more tally bags to carry surgical instruments. A standardized procedure or protocol can be used when counting the ingredients. Figure 6 shows: This shows one such protocol for use in the operating room. The instruments are, for example, below The pockets of the tally bag 600 are arranged in the order indicated by the numbers, from top to bottom and from right to left. It can be placed in 610. Therefore, if the procedure is performed correctly, the first filled pocket The pocket in the bottom right corner (pocket 1) is the last pocket to be filled, and the pocket in the top left corner is the last pocket to be filled. It will become the pocket (pocket 10) of the section. According to other protocols, the tally bag 600 is It can be filled from top to bottom and from left to right. However, other appropriate protocols should be followed. It is possible.

[0038] Figure 4 shows a schematic representation of a tally bag 400 used in medical procedures. Tally bag 4 00 comprises a lining 402 and multiple pockets 410 or other compartments. (See Figure 4) The tally bag 400 includes 10 pockets arranged in a rectangular array, as shown in Figure 4. To that end, the 10 pockets 410 are arranged in 5 columns, and each column contains pockets 410 It includes two of the following. Each row is, for example, a larger one formed between the backing 402 material and the front material. It may include a large pocket 412, and a larger pocket 412 is a larger pocket 412 It can be divided into two smaller pockets 410, each having a seal 414 that forms a seam. However, the tally bag 400 may contain any appropriate number of pockets 410. The pocket 410 can be configured in any suitable way. For example, the pocket Some or all of the 410s may be separate compartments, and some or all of the pockets 410s may be All of this is a single larger pocket (e.g., each pocket 410 is separated by a seal) For example, it can be made from a larger pocket (412), or any suitable combination thereof. The collection bag 400 is a stand such as a pole 430 (for example, an intravenous (IV) pole). It can be attached to a pole. Pole 430 can be attached to one or more (for example, two) feet. It may include a lateral mounting rod 431 including a 432. The collection bag 400 is a collection bag One or more (for example, 2) that allow the bag 400 to be suspended from the hook 432. It may include an opening 404 of the form (1). The collection bag 400 shown in Figure 4 is rectangular and The tally bag 400 and its pockets 410 include 0 rectangular pockets 410, Any suitable configuration is possible.

[0039] The collection bag 400 may contain any suitable material (for example, it may be made from such material). For example, the lining 402 of the counting bag 400 is made of polymer, plastic, silicone. Nylon, nylon, rayon, any other suitable material, or any suitable combination thereof It can be made from flexible materials such as se. Another example is the lining of the counting bag 400 40 2. Rigid plastic, polymer, metal, any other suitable material, or any of them It can be made of more rigid materials, such as an appropriate combination of these. (Back of tally bag 400) 402 is available in transparent, translucent, opaque, colored, or any suitable combination thereof. It's possible. For example, backing 402 could be opaque blue. Opaque colored backing 402 (for example, opaque blue) is used to select tally bag 400 individually from among multiple tally bags. It can be made easier to identify (for example, multiple tally bags on the same pole 430 to each other) If they are layered in front of each other, or if multiple poles (e.g., pole 430) are in front of each other (When layered), it can provide a contrasting background that makes the surgical fibers stand out. T410 can be made from the same or different materials as backing 402. For example, pocket The T410 can be made from flexible plastic, silicone, or polymer material. The pocket 410, made of flexible material, allows for easy placement of surgical fibers within it. This could offer the advantage of making it possible. Pocket 410 can also be transparent or opaque. In some exemplary embodiments, one or more pockets 410 are used for surgical instruments. It is transparent to allow for easy visualization and aggregation.

[0040] The tally bag 400 shown in Figure 4 is rectangular and has 10 rectangular pockets 410. The tally bag 400 can be any suitable configuration, including the following: The backing 402 is rectangular, substantially square, elliptical, triangular, or any suitable shape. It can have any shape. The tally bag 400 has 10 pockets 41 as shown in Figure 4. It does not need to have 0s, and can contain any appropriate number of pockets 410. For example, The counting bags are numbers 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, and 15. 410 may include 16, 17, 18, 19, 20, or any appropriate number of pockets. Figure 4 shows a tally bag 400 configured to be suspended from a pole 430. The tally bag 400 can be attached in any suitable way. For example, tally bag 40 0 is one or more openings 404 or any other suitable mounting at any appropriate location It may have a mounting mechanism. For example, the collection bag may be configured to be attached to a hook on the wall. A fold that is either obtained or configured to be placed on top of a door or cabinet. It can be attached to a rack or mounting rod. As another example, the collection bag 400 is attached to It can be attached to the wall with adhesive or other suitable fasteners. Furthermore, the collection bag 400 is a po It does not need to be sized to fit the dimensions of the pole (for example, IV pole), tally bag 40 0, its pocket 410, or both, other tally bags, their pockets, also They can be made in different sizes from both, and various sizes of surgical fibers, etc. It houses various types of surgical instruments.

[0041] In some exemplary embodiments, the pole 430 also mounts an imaging device. This may include mounting for the first aggregation using one or more imaging devices. Methods for tracking surgical instruments, including determination, second count determination, or both. It is possible to generate one or more images for use in various components (e.g., operations). Yes, it is possible. In particular, the pole 430 to which the counting bag 400 is attached is 1 One or more imaging devices determine the second count of surgical instruments in the counting bag 400. It can be used when... For example, a mount for an imaging device is used for the user to aggregate data... This makes it easier to capture images (e.g., capture) of the 400, and as a result, The user does not need to hold the imaging device while taking pictures. One or more cameras The mount can be permanently attached to pole 430 or removed from pole 430. It can be fixed in place. Furthermore, the mount is adjustable along the pole 430 (for example) (The pole 430 is configured to slide vertically up and down, and rotates around the pole 430.) It is adjustable to either the left or right side of pole 430, or both. This is possible. Figure 5 shows a mobile device 550 (for example, a tablet or smartphone). Includes a mount 540 attached to a pole 530 configured to hold, An exemplary embodiment of the tally bag stand 500 is schematically shown. In this configuration, the mount 540 securely and detachably holds the mobile device 550. Includes a grip 542 configured as follows: The grip 542 is, for example, a mount 540 and a mobile Friction fitting between the device 550, adjustable clamp, mount 540 and mobile Snap-fit ​​mating parts on the device 550, one or more magnets, mount A removable adhesive layer attached to the T540 or mobile device 550, Mobile devices can use any appropriate mechanism through any appropriate combination of them, etc. The vise 550 can be held. In the exemplary embodiment shown, the mount 540 It is fixed to the pole 530 by the mounting mechanism 544. The mounting mechanism 544 is Clamps, clasps, hinges, threads, one or more fasteners (e.g., mechanical fasteners) Any suitable mounting method such as tools, adhesives, or both, or any suitable combination thereof. It may include a mounting mechanism. For example, the mounting mechanism 544 may be attached to the dimensions of the pole 530. An adjustable clamp (e.g., adjustable jaws) that is attached and configured to adjust to it. ) or expandable sleeve or other insert (e.g., inflatable foam) This may include. In some exemplary embodiments, the mounting mechanism 544 may include the mount 540 Includes one or more fasteners configured to connect to pole 530 (e.g., Mau Inserted through the openings of the 540 and 530 poles, nuts, and other threaded backings. (or screws or bolts secured with other fastener backing). Mount 540 in Figure 5 is Although depicted as extending horizontally from pole 530, mount 540 is mobile The camera of device 550 is positioned over a tally bag (for example, a tally bag) attached to pole 530. It can be positioned to capture images of the 400 (Bag 400) and extended at any appropriate angle. It can be mounted. Furthermore, the mount 540 can be mounted on any suitable tally bag stand 500. It can be fixed to any part. For example, mount 540 can be attached to the tally bag stand 500. It can be fixed to the pole 530, the mounting rod 531, or the hook 532. Furthermore, Mount 540 can have any suitable configuration. Mount 540 is substantial The mount 540 can be straight, or it may include a curved configuration. Furthermore, The Mount 540 uses a gooseneck structure and other features to allow for length and angle adjustment. (For example, the angle between mount 540 and pole 530 is adjustable), or their respective This could be an appropriate combination of intentions. This depends on the user's specific needs or the actions they are currently taking. This could offer the advantage of allowing users to adjust the position of the mount 540. ru.

[0042] Examples of computational techniques for tracking surgical instruments In some exemplary embodiments, one or more computational techniques are used to perform one or Surgical instruments that may have been placed in multiple collection bags (e.g., collection bag 400) Identify, tally, or both. Automate and streamline the process of locating surgical instruments. To do this, combine one or more such tally bags with one or more tally bags. It may be desirable to use arithmetic techniques to improve the accuracy of one or more calculations. Therefore, compliance to the protocol for using one or more aggregation bags This can improve performance. For example, taking one or more images of the tally bag 400. It can be shadowed, and any of the calculation techniques in the total bag 400 can be used. Surgical fibers can be identified and counted (for example, as described elsewhere in this book). (For example, using computer vision, machine learning, or deep learning.) The image of mobile devices 550 (e.g., mobile computing devices) To capture images of the tally bag 400 using an imaging system such as an image capture system. This can be done. Figure 7 shows how to take an image of the collection bag 730 using a mobile device 720. This shows a schematic representation of user 710. As shown in Figure 7, user 710 is... As shown by the dashed line, the tally bag 730 is within the field of view of camera 722, To arrange an imaging system in an exemplary form of a mobile device 720 equipped with 722 This is possible. One or more generated by the camera 722 of the mobile device 720 The images can be analyzed using one or more computational techniques described herein. Figure 7 shows the mobile device 720 being held in front of the aggregation bag 730 to generate an image. This shows user 710, but the imaging system (e.g., mobile device 720) is mouse Collected by any appropriate method, such as via a mount (for example, mount 540 shown in Figure 5). It may be positioned relative to the total bag 730. It may be adjacent to the total bag 730, or Alternatively, the tally bag 730 can be angled toward a pocket (for example, pocket 410). It is directly on top of the tally bag 730.

[0043] Example of a tracking algorithm model Figure 8 schematically illustrates the method according to several exemplary embodiments and various training The model is placed in one or more aggregation bags (e.g., aggregation bag 400). Method 800 (e.g., tracking algorithms) used to track surgical instruments This illustrates the exemplary relationships and data flows between possible components, as included in Method 800. Each model can achieve its sub-goals using machine learning, deep learning, or both. . Combine the algorithms of each model in Method 800 (for example, in your own way) Alternatively, it can reach the exact location of surgical instruments within multiple tally bags and provide the user with additional information. It can be provided. In some exemplary embodiments, a method for tracking surgical instruments is , relying on two or more independent aggregation approaches, as well as one or more error reduction techniques. This leads to a robust method for counting surgical instruments. (See Figure 8 for details of the method described.) (For example, what is considered an overall tracking algorithm) is described in relation to the aggregation bag. However, method 800 does not include instruments (e.g., surgical instruments) that are composed or included in any suitable manner. ) can be used to aggregate them. Furthermore, the steps of method 800 shown below can be used to aggregate them The actions do not need to be performed in the order described or depicted in the flowchart shown in Figure 8. They can be executed in any appropriate order.

[0044] As shown in Figure 8, the input to method 800 is one or more tally bags (810) This is an image of one or more tally bags 810. It can be obtained using any suitable method. Several exemplary embodiments So, the user can use the mobile device 720 (for example, a cell phone or tablet) Using the Mera 722, we obtain an image of the tally bag 730. However, the digital camera Among various imaging systems such as cameras, computer cameras, and video cameras You can obtain the input image using any one or more of the following. Next, the image is The image may be received by a lossr. The image may be preprocessed for subsequent analysis. Image preprocessing includes, for example, brightness normalization, contrast correction, and one or more deep learning techniques. Image size reduction to dimensions suitable for processing by learning or computer vision models, or may include any appropriate combination thereof. Imaged aggregation bags (e.g., aggregation) Total number of surgical instruments in bags 400 or 730 (e.g., first count, second count) The decision of whether to perform further aggregation or any appropriate combination thereof depends on the aggregation batch in the image. Aggregation bag detection model 840 for detecting the presence of aggregate bags, geometric features (e.g., aggregate bags) (The dimensions and other features of one or more pockets within the bag and tally bag) A scrutiny bag shape model 830 for creating a scrutiny bag, and for detecting the presence of any device inside the scrutiny bag. Surgical instrument detection model 850 for each pocket containing a surgical instrument (e.g., general or Empty / full pocket classifier model 860 to determine the presence or absence of a specific type, or picture To synthesize information about surgical instruments in the imaged tally bag, the imaged tally bag An instrument counting model to provide an index of surgical instruments in a bag, or to do both. This includes analyzing images using one or more of various computing techniques, such as 870. Obtain. In some exemplary embodiments, after any pretreatment operation, method 800 uses a collection of instruments. Use two or more routes in total. For example, one route directly accesses the surgical instruments in the collection bag. Based on contact detection, one route identifies the pockets in the collection bag, and the pocket This may be based on classifying them as empty or full. Next, method 800 is a multiple aggregation path The results can be combined using one or more error detection algorithms. This allows for the final confirmation of the location of surgical instruments.

[0045] The 840 aggregate bag detection model preprocesses one or more aggregate bags for analysis. It can receive processed or unprocessed images. Aggregation bag detection model 8 40 is at least one or more trained machine learning or deep learning models Based on partial findings, the presence of at least one aggregation bag in the image can be identified. An example of an object detection model is a faster region-based convolutional neural network (R- CNNs, single short detectors (SSDs), and region-based fully convolutional networks (Includes R-FCN) and can achieve high performance in object detection tasks. Aggregation bag detection model 840 also utilizes one or more such trained models to image Identify the location of each tally bag inside, and one or more edges, corners, or of the tally bag. Both, or any suitable combination thereof, can be identified or aggregated. For example, as shown in the exemplary graphical user interface in Figures 9 and 10. As described above, the tally bag detection model 840 detects the presence of the tally bag 910 and displays In the image (for example, indicated by the corresponding bounding box), the aggregation bag 910 The location can indicate one or more boundaries of the tally bag 910, or both. In several exemplary embodiments, the tally bag detection model 840 identifies the tally bags according to the following Then crop the tally bag image (for example, the part of the image corresponding to the identified tally bag). (In order to effectively separate them), the aggregated bag image 84 was trimmed for later use. It can output 2.

[0046] The tally bag shape model 830 contains geometric information about one or more tally bags. For example, the vertical and horizontal dimensions of the collection bag (e.g., collection bag 400 or 730), The location of that pocket (e.g., pocket 410), or both, can be encoded and identified. This helps identify specific geometric features of the collected tally bags. Tally bag shape model 83 The aggregate bag dimensions 812 encoded within 0 (for example, whether or not other geometric information is present) For example, the manufacturer of the tally bag (e.g., brand or manufacturer), the model, etc. It may depend on both, and may be pre-encoded (for example, the specific manufacturer of the sizing bag). (or manually enter as associated with the model), learn from the training data. It is possible. In some exemplary embodiments, the collection bag shape model 830 is Other relevant information that may be helpful in identifying, analyzing, or both of the shapes of the collection bags. Whether present or not, one or more locations such as the corners 814 or edges of the tally bag. It can accept input. In some exemplary embodiments, the shape of the collection bag is Identified at least partially based on the knowledge of the manufacturer of the tally bag, this is user input As a force (for example, through the user interface of a mobile application) The data may be entered by the tally bag, an identifier code on its packaging (e.g., barcode, Scan a QR code (registered trademark, etc.) or directly scan the image of the tally bag. By recognizing the manufacturer of the product (e.g., label, distinctive color features, distinctive geometry) Identified based on optical character recognition of scientific features, or any appropriate combination thereof. It is possible. For example, the user can input the manufacturer of the tally bag, and the shape model is Known information can be used to help determine the geometric information of the tally bag. As another example, a user can apply a reference marker to a summary bag, or to its pocket. To resize one or more virtual contours to define, or both Therefore, manually set the boundaries of the tally bag, its pockets, or both on a mobile device. This can be identified by the aggregate bag shape model, which is homography or one or more. Using other perspective transformations, the location of the pockets in the calculation can be automatically identified. Based on these positions, the tally bag shape model 830 is an empty / full pocket classifier model. For acceptance by 860, the images of each tally bag pocket are cropped. So, the tally bag shape model 830 is the pocket image 832 (for example, the tally bag pocket) It supports cropped image segments, or any appropriate combination thereof. This can provide identification of parts of the image, and this can also provide pockets, those pockets This may include information regarding the location of the corner 834, or both. For example, as shown in Figure 9. As shown in the illustrative graphical user interface, the aggregate bag shape model 830 detects the position of the tally bag, the shape of the pocket of the tally bag, or both. In the displayed image, the pockets of the tally bag (for example, pockets 920A to 920C) It can be shown and has pockets indicated by the corresponding bounding boxes.

[0047] As described above, method 80 for tracking surgical instruments (e.g., by tallying them) There are several exemplary embodiments (e.g., variations) of 0. So, does the surgical instrument detection model 850 use deep learning algorithms or other appropriate artificial intelligence? Using the model, each surgical instrument is generated by the aggregation bag detection model 840. Surgical instruments in image 842, including the instruments (e.g., each surgical fiber) and trimmed tally bags. Identify the position of the instrument. The deep learning algorithm used in the surgical instrument detection model 850 is , a dataset representing a diverse array of aggregated bag images (for example, a reference dataset or others) The model can be trained on the training dataset, and each model can be trained on each surgical instrument in the image. The instruments are labeled with IDs. Therefore, deep learning of surgical instrument detection model 850 The algorithm identifies surgical instruments (e.g., surgical fibers) in each collection bag within the image. It can perform location identification, or both. The surgical instrument detection model 850 is an aggregation machine. It is possible to generate data regarding the boundaries of each surgical instrument within the bag. In the case of surgical fibers... This can be done, for example, by identifying the corner portion 852 of the fiber. The surgical instrument detection model 850 detects all detected instruments in one or more tally bags. Provides the location of surgical instruments and the total number of surgical instruments in one or more totalization bags (e.g.) (the first total, the second total, further totals, or any appropriate combination thereof) It can enable decision-making.

[0048] In a particular exemplary embodiment, the empty / full pocket classifier model 860 collects pockets. Analyze images of one or more aggregate bags identified by the aggregate bag shape model 830. This allows you to identify whether each pocket is full or empty. (Counting bag shape model 830) Therefore, the cropped images of each pocket generated are used in the empty / full pocket classifier model. Received by 860. Empty / Full Pocket Classifier Model 860 determines which pockets are empty. Therefore, to identify which pockets are full, label them with an empty / full pocket identifier. A deep learning algorithm trained on a dataset of labeled aggregated bag images. It can be used. Examples of suitable object classification networks include Inception. ResNet, MobileNet, MnasNet, and EfficientNet These include: Empty / Full Pocket Classification. Output 862 of the device model 860 indicates that in one or more tally bags, which pockets are empty? It includes information indicating which pockets are full. Therefore, it classifies pockets as empty / full. Instrument model 860 aggregates surgical instruments in one or more aggregation bags (e.g., the first Determining the appropriate steps (tallying, second tallying, further tallying, or any suitable combination thereof) is possible. To enable this. Figures 9 and 10 show the output 862 of the empty / full pocket classifier model 860. An example of the corresponding display is shown. Information (e.g., surgical instrument detection model 850, empty / full pocket) Based on a combination of the 860 classifier model, or both, the aggregate bags are , full collection bags (for example, as shown in Figures 9 and 10), partially full collection It can be identified as a counting bag or an empty counting bag. Furthermore, as shown in Figures 9 and 10 To enable this, each pocket in the image of the tally bag is a surgical sponge (for example, pocket 9 As including, or as containing, detected surgical instruments such as 20A and 920B) It can be individually identified as not containing surgical instruments (e.g., pocket 920C). The instrument aggregation model 870 synthesizes information generated by one or more of the aforementioned models. Then, various information about each analyzed image is generated. For example, the instrument aggregation model 870 This involves prior information (for example, the shape of the determined tally bag, the detection of surgical instruments, or both). Post-processing can be performed using the method, and one or more surgical instruments (surgical fibers) can be used. (e.g.) to reach information about one or more tally bags, or both, It provides the final number of surgical instruments, the location of the counting bag, and the number of one or more surgical instruments. Position, the location of one or more empty pockets, and the location of one or more full pockets These are examples of placement. As shown in Figure 8, the instrument aggregation model 870 is one of the aggregation bags in the image. The total equipment count within 872 can be determined. For example, in equipment count model 870, 1 Information from one or more of the aforementioned models can be used, and surgical instrument detection model 8 50, empty / full pocket classifier model 860, or both, etc., and tally bag 8 Determine the number of surgical instruments per 72. Further, in some exemplary embodiments, the instrumen counting model 870 variously combines information from one or more other models described above in different ways, uses a combination of multiple methods to determine instrument counting, compares the counts reached using each method (e.g., verifies the numbers against each other), and determines the fi nal surgical instrument count.

[0049] For example, the instrument counting model 870 may, as described above, compare a first estimate of su rgical instruments generated by the surgical instrument detection model 850 with a second estimate of s urgical instruments generated by the empty / full pocket classifier model 860 as described above, and d etermine a surgical instrument count (e.g., a first count of surgical instruments or a second count of surgical instruments). In other words, the instrument counting model 870 can compare positions of det ected surgical instruments in a counting bag obtained using two different types of deep learning mode ls (e.g., by comparing object detection results from the surgical instrument detection model 850 with object classification results from the empty / full pocket classifier model 860). In some exemplary emb odiments, the instrument counting model 870 receives information related to surgical instruments (e.g , surgical gauzes) identified and detected by the surgical instrument detection model 850 to determine a first estimate of the surgical instrument count. The instrument counting model 870 can generate a sec ond estimate of the surgical instrument count using information generated from the empty / full pocket c lassifier model 860. If the surgical instrument counts generated using both methods match, the instrum ent counting model 870 uses the matching count as an output when providing the count of instruments p This is possible. If the two counts do not match, the instrument counting model 870 performs surgical instrument detection. This unique approach combines the outputs of Model 850 and the empty / full pocket classifier Model 860. This can be addressed by using a novel approach, which is described below. To improve the accuracy of tracking (e.g., aggregation) by modifying the aggregation, such as by using an approach that involves collecting data. This may involve utilizing knowledge of the shape of the bag.

[0050] The instrument aggregation model 870 also provides one or more resolutions of one or more instrument aggregation estimates. One or more methods can be used to verify the status (for example, surgical instrument detection model) (If the aggregation based on Dell 850 and the empty / full pocket classifier model 860 does not match.) For example, the instrument aggregation model 870 is identified or aggregated by the aggregation bag shape model 830. The total number of pockets, and the identification or collection by the empty / full pocket classifier model 860. The total number of full or empty pockets is taken, and the surgical instruments (e.g., surgical fibers) are... , in the pockets of the tally bag (for example, if there is only one surgical instrument in each full pocket) (Based on the assumption that) the number can be determined. For example, in the aggregation bag shape model 830 Therefore, there are 10 pockets that can be identified, and one pocket is labeled as empty. Or, if 9 pockets are labeled as full, then, instrument counting model 8 Using this information, 70 can determine that the total number of surgical instruments is 9.

[0051] As shown in Figure 8, additional useful information is the determination of one or more summaries of surgical instruments. In addition to the standard (for example, the first or second counting of surgical fibers in the counting bag), various models Based on information obtained from one or more of the following, it may be provided in accordance with Method 800. For example, the instrument aggregation model 870 can provide the aggregation bag position 874 in the image. Yes, this is useful for automatically highlighting all summary bags for visualization. It is possible. As another example, the instrument counting model 870 shows which pockets of the counting bag contain surgical instruments. The location of identified or counted surgical instruments within the counting bag, including whether or not they contain any materials. This information may be provided. This information may include, for example, one or more error corrections as described below. This information can be used in the following methods: It can also be useful in determining compliance with protocols for aggregation. If the upper pocket of the counting bag contains surgical fibers, but the lower pocket of the counting bag is empty... In addition, this is an approved method where the user needs to fill the pockets of the tally bag from bottom to top. This could indicate that the aggregation protocol was not followed. Another example of useful information is the instrument aggregation model. The Dell 870 can provide images of empty and full pockets in the tally bag. This also helps in determining compliance with aggregation protocols and surgical instruments. Verification of the location or number of surgical instruments, tally bag for simple evaluation by end-users It can serve to highlight the location of empty pockets inside, or both.

[0052] An example of combining models to reduce aggregation errors. Method 800 (for example, a comprehensive tracking algorithm for tracking surgical instruments) Examples include the surgical instrument detection model 850 and the empty / full pocket classifier model 860. By combining multiple (for example, several) models (for example, deep learning models), and knowledge of the counting bag shape (e.g., from counting bag shape model 830) to remove or mitigate vari ous types of errors, thereby improving the accuracy of tracking (e.g., counting). A unique and innova tive approach can be adopted to achieve this improvement. For illustrative purposes, examples of two methods for combining multiple models are described below.

[0053] In an example of combining multiple models to improve overall tracking accuracy, different models may be combined to correct or address common errors in instrument counting models. For example, a first type of error occurs when there is a false detection of the presence of a surgical instrument (i.e., failure to detect the absence of a surgical instrument), which leads to reduced accu racy and incorrect counting of surgical instruments. A second type of error occurs when there is a false detection of the absence of a surgical instrument (i.e., failure to detect the presence of a surgical in strument), which leads to reduced recall and incorrect counting of surgical instruments.

[0054] In some exemplary embodiments of method 800, one or both of these types of errors can be resolved by algorithmic matching (e.g., algorithmic error correction). For example, false detection of the presence or absence of a surgical instrument may be addressed based at least in part on the assumption that the position of a detected surgical instrument should closely match the position of a detected pocket of the counting bag. Accordingly, one or more error correction models can identify and reject "identified" surgical instruments whose determined positions do not match the determined positions of counting bag pockets. For example, the error correction model can identify detected The center of the surgical instrument (e.g., center of gravity) and the closest summation obtained from the shape of the tally bag. Based on the Euclidean distance between the center of the bag pocket and the identified surgical instrument, it is rejected. It is possible. In other words, the center of the detected surgical instrument and the center of the nearest counting bag pocket If the Euclidean distance between them exceeds a predetermined threshold, the error correction model identifies that A surgical instrument may be rejected as an error (for example, as being misidentified), therefore This identification will not be included in the count of surgical instruments. The remaining (not rejected) identified surgical procedures The correspondence between the instrument and the counting bag pocket is established based on the shortest Euclidean distance. This is possible. In other words, the error correction model determines the identified pocket closest to each instrument. By doing so (for example, to verify that each surgical instrument corresponds to a pocket), Surgical instruments can be aligned with specific pockets.

[0055] Once the procedure is established, a comparison will be performed between the device detection results and the empty / full pocket classification results. This is possible. For example, the surgical instrument detection model 850 can detect surgical instruments that actually exist (as described above). If an instance of the second type of error cannot be identified, the empty / full pocket classifier will fail. This error occurs because the Dell 860 identifies that the corresponding pocket is full (for example) (This can be corrected by the error correction model.) Similarly, the surgical instrument detection model 8 Surgery in pocket 50 determined to be empty based on the empty / full classifier model 860. If the instrument is misidentified, this instance of detection is (for example, error correction model) It may be rejected by (the party).

[0056] One of the advantages of this algorithmic matching approach is that the training data required for implementation is Less data is required, and compared to using a single model alone, tracking of surgical instruments is improved. The performance will be improved (for example, by using only surgical instrument detection model 850, (Alternatively, use only the empty / full pocket classifier model 860.)

[0057] In other exemplary embodiments, the aim is to improve overall tracking accuracy and reduce aggregation errors. The objective is to combine multiple models to form a tracking ensemble network. This is possible. For example, one or more training sessions, as described in more detail below. In addition to using the technology, the ensemble of surgical instrument detection networks is one or more It is trained using multiple appropriate ensemble learning techniques (e.g., snapshot ensemble). It can be nerfed.

[0058] As an example, a penalty clause is added to the training of the surgical instrument detection model 850. It can be added. Specifically, a penalty clause can be added so that the detected location corresponds Surgical instruments that are not close to (for example, the nearest) pocket location (for example, within the threshold distance) By automatically penalizing detection, the loss function of the surgical instrument detection model 850 is It can be corrected. The penalty clause is, for example, the detected surgical instrument (e.g., surgery The corners of the fibers used and the corners of the collection bag pocket (for example, using collection bag shape model 830) This penalty term may relate to the distance between (determined by the surgical instrument detection model). Adding directly to the 850 training is a tally bag (for example, a sponge bag). By incorporating prior knowledge regarding the shape of other collection bags, and therefore, surgical instrument inspection The output of model 850 is placed in the pockets of the aggregation bag (e.g., the pocket grid). Effectively restricts to the vicinity. Furthermore, the end-to-end of the surgical instrument detection model 850 The training was carried out, and the geometric information of the tally bag that was available during the training phase The information can be automatically taken into consideration.

[0059] Furthermore, in this example, an ensemble of multiple device detection networks of different types is, Randomly, or using a method such as K times, the training dataset (for example, further as follows) Modifying the dataset (as described below), one or more hyperspaces of the network Lameter (e.g., depth, regularization, penalty weight, or an appropriate combination thereof) Change which hyperparameters, and ensembles such as snapshot ensembles It can be trained by performing learning techniques. Similarly, multiple different types of empty The ensemble of full pocket classification networks changes the network architecture. You can either change the network's hyperparameters (for example, as shown above), or Alternatively, training can be performed using any appropriate combination of these methods.

[0060] Finally, all different instrument detection networks and all empty / full pocket classification networks The results from the network suggest a new layering that could be called a tracking ensemble network. It can be used within a generalized network. A tracking ensemble network is used for each answer. To learn how to best combine predictions from group members, individual validation days Training individually on sets of data (for example, "holdout" validation sets) Yes, it is possible. This separate training improves the overall accuracy of tracking (e.g., aggregation), as well as each individual. Prediction of surgical instrument placement, prediction of each empty / full pocket, or any appropriate combination thereof. It can help improve accuracy. For example, a tracking ensemble network can improve accuracy in 10 dimensions. Evaluate the vector (for example, 'l' indicates a full pocket, 'O' indicates an empty pocket). In the case of a 10-pocket tally bag, the predicted occupancy vector is calculated accordingly (for example, Competing ensemble instrument detection networks and empty / full pocket classification networks. The loss function is calculated based on the inner product of the ground truth occupation vectors. Therefore, once trained, the tracking ensemble network will perform all 800 methods. To improve the overall accuracy (e.g., the overall tracking algorithm), ensemble objects The predictions from both the detection and object classification networks can be quantified. Therefore, the grid penalty and ensemble approach described above are more difficult to implement. While a large amount of training data can be used, it further enhances the performance of Method 800. This can be improved.

[0061] Examples of training data collection The success of training one or more of the above models is representative of the training examples. Collect a dataset and select the instruments (e.g., surgical instruments) within the dataset for the desired final goal. This can be helped by appropriately labeling the components. One such dataset is... Or, multiple, for example, representative, such as an operating room or a trained model. This may include deformation of the aggregated bag image that is expected to be seen with other settings used. Then, one or more of the above methods 800 (e.g., tracking algorithms) models The dataset used to train Dell is, as described below, "Good It may include both "good" and "bad" images.

[0062] In some exemplary embodiments of model training described herein, good The image shows a complete front view of the tally bag, properly oriented vertically (e.g., side view, top view, It may feature a tally bag from a (not angled) photograph, and no part of the bag is other Not blocked by objects. Good resolution, sufficient to read the text on the bag. It can focus on images. (This applies to some mobile computing devices, etc.) Imaging devices can automatically capture images with sufficient resolution by default. The sizing bag for the statue has intact pocket dividers (for example, seams dividing the pockets) (It does not tear), and each pocket may contain 0 or 1 surgical instrument. Method 800 One or more models include images depicting the deformation expected during various medical procedures. It can be trained with a series of good images. For example, the training dataset may include As shown in Table 1 below, the tally bag, image background or settings, or both can be changed. It may include one or more shapes. [Table 1]

[0063] In some exemplary embodiments of model training described herein, a bad picture The images include those where it is difficult to detect features of a sizing bag or surgical instruments, and are generally difficult to analyze. However, it may include images that are difficult to process (for example, poorly lit, blurry, or both). (This is the cause.) Bad images are likely to be sent by users during practice, so the deformation of bad images is important. Train one or more models to be resilient to incomplete images in aggregation bags. It may be useful to create one or more robust aggregation models with these poor drawings. The statue uses a "guardrail" algorithm that can warn users about incorrect use of the tally bag. It can also be used to help create a video, and to warn the user when a bad image is taken. Users can be notified to provide better images (e.g., a new, sharper image). Examples of bad images include a bag obscuring an object in the foreground (e.g., a user's hand, a handrail, a tube). Images obscured by (or any suitable combination thereof), pocket dividers From an angle where the seal of the pocket (for example, between two or more surgical instruments) is difficult to see. The tally bag contains the photographed image and has a torn pocket divider or torn pocket seal. Image (for example, one large pocket where such a slit should have two separate pockets) If a pocket is created, the image shows multiple surgical instruments in one pocket, and the lighting is incorrect. Other cases that may generate images where it is difficult for the algorithm to analyze and extract features. Images taken under the conditions, images having one or more combinations of the above embodiments. The image is included.

[0064] Other examples of validation for aggregation In some exemplary embodiments, the methods described herein relate to Method 800. One or more additional checks to provide further checks (e.g., independent checks) This may include a verification stage. Providing one or more additional checking methods for surgical instruments The accuracy of location confirmation can be improved. Such additional methods include the location of surgical instruments in the tally bag. This may include prompting users to manually verify the aggregation. Such additional methods could be User detection of information generated by one or more of the various submodels of Law 800 This may include requiring proof. For example, one or more of such additional methods are The 800 correctly identifies pockets, correctly identifies tally bags, and correctly identifies full pockets. Separate and correctly identify the surgical fibers in the pocket, or any appropriate combination thereof. This may include asking the user to verify that they have done so. For example, Figure 11 shows a mobile device. An exemplary embodiment of a display on a vise is shown, the display being provided by Method 800 Verify that the number of identified and counted surgical instruments (e.g., surgical sponges) is correct. The user is being prompted to do so. This is indicated by the box surrounding the surgical instrument in Figure 11. Therefore, one or more of such additional methods may be identified as surgical instruments in Method 800. This may include displaying information to the user indicating that something has been done.

[0065] In certain exemplary embodiments, the method described herein uses weight information to perform surgery This may include verifying the count of the equipment used. For example, the port to which the counting bag is attached. The pole can be attached to a scale. The scale attached to the pole is used for counting surgical fibers. Each time it is placed on the bag, it senses the change in weight, and therefore the weight sensed by the scale. The number of surgical instruments can be tallied based on the number of increments in volume. The scale can be placed on the pole in any appropriate manner. They can be combined. For example, a mounting pole, a tally bag, or both. It can be placed (for example, a mounting pole, a counting bag, or both on top of the scale) (Place the device and measure the change in weight when it is added to the tally bag.) Alternatively, This is an exemplary form of a strain gauge, attached to a mounting pole and connected to a tally bag. It can take a certain position (for example, one end of a strain gauge is suspended from a mounting pole) (The tally bag is suspended from the other end of the strain gauge.) Some examples In an exemplary embodiment, weight information is generated by one or more other methods. Instead of, or in addition to, the following are generated from one or more surgical instrument collection containers: Obtain. For example, the collection container may include a weighing system. The user can obtain surgical samples from the collection container. When the instrument is removed, the weight measurement system detects the decrease in weight, and the fibers of the surgical instrument are collected. It is determined that it has been removed from the container. The processor records the number of weight reductions and the collection container. The total number of surgical instruments removed, and therefore the surgical instruments that were previously in the collection container. The total amount of ingredients can be determined. Therefore, using one or more collection containers Additional checks may be provided regarding the counting of surgical instruments (e.g., surgical fibers).

[0066] In various exemplary embodiments, the methods described herein involve surgically removing the contents from a collection container. This may include using time data from the removal of the instrument, and the surgery in the tally bag. The arrangement of instruments can provide additional validation for surgical instrument counts. For example, the processor can be heavy Each time the quantity measurement system detects the removal of a surgical instrument from the collection container, a timestamp is generated. It can generate. Furthermore, the processor allows the weight measurement system to hand into the tally bag. A timestamp can be generated each time an additional surgical instrument is detected. One or more times. The number of processors records the timestamp of the removal of surgical instruments from the collection container (for example, (Discharge timestamp) and additional timestamps for surgical instruments added to the tally bag (for example) Compare with additional timestamps and verify the aggregation of surgical instruments (e.g., additional verification). It can be configured to provide the retrieval timestamp and append timestamp. If it matches, it provides information indicating that the count of surgical fibers is correct.

[0067] Example of a decision for interim tally In some exemplary embodiments, the determination of the second tally is based on the medical procedure (e.g., surgical procedure). This includes determining an intermediate count of surgical instruments during the process. In an alternative exemplary embodiment, The second tally decision is to determine the final tally of surgical instruments after the completion of medical procedures. This includes, for example, the methods discussed herein for tracking surgical instruments (e.g., Method 8). 00) A second collection to confirm the location of surgical instruments at any point during the course of medical procedures. This may include comparing the total (for example, as an interim or final total) with the first total. Various exemplary embodiments of such methods, whether they are interim or final tally Then, use one or more of the above algorithms to determine the second aggregation. It may include.

[0068] The decision to make an interim tally of surgical instruments may include updating the indicator counters for surgical instruments. In some exemplary embodiments, the update of the indicator counter is performed on one or more of the aggregation bags. A tally bag containing one or more surgical instruments (e.g., surgical fibers) in several pockets. This includes analyzing images. The collection bags are filled with surgical fibers by the user. One or more images of the aggregation bag may be generated. One or more processors, It is possible to receive one or more images of the collection bags and one or more of the above technologies Using one or more computational techniques such as the above, one or more images are processed to make one Alternatively, it can identify and count surgical fibers within multiple counting bags.

[0069] In some exemplary embodiments, instead of analyzing images of a tally bag containing surgical instruments, In addition to or from analysis, the methods described herein involve placing a hand within the camera's field of view. This includes holding surgical instruments. For example, the user holds surgical instruments (e.g., surgical sponges). You can hold surgical fibers (such as ji) up to the camera, and the camera will capture an image of the surgical instrument. It can generate an image. The image can detect the presence of surgical instruments depicted within it. It can be received and analyzed by one or more processors configured as follows: Surgical instruments Images of the instruments can be used to track surgical instruments. For example, indicator counters. The surgical instrument is held up to the camera and identified by one or more processors. It can be updated. In some exemplary embodiments, a surgical instrument held up to the camera The metric counters, updated using image analysis, verify the number of metrics for surgical instruments. Further updated fingers using image analysis of surgical instruments in one or more tally bags It can be compared with the target counter (for example, as shown above). Figure 13 shows individual surgical counters Images of instruments (e.g., surgical fibers) are acquired and analyzed, and a collection of such surgical instruments is formed. This shows an example of a graphical user interface for updating the meter. Specifically, the user The 1210 captures images (e.g., depth images, color images, or both). A surgical fiber 1220 is held in front of the camera, and as a result, one or more processing structures are observed. The component (e.g., a processor) can identify the surgical fiber 1220 in the image and image it. Surgical fibers 1220 may be included in the instrument assembly 1230. An example of a symmetric The stem and method are described in U.S. Patent No. 8,897,523 and U.S. Patent Publication No. 2017 / Further details are provided in document 0186160, and each of these is by reference The entirety of this is incorporated herein. Furthermore, the amount of blood loss is estimated as described below. One or more methods described herein for tracking surgical instruments It can be used in combination with multiple methods, and therefore the user can use 1 for image creation. This may include holding one or more surgical instruments up to the camera.

[0070] The decision regarding the interim count of surgical instruments is made when the containers are filled and imaged, either one or multiple times. An index counter is used to measure the number of surgical fibers in a number of containers (e.g., one or more counting bags). This may further include updating. This process is repeated throughout the entire medical procedure. The indicator counter is continuously updated, and at any given time, one or more containers are loaded for surgical use The execution count of instruments (e.g., surgical fibers) can be maintained. In some exemplary embodiments, The interim total (for example, the current value of an indicator counter) is compared with the first total for the surgical instruments. This may be desirable in some cases. For example, the user loads the items into a set of collection bags and confirms their location. The number of approved surgical instruments, and the number of surgical instruments currently in use or whose whereabouts are unknown. Sometimes you need to know the number of devices.

[0071] Specific exemplary embodiments of the methods described herein may be used at any appropriate time during a medical procedure. This includes displaying or otherwise providing interim summaries to the user. This provides useful information regarding the number of surgical fibers located at a given point in time. This may be provided to the user. Figure 14 is a graphical user that displays information about the interim summary. The example of interface 1300 is shown. Box 1310 on the screen in Figure 14 is S Surgical sponges whose location has been confirmed, compared to the first count of Pongee (e.g., "40") This shows the total number (for example, "17"). Furthermore, the location of the surgical sponges has been confirmed. Information related to the type (e.g., brand, size, function type, etc.) is in box 13. Displayed at 20, 1330, and 1340. Graphical User Interface S1300 also allows the user to select the "aggregated" icon 1350. Update the summary in step 1 and determine the final summary by selecting the final summary icon 1360. It provides a function that makes this possible.

[0072] Example of detecting duplicate images Some exemplary embodiments of the method described herein are those in which a particular collection bag is previously This may further include determining whether the image has been visualized and analyzed. Multiple users Because images can be taken of the counting bag, multiple surgical instruments, or both, individual counting Bags, individual surgical instruments, or both may be incorrectly imaged multiple times, and the surgical instruments This can lead to inaccurate calculations. To counteract these results caused by careless duplicate images, Analyze one or more images to determine the likelihood that they depict the same aggregate bag as other images. The scale can be determined. It can be determined whether the tally bag has already been located. An example of such a method is when the first image and the second image are of the same fiber (for example, the same aggregate). To measure the likelihood of having an image area that depicts at least a portion of the inside of the bag or This may include determining by other means. The first and second images are of the same fiber An exemplary method for measuring the likelihood of having an image region that depicts at least a portion of it is, PCT application PCT / US2017 / 068, which is incorporated in its entirety herein by reference. Details are provided in issue 234. Images of specific tally bags have already been received and analyzed. An example method for determining whether or not it is present is to have the first image region depict the tally bag. The first image is received, and the second image is received in which the second image region depicts the tally bag. This means that the first aspect of the first image, the second aspect of the second image, or both, are at least This may also include defining at least one classification function based on a partial basis. The exemplary method involves first and second image regions depicting at least a portion of the same collection bag. This may further include measuring the probability of a certain outcome, and measuring the probability involves learning a classification algorithm. It is at least partially based on classification functions, such as by using machines. The method may include comparing the measured likelihood of duplicate images with a predetermined threshold, where the threshold is Cutoff for classifying image pairs as "non-overlapping" or "potentially overlapping" or including the first and second image regions are the same surgical fiber or To measure the possibility of depicting at least some of the other surgical instruments, a similar process was used. It can be executed.

[0073] If method 800 determines that the possibility of duplicate images exceeds a predetermined threshold, follow Up-action may be prompted. For example, generally, the obtained tally bags or surgical instruments. Each new image of the instrument may correspond to an increase in the total number of surgical instruments (for example, the second Surgical instruments extracted from the sterile area of ​​a patient or surgical procedure for tabulation, tabulation is The bag, surgical instruments, or both may have been imaged and measured multiple times. It can also be adjusted based on partial considerations. Potential of surgical tally bags or surgical instruments Duplicate image detection is performed, for example, when a collection bag, surgical instruments, or both are imaged multiple times. A prompt may be triggered to the user to confirm whether it has been done. As another example, Detecting potential duplicate images of tally bags or surgical instruments increases the tally of surgical instruments. It can be automatically refrained from doing so. Whether the tally bag has already been digitized or not Exemplary methods for determining this may include the use of identification tags. For example, tally bags, surgical bags. The device, or both, may include scannable tags (such as RFID tags or barcodes). A scanner can be used to determine if the counting bag has already been imaged. The scanner can be a separate scanning device or it can be integrated into a mobile device. i. Instead of, or in addition to, one or more techniques including image analysis, tags or One or more exemplary methods, including scanning a barcode, can be used. .

[0074] Example of final calculation The second count may, in some exemplary embodiments, include the final count of surgical instruments. For example, exemplary embodiments of the methods described herein determine the final count of surgical instruments. This may include comparing the final count with the first count of surgical instruments. The calculation, for example, is based on the location of surgical instruments at a point in time when they are no longer introduced or used in a procedure. This is distinguished from the interim count based on the final location confirmation, which refers to the total number of surgical instruments that have been identified. It is possible. For example, the final tally may be performed at the end of the medical procedure. The end of the medical procedure is It can be indicated by any appropriate method. For example, the completion of a medical procedure may be indicated by hand after the surgical site has been closed. After all surgical procedures have been performed on the patient except for closing the surgical site, the patient is surgically removed. When ready to take it out of the room, or at any other time suitable to use as final instructions. It can be a point. In some exemplary embodiments, the final calculation is prompted by the user. It is possible. For example, a mobile application or other computing program may have a final calculation. It may be possible to allow the user to indicate when the results will be displayed (for example, the final summary icon in Figure 14). (Selection of 1360). In some exemplary embodiments, the mobile application is particularly Based on the specified instructions, the total number of surgical instruments should be labeled as the final total. The user can be prompted to verify this. For example, the metric counter is the value of the first aggregate. When it reaches this point, the mobile application displays the current value of the metric counter as the final total. The user can be prompted to confirm whether or not to proceed. In other exemplary embodiments, In mobile applications, the metric counter will be finalized after a certain period of time has elapsed. The user can be asked to indicate whether or not it should be shown.

[0075] Examples of providing notifications based on the first aggregate, the second aggregate, or both. Various exemplary embodiments of the methods described herein for tracking surgical instruments include: This may include comparing a first count of surgical instruments with a second count of surgical instruments. For example, Some exemplary embodiments of such methods for tracking surgical instruments are as described above. This includes comparing an intermediate aggregate (for example, between one or more intermediate aggregates) with a first aggregate. A particular exemplary embodiment of such a method involves comparing the final aggregate with the first aggregate. And whether the final count matches, and therefore all surgical instruments introduced into the operating room. This includes determining whether the location of the ingredients has been confirmed. It also involves comparing the final count with the first count. By doing so, medical staff can confirm the location of all surgical fibers or other surgical instruments. It can be confirmed that it is not held by or within the patient. A few exemplary embodiments show whether the first aggregate matches the second aggregate (for example, the final This may include notifying the user of the aggregated or interim aggregated results. For example, such a method A typical exemplary embodiment includes a first aggregate, a second aggregate, and a first aggregate that is combined with the second aggregate. A prompt indicating whether to proceed or not is displayed to one or more users; this is a key element in the measurement of surgical instruments. This includes displaying reports.

[0076] Figure 15 shows a graphical user interface that displays a summary of surgical fiber data. An example is shown. The screen in Figure 15 shows the number of fibers "counted" (for example, introduced into the operating room). (t) the number of "out-of-scan" fibers (e.g., those imaged on the tally bag), and unused fibers. This indicates the number of items (for example, items introduced into the operating room but not yet imaged in the counting bag). In some implementations, unused surgical fibers are processed in the same way as used surgical fibers. It is placed in one or more aggregation bags. In some other implementation forms, the unused surgery The fibers used are identified as unused in one or more tally bags, and displayed accordingly on the display screen. They are located using different methods, such as being labeled as described above. In exemplary embodiments, the method described herein is used to ensure that the compared aggregates match. This includes notifying the user (for example, by providing the user with a notification). Such notifications may include a short message informing the user that the aggregate matches, or Knowledge can be a symbol. For example, a notification might have a checkmark or an equals sign next to the first and final tally. Display a number or other appropriate symbol, and when the tally matches, use a specific color (such as green). Displaying a color scheme on the screen that replaces the previous one, and ensuring that the first total and the final total match. If the audio display shows a match, there will be some form of flashing or vibration, or similar signals. This may include reproducing the appropriate combination. Furthermore, regarding Figure 16, see below for more details. As explained in detail, summary reports are for personal reference, hospital records (for accountability purposes) Summary reports may be provided to one or more users for the purpose of, or both. For each of one or more types of surgical instruments, the first total and the final total are calculated. This can be shown. For example, the summary is a first aggregate and a second aggregate, such as the number of “matches” shown in Figure 15. It may include or indicate a comparison between the aggregate and the aggregate.

[0077] In certain exemplary embodiments, the method described herein is used when the compared aggregates match. This includes providing the user with a notification that there is no item. The final count of surgical instruments is the first of the surgical instruments. If the situation does not match the aggregate in 1, the notification may include a warning to the user. The warning will be issued if the location is confirmed. Example of a display that shows the user that there is one or more unauthorized surgical instruments. It can be in the form of (for example, on a mobile device). The display shows the compared aggregate. Except for aspects that contradict showing a discrepancy, the comparison of aggregates indicates that they are equal. Knowledge may include one or more of the above elements. Some exemplary implementations In terms of form, the system notifies the user if the initial total and the final total for surgical instruments do not match. This includes providing a predetermined protocol for proceeding in the event of a mismatch in location verification. For example, notifications to the user involve a predetermined protocol stage (e.g., on a mobile device). (On the screen) Display and instructions on how to handle cases where the first and final totals of surgical instruments do not match. This may include providing accompanying voice cues to both parties. Medical personnel, whose location has been confirmed In the case of surgical instruments that are not available, one or more protocols can be used to precede the procedure. However, additional procedures that are not affected by the potential anxiety of the fact that the whereabouts of the surgical instruments have not been confirmed Providing a benefit (for example, an additional instance of the protocol) allows the user to This may help in adhering to the col. This is the surgical instrument held inside the patient's body. A decrease in instances, better detection of retained surgical instruments when they occur, A more effective response in the case of surgical instruments, or any appropriate combination thereof. This could lead to... If the first total and the final total do not match, the method described herein may be used... Several exemplary embodiments include automatically sending a notification to alert additional personnel, and responding to This may include triggering a protocol, or both. For example, a first that does not match The tabulation and final count are performed by hospital management staff and radiologists (for example, those who generate X-rays for patients). (In order to obtain prior approval), X-ray technicians, additional medical personnel to improve the situation, This may trigger notification to other appropriate personnel.

[0078] If the first tally and the final tally do not match, this specification is used to confirm the location of surgical instruments. Some exemplary embodiments of the method discussed therein are whether or not there are held surgical instruments To determine whether (for example, in the patient's body or retained by the patient) a predetermined This may include executing a protocol. The execution of a given protocol is performed through the protocol. One or more computing tools such as a device and display for guiding the user. It can be done with assistance. The protocol is to first involve all medical personnel in the operating room. This may include notifying the person of any surgical instruments that may be in their possession. Next, Cor recounted all surgical instruments in the operating room and identified any instruments that might have been left behind. This may include checking the room for any missing items. Recounting surgical instruments may involve one or more items. Using the manual aggregation method, or any appropriate combination thereof, one or more This may include operating a calculation and aggregation system. An example of a manual aggregation method is the number of aggregation bags. Recount, recount of the number of surgical instruments in each counting bag, multiple surgical instruments in a pocket Checking each pocket to determine whether it fits, or the appropriate combination of them. It is included. Checking surgical instruments in the operating room involves checking for debris (for example, one piece). (or checking multiple trash cans), checking one or more collection containers, patient Checking the surroundings, for instances of multiple instruments placed in the same pocket Check one or more tally bags, or a suitable combination thereof. It is visible. Even after recounting the surgical instruments and checking for any misplaced instruments, the first and final counts remain the same. If the summaries do not match, the protocol requires taking X-ray images or other internal images of the patient. This may include detecting the presence of surgical instruments retained within the patient. This may include warning the radiologist about the need to take X-ray images and proceeding with radiation. Approval from an orthodontist may be required. X-ray imaging may be additional or alternative. This may include notifying other appropriate medical staff. The protocol does not comply with This may also include notifying other managers or hospital administrators of the total number of surgical instruments used.

[0079] Examples of additional methods The computational systems and methods (e.g., algorithms) described herein are for medical treatment It has broad applicability to influence various improvements in the field. Several exemplary embodiments, as described in detail below, enhance user compliance. Tracking, guiding the user through aggregation protocols, surgical instruments throughout the procedure Tracking the use of instruments, receiving patient and / or operating room information, and specific instructions. Receiving this triggers additional actions, or an appropriate combination thereof. It may include.

[0080] Specific exemplary embodiments of the methods described herein include one or more protocols This includes tracking compliance to [the relevant standards]. User compliance tracking involves aggregation. This includes tracking user compliance to the textile aggregation protocol for using the bags. Obtain. As described above, one or more predetermined procedures are performed on one or more tally bags. One or more desired methods for arranging the ingredients can be controlled. According to the instructions, the operating room staff will check the pockets of each tally bag from bottom to top and from right to left. You may be instructed to fill on the left. Depending on the situation, follow one or more of the methods described above. Using one or more algorithms developed by the user, the bag filling protocol It is possible to evaluate whether it conforms to the standard. Such algorithms are one or more It receives multiple input images and determines compliance based on one or more images. For example, by analyzing a series of images taken over time, it is possible to determine which of the aggregation bags... It is possible to determine if the data was filled in order. In other situations, video analysis can be used to collect The order in which the bags were filled can be identified and tracked. The algorithm uses images Alternatively, the video's timeline is analyzed to determine the order in which the user filled the pockets of the tally bag. to evaluate user compliance with one or more applicable protocols. It is possible.

[0081] Some exemplary embodiments of the methods described herein are non-aggregation protocols. This includes providing notifications when compliance is detected, for example, by such means. This involves displaying warnings to users as a reminder of the appropriate protocol, and hospital management staff Send a notification to the staff, other hospital staff, or both, indicating misuse of the fiber counting procedure. This may include, or any appropriate combination thereof. As another example, such The law could include triggering a warning if other medical professionals intervene in an incorrect filling procedure. For example, a misplaced surgical instrument (e.g., one that violates the prescribed procedure of an applicable protocol). When detecting surgical instruments placed in the pockets of the collection bag, such a method is You can notify your supervisor or colleague to intervene in the bag filling process.

[0082] Specific exemplary embodiments of the methods described herein include aggregation or tracking algorithms. This includes prompting the user to enter their name in conjunction with the use of [the feature]. (Mobile app) The application operates to take images of the collection bags for processing. Before or after, prompt the user to enter their name or other unique identifier. This is possible. For example, a mobile application can provide such identification information. Users can be prompted to scan their ID badge. Compliance Day The data can be combined with identifying information to enhance user accountability. Combining alliance information with user identification information enables hospital administrators to perform appropriate instrument aggregation procedures. This offers the advantage of being able to implement training or disciplinary protocols for users who do not comply. obtain.

[0083] Various exemplary embodiments of the method described herein use a collection bag to collect... This includes guiding the user through a protocol (e.g., a fiber aggregation protocol). Or using multiple computational techniques, for example, one or more visual cues, one or By presenting multiple voice cues, or any appropriate combination thereof, the following Show the user the pocket of the tally bag that needs to be filled, or the user forgets to fill it. It can identify the pocket. For example, the display screen can accommodate one or more users. It may provide visual indicators to guide the user to the next pocket to be filled (for example, around the pocket) (Provide a circle or arrow as a guide, or both.) Therefore, such a method allows users to fill the collection bags through a protocol. It can be guided.

[0084] Some exemplary embodiments of the methods described herein are for one surgical instrument. or include providing multiple other types of tracking metrics. Such methods include medical procedures. It can be used to collect information about medical procedures at various points in time throughout the entire process. For example, such methods include tracking used and unused surgical instruments. It is possible to track used and unused equipment to determine whether the user has used the equipment. This may include manually separating or sorting based on the following criteria. For example, the user may sort used containers. You can put the ingredients in one container and the unused utensils in a separate container. Using various methods, including multiple computational techniques, used and unused containers are identified and used. Used and unused equipment can be counted. Such a method allows for the counting of used and unused containers. This may include taking images of a portion of the operating room, and is one of the image analysis methods described herein. Information can be extracted from images using one or more methods. Used and unused instruments used during medical procedures. The identification and counting of instruments used can provide one or more useful metrics for medical procedures. A single snapshot at a specific point in time during a medical procedure (e.g., at the end of the procedure) is, This may provide information regarding the number of instruments removed from their packaging and the number of instruments actually used. A series of images taken throughout the entire medical procedure are used to distinguish between used and unused instruments. Separate and compile data on how instruments are used over time in medical procedures. We can provide information about them.

[0085] Certain exemplary embodiments of the methods described herein may be used to obtain information related to medical procedures. This includes believing. In such a way, the user can obtain patient statistics or characteristics (e.g., (Height, weight, gender, age, etc.), medical procedures to be performed, expected length of medical procedures, medical Whether the procedure is scheduled or urgent, one or more existing conditions, and other relevant information. Enter patient information (e.g., patient data), such as, or any appropriate combination thereof. This is possible. Such methods involve various approaches to one or more environmental parameters. This may include receiving, displaying, or both, information about which operating rooms are used and which operating rooms are Is it available? Is specific equipment available in a particular operating room? Which medical personnel are currently working on it? This could be due to other appropriate parameters, or a suitable combination thereof.

[0086] Some exemplary embodiments of the methods described herein are events or protocols This includes receiving information that can trigger a response (for example, one held within the patient's body) Or, if it is determined that one or more surgical instruments pose a relatively high risk, (Request or initiation of one or more preventive measures). Such methods may be used by the user in medical procedures. This may include allowing the request for additional tools or equipment for use. Such methods involve the protocol receiving information about one or more specific instructions. This may include triggering one or more specific occurrences during treatment. One or more specific patient parameters indicate a higher risk of a particular event occurring. This may indicate, for example, the threshold values ​​for surgical instruments expected to be used during a medical procedure. Patients with a BMI within a specific range in combination with a number (for example, if the first count exceeds a predetermined count) If this is the case, it may indicate a high risk of surgical instruments being held. One method involves combining patient data with surgical instrument counts once the threshold number of surgical instruments has been aggregated. These may be used in conjunction to trigger one or more additional protocols. Such protocols, for example, involve preparing appropriate equipment for taking X-ray images of a patient. Warn X-ray technicians and notify radiologists to take X-ray images of patients. This may include obtaining prior approval for, or both.

[0087] Certain exemplary embodiments of the methods described herein may present information related to medical procedures. This includes providing information or other means. Such methods include providing a summary report. This may include providing, displaying, or both. A summary report might include, for example, a patient's electronic medical record. As part of this, evidence of compliance with one or more surgical instrument tracking protocols. It can be saved as, or both. The summary report may contain relevant information. As described above, one or more sums of surgical instruments, one or more sums of surgical instruments Information related to multiple comparisons, or both, may be displayed in the summary report. Alternatively, one or more of the individual surgical instruments, individual tally bags, or both. You can save, display, or both save the image as a record (for example, in a summary report). This is possible. However, the type of medical procedure, the length of the medical procedure, patient information, doctor information, and hospital information all need to be considered. Additional information regarding medical procedures, such as reports or any appropriate combination thereof, will also be displayed. Obtain. Measurement criteria for blood loss may also be displayed. For example, using analysis of surgical fibers to determine the patient's blood loss. When monitoring blood loss, the estimated value of blood loss can be displayed in the summary report. The summary report includes medical information. The display may include one or more symbols indicating the result of the procedure. For example, the display may indicate blood loss. This can be a specific color within a given range (for example, blood loss is defined between a given threshold). If the blood loss is within the specified range, the display will be green; if the blood loss is outside the specified range, (May be red). One or more summary reports may be submitted at any appropriate time during medical treatment. One or more summary reports can be generated. One or more summary reports can be displayed on a digital screen (e.g., by phone or tablet). It is displayed on the screen of a mobile device such as a tablet and stored in memory (for example, (As part of the patient's or hospital's electronic medical record), it is saved for later viewing, and the patient or These can be digitally transmitted to medical personnel, sent to printers for printing, or otherwise adapted to their needs. This is a poignant combination. Figure 16 shows information regarding compliance with the aggregation protocol. The figure also shows an example of a summary report that includes additional information about the medical procedures performed. The 16 summary reports include the case number and the location of the case (e.g., which operating room was used). ), the start and end times of the medical procedure, the duration of the medical procedure, the total number of surgical instruments (for example) The person who performed the final count of surgical fibers labeled "sponge" and surgical instruments. It contains information about the name. According to various exemplary embodiments, the summary report is Display any appropriate information regarding medical procedures, including any information described herein. It is possible.

[0088] Some exemplary embodiments of the method described herein involve entering “emergency mode”. One or more methods are provided, and in this mode, some functions of the method or system are provided. It can be changed. For example, the fiber aggregation algorithm (e.g., via a mobile application) (to be implemented as follows) may allow the user to select emergency mode, which is aggregated This could indicate that Rotol is no longer being followed. This would mean that the collection of instrument aggregate data is Stoppage, delay in tracking user compliance to aggregation protocols, emergency to hospital staff One or more of the following actions may be triggered, such as a warning about the situation.

[0089] In certain exemplary embodiments of the methods described herein, one or more images (e.g.) For example, one or more surgical instruments, one or more tally bags, or any of them Analyze the patient's condition (e.g., total blood loss, loss of blood components) to show the appropriate combination of factors. It is possible to estimate (or both). For example, as shown in Figure 12, The cutting device 1100 is an imaging system equipped with one or more cameras 1120. Using TEM 1122, one or more images 1102 of surgical fibers can be obtained. Yes, it is possible. One or more images 1102 show surgical gauze, surgical sponge, or surgical Capture and depict the field of view 1108, which includes surgical fibers 1106a such as a piece of a towel. It is possible. The surgical fiber 1106a can be held by the user. As shown in Figure 12. As such, the captured image, including image 1106b of the surgical fiber 1106a, It can be displayed on a display 1118 such as a computing device 1100. Alternatively, multiple images 1102 show the blood content, blood component content in the imaged surgical fibers. This may include a color image that can be analyzed to estimate, or both. For example, as above As described in incorporated U.S. Patent No. 8,897,523, the color of the color image Features related to (e.g., intensity) are processed locally or remotely for such processing. The tuner system detects blood or blood components (e.g., hemoglobin) within the surgical fiber 1106a. It can be converted into an estimate of the amount of globin (mass, whole blood volume, or both).

[0090] Furthermore, one or more images 1102 are depth images (e.g., infrared data, stereoscopic images). This may include depth information based on the image or both. Degree information makes it easier to distinguish objects in the foreground from other objects in the background. Analyze depth images (for example, U.S. Patent Publication No. 2017 / 01861 incorporated above) As described in issue 60, confirm the presence of surgical fiber 1106a in the image. Then, the computing device 1100 fingers the local surgical fiber counter. A mark can be attached. A local surgical fiber counter can be used by any one of the methods described above or The count of surgical instruments determined by multiple factors (e.g., using image analysis of counting bags). It can be used to verify or as an independent method for counting surgical instruments.

[0091] Example of a system for tracking surgical instruments Furthermore, this specification describes an exemplary system for tracking surgical instruments. Such a system for tracking surgical instruments determines the first count of surgical instruments. It may include one or more components configured in such a manner. For example, such a system This is one or more imaging systems used to determine the first count of surgical instruments. A system, one or more weighing systems (e.g., scales), or any suitable one of them. This may include combinations. Such a system determines a second count of surgical instruments. It may include one or more components configured as follows. For example, such a system may be 1 One or more pockets configured to contain one or more surgical instruments The system may include one or more tally bags. It may include additional equipment used to house and handle a number of surgical instruments. For example, Such a system includes one or more collection containers for holding used surgical instruments. A container, one or more stands for holding one or more tally bags, imaging, One or more mobile computing devices used for image processing, or both. The system may include one or more mounts for holding the vise. One or more images of one or more tally bags or other containers for surgical instruments It may include one or more imaging systems configured to generate a first aggregate. The imaging system used to acquire the second aggregate is used to acquire the second aggregate. It could be the same as an imaging system. Such a system could be a first aggregation, a second aggregation, and It is used when determining both, and one or the other to compare the first aggregate with the second aggregate. It may include multiple processing components. For example, one or more such processing components may be: Analyze one or more images to identify surgical instruments appearing in the images, or to perform surgery within the images. It may be configured to count the instruments used, or both. Multiple processing components include computer vision, machine learning, depth vision, or the processes involved. Using one or more computational techniques, such as the appropriate combination of intentions, the tracking of surgical instruments is performed. The supporting image can be analyzed. Such components (e.g., processing components, image) The imaging component (or both) is one or more mobile computing devices It can be implemented via a chair, each consisting of one or more cameras or other image sensors, One or more processors, one or more displays, or any suitable equivalent thereof. It may include poignant combinations.

[0092] According to some exemplary embodiments of the system described herein, such a One or more computing devices include, for example, a mobile phone, a smartphone, Tablet computers, laptop computers, or any suitable combination thereof Mobile devices such as cameras, processors, and displays may be included. This may include rays, or any appropriate combination thereof. However, certain exemplary... In one embodiment, some or all of the system components described herein are individual It can be isolated as another interconnected device or other component. For example, a camera. The display, or both, is placed substantially close to the tally bag (e.g., in the operating room). On the other hand, the processor may be located in a separate location (for example, the camera, display, etc.) (or in a separate operating room, or outside the operating room), wired or wireless communication network It communicates with the camera and display via such computing devices. You can use one or more of these to display information to one or more users. For example, a computing device can aggregate one or more surgical instruments, or This includes multiple patient parameters, one or more medical procedures, hospital, operating room, patient blood loss, and user Information relating to compliance, any appropriate combination thereof, or the above information It may include one or more display screens capable of displaying any of the information. One or more of the touch devices will provide voice information to one or more users. It can be constructed in the following way.

[0093] One or more processors are any one or more of the methods described herein. It can be configured to perform some or all of these functions. For example, one of such processors One or more receive one or more images and perform one or more computational algorithms ( For example, computer vision, machine learning, deep learning, or any suitable combination thereof. (For example, you) perform the analysis of such images, receive the data and analyze it (for example, (from the input or computer memory), trigger one or more responses, or It can be configured to perform the appropriate combination of these. One such processor Or multiple: One or more images depicting one or more surgical instruments, surgical instruments One or more tally bags, weight information, to determine the first and second tally, Imstamp data (e.g., paired with weight information), user input, or those To receive and analyze one or more images that depict any suitable combination of [the following] It may be configured such that one or more such processors are, for example, one or more machines The machine learning algorithm is executed to analyze one or more images and then... It may be configured to determine the number of surgical instruments to be shown. One such processor Or multiple, based on the number of surgical instruments appearing in one or more images, intermediate surgical instruments It may be configured to update the aggregate. One or more of such processors It may be configured to determine the final count of surgical instruments, and such determination of the final count is U This may include accepting manual input from the processor. One or more such processors It may be configured to compare a first count of surgical instruments with a second count of surgical instruments. For example, intermediate or final aggregation). One or more of such processors Configured to generate notifications (e.g., warnings) based on a comparison between the first aggregate and the second aggregate. It is possible that the first and second aggregates do not match, among such processors One or more of these may be configured to generate or display warnings or other notifications. Additively or alternatively, one or more such processors may be used with other instruments (e.g., Determining the total number of used and unused equipment, tracking compliance information, and receiving user input. Entry, triggering one or more responses to situations occurring during medical procedures, appropriate personnel Sending information and warnings to, or any appropriate combination thereof, one or more related to It can perform tasks that involve adding numbers.

[0094] In general, any one or more processors described herein store in memory It may be configured to execute the given instructions, and as a result when executing the instructions, one or more The processor performs one or more of the operations of the method described herein. The instructions are for user computers, mobile devices, wristbands, and smartphones. , or any suitable combination thereof, applications, applets, hosts, etc. Cars, networks, websites, communication services, communication interfaces, hardware A firmware element, a software element, or any appropriate combination thereof. It can be executed by a computer executable component integrated with memory. Instructions are in memory , or RAM, ROM, flash memory, EEPROM, optical devices (CD or DV Other devices such as D, hard drives, floppy drives, or any suitable device. It can be stored on a computer-readable medium.

[0095] Perform one or more or all of the methods described herein One or more processors configured to do so are used in handheld or mobile computers. It can be integrated into a routing device or implemented as an external processor. In some exemplary embodiments, one or more such processors are cloud-based Computer systems, mainframe computer systems, grid computers Computer devices such as data systems or other suitable computer systems It can be incorporated into the system. One or more systems described herein are one Alternatively, it may include means of communication for communicating data to multiple external processors. Alternatively, one or more such processors receive images of surgical instruments, and As described, the images are reconstructed or analyzed, and information related to tracking surgical instruments is transmitted remotely. It can be integrated into a server.

[0096] As described above, one or more exemplary embodiments of the systems described herein are , may include one or more imaging systems. For example, such a system may be for surgical use One or more instruments (for example, surgical instruments contained in one or more collection bags) It may include a camera that functions to generate images, and one or more sets of still images or video This includes parts of the deodorizer. One or more images are color images, depth images (for example) (For example, infrared, stereoscopic, ultrasound, etc.), hyperspectral imaging, another appropriate type of imaging, Or it may include any suitable combination thereof. The camera has at least one optical image This may include an image sensor (e.g., CCD, CMOS, etc.), which has red, green, and blue pixels. Using RGB color components, or one or more other suitable optical components Capture a color optical digital image. For example, a camera has a suitable corresponding optical system. Filters (for example, color filter arrays such as Bayer pattern filters), This could include a single image sensor paired with both of them. As another example, a camera could be white At least one preset to split light into separate color channels (e.g., RGB) It may include multiple image sensors paired with appropriate corresponding optical systems such as a diffractive or diffraction plane, Each is detected by its respective image sensor. One or more imaging systems, One or more computing tools, or any suitable combination thereof, on the same device The system can be configured on a surface, or the imaging system can process image data into one or more other It could be a separate component that communicates with the components of the system. Multiple instances of this can be part of a mobile device (for example, the camera on a smartphone). This is configured to implement one or more of the above processing components. That is also fine. Such an imaging system uses one or more processors to process the images for analysis. Send the image to a database that stores it (e.g., cloud storage), or both. It can be configured to do so.

[0097] One or more exemplary embodiments of the systems described herein are for the user (for example) If you have information, please provide it to a doctor, nurse, other healthcare professional, or any appropriate combination thereof. It may include a display that functions to show or otherwise communicate information to the patient Information, one or more images of surgical instruments, one or more related to the location of surgical instruments Multiple quantified metrics, first and second totals of surgical instruments (e.g., final totals) ) One or more notices regarding the comparison, the first and second counts of surgical instruments match If not available, the prescribed protocol that the user must follow, the weight of surgical instruments (e.g., surgical fibers) One or more measurements of the possibility of multiple imaging, values ​​of the indicator counters of surgical instruments, surgical instruments One or more warnings or prompts to the user indicating potential duplicate images of the object, one Or include multiple summary reports, or any appropriate combination thereof. (i) refers to screens on handheld or mobile devices, computer monitors, and television screens. This may include a surface, projector screen, or other suitable display. The display is It can be integrated into the same device as one or more components of the system. Additional or alternative. The display is a separate standalone monitor, screen, or other suitable display. This may include playing.

[0098] According to some exemplary embodiments, the display interacts with the information displayed to the user. User interfaces that enable interaction (e.g., graphical user interfaces) It can be configured to display a user interface. For example, the user interface can be configured to display a user interface. The user manipulates one or more images (e.g., zoom, crop, rotate, and (Any suitable combination thereof), or a drawing depicting at least one part of a surgical instrument It may be possible to manually define the image region. As another example, the user interface The user can choose one or more display options (e.g., font, color, language, or something else). Select any appropriate combination of these, and the content (patient information, quantified metrics). It will be possible to select other bodily fluid-related information, warnings, etc., or both. As yet another example, the user interface is used to depict redundant surgical instruments. Select one or more images to delete, or one or more images on the display. It may be possible to rotate, flip, or manipulate a number of images. The display is for the user. It is a resistive or electrostatic device that responds to skin, stylus, or other user contact. It may include a quantitative touchscreen. The display can be controlled by a mouse, keyboard, or other means. It may be user-interactive via a cursor controlled by other input devices. If so, the display will show the user the first summary, the second summary, patient information, or the tasks related to them. This could allow users to manually input information indicating the appropriate combination of meanings.

[0099] One or more exemplary embodiments of the systems described herein are surgical instruments Location confirmation (e.g., first or second count), values ​​of surgical instrument indicator counters, hand One or more comparisons of the first and second (e.g., final) counts of surgical instruments. Notification, prescribed rules to follow if the first and second totals of surgical instruments do not match. The protocol, one or more measurements of the possibility of duplicate imaging of surgical instruments, surgical instruments One or more warnings or prompts to the user indicating the possibility of duplicate images, one Information related to multiple summary reports, or any appropriate combination thereof, is communicated. This may include speakers or other suitable audio systems. (Display, audio) The io system, or both, means that the first aggregate matches the second aggregate (e.g., the final aggregate). If this is not done, one or more notices or warnings may be provided. This is specified by the user. It can be useful in prompting specific actions as responses, such as prompting to start a protocol. It is possible. Another example is a display, an audio system, or both, being one. Alternatively, provide the user with multiple warnings or prompts, showing two or more images of the same surgical instrument. This could indicate that the user experienced duplicate images. They were asked to check the location of surgical instruments that had been tallied or not tallied, or so This could be helpful in re-evaluating any suitable combination of them.

[0100] One or more exemplary embodiments of the systems described herein are surgical instrument sets. This may include instruments and equipment for use in the measurement method. For example, such a system may include 1 One or more collection containers, one or more for use in tracking and tallying surgical instruments. A tally bag, one or more stands configured to hold the tally bag, one or one configured to hold multiple imaging systems (such as mobile devices) Or multiple mounts, one or more components of a system combined. It may include a number of weight detection components, or any suitable combination thereof.

[0101] One or more exemplary embodiments of the systems described herein are surgical fibers It may include one or more collection containers for use when collecting surgical instruments. The collection container is for putting used equipment into before aggregation (for example, after the fibers have been used). It may be used by medical personnel. The collection container (e.g., "kick bucket") is optional. It may be of an appropriate size, shape, or material. The collection container may have a circular cross-section. The container may be a small bucket-like container or may include one, and may include a liner. It is possible. The collection container can be made of metal, plastic, or any suitable material. The liner of the collection container can be made from any suitable material. For example, the liner is permeable It can be a clear plastic liner. A clear liner allows for cleaning dirty surgical instruments and clean hands. It can offer the advantage of easily visualizing both surgical instruments. The collection container can be any appropriate size. It may be and can accommodate any appropriate number of surgical instruments. Some such systems An exemplary embodiment involves one or more collection containers placed in various locations throughout the operating room. This may include, for example, placing one or more collection containers near the operating table so that a doctor or nurse can see the contents. This allows nurses to easily dispose of surgical instruments after use.

[0102] One or more exemplary embodiments of the systems described herein involve surgical instruments It may include one or more tally bags for use in storage and tallying. As described above, the tally bag has a lining and is designed to hold one or more surgical instruments. It may include one or more pockets configured as follows. The tally bag can be any appropriate size It could be a system that includes one or more tally bags of various sizes. To obtain. For example, to house different types of surgical instruments (e.g., surgical fibers of different sizes). To achieve this, different sizes of collection bags can be set. Various types of surgical fibers The fibers come in various sizes, and the tally bags can be any number and any type. They can be made to the appropriate size to accommodate surgical fibers. For example, a collection bag, They can be sized to accommodate between 1 and 30 surgical fibers. Similarly, tally bags are It may have any number of pockets to accommodate any number of appropriate surgical fibers. Fiber counting protocols generally involve placing one surgical fiber per pocket. However, the pockets of the tally bag may be configured to accommodate any appropriate number of surgical fibers. Furthermore, the pockets of the collection bag are large enough to accommodate various types of surgical fibers. It can be of size and shape. For example, the pocket on a tally bag could be 4 inches x 4 inches or Surgical fibers of various sizes, including those ranging in size from 18 inches x 18 inches. The pockets of the tally bag may also be configured to accommodate abdominal fibers (e.g., abdominal fibers). It can be configured to accommodate various types of surgical fibers (such as surgical fibers for general use).

[0103] One or more exemplary systems described herein for tracking surgical instruments One embodiment includes one or more hooks, mounts, or any suitable combination thereof. It may include one or more stands such as poles equipped with a weave. This is one or more for holding multiple imaging devices (e.g., mobile devices). This may include mounting. Such a system may include one or more aggregation bags. Each is configured to include surgical instruments such as surgical fibers, and is used by one or more users. The helps implement one or more aggregation protocols for surgical instruments. As described above. (See, for example, Figure 4), the tally bag has a lining and one or more pockets. It may include. The backing interacts with one or more hooks on the pole, one or more times. It may include one or more openings configured to suspend a tally bag from a hook. The components of the tally bag (e.g., lining and pockets) can be made from any suitable material. It can be done and can have any appropriate coloring. For example, the lining of the tally bag is not The pocket can be transparent blue, opaque white, or other suitable color, and is made of transparent material. It is possible. Even when stacked, the counting bags can be easily identified (for example, stacked on top of each other). (When stacked) The lining of one or more counting bags may be opaque and colored. It can be beneficial, and as a result, both the contaminated and clean surgical instruments placed inside. The colors are contrasting (for example, dirty and clean surgical fibers). Additionally, there are transparent pockets. This involves visualizing surgical instruments in a pocket, and marking one or more markers on the surgical instruments (for example) This could be useful for enabling the visualization (of tags on surgical fibers) or both. The tally bags can be any shape and size that is convenient for hanging them from a pole. It may be of an appropriate shape and size. An exemplary embodiment shown in Figure 4 is rectangular A rectangular tally bag with a pocket of the same shape is used, but the tally bag and its pocket As described above, it can be made into any suitable shape and size.

[0104] One or more exemplary systems described herein for tracking surgical instruments Such embodiments may include one or more weight detection components. The elements sense the presence of surgical instruments, weigh them, tally them, or their It can be used in any suitable combination. As described above, one or more weights The detection components are one or more used to determine the first count of surgical instruments. It may include a balance. For example, one or more weight-sensing components are the first of the surgical instruments. Configured to receive totals and communicate weight information to the processor to determine the first total. It may be possible. One or more weight-detecting components may also be one or more collection containers (e.g.) The second surgical instrument is attached to or incorporated into a tally bag or "kick bucket". The aggregation can be determined. One or more collection containers can be used by one or more users. To detect a decrease in weight when surgical instruments are removed from the collection container, a scale is used. It may be coupled with or include other suitable weight detection components. One or Multiple counting bags are designed to detect weight changes when surgical instruments are added to the counting bags. An exemplary form of one or more strain gauges or balances mounted on a pole. It can be coupled to one or more weight-detecting components to determine a second total weight of surgical instruments.

[0105] The above explanation uses a specific nomenclature for explanatory purposes to provide a complete understanding of the subject. It was used. However, those skilled in the art will see that no specific details are required to carry out the subject matter. It should be clear that the above description of specific exemplary embodiments is illustrative. They are presented for explanatory purposes. They are not intended to be comprehensive or to disclose the subject matter. It is not intended to limit it to the exact form. Considering the above instruction, many Modification and transformation are possible. Exemplary embodiments illustrate the principles of this subject matter and their practical applications. Some of the following have been selected and explained to illustrate the subject matter and By utilizing various exemplary embodiments with various modifications suitable for the specific intended use This makes it possible that the claims and their equivalents define the scope of the invention. It is intended.

[0106] The following listed descriptions refer to the methods, machine-readable media, and systems described herein. Describe various examples (for example, machines, devices, or other equipment).

[0107] The first example provides a method for tracking surgical instruments, and this method is, With one or more processors To receive the first total for surgical instruments, The process involves receiving one set of images, each image representing one set of surgical instruments. Receiving one or more images that include a field of view, A second aggregate of surgical instruments is determined based at least partially on one or more received images. To decide, Notifications will be provided based on a comparison between the first total and the second total of surgical instruments. It includes "toto".

[0108] The second example provides the method described in the first example, and the determination of the second count of surgical instruments is one or includes identifying one or more surgical instruments in multiple received images.

[0109] A third example presents the method of the second example, wherein at least one of the received images is a depth image. To provide.

[0110] A fourth example provides the method of the third example, wherein the depth image is an infrared image.

[0111] The fifth example provides a method of any of the second to fourth examples, wherein the received image is at least Another type is a color image.

[0112] The sixth example provides a method according to any of the second to fifth examples, wherein the surgical instruments are used in surgery. It is a fiber used for general purposes.

[0113] The seventh example provides a method according to any of the second to sixth examples, and one or more hands Identifying surgical instruments involves identifying containers containing one or more compartments within one or more images. This includes calling and characterizing.

[0114] The eighth example provides the method described in the seventh example, wherein the container has a lining and a rectangular shape on the lining. It features multiple pockets arranged in a grid.

[0115] The ninth example provides a method of the eighth example, wherein the multiple pockets include a transparent material.

[0116] The tenth example provides the method described in the eighth example, wherein the backing includes an opaque material.

[0117] The eleventh example provides a method for any of the seventh to tenth examples, and characterizes the container. This includes determining one or more parameters of the container.

[0118] The twelfth example provides the method described in the eleventh example, and one or more identified containers Parameter determination involves quantifying one or more compartments of the container.

[0119] The 13th example provides the method described in the 11th or 12th example, for the identified container Determining one or more parameters determines the geometric arrangement of one or more compartments in the container. This includes determining.

[0120] The 14th example provides a method of any of the 11th to 13th examples, and identifies the container The determination of one or more parameters of the container is performed for each of one or more compartments of the container. This includes determining whether or not surgical instruments are needed.

[0121] The 15th example provides a method according to any of the 1 to 14th examples, and the 15th surgical instrument The determination of the count in 2 is to hold at least one or more surgical instruments. It is further based on detecting changes in the weight of the configured containers.

[0122] The 16th example provides a method according to any of the 1 to 15 examples, and the 16th surgical instrument Receiving the aggregated data in step 1 involves identifying one or more surgical instruments in the image.

[0123] The 17th example provides a method of any of the 1 to 16 examples, and the 17th surgical instrument The receipt of the total is at least in part based on the detection of the weight of one or more surgical instruments. Duku.

[0124] The 18th example provides a method of any of the 1 to 17 examples, and the 18th surgical instrument The aggregate value for item 1 is provided via user input.

[0125] The 19th example provides a method of any of the 1 to 18 examples, and the 1st example of a surgical instrument The decision to compile item 2 includes updating the current index values ​​for surgical instruments.

[0126] The 20th example provides the method described in the 19th example, and the current index value of the surgical instrument is displayed This further includes displaying it during gameplay.

[0127] The 21st example provides the method of any of the 1st to 20th examples, and the first aggregation and Furthermore, encourage users to verify the accuracy of at least one of the second aggregations. include.

[0128] The 22nd example provides a method according to any of the 1st to 21st examples, and surgical instruments Display at least one of the following: the first tally, the second tally of surgical instruments, or a notification. This further includes displaying.

[0129] Case 23 provides a method similar to that of Cases 1 through 22, and the surgery followed up. This further includes providing a summary report of the equipment used.

[0130] The 24th example provides a method of any of the 1st to 23rd examples, with the first aggregation and the second The provision of notification based on a comparison between the two aggregates is for cases where the first aggregate does not match the second aggregate. This includes generating a warning in response to the response.

[0131] Example 25 provides the method used in Example 24, wherein the warning follows a predetermined protocol.

[0132] The 26th example provides a method of any of the 1st to 25th examples, and the first aggregation At least some of these are received before medical treatment.

[0133] Example 27 provides the method of any of Examples 1 through 26, and the second aggregation is This is determined during or after a medical procedure.

[0134] Example 28 provides a method for any of Examples 1 through 27, and the determination of the second aggregation. The system analyzes one or more received images using one or more machine learning models. This includes the following.

[0135] The 29th example provides the method described in the 28th example, and one or more machine learning models It incorporates deep learning technology.

[0136] The 30th example provides a system for tracking surgical instruments, and this system, Includes one or more processors configured to perform operations including the following: The aforementioned operation is, To receive the first total for surgical instruments, The process involves receiving one set of images, each image representing one set of surgical instruments. Receiving one or more images that include a field of view, A second aggregate of surgical instruments is determined based at least partially on one or more received images. To make a decision, Notifications will be provided based on a comparison between the first total and the second total of surgical instruments. It includes "toto".

[0137] Example 31 provides the system described in Example 30 and determines the second total of surgical instruments. This includes identifying one or more surgical instruments within one or more received images.

[0138] The 32nd example provides the system described in the 31st example, wherein at least one of the received images is deep This is a degree image.

[0139] Example 33 provides the system described in Example 32, wherein the depth image is an infrared image.

[0140] The 34th example provides the system described in any of the 31st to 33rd examples, and the received image At least one of them is a color image.

[0141] Example 35 provides a system described in any of Examples 31 through 34, and one or The identification of multiple surgical instruments is a container containing one or more compartments of one or more images. This includes identifying and characterizing.

[0142] Example 36 provides the system described in Example 35, and the characterization of the container is one of the containers Or, including determining multiple parameters.

[0143] Example 37 provides the system described in Example 36, with one or more identified containers. Determining the numerical parameters involves quantifying one or more compartments of the container.

[0144] The 38th example provides the system described in the 36th or 37th example, and identifies the container Determining one or more parameters of a container involves the geometric arrangement of one or more compartments of the container. This includes the decision.

[0145] Example 39 provides and identifies a system described in any of Examples 36 to 38. The determination of one or more parameters of the container is performed for each of the one or more compartments of the container. This includes determining whether or not surgical instruments are present.

[0146] The 40th example provides the system described in any of the 35th to 39th examples, wherein the container is It is a flexible container that includes a lining and multiple pockets arranged in a rectangular grid.

[0147] The 41st example provides the system described in the 40th example, with multiple pockets made of transparent material. Includes.

[0148] The 42nd example provides the system described in the 40th example, which includes an opaque backing material. .

[0149] Example 43 provides the system described in any of Examples 30 through 42, and processes An optical sensor configured to generate one or more images received by the sensor Prepare for it.

[0150] Example 44 provides the system described in any of Examples 30 through 43, and displays a screen To further prepare.

[0151] Example 45 provides the system described in Example 44, and the display screen is for tracking surgery. It is configured to display a summary report of the device.

[0152] The 46th example provides the system described in the 44th or 45th example, and the display screen is: It is configured to display notifications based on a comparison between the first aggregate and the second aggregate.

[0153] Example 47 provides the system described in Example 46, and the notification states that the first aggregate is the second aggregate If the reading does not match the total, a warning will be issued in accordance with the prescribed protocol.

[0154] Example 48 provides a system described in any of Examples 30 to 47, and a surgical instrument. The material is surgical fiber.

[0155] Example 49 provides a system described in any of Examples 30 through 48, and one or At least one of the multiple processors is detachably mounted on the stand. It is located inside the iL Computing device.

[0156] The 50th example provides a method for tracking surgical instruments, and this method is: With one or more processors, Receiving an image of the field of view, wherein the field of view includes one or more surgical instruments. and, To determine the presence of one or more surgical instruments in the image, Includes providing a determination of the presence of one or more surgical instruments in an image. nothing.

[0157] Example 51 provides the method described in Example 50, and at least one trained Based on a machine learning model, the number of surgical instruments in an image is quantified. It also includes.

[0158] Example 52 provides a method similar to that described in Example 51, where the machine learning model utilizes deep learning techniques. It's integrated.

[0159] Example 53 provides a method of any of Examples 50 through 52, one or more. Determining the presence of multiple surgical instruments involves detecting the presence of containers in the image, and if there are multiple containers, It includes compartments, each compartment configured to receive at least one of its respective surgical instruments. It will be done.

[0160] The 54th example provides the method described in the 53rd example, with each section based on the presence or absence of surgical instruments. This further includes classifying them.

[0161] Example 55 provides the method of any of Examples 50 to 54, and the determined The provision of the presence indication provides the indication of the determined presence of at least one surgical instrument in the image. This includes doing so.

[0162] Example 56 provides a method for any of Examples 50 through 55, one or more. The number of surgical instruments includes surgical fibers.

[0163] Example 57 provides a method of any of Examples 50 to 56, one or more. The number of surgical instruments includes surgical equipment.

[0164] Example 58 performs an operation (e.g., a method operation) that is performed in any of the previous examples. It provides a carrier medium that carries machine-readable instructions for controlling a machine.

[0165] The 59th example provides a machine-readable medium (e.g., a non-temporary machine-readable storage medium) that, when executed by one or more processors of the machine, contains instructions causing the machine to perform an operation (e.g., a method operation) specified in any of the above examples. The claims described in the initial patent application were as follows: Claim 1: Determining a first count of surgical instruments by one or more processors, wherein the first count quantifies the set of surgical instruments, and determining the first count of surgical instruments, The one or more processors access an image depicting at least a subset of the set of surgical instruments, The one or more processors determine a second count of the surgical instruments based on the image, A method comprising providing a notification based on a comparison between the first total of the surgical instruments and the second total of the surgical instruments using one or more processors. Claim 2: The method according to claim 1, wherein the determination of the second count of the surgical instruments comprises identifying at least one surgical instrument depicted in the image. Claim 3: The method according to claim 2, wherein the identification of the at least one surgical instrument depicted in the image comprises a set of compartments and characterizes the container depicted in the image. Claim 4: The method according to claim 3, wherein the characterization of the container includes quantifying the set of compartments of the container based on the image. Claim 5: The method according to claim 3, wherein the characterization of the container comprises determining the geometric arrangement of the set of compartments of the container based on the image. Claim 6: The method according to claim 3, wherein the characterization of the container includes determining, based on the image, the presence or absence of a corresponding surgical instrument in each compartment of the set of compartments of the container. Claim 7: The method according to claim 1, wherein the determination of the second total of the surgical instruments is based on a detected change in the weight of a container configured to receive at least one surgical instrument from the set of surgical instruments. Claim 8: The method according to claim 1, wherein the determination of the first count of the surgical instruments comprises identifying the set of surgical instruments from further images. Claim 9: The method according to claim 1, wherein the determination of the first total of the surgical instruments is based on the weight of at least one surgical instrument from the set of surgical instruments. Claim 10: The method according to claim 1, wherein the provision of the notification based on a comparison of the first aggregate and the second aggregate includes providing a warning in response that the first aggregate does not match the second aggregate. Claim 11: A machine-readable medium containing instructions, When the instruction is executed by one or more processors of the machine, the machine will: Determining a first total of surgical instruments, wherein the first total is to quantify the set of surgical instruments, and determining the first total of surgical instruments, Accessing images depicting at least a subset of the set of surgical instruments, Based on the aforementioned image, a second count of the surgical instruments is determined, A machine-readable medium that causes an operation to be performed which includes providing a notification based on a comparison of the first total of the surgical instruments and the second total of the surgical instruments. Claim 12: The machine-readable medium according to claim 11, wherein the determination of the second count of the surgical instruments comprises identifying at least one surgical instrument depicted in the set of images. Claim 13: The machine-readable medium according to claim 12, wherein the identification of the at least one surgical instrument depicted in the image comprises a set of compartments and characterizes the container depicted in the image. Claim 14: The machine-readable medium according to claim 13, wherein the characterization of the container includes quantifying the set of compartments of the container based on the image. Claim 15: It is a system, One or more processors, Includes memory for storing instructions, When the instruction is executed by at least one of the one or more processors, it will cause the system to: Determining a first total of surgical instruments, wherein the first total is to quantify the set of surgical instruments, and determining the first total of surgical instruments, Accessing images depicting at least a subset of the set of surgical instruments, Based on the aforementioned image, a second count of the surgical instruments is determined, A system that causes operations to be performed, including providing a notification based on a comparison of the first total of the surgical instruments and the second total of the surgical instruments. Claim 16: The system according to claim 15, wherein the determination of the second count of the surgical instruments comprises identifying at least one surgical instrument depicted in the set of images. Claim 17: The system according to claim 16, wherein the identification of the at least one surgical instrument depicted in the image comprises a set of compartments and characterizes the container depicted in the image. Claim 18: The system according to claim 17, wherein the characterization of the container includes quantifying the set of compartments of the container based on the image. Claim 19: The system according to claim 17, wherein the characterization of the container includes determining the geometric arrangement of the set of compartments of the container based on the image. Claim 20: The system according to claim 17, wherein the characterization of the container includes determining, based on the image, the presence or absence of a corresponding surgical instrument in each compartment of the set of compartments of the container.

Claims

1. A method for tracking surgical instruments using a system comprising an imaging system, a display, and one or more processors, The imaging system acquires a video depicting the user's handling of the surgical instruments, The one or more processors receive the video, In order to detect characteristic arm movements of the user indicating that the user is moving the surgical instruments to be aggregated during the surgical procedure, one or more processors perform computational analysis of the video, The one or more processors update the sum of surgical instruments in response to each instance of the characteristic arm movement detected, A method comprising displaying the updated summary on the display.

2. The method according to claim 1, wherein the characteristic arm movement is a sweeping arm movement.

3. The method according to claim 2, wherein the sweeping arm movement indicates that the user has removed the surgical instrument from its packaging and placed it on the surface.

4. The method according to claim 1, wherein the imaging system includes a camera positioned to acquire one of the following: a front view, a side view, a top view, and an appropriate combination thereof of the user.

5. The updated summary is the first summary, The aforementioned method, The one or more processors receive an image depicting at least a part of the surgical instrument, The one or more processors determine a second count of the surgical instruments based on the image, The method according to any one of claims 1 to 4, further comprising providing the display with a notification based on a comparison between the first total and the second total.

Images