Method and device for providing information on skill level related to surgery

Abstract

Disclosed are a method, and a device and a recording medium according to the method, the method comprising the steps in which: a reception unit acquires a plurality of surgical videos corresponding to a user account and including a situation in which surgery is performed; a processor determines a surgical step execution time for each surgical step with respect to each of the plurality of surgical videos; the processor acquires execution time variation information indicating a change over time in the surgical step execution time on the basis of acquisition time points of the plurality of surgical videos; the processor performs scoring of a skill level for each surgical step on the basis of the execution time variation information; and the processor provides information on the skill level acquired on the basis of a result of performing the scoring.

Description

Method and device for providing information on proficiency related to surgery

[0001] The technical field of the present disclosure relates to a technical field that provides information on skill based on a surgical situation in a plurality of surgical videos related to a surgical act.

[0002] Surgical methodology, or the surgical technique, varies depending on the surgeon performing the same procedure. This is because each surgeon develops their own unique approach to overcome intraoperative challenges based on their experience. These differences can vary not only by professor or hospital, but also by individual surgeon, depending on the timing of the surgery, the medical equipment used, and the acquisition of new surgical techniques. However, these methodological differences applied to each surgery were previously assessed qualitatively based on factors such as the surgeon's satisfaction and patient prognosis. This lack of scientific basis for effective methodologies led to repetitive transmission based on the personal biases of the instructors. Meanwhile, recent advancements in AI technology for recognizing specific objects in videos have led to the accumulation of vast amounts of specialized medical data in surgical videos, making them valuable resources for medical education and academic research. Analyzing surgical videos to capture key surgical behaviors could potentially enable the development of models for predicting surgical risk and for evaluating and validating surgical procedures. Furthermore, with the recent advancements in big data and artificial intelligence, countless medical documents and photographs are evolving into valuable medical information. However, because this medical information is so vast, the methods for performing surgical evaluations using multiple medical records can vary significantly. Therefore, there is a pressing need for methods and technologies that facilitate the development of surgical evaluation and verification models.

[0003] The problem to be solved in the present disclosure relates to a method and device for providing proficiency information for a situation in which a surgery is performed, and provides a method for providing proficiency information for each surgical step for each of a plurality of surgical videos.

[0004] The problems to be solved in this disclosure are not limited to the technical problems described above, and other technical problems may exist.

[0005] As a technical means for achieving the above-described technical task, a method for providing information on proficiency related to surgery according to the first aspect of the present disclosure may include the steps of: a receiving unit acquiring a plurality of surgery videos corresponding to a user account and including a situation in which a surgery is performed; a processor determining a surgery step performance time for each surgery step for each of the plurality of surgery videos; a step in which the processor acquires performance time variation information indicating a change in the surgery step performance time over time based on acquisition times of the plurality of surgery videos; a step in which the processor performs scoring on proficiency for each surgery step based on the performance time variation information; and a step in which the processor provides information on the proficiency acquired based on a result of performing the scoring.

[0006] In addition, the step of performing the scoring may include a step of the processor obtaining a rate of change in the execution time of the surgical step based on the execution time variation information; and a step of the processor performing the scoring so that the proficiency becomes equal to or higher than the threshold proficiency when the rate of change exceeds a threshold rate of change.

[0007] Additionally, the step of performing the scoring may allow the processor to perform the scoring so that the surgical step performance time and the score are inversely proportional to each other.

[0008] In addition, the processor further includes a step of determining an event occurrence video in which an event related to a delay in surgery or an increase in the difficulty of surgery occurs among the plurality of surgical videos; and the step of performing the scoring may allow the processor to perform the scoring using an event non-occurrence video in which the event occurrence video is excluded among the plurality of surgical videos.

[0009] In addition, the step of performing the scoring may include a step in which the processor obtains tool usage variation information including the number of tools used, the type of tools used, and the amount of usage for each tool for each surgical step for each of the plurality of surgical videos; and a step in which the processor provides the tool usage report for each surgical step based on the tool usage variation information.

[0010] Additionally, the step of determining the event occurrence video may include allowing the processor to determine the event occurrence video based on at least one of the surgery delay time, the sex of the surgery subject, the age of the surgery subject, and the prognosis information of the surgery subject.

[0011] In addition, the step of performing the scoring using the event-free video may include: the step of the processor obtaining a rate of change in the surgical step execution time based on the execution time change information in the event-free video; the step of the processor performing the scoring so that the proficiency becomes less than a first proficiency level when the rate of change exceeds a threshold rate of change in a direction in which the execution time becomes longer; and the step of the processor performing the scoring so that the proficiency becomes a second proficiency level or greater than the first proficiency level when the rate of change exceeds a threshold rate of change in a direction in which the execution time becomes shorter.

[0012] In addition, the step of performing the scoring may include a step in which the processor determines an average surgical step performance time for each surgical step for a user account other than the user account; a step in which the processor determines an average standard deviation of the surgical step performance time for each surgical step for the other user account; a step in which the processor obtains a recent surgical step performance time for each surgical step for the user account; and a step in which the processor performs the scoring based on the average surgical step performance time, the average standard deviation, and the recent surgical step performance time.

[0013] In addition, the processor may further include a step of determining an event occurrence video in which an event related to a delay in surgery or an increase in the difficulty of surgery occurs among the plurality of surgical videos; a step of obtaining an event annotation indicating the event for the event occurrence video by the processor; and a step of providing an event report including metadata related to the event occurrence video and the event annotation by the processor.

[0014] A device for providing information on proficiency related to surgery according to a second aspect of the present disclosure may include a receiving unit that corresponds to a user account and acquires a plurality of surgery videos including situations in which surgery is performed; and a processor that determines a surgery step performance time for each surgery step for each of the plurality of surgery videos, acquires performance time variation information representing a change in the surgery step performance time over time based on acquisition times of the plurality of surgery videos, performs scoring on proficiency for each surgery step based on the performance time variation information, and provides information on the proficiency acquired based on a result of performing the scoring.

[0015] In addition, the processor may obtain a rate of change in the surgical step execution time based on the execution time variation information, and, if the rate of change exceeds a threshold rate of change, perform the scoring so that the proficiency becomes equal to or higher than the threshold proficiency.

[0016] Additionally, the processor can perform the scoring such that the surgical step execution time and the score are inversely proportional to each other.

[0017] In addition, the processor can determine an event occurrence video in which an event related to a delay in surgery or an increase in the difficulty of surgery occurs among the plurality of surgical videos, and perform the scoring using an event non-occurrence video in which the event occurrence video is excluded among the plurality of surgical videos.

[0018] In addition, the processor may obtain tool usage variation information including the number of tools used, the type of tools used, and the amount of usage for each tool for each surgical step for each of the plurality of surgical videos, and provide a tool usage report for each surgical step based on the tool usage variation information.

[0019] According to the third aspect of the present disclosure, a non-transitory computer-readable recording medium having recorded thereon a program for implementing the first aspect may be included.

[0020] According to one embodiment of the present disclosure, a user can easily visually check the change in the performance time by providing a change in the performance time of a surgical step over time based on the acquisition time of a plurality of surgical videos.

[0021] Additionally, it provides a tool usage report that includes information on changes in tool usage for each surgical stage, allowing users to monitor their own tool usage patterns and styles.

[0022] Additionally, there is an effect that the accuracy of scoring can be improved because scoring is performed using video in which an event does not occur, excluding video in which an event occurs.

[0023] The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

[0024] FIG. 1 is a diagram illustrating an example of a device or server implemented on a system according to one embodiment.

[0025] Figure 2 is a block diagram schematically illustrating the configuration of a device according to one embodiment.

[0026] Figure 3 is a flowchart illustrating each step of operation of a device according to one embodiment.

[0027] FIG. 4 is a drawing illustrating an example of a device according to one embodiment determining a surgical step performance time for each surgical step.

[0028] FIG. 5 is a diagram illustrating an example of a device according to one embodiment determining the appearance time of each surgical tool for each of a plurality of surgical videos.

[0029] FIG. 6 is a diagram illustrating an example of a device according to one embodiment obtaining information on the change in the execution time of each surgical step based on the acquisition time of multiple surgical videos.

[0030] FIG. 7 is a diagram illustrating an example of a device according to one embodiment obtaining tool-specific usage time variation information based on the acquisition time of multiple surgical videos.

[0031] FIG. 8 is a schematic diagram illustrating an example in which a device according to one embodiment provides the amount of tool usage for each surgical step through a bar graph or a circular graph.

[0032] FIG. 9 is a schematic diagram illustrating an example in which a device according to one embodiment provides the amount of tool usage for each surgical step through a band graph.

[0033]

[0034] The advantages and features of the present disclosure, and the methods for achieving them, will become clearer with reference to the embodiments described below in detail together with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. These embodiments are provided solely to ensure that the disclosure is complete and to fully inform those skilled in the art of the scope of the present disclosure.

[0035] The terminology used herein is for the purpose of describing embodiments only and is not intended to limit the present disclosure. In this specification, the singular also includes the plural unless specifically stated otherwise. As used herein, the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components in addition to the mentioned components. Like reference numerals refer to like components throughout the specification, and "and / or" includes each and any combination of one or more of the mentioned components. Although "first", "second", etc. are used to describe various components, these components are not limited by these terms. These terms are only used to distinguish one component from another. Therefore, it should be understood that a first component mentioned below may also be a second component within the technical spirit of the present disclosure.

[0036] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in their common sense to those skilled in the art. Furthermore, terms defined in commonly used dictionaries should not be interpreted ideally or excessively unless explicitly defined otherwise.

[0037] Spatially relative terms such as "below," "beneath," "lower," "above," and "upper" can be used to easily describe the relationship between one component and other components as depicted in the drawings. Spatially relative terms should be understood to include different orientations of the components during use or operation in addition to the orientations depicted in the drawings. For example, if a component depicted in the drawings were flipped over, a component described as "below" or "beneath" another component could end up "above" the other component. Thus, the exemplary term "below" can include both the above and below orientations. Components can also be oriented in other directions, and thus spatially relative terms can be interpreted accordingly.

[0038] Hereinafter, embodiments are described in detail with reference to the drawings.

[0039]

[0040] FIG. 1 is a drawing showing an example of a device (100) or server implemented on a system according to one embodiment.

[0041] As illustrated in FIG. 1, a system for providing information on proficiency related to surgery may include a device (100), an information acquisition device (110), an external server (130), a storage medium (140), a communication device (150), a virtual server (160), a user terminal (170), an external terminal (180), and a network.

[0042] However, those skilled in the art will appreciate that, in addition to the components illustrated in FIG. 1, other general-purpose components may be included in the medical information system. For example, a system providing information on surgical proficiency may further include a blockchain server (not shown) that operates in conjunction with a network. Alternatively, those skilled in the art will appreciate that, in other embodiments, some of the components illustrated in FIG. 1 may be omitted.

[0043] According to one embodiment, the device (100) can acquire information or target images related to medical procedures, such as surgery, from various sources. For example, the device (100) can acquire information (e.g., a video) related to medical procedures, such as surgery, from an information acquisition device. The information acquisition device may include, but is not limited to, a photographing device, a recording device, a biosignal acquisition device, etc. As another example, the device (100) can acquire information (e.g., a video) related to medical procedures, such as surgery, from a network.

[0044] An example of an information acquisition device (110) is a photographing device, which may include, but is not limited to, a first photographing device (e.g., an endoscope, etc.) that focuses on photographing a surgical site.

[0045] According to one embodiment, a device (100) may acquire images (videos, still images, etc.) related to medical procedures such as surgery from an information acquisition device (110) or a network. The device (100) may perform image processing on the acquired images. Image processing according to one embodiment may include, but is not limited to, naming, encoding, storage, transmission, editing, and metadata generation for each image.

[0046] According to one embodiment, a device (100) can transmit medical practice-related information acquired from an information acquisition device or a network, either as is or updated, to a network. The transmission information transmitted by the device (100) to the network can be transmitted to an external device (130, 140, 150, 160, 170, 180) via the network. For example, the device (100) can transmit an updated video to an external server (130), a storage medium (140), a communication device (150), a virtual server (160), a user terminal (170), etc. via the network. The device (100) can receive various information (e.g., feedback information, update requests, etc.) from the external devices (130, 140, 150, 160, 170, 180). A communication device (150) can refer to a device used for communication without limitation (e.g., a gateway), and the communication device (150) can communicate with a device that is not directly connected to a network, such as a user terminal (170).

[0047] A device (100) according to an embodiment may include an input unit, an output unit, a processor, a memory, etc., and may also include a display device (not shown). For example, a user may check a communication status, memory usage status, power status (e.g., battery state of charge, whether external power is supplied, etc.), thumbnail images of stored videos, current operation mode, etc. through the display device. Meanwhile, the display device may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, an electrophoretic display, etc. In addition, the display device may include two or more displays depending on the implementation form. In addition, when the touchpad of the display is configured as a touch screen by forming a layer structure, the display may be used as an input device in addition to the output device.

[0048] In addition, the network can perform mutual communication through wired communication or wireless communication. For example, the network can be implemented as a type of server and can include a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, an NFC chip, etc. Of course, the device (100) can perform communication with various external devices using a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, an NFC chip, etc. The Wi-Fi chip and the Bluetooth chip can perform communication using the Wi-Fi method and the Bluetooth method, respectively. When using a Wi-Fi chip or a Bluetooth chip, various connection information such as an SSID and a session key are first transmitted and received, and then communication is established using this, and various information can be transmitted and received. The wireless communication chip can perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), etc. NFC chips can operate in the NFC (Near Field Communication) mode using the 13.56MHz band among various RF-ID frequency bands such as 135kHz, 13.56MHz, 433MHz, 860~960MHz, and 2.45GHz.

[0049] An input unit according to one embodiment may refer to a means for a user to input data for controlling a device (100). For example, the input unit may include, but is not limited to, a key pad, a dome switch, a touch pad (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, a jog switch, etc.

[0050] An output unit according to one embodiment may output an audio signal or a video signal, and the output unit may include a display device, an audio output device, or the like.

[0051] The user terminal (170) according to one embodiment may include, but is not limited to, various wired and wireless communication devices such as a smartphone, a smart pad, and a tablet PC.

[0052] According to one embodiment, the device (100) can update medical practice-related information (e.g., video) acquired from an information acquisition device. For example, the device (100) can perform naming, encoding, storage, transmission, editing, metadata generation, etc. for images acquired from the information acquisition device. For example, the device (100) can perform naming of image files using metadata (e.g., creation time) of the acquired images. As another example, the device (100) can classify images related to medical practices acquired from the information acquisition device. The device (100) can classify images related to medical practices based on various criteria, such as type of surgery, surgical tools, surgeon, and surgical location, using learned AI.

[0053] Additionally, in FIG. 1, the device (100) may be implemented as a server, and the range of physical devices in which the device (100) may be implemented is not interpreted as being limited.

[0054]

[0055] FIG. 2 is a block diagram schematically illustrating the configuration of a device (100) according to one embodiment.

[0056] As illustrated in FIG. 2, a device (100) according to an embodiment may include a receiver (210), a processor (220), an output unit (230), and a memory (240). However, not all of the components illustrated in FIG. 2 are essential components of the device (100). The device (100) may be implemented with more components than the components illustrated in FIG. 2, or may be implemented with fewer components than the components illustrated in FIG. 2.

[0057] For example, a device (100) according to one embodiment may further include a communication unit (not shown) or an input unit (not shown) in addition to a receiving unit (210), a processor (220), an output unit (230), and a memory (240). In addition, a display (not shown) may be included as an example of the output unit (230).

[0058] According to one embodiment, the receiving unit (210) can obtain a plurality of surgical videos corresponding to a user account and including a situation in which a surgery is performed.

[0059] According to one embodiment, a processor (220) may determine the surgical step execution time for each surgical step for each of a plurality of surgical videos. Furthermore, the processor (220) may obtain performance time variation information indicating changes in the surgical step execution time over time based on the acquisition time of the plurality of surgical videos. Furthermore, the processor (220) may perform scoring of proficiency for each surgical step based on the performance time variation information. Furthermore, the processor (220) may provide information on the acquired proficiency based on the results of the scoring.

[0060] Additionally, in one embodiment, while the processor (220) is shown as providing information about proficiency, the output unit (230) may also provide information about proficiency. In one embodiment, the output unit (230) may include a display (not shown).

[0061] Figure 3 is a flowchart illustrating each step of operation of a device (100) according to one embodiment.

[0062] Referring to step S310, the device (100) according to one embodiment may acquire multiple surgical videos corresponding to a user account and including a surgical situation. In one embodiment, the user account may correspond to a surgical operator performing the surgery. Additionally, the multiple surgical videos may include videos acquired differently by date or time.

[0063] Referring to step S320, the device (100) according to one embodiment may determine the surgical step execution time for each surgical step for each of a plurality of surgical videos. In one embodiment, the plurality of surgical videos may include one or more surgical videos corresponding to multiple types of surgeries, and each type of surgery may include one or more surgical steps corresponding to each type of surgery. Accordingly, the device (100) may determine the surgical step execution time for each of the plurality of surgical videos corresponding to one or more surgical steps according to the type of surgery. That is, the surgical step execution time for each of the plurality of surgical steps included in each surgical video may be determined.

[0064] Referring to step S330, the device (100) according to one embodiment may obtain performance time variation information indicating a change in the performance time of a surgical step over time based on the acquisition time of a plurality of surgical videos. In one embodiment, the plurality of surgical videos may be surgical videos in which the same surgery was performed on different dates or at different times for a single user account, and the surgical performance time for each surgical step may be determined corresponding to the time at which each surgical video is acquired for each of the plurality of surgical videos. Accordingly, the device (100) may obtain performance time variation information from the surgical performance time for each surgical step determined corresponding to each time at which the plurality of surgical videos are acquired. That is, the device (100) may obtain performance time variation information indicating information indicating a change in the surgical performance time of the same surgical step over time at the time at which each of the plurality of surgical videos of the same type of surgery is acquired for the same user account. Specifically, the acquisition time of the plurality of surgical videos may refer to the time at which each surgical video is filmed. Additionally, the performance time variation information may include a graph showing the performance time of a surgical step relative to the acquisition time of the surgical video, or matching information that matches the performance time of a surgical step to the acquisition time of the surgical video. In other words, the performance time variation information may be information indicating a relationship between the acquisition time of the surgical video and the performance time of a surgical step for each acquisition time.

[0065] Referring to step S340, the device (100) according to one embodiment may perform scoring on the proficiency for each surgical step based on the performance time change information. The device (100) according to one embodiment may perform scoring on the proficiency for each of a plurality of surgical steps determined according to the type of surgery. For example, the device (100) may obtain a rate of change in the surgical step performance time based on the performance time change information. That is, the device (100) may obtain a rate of change in the surgical step performance time determined for each of a plurality of surgical videos according to a plurality of surgical steps. In addition, the device (100) may perform scoring so that the proficiency becomes equal to or greater than the threshold proficiency when the rate of change exceeds a threshold rate of change. In one embodiment, the threshold rate of change may be a preset rate of change for determining a learning curve section representing a point in time corresponding to a point in time when the surgical step performance time becomes shorter than a certain level. Accordingly, the device (100) may perform scoring so that the proficiency becomes higher than the critical proficiency by determining the point in time when the rate of change exceeds the critical rate of change as a learning curve section where the proficiency increases to a certain level or higher. In this case, the critical rate of change may be a rate of change in a direction in which the execution time becomes shorter. In addition, the device (100) may perform scoring so that the surgical step execution time and the score are inversely proportional to each other. That is, the shorter the surgical step execution time, the higher the score may be, and the longer the surgical step execution time, the lower the score may be. The device (100) according to one embodiment may determine the score so that it is linearly inversely proportional to the execution time. In addition, for each score determined according to the inverse relationship for each identical surgical step of a plurality of surgical videos, the score may be updated by comparing the execution time of each point in time with the previous preceding execution time to determine the score to which the proficiency is applied.For example, if the current execution time is more than twice that of the previous execution time, it can be determined that the proficiency has significantly improved, and thus the score can be updated to the square of each determined score. Furthermore, if the current execution time is more than half (1.5 times) that of the previous execution time, the score can be updated to twice that of each score. Furthermore, if the execution time increases two or more times in a row, the score can be updated to 0.8 times, 0.7 times, or 0.8-N times that of each score, depending on the number of consecutive increases in the execution time. Alternatively, the score can be updated if it is maintained within a certain boundary for two or more consecutive times. For example, if the difference between the execution times for two or more consecutive times continues to remain within a boundary of less than 0.3 percent of the execution time, it can be determined that the proficiency has not improved, but is being maintained, and thus the score can be updated to 0.9 times that of each score. Accordingly, the device (100) has the effect of being able to determine a score that applies proficiency in that it updates the score by utilizing the degree of change over time rather than determining the score solely based on the performance time. In addition, the device (100) can determine an event-occurring video in which an event related to a delay in the surgery or an increase in the difficulty of the surgery occurs among a plurality of surgery videos. In one embodiment, the event-occurring video may be one or more videos in which the performance time of a surgery step is determined to be longer than a preset percentage among the performance times of a plurality of surgery steps corresponding to the same surgery step in the plurality of surgery videos. That is, the event-occurring video is a video that is longer than a preset percentage (for example, 1.) of a general average performance time corresponding to each surgery step.A video corresponding to a surgical step execution time determined to be longer than 5 times may be a video in which an event that delays the surgery or increases the difficulty of the surgery, such as patient bleeding or a surgeon's mistake, has occurred. The device (100) may determine a video corresponding to a surgical step execution time that corresponds to a preset percentage or more as an event occurrence video based on the average execution time corresponding to the same type of surgery and the same surgical step acquired for multiple user accounts. Alternatively, a video corresponding to a surgical step execution time that is longer than a preset percentage or longer than the average execution time of multiple surgical step execution times for the same surgical step among multiple surgical videos corresponding to each user account may be determined as an event occurrence video. The device (100) may perform scoring using an event-free video from among multiple surgical videos in which an event-occurring video is excluded. In one embodiment, since the event-occurring video may be a video in which a special situation has occurred, scoring may be performed using multiple non-event-occurring videos in which the video is excluded, as applying the rate of change in the surgical step execution time for the same surgical step acquired over time may lower the accuracy of the proficiency result. In addition, in one embodiment, the device (100) may determine the event-occurring video based on at least one of the surgical delay time, the gender of the surgical subject, the age of the surgical subject, and the prognosis information of the surgical subject. For example, the device (100) may determine the event-occurring video based on at least one of the following: the gender of the surgical subject is male, the age of the surgical subject is equal to or greater than the preset age, and the prognosis information of the surgical subject includes risk information, only when the surgical delay time delayed from the average execution time is equal to or greater than a preset percentage.For example, if the surgery delay time is greater than or equal to a preset percentage, the gender of the surgery subject is female, the age of the surgery subject is less than or equal to the preset age, and the prognosis information of the surgery subject does not include risk information, even if the surgery delay time is greater than or equal to the preset percentage, it may be determined as a non-event video because it is determined that it is not an event-occurring video. That is, the device (100) may identify an event-occurring video according to the difficulty of the surgery. The difficulty of the surgery may generally increase when the gender is male, when the age of the surgery subject exceeds the preset age, or when the prognosis information of the surgery subject includes risk information. Therefore, the device (100) may not simply determine an event-occurring video based on the surgery delay time, but may identify the difficulty of the surgery and determine an event-occurring video based on the surgery delay time and the surgery difficulty. The device (100) may obtain a rate of change in the surgery step execution time based on the performance time change information in the event-occurring video. In addition, the device (100) may perform scoring so that the proficiency becomes less than the first proficiency when the rate of change exceeds a threshold rate of change in the direction in which the performance time increases. In one embodiment, the first proficiency may be a proficiency lower than the average proficiency corresponding to each user account at the current time. The device (100) may perform scoring so that the proficiency is lower than the first proficiency, which is lower than the average proficiency, when the rate of change of the non-event videos excluding the event-occurring videos exceeds a threshold rate of change in the direction of increasing the execution time. In other words, the score may be lowered. In addition, the device (100) may perform scoring so that the proficiency is higher than or equal to a second proficiency, which is higher than the first proficiency, when the rate of change exceeds a threshold rate of change in the direction of decreasing the execution time. In one embodiment, the second proficiency may be a proficiency higher than the average proficiency corresponding to each user account at the current time.The device (100) may perform scoring so that the rate of change of the event-free video exceeds the threshold rate of change in the direction of shortening the execution time so that the score is higher than the second proficiency level that exceeds the average proficiency level. That is, the score may increase. In addition, the device (100) may identify the event-free video according to the difficulty of the surgery, and may identify a video in which the difficulty of the surgery is determined to be high among one or more videos in which an event is predicted to have occurred among multiple surgical step execution times corresponding to multiple identical surgical steps, as an event-free video, and may identify a video in which an event is predicted to have occurred but the difficulty of the surgery is determined not to be high, as an event-free video. Accordingly, the device (100) may obtain the rate of change in the execution time of the surgical step based on the execution time variation information in the event-free video through a comparative analysis between the event-free videos from which the event-free videos are excluded, and may perform scoring so that the proficiency of the user account is lower than the first proficiency level or higher than the second proficiency level based on the direction and magnitude of the rate of change. Accordingly, if the device (100) predicts that an event has occurred in a situation other than a situation in which the difficulty of the surgery is judged to be high based on the gender, age, prognosis information, etc. of the surgical subject that increases the probability of an event occurring, the device can evaluate the skill of the surgical operator by determining the video as a video in which the event did not occur.

[0066] In another embodiment, the device (100) may determine the average surgical step performance time for each surgical step for user accounts other than the user account. The device (100) may perform scoring for each of a plurality of user accounts. Accordingly, the average surgical step performance time for multiple user accounts other than the user account may be obtained. In addition, the device (100) may determine the average standard deviation of the surgical step performance time for each surgical step for each user account. The device (100) may obtain a plurality of standard deviations indicating the extent to which the surgical step performance time deviates from the average surgical step performance time for each surgical step for multiple user accounts other than the user account, and may determine the average standard deviation for the plurality of standard deviations. In addition, the device (100) may obtain the most recent surgical step performance time for each surgical step for each user account. The most recent surgical step performance time may include a surgical step performance time corresponding to a preset number of surgical step performance times close to the current time among the total number of multiple surgical videos. The device (100) may perform scoring based on the average surgical step performance time, the average standard deviation, and the most recent surgical step performance time. In one embodiment, the average surgical step performance time, average standard deviation, and most recent surgical step performance time may be values ​​corresponding to the same surgical step of the same surgical type. The device (100) may perform scoring so that the score is updated based on the extent to which the most recent surgical step performance time corresponding to the user account differs from the average surgical step performance time, and whether the extent of the difference is greater than or equal to the average standard deviation.For example, the device (100) may update the score to exceed the average score when the most recent surgical step performance time, which represents the average surgical step performance time of a preset number (e.g., 3), is less than the average surgical step performance time determined for other user accounts. In addition, the device (100) may perform scoring so that the score is updated to exceed the average score by a first multiple (e.g., 1.5 times) from the score updated to exceed the average score when the standard deviation, which represents the extent to which the average performance time is less than the average standard deviation, is greater than the average standard deviation, because this means that the proficiency has significantly increased compared to other user accounts. In addition, the device (100) may perform scoring so that the score updated to exceed the average score is updated to a second multiple (e.g., 1.2 times) that is smaller than the first multiple, because this means that the proficiency has increased to a similar level as other user accounts. In addition, the device (100) may update the score to be less than the average score if the recent surgical step execution time is greater than or equal to the average surgical step execution time determined for other user accounts, and if the standard deviation indicating the degree to which the average execution time is exceeded exceeds the average standard deviation, the score may be updated to be determined as a score updated once more to a third multiple (e.g., 0.7 times) smaller than the second multiple from the score updated to be less than the average score, because this means that the skill level has not significantly increased compared to other user accounts.In addition, since the device (100) may perform scoring so that the score is determined to be updated once more by a fourth multiple (e.g., 0.8 multiple) that is greater than the third multiple when the recent surgical step performance time is greater than the average surgical step performance time determined for other user accounts and the standard deviation indicating the extent to which the average performance time is exceeded is less than the average standard deviation, it means that a similar level of skill is maintained as other user accounts. Accordingly, the device (100) has the effect of further applying a relative score in that it updates the score for the recent surgical step performance time for a user account by using the average performance time and the average standard deviation for other user accounts.

[0067] Referring to step S350, the device (100) according to one embodiment may provide information on proficiency acquired based on the results of performing scoring. The device (100) may provide information on proficiency based on a score determined for each user account.

[0068] According to an embodiment, the device (100) may determine an event occurrence video as described above, and may obtain an event annotation indicating an event for the event occurrence video. In an embodiment, the event annotation may indicate labeling information of a situation corresponding to the event. For example, the event annotation may include labeling information for the corresponding event situation, such as information on the gender of the surgical subject, information on the time of excessive bleeding, and an increase in surgical time due to fat removal. The device (100) may provide an event report including metadata and event annotations related to the event occurrence video. That is, the device (100) may provide an event report including metadata corresponding to information requiring learning about surgery, etc., and event annotations labeled with topics for each information requiring learning, based on summary information for at least one event occurrence video and monitoring information regarding the reason and situation of the event occurrence, for each user account. Accordingly, the user can obtain and confirm additional information about areas where the user made mistakes, areas requiring learning, etc., in one or more event occurrence videos corresponding to the user account.

[0069] According to one embodiment, the device (100) can obtain tool usage variation information, including the number of tools used, the type of tools used, and the amount of usage for each tool, for each surgical step, for each of a plurality of surgical videos. Furthermore, the device (100) can provide a tool usage report for each surgical step based on the tool usage variation information. This will be described later with reference to the drawings.

[0070] FIG. 4 is a drawing for explaining an example of a device (100) according to one embodiment determining a surgical step performance time for each surgical step.

[0071] Referring to FIG. 4, a device (100) according to one embodiment may determine a surgical step execution time for each of a plurality of surgical videos, each of which is preset to one or more surgical steps corresponding to the type of surgery. In one embodiment, the surgical steps may be determined differently depending on the type of surgery, and the device (100) may divide each surgical video into a plurality of surgical steps corresponding to the type of surgery and determine a surgical step execution time for each surgical step.

[0072] FIG. 5 is a drawing for explaining an example in which a device (100) according to one embodiment determines the appearance time of each surgical tool for each of a plurality of surgical videos.

[0073] Referring to FIG. 5, a device (100) according to one embodiment can determine the time at which each of one or more surgical tools appears in each of a plurality of surgical videos. Accordingly, the device (100) can determine the time at which each surgical tool appears corresponding to a user account, and based on the time at which each surgical tool appears, can determine the number of tools used, the type of tools used, and the amount of each tool used for each surgical step in the corresponding surgical video.

[0074] FIG. 6 is a drawing for explaining an example in which a device (100) according to one embodiment acquires information on the change in the execution time of each surgical step based on the acquisition time of multiple surgical videos.

[0075] Referring to FIG. 6, a device (100) according to an embodiment may determine a surgical step execution time for each of a plurality of surgical videos. For example, Videos 1 to 10 illustrated in FIG. 6 may be surgical videos filmed at different points in time for the same type of surgery. The device (100) may determine the execution time corresponding to the same surgical step included in each of the plurality of surgical images, and obtain a line graph representing information on how each execution time changes over time when the plurality of surgical videos were filmed. In FIG. 6, information on how the execution time corresponds to step 7 among the plurality of surgical steps included in the plurality of surgical videos is provided through a line graph. Accordingly, the user's skill level in the same surgical step may be confirmed over time. That is, information on the user's skill level may be provided based on information on how the surgical step execution time is updated over time when the user performs the same surgical step. In Fig. 6, the execution time of surgical step 7 in Video 1 may be 7 minutes 15 seconds, and the execution time of surgical step 7 in Video 2 may be 6 minutes 1 second. That is, it can be confirmed that the skill of surgical step 7 in Video 1 has improved in Video 2. In addition, the execution time of surgical step 7 in Video 4 may be 11 minutes 21 seconds, and the execution time of surgical step 7 in Video 5 may be 4 minutes 41 seconds. At this time, it can correspond to a learning curve section, which is a section in which the user's skill rapidly improves after a certain period of time. In addition, the execution time of surgical step 7 in Video 6 may be 13 minutes 31 seconds, and at this time, it can be confirmed that the skill of surgical step 7 in Video 6 has decreased. At this time, if the execution time of a surgical step between Videos differs significantly by more than a preset time, the device (100) may determine the corresponding Video as an event occurrence video.Therefore, users can easily visually check information about the level of proficiency corresponding to the same surgical step over time.

[0076] FIG. 7 is a drawing for explaining an example of a device (100) according to one embodiment of the present invention obtaining tool-specific usage time variation information based on the acquisition time of multiple surgical videos.

[0077] Referring to FIG. 7, the device (100) can provide tool usage time variation information for each of a plurality of surgical videos. In FIG. 7, it can be confirmed that the total time of using the tool Gauze in Video 1 is longer than the total time of using the tool Gauze in Video 2. Accordingly, the user can predict that the degree of bleeding was less in Video 1 than in Video 2. In this way, the device (100) can obtain and provide tool usage time variation information, including the type of tool used or the amount of use of each tool for each surgical step, over time, for each of a plurality of surgical videos. Accordingly, the user can easily visually check the usage time information for each tool used in the same surgical step over time.

[0078] FIG. 8 is a schematic diagram illustrating an example in which a device (100) according to one embodiment provides the amount of tool usage for each surgical step through a bar graph or circular graph.

[0079] Referring to FIG. 8, a device (100) according to one embodiment may provide tool usage data for each surgical step via a bar graph or circular graph. Accordingly, a user can monitor information regarding the surgical tool he or she uses most and least for each surgical step.

[0080] FIG. 9 is a schematic diagram illustrating an example in which a device (100) according to one embodiment provides the amount of tool usage for each surgical step through a band graph.

[0081] Referring to FIG. 9, a device (100) according to one embodiment can further improve visual convenience by providing the usage amount for each tool as a band graph other than a bar graph or a circular graph as shown in FIG. 8.

[0082] According to one embodiment, the method provides a visual and easy-to-understand change in the execution time of a surgical step based on the acquisition time of multiple surgical videos, thereby enabling the user to easily check the change in the execution time, and provides a tool usage report including information on the change in tool usage for each surgical step, thereby enabling the user to monitor his / her tool usage pattern and style. In addition, the method improves the accuracy of the scoring by performing the scoring using a video in which an event does not occur, excluding a video in which an event occurs.

[0083]

[0084] Various embodiments of the present disclosure may be implemented as software comprising one or more instructions stored in a storage medium (e.g., memory) readable by a machine (e.g., a display device or a computer). For example, a processor of the machine (e.g., processor 220) may call at least one instruction from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0085] According to one embodiment, the method according to the various embodiments disclosed in the present disclosure may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0086] Although the present invention has been described with reference to the drawings, it is not limited to the disclosed embodiments and drawings, and a person skilled in the art related to the present embodiment will understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the above-described description. Therefore, the disclosed methods should be considered from an illustrative rather than a restrictive point of view. Even if the operation and effect according to the configuration of the present invention is not explicitly described and described while describing the embodiment, the effect that can be predicted by the configuration can also be recognized. The scope of the present invention is indicated by the claims rather than the foregoing description, and all differences within the equivalent scope should be interpreted as being included in the present invention.

Claims

1. In a method of providing information on proficiency related to surgery, A step of obtaining a plurality of surgical videos including a situation in which a receiving unit corresponds to a user account and performs a surgery; A step in which a processor determines a surgical step execution time for each surgical step for each of the plurality of surgical videos; A step in which the processor acquires performance time variation information representing a change in the time of execution of the surgical steps over time based on the acquisition time of the plurality of surgical videos; The step of the processor performing a score on the skill level for each surgical step based on the performance time variation information; and A method comprising: providing information on the proficiency acquired based on the result of the scoring performed by the processor; 2. In paragraph 1, The steps for performing the above scoring are: The step of the above processor obtaining the rate of change in the execution time of the surgical step based on the execution time variation information; and A method comprising: performing the scoring so that the proficiency is equal to or greater than a threshold proficiency when the change rate exceeds a threshold change rate; 3. In paragraph 1, The steps for performing the above scoring are: A method wherein the processor performs the scoring such that the time taken to perform the surgical step and the score are inversely proportional to each other.

4. In paragraph 1, The above processor further includes a step of determining an event occurrence video in which an event related to a delay in surgery or an increase in the difficulty of surgery occurs among the plurality of surgery videos; The steps for performing the above scoring are: A method wherein the processor performs the scoring using a video in which an event does not occur, excluding a video in which the event occurs, from among the plurality of surgical videos.

5. In paragraph 1, The steps for performing the above scoring are: The step of the above processor obtaining tool usage change information including the number of tools used, the type of tools used, and the amount of usage for each tool for each surgical step for each of the plurality of surgical videos; and A method comprising: providing a tool usage report for each surgical step based on the tool usage variation information by the processor.

6. In paragraph 4, The step of determining the video of the above event occurrence is A method wherein the processor determines the event occurrence video based on at least one of the surgery delay time, the sex of the surgery subject, the age of the surgery subject, and the prognosis information of the surgery subject.

7. In paragraph 6, The step of performing the scoring using the above event non-occurrence video is A step in which the processor obtains a rate of change in the execution time of the surgical step based on the execution time variation information in the event non-occurrence video; The step of performing the scoring so that the skill becomes less than the first skill when the change rate exceeds the threshold change rate in the direction in which the execution time becomes longer; and A method comprising: performing the scoring so that the skill becomes a second skill level or higher, when the change rate exceeds a threshold change rate in the direction in which the execution time becomes shorter; 8. In paragraph 1, The steps for performing the above scoring are: A step in which the above processor determines an average surgical step execution time for each surgical step for a user account other than the above user account; A step in which the processor determines an average standard deviation of the surgical step execution time for each surgical step for the other user account; The step of the above processor obtaining the most recent surgical step execution time for each surgical step for the above user account; and A method comprising: a step of performing the scoring based on the average performance time of the surgical step, the average standard deviation, and the most recent surgical step performance time of the surgical step; 9. In paragraph 1, A step in which the processor determines an event occurrence video in which an event related to a delay in surgery or an increase in the difficulty of surgery occurs among the plurality of surgery videos; The step of the above processor obtaining an event annotation indicating the event for the event occurrence video; and A method further comprising: providing an event report including metadata related to the event occurrence video and the event annotation by the processor; 10. For a device that provides information on proficiency related to surgery, A receiving unit that obtains a plurality of surgical videos corresponding to a user account and including a situation in which a surgery is performed; and For each of the above multiple surgical videos, the surgical step execution time is determined for each surgical step, Obtaining performance time variation information representing the change in the time of execution of the surgical steps over time based on the acquisition time of the above multiple surgical videos, Based on the above performance time variation information, scoring for proficiency is performed for each surgical step, A device comprising a processor that provides information on the proficiency acquired based on the result of performing the scoring.

11. In Article 10, The above processor Based on the above performance time variation information, the change rate of the surgical step performance time is obtained, A device that performs the scoring so that the proficiency is equal to or greater than the threshold proficiency when the change rate exceeds the threshold change rate.

12. In paragraph 10, The above processor A device that performs the scoring such that the time for performing the above surgical steps and the score are inversely proportional to each other.

13. In paragraph 10, The above processor Among the above multiple surgical videos, determine an event occurrence video in which an event related to surgical delay or increased surgical difficulty occurred, A device that performs the scoring using a video in which an event does not occur, excluding a video in which the event occurs from among the plurality of surgical videos.

14. In paragraph 10, The above processor For each of the above multiple surgical videos, tool usage change information including the number of tools used, the type of tools used, and the amount of usage for each tool is obtained for each surgical step. A device that provides a tool usage report for each surgical step based on the tool usage change information.

15. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 1 to 9 on a computer.

Images