Surgical procedure video transmission method and system using the same

Abstract

According to the present application, it is possible to provide a surgery procedure video transmission system including a content server configured to store a plurality of surgery videos, a video clip management server configured to receive surgery-related information including a surgery type, and based on the surgery-related information, segment the plurality of surgery videos stored in the content server based on detailed surgery procedures and store, a surgery procedure determination server configured to determine detailed surgery procedures based on a surgery type of a surgery patient, and determine each video clip related to each detailed surgery procedure, and a user terminal configured to receive a plurality of video clips based on the detailed surgery procedures determined by the surgery procedure determination server.

Description

TECHNICAL FIELD

[0001] The present application relates to a surgical procedure video transmission method and a system using the same. More particularly, it relates to a method and system capable of generating and providing a surgical video related to an optimal detailed surgical procedure based on surgical related information. BACKGROUND

[0002] Recently, as multimedia related technologies are rapidly developed and applied in various fields, the medical field has also developed a technology of producing a video recording of a patient's surgery scene for doctors to present at medical related conferences or for other purposes.

[0003] In addition, there are many cases where a surgery video is taken for surgery records and defense of possible medical disputes, or in the case of endoscopic surgery of joints or the like, diagnosis and treatment are performed while confirming the lesion with the naked eye using a miniature camera, and most of the medical devices are recently equipped with a video shooting function, resulting in a sharp increase in surgery video shooting.

[0004] Such a surgery video recorded has various utilization values for other doctors, patients, researchers, etc. In particular, if various medical information is added to the surgery video, its utilization value and asset value can increase.

[0005] Therefore, there is a need for a new method and system to prevent medical video records from being tampered with and to securely store and mediate transactions. In addition, there is also a need for a method and system capable of providing uninterrupted medical videos more quickly and stably as surgery is performed. In addition, there is also a need for a method and system capable of more effectively providing detailed surgery procedure videos that can be referred to a doctor or medical staff performing surgery. SUMMARY

[0006] TECHNICAL PROBLEM

[0007] An object of the present application is to provide a method and system, for example, to divide a video recording of a surgery scene into a plurality of video segments and manage connection link information and interval information of each video segment through a blockchain, thereby preventing forgery and tampering of a surgery video and preventing records of a surgery procedure order from being tampered with or a surgery record from being destroyed.

[0008] In addition, another object of the present application is to construct a system that effectively manages a surgery video recording by dividing the surgery video recording into a plurality of video segments and constructing a block using a combination of connection link information and interval information, thereby reducing the data capacity of the block.

[0009] Further, another object of the present application is to construct a medical video management system that transparently manages the use and transaction of recorded surgery videos through a smart contract-based transaction and can thereby create a profit.

[0010] Further, another object of the present application is to provide a method and system that reduces buffering when a doctor or medical staff who performs surgery refers to a video for play and can more quickly and stably transmit a surgery video using a cache server.

[0011] Further, another object of the present application is to provide a cache server system that can provide segmented multiple surgery video segments to a user terminal in a stable streaming manner without delay.

[0012] Further, another object of the present application is to provide a video transmission system that can generate and recommend the best surgery video according to surgery-related information of a performed surgery.

[0013] Further, another object of the present application is to provide a surgery step video transmission system configured to determine a more effective and safer detailed surgery step based on past surgery record information of a surgery performed on a surgery patient and transmit multiple video segments generated based thereon.

[0014] Further, another object of the present application is to provide a method and system that recommend the best detailed surgery step suitable for a surgery patient using an artificial intelligence technique and sequentially provide detailed surgery step videos to medical staff based thereon.

[0015] The technical problems to be solved by the present application are not limited to the above, and other technical problems not mentioned can be clearly understood by those skilled in the art through the following description.

[0016] Technical solutions

[0017] According to one embodiment of the present application, there is provided a surgery step video transmission system including a content server configured to store a plurality of surgery videos, a video segment management server configured to receive surgery-related information including a surgery type and, based on the surgery-related information, segment and store the plurality of surgery videos stored in the content server based on detailed surgery steps, a surgery step determination server configured to determine a detailed surgery step based on a surgery type of a surgery patient and determine each video segment related to each detailed surgery step, and a user terminal configured to receive a plurality of video segments based on the detailed surgery step determined by the surgery step determination server.

[0018] Further, the surgery step determination server can be configured to determine a detailed surgery step based on record information of a plurality of past surgery patients who have performed the same surgery as the surgery type of the surgery patient.

[0019] In addition, the record information of the past surgery patient can include at least one of gender, age, surgery time, underlying disease, other surgery history, postoperative prognosis, and postoperative recovery period.

[0020] In addition, the surgery step determination server can be configured to combine detailed surgery steps of a first past surgery patient who has undergone a surgery of the same kind as the surgery of the surgery patient and detailed surgery steps of a second past surgery patient who has undergone a surgery of the same kind as the surgery of the surgery patient, to determine the detailed surgery steps of the surgery patient.

[0021] In addition, the surgery step determination server can be configured to recommend the detailed surgery steps of the surgery patient by using a learning model of artificial intelligence.

[0022] In addition, a cache server configured to receive and store the video clips related to each of the detailed surgery steps from the video clip management server and transmit the video clips related to the detailed surgery steps to the user terminal upon receiving a video request for the detailed surgery steps from the user terminal can be further included, and the cache server can be determined from among a plurality of cache servers based on proximity to the location of the user terminal or response speed.

[0023] In addition, the cache server can be configured to confirm storage states of the video clips related to each of the detailed surgery steps determined by the surgery step determination server, and for the video clips not stored in the cache server, receive and store corresponding video clips from the video clip management server based on a surgery schedule of the surgery patient.

[0024] According to another embodiment of the present application, there is provided a surgery step video transmission method including the steps of storing a plurality of surgery videos in a content server, receiving surgery-related information including a surgery kind in a video clip management server, and based on the surgery-related information, segmenting and storing the plurality of surgery videos stored in the content server based on detailed surgery steps, determining detailed surgery steps based on a surgery kind of a surgery patient in a surgery step determination server, and determining video clips related to each of the detailed surgery steps, and receiving the video clips based on the detailed surgery steps determined by the surgery step determination server in a user terminal.

[0025] Effects of the Invention

[0026] According to the present application, for example, a method and system capable of preventing a surgical video from being falsified and tampered with, and preventing a record of a surgical procedure order from being tampered with or a surgical record from being destroyed can be provided by dividing a video recording a surgical scene into a plurality of video segments and managing connection link information and interval information of each video segment using a blockchain.

[0027] In addition, according to the present application, a system capable of effectively managing a surgical video recording while reducing the data capacity of a block can be constructed by dividing a surgical video recording into a plurality of video segments and constructing a block using a combination of connection link information and interval information.

[0028] In addition, according to the present application, a medical video management system can be constructed by transparently managing the use and transaction of a recorded surgical video based on a smart contract transaction and thereby creating a profit.

[0029] In addition, according to the present application, a method and system can be provided that reduces buffering when a video is played by a doctor or medical staff who performs a surgery using a cache server and thereby transmits a surgical video more quickly and stably.

[0030] In addition, according to the present application, a cache server system can be provided that provides a plurality of divided surgical video segments to a user terminal in a stable streaming manner without delay.

[0031] In addition, according to the present application, a video transmission system can be provided that generates and recommends the best surgical video according to information related to a performed surgery.

[0032] In addition, according to the present application, a surgical procedure video transmission system can be provided that is configured to determine a more effective and safer detailed surgical procedure based on past surgical record information and transmit a plurality of video segments generated based thereon.

[0033] In addition, according to the present application, a method and system can be provided that recommend the best detailed surgical procedure suitable for a surgical patient using an artificial intelligence technology and sequentially provide detailed surgical procedure videos to medical staff based thereon.

[0034] The effects of the present application are not limited to the above-described content, and other effects not mentioned can be clearly understood by those skilled in the art from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0035] Figure 1 is a conceptual diagram showing the configuration of a system for managing a medical video record using a blockchain according to an embodiment of the present application.

[0036] Figure 2is a block diagram for explaining a configuration of a medical video management server according to an embodiment of the present application.

[0037] Figure 3 is an example diagram showing a generation process of a block generated on a blockchain network for a plurality of video clips related to a medical video according to an embodiment of the present application.

[0038] Figure 4 is an example diagram for explaining a header structure of a block according to an embodiment of the present application.

[0039] Figure 5 is a flowchart for explaining a method for managing a medical video using a blockchain according to an embodiment of the present application.

[0040] Figure 6 is a conceptual diagram for explaining a configuration of a surgery video transmission system using a cache server according to an embodiment of the present application.

[0041] Figure 7 is a block diagram for explaining a configuration of a cache server according to an embodiment of the present application.

[0042] Figure 8 is an example diagram for explaining a method for providing a plurality of video clips related to a surgery video using a cache server according to an embodiment of the present application.

[0043] Figure 9 is a flowchart for explaining a surgery video transmission method using a cache server according to an embodiment of the present application.

[0044] Figure 10 is a conceptual diagram for explaining a configuration of a surgery step video transmission system using a cache server according to an embodiment of the present application.

[0045] Figure 11 is an example diagram for explaining a configuration of a detailed surgery step of a recommended surgery patient according to an embodiment of the present application.

[0046] Figure 12 is an example diagram for explaining a method for providing a detailed surgery step video using a cache server according to an embodiment of the present application. DETAILED DESCRIPTION

[0047] Hereinafter, the present application will be described in detail by explaining embodiments of the application with reference to the attached drawings. The present application may, however, be realized in many different ways and is not limited to the embodiments described herein, which are merely given as examples so that this disclosure will be thorough and complete and will fully convey the concept of the application to those skilled in the art.

[0048] The terms used in the present specification are used only to describe embodiments, and are not intended to limit the present application. In the present specification, the singular forms are intended to include the plural forms unless the context clearly indicates otherwise.

[0049] As used in the present specification, "comprises" or "comprising" means not excluding the presence or addition of one or more other constituent elements, steps, operations, and / or components.

[0050] In addition, the terms including ordinal numbers (such as first, second, etc.) used in the present application can be used to describe a constituent element, but the constituent element should not be limited by these terms. These terms are used only to distinguish one constituent element from another constituent element. In addition, in describing the present application, if it is judged that a detailed description of related known technology can obscure the gist of the present application, a detailed description thereof is omitted.

[0051] In addition, the constituent parts appearing in the embodiments of the present application are independently shown in order to represent different characteristic functions from each other, and do not mean that each constituent part is composed of a separate hardware or a software constituent unit. That is, for convenience of explanation, each constituent part is described by being listed separately, and at least two constituent parts can be combined into one constituent part, or one constituent part can be divided into a plurality of constituent parts to perform a function. The combined embodiment and the separated embodiment of these constituent parts, as long as it does not depart from the essence of the present application, is included in the scope of the present application.

[0052] Hereinafter, embodiments according to the present application will be described in detail with reference to the accompanying drawings. Through the following detailed description, the constitution of the present application and its corresponding effects can be clearly understood.

[0053] Figure 1 is a conceptual diagram showing a configuration of a system for managing medical video records using a blockchain according to one embodiment of the present application.

[0054] The medical video management system can be composed of a medical video shooting unit (100), a medical video management server (200), and a blockchain network (300). The medical video shooting unit (100) can record a video related to surgery, treatment, diagnosis, etc. in a space such as an operating room, a treatment room, or a diagnosis room in a hospital, and can be configured to transmit the medical video thus recorded to the medical video management server (200). The medical video shooting unit (100) can have a plurality of cameras in various forms or the form of a CCTV, such as a head-mounted display (HMD) camera that a medical staff such as a doctor can wear, a camera installed in an operating room, an endoscope camera for endoscopic surgery, etc. For example, the camera installed in the operating room can be installed on the ceiling, the coordinates of each object are specified in an initial real-time video to determine an initial position, and movement tracking is performed by grasping the movement of the operating scene and the movement of the operating surgeon, etc. In addition, all objects such as surgical instruments photographed can be tracked using image recognition technology, thereby automatically photographing and recording the operating scene.

[0055] The medical video management server (200) can be configured to receive a medical video related to surgery or treatment recorded using the medical video shooting unit (100), generate a block on the blockchain network (300) based on data related to the medical video, and update the block based on new data related to the medical video. The medical video management server (200) can include a storage for storing data and instructions, etc. for managing information related to each module configured for receiving and managing a medical video, and a processor for executing the instructions, etc., and a more specific configuration of the medical video management server (200) will be described with reference to Figure 2

[0056] The medical video management server (200) can be a server corresponding to any one of the blockchain nodes constituting the blockchain network (300), or can be a server for managing the blockchain network (300). The blockchain technology is a technology in which small-scale data is connected in a chain form to form a distributed data storage environment called a block, in which object data is stored and managed, so that anyone cannot arbitrarily modify it, and anyone can check the results of changes. All transaction records or state information, etc. propagated to users before the block is discovered are recorded in the block, which is also transmitted to all users in a P2P manner, so that transaction records or state information, etc. cannot be arbitrarily modified or omitted. In the present invention, data or a set of data for medical video management stored and updated through the blockchain network (300) is referred to as a "block".

[0057] Figure 2 is a block diagram for explaining the configuration of a medical video management server according to an embodiment of the present invention.​

[0058] The medical video management server (200) can include a video receiving unit (210), a video dividing unit (220), a connection link management unit (230), a block generation processing unit (240), a block update processing unit (250), and a contract processing unit (260), etc., which can include programs or program modules executable by one or more processors. The programs or program modules included in the medical video management server (200) can be constituted in the form of an operating system, an application program, or a program, etc., and can be physically stored on various storage devices widely used. Such programs or program modules can include one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing specific tasks or performing specific data types, but are not limited to these forms.

[0059] First, the video receiving unit (210) is configured to receive a medical video related to surgery or treatment recorded using the medical video shooting unit (100), and can be connected to the medical video shooting unit (100) through wired or wireless Internet.

[0060] The video dividing unit (220) is configured to divide the medical video into a plurality of video segments, and can generate and sequentially record blocks corresponding to each video segment information through the block generation processing unit (240) based on data related to the plurality of video segments thus divided. For example, the video dividing unit (220) can sequentially generate a plurality of video segments from one medical video based on timestamp information set at each interval within the medical video. For example, the timestamp information can be distinguished according to detailed steps within the surgery by the main surgeon or medical staff, etc., and set by each step, or can be automatically set using artificial intelligence technology, etc. In addition, the plurality of video segments can further contain tag information inserted into the recorded surgery video, and the tag information can include at least one of a surgery subject, a comment related to a surgery situation, a surgery sequence, a surgery instrument, and a surgery related event. Such tag information can be associated with each timestamp information, input by medical staff, etc., or can automatically input related information using artificial intelligence technology, etc.

[0061] The block generation processing unit (240) can be configured to generate a block on the blockchain network (300) based on data related to the medical video, for example, can be configured to generate a new block for each of the plurality of video segments. In addition, the header of the generated block can contain information related to the connection link through which each of the plurality of video segments can be accessed. In addition, the header of the generated block can further contain interval information generated based on the start and end time points of each of the plurality of video segments.

[0062] The block update processing unit (250) can be configured to update the block information of the generated block based on the tag information and the like. For example, it can contain additional information such as tag information corresponding to each video segment, viewing records, transaction records, usage records, and the like. For example, it can track log records of visitor information, access IP information, and access time information accessed through the connection link of the video segment, and update such access information in the body of the block corresponding to the video segment.

[0063] The contract processing unit (260) is configured to conclude various transaction contracts for using the medical video and process related procedures, and such transaction contracts can be configured using a smart contract to settle fees according to pre-set transaction conditions. The contract processing unit (260) can be configured to generate a block for the smart contract on the blockchain network (300) based on data related to the use of the medical video through the smart contract, and can contain information such as the use period information of the medical video, i.e. the information of the start date and the end date, the access and editing authority related information of the video, and the like.

[0064] Figure 3 is an example diagram showing the generation process of the block generated on the blockchain network for the plurality of video segments related to the medical video according to an embodiment of the present application.

[0065] Referring to Figure 3 For example, a medical video related to a stent implantation or surgery can be divided into 4 video segments according to the respective steps, i.e. 1) surgery preparation and anesthesia, 2) catheter insertion, 3) balloon expansion, 4) catheter removal and stent installation, each video segment can contain interval information related to the start time and end time of t1t2, t2t3, t3t4, t4t5 as timestamp information, and a different accessible connection link can be assigned for each video segment divided, thereby generating information related to the connection link corresponding to each video segment, i.e. connection link information. For each of the plurality of video segments of the medical video thus divided in sequence, a plurality of blocks containing respective connection link information and time interval information can be generated.

[0066] Figure 4 is an example diagram for explaining a header structure of a block according to an embodiment of the present application.

[0067] The structure of a block can be roughly composed of a block hash serving as a block identifier, a header having basic information, and a body having transaction information, etc. The header here generally includes version, previous block hash, Merkle root, time, difficulty target, nonce, etc. information, and the block according to the present application can further include connection link information related to a connection link that can access each of a plurality of video segments in the header, and interval information generated based on timestamp information of a start and end time point of each of a plurality of video segments.

[0068] With such a block structure, the connection link information that can access the surgical video segments or static screenshots is matched with each of the distributed ledgers that are divided and dispersed, and recorded using a blockchain, so that the medical video recording can be prevented from being tampered with, for example, the connection link information can be encrypted, and the storage space storing the video or static screenshot is set to a read-only mode that cannot be modified, so that the video at the access site cannot be changed.

[0069] The present application can provide a system for effectively managing a surgical video recording by dividing the surgical video recording into a plurality of video segments and constructing a block using a combination of connection link information and interval information, while reducing the data capacity of the block, and can solve the problem of discarding the surgical recording or tampering with the main content of the related surgery due to the expiration of the storage period.

[0070] Figure 5 is a flowchart for explaining a method for managing a medical video using a blockchain according to an embodiment of the present application.

[0071] Referring to Figure 5 , first, a medical video photographed and recorded by a medical video photographing unit (100) can be received (S510) by a video receiving unit (210) of a medical video management server (200).

[0072] The medical video management server (200) can sequentially divide the medical video into a plurality of video segments by a video dividing unit (220) (S520).

[0073] The medical video management server (200) can generate connection links for the plurality of video segments by a connection link management unit (230), and can generate interval information for each video segment (S530).

[0074] The medical video management server (200) can sequentially record data related to the plurality of video segments in the block through the block generation processing unit (240) (S540). At this time, the header of the block can include connection link information related to a connection link through which each of the plurality of video segments is accessible, and interval information generated based on timestamp information of a start and end time point of each of the plurality of video segments.

[0075] In addition, the medical video management server (200) can perform block update based on tag information related to the plurality of video segments through the block update processing unit (250) (S550). For example, the corresponding block can be updated based on tag information, additional information, viewing records, transaction records, usage records, etc. corresponding to each video segment.

[0076] In addition, the medical video management server (200) can track log records of visitor information, access IP information, and access time information (S560). By tracking access-related information accessed through the link, access information can be monitored. In addition, the corresponding block can be updated based on such access-related information to prevent access records from being tampered with.

[0077] Figure 6 FIG. 1 is a conceptual diagram illustrating a configuration of a surgery video transmission system using a cache server according to an embodiment of the present application.

[0078] Referring to Figure 6The user terminal (400) is a device used by a user such as a doctor or medical staff who performs surgery, treatment, diagnosis, etc., and is capable of connecting to the content server (600), the cache server (700), and the video segment management server (800), etc., and can be any one of a smart phone, a tablet computer, a desktop computer, a laptop computer, a notebook, a workstation, a Personal Digital Assistant (PDA), a portable computer, a wireless phone, a mobile phone, an e-book, a portable multimedia player (PMP), a portable game machine, a digital camera, a television, a wearable device, a head-mounted display (HMD), an artificial intelligence (AI) speaker, but is not limited to these. In addition, the user terminal (400) can include a display unit for providing a medical video screen, or can have a form connected to and controllable with the display unit.

[0079] The user terminal (400) is configured to be able to communicate with various servers, such as a content server (600), a cache server (700), and a video segment management server (800) through a network (500), which is a constituent element of wired / wireless communication for data transmission / reception between the user terminal (400) and the plurality of servers (600, 700, 800), and when the network is a wireless communication network, can include cellular communication or close-range communication. For example, the cellular communication can include at least one of LTE (Long-Term Evolution), LTE-A (LTE Advanced), 5G (5th Generation), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), UMTS (Universal Mobile Telecommunications System), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications), etc. In addition, the close-range communication can include at least one of Wi-Fi (Wireless Fidelity), Bluetooth, Zigbee, NFC (Near Field Communication), or RFID (Radio Frequency Identification), etc. However, the communication method is not limited thereto, and wireless communication technology developed in the future will also be included.

[0080] Next, the content server (600) can be configured to store a plurality of surgery videos, for example, can be configured to store videos related to surgery, treatment, diagnosis, etc. recorded in a space such as an operating room, a treatment room, or a diagnosis room in a hospital by a medical video shooting unit (100) via various forms of cameras.

[0081] The cache server (700) can be configured to receive and store at least a part of the surgery videos related to the surgery from among the plurality of surgery videos stored in the content server (600), and transmit the at least a part of the surgery videos to the user terminal (400) upon receiving a reference video request from the user terminal (400). In addition, the cache server (700) can select the most advantageous cache server from among a plurality of cache servers based on proximity to the location of the user terminal (400) or response speed.

[0082] The video segment management server (800) can be configured to receive surgery-related information including a surgery date and a surgery category, determine a surgery video related to the surgery from among a plurality of surgery videos stored in the content server (600) based on the surgery-related information, and divide the related surgery video into a plurality of video segments of a predetermined capacity or less.

[0083] The plurality of video segments thus divided are sequentially generated based on timestamp information of each interval within the surgery video, and the video segment management server (800) can be configured to deliver at least one video segment corresponding to the beginning portion from among the plurality of video segments to the cache server (700).

[0084] In addition, the video segment management server (800) can be configured to deliver at least one video segment to the cache server (700) before the surgery date based on a predetermined surgery date. For example, the corresponding video segment can be delivered to the cache server (700) in advance to be stored in the cache server (700) based on a predetermined criterion, such as 1 day or 1 hour before the corresponding surgery date.

[0085] In addition, the video segment management server (800) can be configured to determine a related surgery video from among the plurality of surgery videos stored in the content server (600) based on similarity to reference video information previously used by the user terminal (400). That is, a surgery video that can be referred to at the time of the surgery can be determined using history data in which a user of the user terminal (400) has previously referred to or searched.

[0086] In addition, when more than a predetermined proportion of at least one video segment is streamed on the user terminal (400), it is determined that the user is referring to the video segment, and the cache server (700) can be configured to request and receive, from the video segment management server (800), and store the remaining video segments of the video segment except for the beginning portion, so that transmission delay in viewing the surgery video stream by the user terminal (400) can be minimized by storing the remaining video segments in the cache server (700) in advance.

[0087] In addition, when the plurality of video segments are all completely streamed on the user terminal (400), the cache server (700) can be configured to transmit at least a portion of a second surgery video corresponding to the next order of the transmitted surgery video to the user terminal (400). In addition, when more than a predetermined proportion of at least one video segment or all video segments of the second surgery video is streamed on the user terminal (400), it is determined that the user is referring to the video segment in the second surgery video, and the cache server (700) can be configured to request and receive, from the video segment management server (800), and store the remaining video segments from among the plurality of video segments except for the above-mentioned beginning portion.

[0088] Further, the video segment management server (800) can be configured to perform video analysis on the plurality of video segments by artificial intelligence technology or the like, determine at least one main video segment from the plurality of video segments based on at least one of movement of a surgical instrument, amount of bleeding, and degree of change in an organ related to the surgery, and deliver the main video segment from the plurality of video segments to the cache server (700). In this way, the video segment management server (800) determines the main video segment that is judged to be important from the plurality of video segments, and delivers only the main video segment to the cache server (700), so that the limited storage space of the cache server (700) can be effectively utilized.

[0089] Figure 7 is a block diagram for explaining a configuration of a cache server according to an embodiment of the present application.

[0090] Referring to Figure 7 , the video segment management server (800) according to the present application can include a surgery information receiving unit (810), a surgery video determining unit (820), a video segmentation processing unit (830), and a video transmission processing unit (840), etc., and these constituent elements can include programs or program modules executable by one or more processors. The programs or program modules included in the video segment management server (800) can be configured in the form of an operating system, an application program, or a program, etc., and can be physically stored on various storage devices widely used. Such programs or program modules can include one or more routines, subroutines, programs, objects, components, instructions, data structures, and various forms for performing specific tasks or performing specific data types, but are not limited to these forms.

[0091] First, the surgery information receiving unit (810) can be configured to receive surgery-related information including information related to a surgery date, a surgery object, a surgery site location, and a surgery type, etc. from the user terminal (400) or other servers or terminals that manage surgery information.

[0092] The surgery video determination unit 820 is configured to determine a surgery video to be provided to the user terminal 400 as a surgery reference video, and can be configured to determine a relevant surgery video among a plurality of surgery videos stored in the content server 600 based on the received surgery-related information. In addition, the surgery video determination unit 820 can determine a relevant surgery video among the plurality of surgery videos stored in the content server 600 using previous history information of the user terminal 400 based on similarity determination of reference video information previously used by a user of the user terminal 400 with respect to the surgery category.

[0093] In addition, the surgery video determination unit 820 can be configured to determine at least one main video segment among a plurality of video segments based on at least one of movement of a surgery instrument, amount of bleeding, and degree of change in an organ related to the surgery using video analysis of the plurality of video segments through an artificial intelligence technology or processing by an operator, and deliver only the main video segment among the plurality of video segments to the cache server 700. In this way, the main video segment determined to be important among the plurality of video segments is determined, and only the main video segment is delivered to the cache server 700, so that the limited storage space of the cache server 700 can be effectively used, and medical staff can refer to only the main video segment within a limited time, so that time can be effectively used.

[0094] The video segmentation processing unit 830 can be configured to segment the relevant surgery video determined by the surgery video determination unit 820 into a plurality of video segments of a predetermined capacity or less. At this time, the plurality of video segments are sequentially generated based on timestamp information of each section within the surgery video, and the video segment management server 800 can be configured to deliver at least one video segment corresponding to a beginning portion among the plurality of video segments sequentially generated to the cache server 700 through the video transmission processing unit 840.

[0095] The video transmission processing unit 840 is configured to perform transmission processing and transmission plan management of delivering a video to the cache server 700, and can determine one cache server connected with the user terminal 400 based on proximity to a location of the user terminal 400 or response speed of each cache server. In addition, the video transmission processing unit 840 can be configured to deliver at least one video segment to the cache server 700 before a surgery date based on surgery date information included in the surgery-related information.

[0096] Figure 8 FIG. 1 is an example diagram for explaining a method for providing a plurality of video segments related to a surgery video using a cache server according to an embodiment of the present application.

[0097] For example, the predetermined surgery can include two types of surgeries, and can include a plan to sequentially perform a first surgery video related to a first surgery and a second surgery video related to a second surgery.

[0098] First, the first surgery video related to the first surgery and determined as a reference video can be five video clips sequentially generated based on the timestamp information (t1-t6) of each interval, and the first video clip and the second video clip corresponding to the beginning portion can have been pre-stored in the cache server. At this time, if the first video clip is completely streamed and viewed through the user terminal (400), for example, beyond the t2 time point, the cache server (700) can be configured to request and receive subsequent video clips, for example, the third video clip, the fourth video clip, and the fifth video clip, from the video clip management server (800) and store them. Thus, according to the viewing state of the divided video clips, the subsequent video clips are delivered to the cache server (700) and stored in advance, so that the surgery video viewed by the user can be played without delay.

[0099] On the other hand, if the video streaming is completed before the predetermined standard, that is, the t2 time point, through the user terminal (400), it is determined that the reference video is not needed, and the cache server (700) can be configured not to request the subsequent video clips, for example, the video clips after the third video clip. In addition, in order to effectively manage the storage capacity of the cache server (700), for the corresponding video clips whose video streaming is completed before a certain time point, it can be determined that they are not the object of interest of the user, and configured to be completely deleted.

[0100] In addition, when the streaming and viewing of the first surgery video is completed through the user terminal (400), the cache server (700) can be configured to transmit at least a portion of the second surgery video corresponding to the next order, that is, the video clip of the beginning portion, to the user terminal (400). At this time, if the video clip of the beginning portion of the second surgery video is not stored in the cache server (700), the cache server (700) can be configured to request and receive the video clip of the beginning portion of the second surgery video from the video clip management server (800) and store it in advance, for example, before the first surgery video viewing is completed, for example, at the t4 or t5 time point.

[0101] Figure 9 is a flowchart for explaining a surgery video transmission method using a cache server according to an embodiment of the present application.

[0102] First, a plurality of surgery videos can be stored in the content server (600) (S910). At this time, the surgery video can contain the type of the surgery, the surgery object, the timestamp information of each interval, and the tag information, etc.

[0103] The video clip management server (800) can receive surgery-related information including a surgery date and a surgery type through a surgery information receiving unit (810) (S920).

[0104] The video clip management server (800) can determine a relevant surgery video based on the surgery-related information through a surgery video determining unit (820) (S930).

[0105] The video clip management server (800) can divide the surgery video into a plurality of video clips through a video division processing unit (830) (S940). For example, the surgery video can be a plurality of video clips sequentially generated based on interval-based timestamp information.

[0106] The video clip management server (800) can determine one cache server connected with the user terminal (400) based on proximity to the location of the user terminal (400) or response speed of each cache server through a video transmission processing unit (840) (S950).

[0107] The determined cache server (700) can receive and store partial video clips of the relevant surgery video from the video clip management server (800) (S960).

[0108] When a surgery reference video request is received from the user terminal (400), partial video clips can be provided in a streaming manner through the determined cache server (700) (S970).

[0109] In addition, remaining video clips after the partial video clips can be requested from the user terminal (400) and provided in a streaming manner through the cache server (700) (S980). When a plurality of clips at the beginning of the surgery video are streamed through the user terminal (400) until a certain ratio is exceeded, the cache server (700) can request and receive the remaining video clips thereafter from the video clip management server (800) and store them, thereby ensuring that the entire video can be viewed without delay.

[0110] Figure 10 FIG. 1 is a conceptual diagram illustrating a configuration of a surgery step video transmission system using a cache server according to an embodiment of the present application.

[0111] Figure 10 The surgery step video transmission system is in the form of adding a surgery step determining server (900) to the configuration of the surgery video transmission system using a cache server shown in FIG. 1. Figure 6

[0112] Here, the content server (600) can be configured to store a plurality of surgery videos. ​

[0113] The video segment management server (800) can be further configured to receive surgery-related information including a surgery category, and based on the received surgery-related information, segment and store the plurality of surgery videos stored in the content server (600) based on detailed surgery steps.

[0114] The surgery step determination server (900) can be configured to determine detailed surgery steps based on a surgery category of a surgery patient, and determine each video segment related to each detailed surgery step.

[0115] In addition, the surgery step determination server (900) can be configured to determine the detailed surgery steps based on record information of a plurality of past surgery patients who have undergone the same surgery as the surgery category of the surgery patient. In addition, the record information of the past surgery patients can include at least one of gender, age, surgery time, underlying disease, other surgery history, postoperative prognosis, and surgery recovery period. That is, in determining the detailed surgery steps, the record information of the past surgery patients can be used to use surgery steps and conditions that are similar to the current patient condition and have good prognosis and recovery period.

[0116] In addition, the surgery step determination server (900) can be configured to combine the detailed surgery steps of a plurality of past surgery patients to determine the detailed surgery steps. For example, it can be configured to combine the detailed surgery steps of a first past surgery patient who has undergone the same surgery as the surgery category of the current surgery patient and different detailed surgery steps of a second past surgery patient who has undergone the same surgery as the surgery category of the current surgery patient, to determine the detailed surgery steps of the current surgery patient.

[0117] In addition, the surgery step determination server (900) can use an artificial intelligence-based learning model to derive detailed surgery steps that have the best prognosis and recovery period under similar conditions to the current patient using the record information of the past patients, and be configured to recommend the best detailed surgery steps to the current surgery patient through the artificial intelligence learning model based on the same.

[0118] The cache server (700) can be configured to receive and store each of the plurality of video segments related to each detailed surgery step from the video segment management server (800), and when receiving a detailed surgery step video request from the user terminal (400), transmit the plurality of video segments related to the detailed surgery step determined by the surgery step determination server (900) to the user terminal (400). At this time, the cache server (700) can determine a cache server located at the best location based on proximity or response speed to the location of the user terminal (400).

[0119] Further, the cache server (700) can be configured to confirm the storage state of each video clip related to each detailed surgery step determined by the surgery step determination server (900), and for a video clip not stored in the cache server (700), receive and store the corresponding video clip from the video clip management server (800) based on the surgery schedule of the surgery patient. For example, the cache server (700) can confirm the storage state of each video clip related to each detailed surgery step before the surgery date of the surgery patient, for example, 1 hour or one day before, for a video clip not stored, request to the video clip management server (800), and pre-store the corresponding video clip before the surgery date.

[0120] The user terminal (400) can be configured to receive a plurality of video clips based on the detailed surgery steps determined by the surgery step determination server (900).

[0121] Figure 11 is an example diagram for explaining the configuration of recommending detailed surgery steps of a surgery patient according to an embodiment of the present application.

[0122] One surgery can be divided into a plurality of stages of detailed surgery steps, and a video clip can be divided for each detailed surgery step. In Figure 11 In the above, it is assumed that patient 1, patient 2, and patient 3 have records of having undergone the same kind of surgery in the past, and patient 4 plans to undergo the same kind of surgery.

[0123] For example, looking at the past surgery record of patient 1, it has 3 stages of detailed surgery steps consisting of A step, B step, and C step, and the past surgery record of patient 2 has added D step between A step and B step, having 4 stages of detailed surgery steps. Further, in the past surgery record of patient 3, E step is added after A step, B step, and C step, having 4 stages of detailed surgery steps. Thus, even if it is the same kind of surgery, depending on the patient's situation and the surgery situation, it can happen that some of the detailed surgery steps are added or changed, and by accumulating such surgery data, it is possible to probabilistically judge the result of the detailed surgery steps.

[0124] For patient 4 who plans to undergo the same kind of surgery as patients 1 to 3, the detailed surgery steps determined by the surgery step determination server (900) are in the form of a combination of the detailed surgery steps of patients 1 to 3, including detailed surgery steps of a total of 5 stages consisting of the A step, the D step, the B step, the C step, and the E step, and a detailed surgery step video corresponding to the 5 stages can be provided to medical staff as a reference video. Such a recommendation and determination of the detailed surgery steps, for example, can use an artificial intelligence-based learning model to derive detailed surgery steps having the best prognosis and recovery period under similar conditions to the current patient using the recorded information of past patients, and can find and recommend detailed surgery step conditions having the best prognosis and recovery conditions under the same gender, similar age, similar underlying disease, and the like.

[0125] Figure 12 is an example diagram for explaining a method for providing a detailed surgery step video using a cache server according to an embodiment of the present application.

[0126] Referring to Figure 12 The detailed surgery steps of patient 4 determined by the surgery step determination server (900) can include the A step video, the B step video, and the C step video which are the surgery video of patient 1, and can further include the D step video in the surgery video of patient 2.

[0127] At this time, the cache server (700) can first confirm the storage state of the surgery video of patient 1 and the D step video in the surgery video of patient 2 before the surgery date of the surgery patient, for example, as shown in Figure 12 If it is determined that, although the A step video, the B step video, and the C step video which are the surgery video of patient 1 are stored, the D step video in the surgery video of patient 2 determined to be referred to is not stored, the cache server (700) can request the video clip management server (800) to transmit the D step video in the surgery video of patient 2. At this time, the video transmission time can be arranged so that the D step video of patient 2 is received and stored by the cache server (700) before the surgery date based on the surgery schedule of patient 4.

[0128] Although the various methods and systems according to the embodiments of the present application have been described as specific various embodiments above, this is merely illustrative, and the present application is not limited thereto, and should be construed as having the broadest scope following the basic idea disclosed in the present specification. Those skilled in the art can combine, replace, and modify the disclosed embodiments to implement patterns of shapes not explicitly shown, but this does not depart from the scope of the present application. Furthermore, those skilled in the art can easily alter or modify the disclosed embodiments based on the present specification, and such alterations or modifications also obviously fall within the scope of the present application.

Claims

1. A surgical procedure video transmission system characterized by, The system includes: a content server configured to store a plurality of surgery videos; a video segment management server configured to receive surgery-related information including a surgery category, and based on the surgery-related information, segment and store the plurality of surgery videos stored in the content server based on detailed surgery steps; a surgery step determination server configured to determine detailed surgery steps based on a surgery category of a surgery patient, and determine each video segment related to each detailed surgery step; and a user terminal configured to receive a plurality of video segments based on the detailed surgery steps determined by the surgery step determination server; and, further including a cache server configured to receive and store each video segment related to each detailed surgery step from the video segment management server, and upon receiving a detailed surgery step video request from the user terminal, transmit a plurality of video segments related to the detailed surgery step to the user terminal, the cache server being determined from a plurality of cache servers based on proximity to the user terminal location or response speed; the cache server is configured to confirm the storage status of each video segment related to each detailed surgery step determined by the surgery step determination server, and for video segments not stored in the cache server, based on the surgery schedule of the surgery patient, receive and store the corresponding video segment from the video segment management server before the surgery date of the surgery patient.

2. The surgical procedure video transmission system according to claim 1, wherein The surgery step determination server is configured to determine detailed surgery steps based on record information of a plurality of past surgery patients who have undergone the same surgery as the surgery category of the surgery patient.

3. The surgical procedure video transmission system according to claim 2, wherein The record information of the past surgery patient includes at least one of gender, age, surgery time, underlying disease, other surgery history, postoperative prognosis, and surgery recovery period.

4. The surgical procedure video transmission system according to claim 2, wherein The surgery step determination server is configured to combine the detailed surgery steps of a first past surgery patient who has undergone the same surgery as the surgery category of the surgery patient and the detailed surgery steps of a second past surgery patient who has undergone the same surgery as the surgery category of the surgery patient to determine the detailed surgery steps of the surgery patient.

5. The surgical procedure video transmission system according to claim 4, wherein The surgery step determination server is configured to recommend the detailed surgery steps of the surgery patient by using a learning model of artificial intelligence.

6. A surgical procedure video transmission method characterized by comprising: The system includes: a content server configured to store a plurality of surgery videos; a video segment management server configured to receive surgery-related information including a surgery category, and based on the surgery-related information, segment and store the plurality of surgery videos stored in the content server based on detailed surgery steps; a surgery step determination server configured to determine detailed surgery steps based on a surgery category of a surgery patient, and determine each video segment related to each detailed surgery step; and a user terminal configured to receive a plurality of video segments based on the detailed surgery steps determined by the surgery step determination server; and, further including a cache server configured to receive and store each video segment related to each detailed surgery step from the video segment management server, and upon receiving a detailed surgery step video request from the user terminal, transmit a plurality of video segments related to the detailed surgery step to the user terminal, the cache server being determined from a plurality of cache servers based on proximity to the user terminal location or response speed; the cache server is configured to confirm the storage status of each video segment related to each detailed surgery step determined by the surgery step determination server, and for video segments not stored in the cache server, based on the surgery schedule of the surgery patient, receive and store the corresponding video segment from the video segment management server before the surgery date of the surgery patient. Further comprising a step of receiving and storing the video clips related to each detailed surgical step from the video clip management server in the cache server, and upon receiving a detailed surgical step video request from the user terminal, transmitting the video clips related to the detailed surgical step to the user terminal, the cache server being determined from a plurality of cache servers based on proximity or response speed to the user terminal location; Further comprising a step of confirming the storage status of the video clips related to each detailed surgical step determined by the surgical step determination server in the cache server, and for the video clips not stored in the cache server, receiving and storing the corresponding video clips from the video clip management server before the surgery date of the surgical patient based on the surgery schedule of the surgical patient.

Images